Data Engineer

TekWissen LLC

Not Interested
Bookmark
Report This Job

profile Job Location:

Bentonville, AR - USA

profile Monthly Salary: Not Disclosed
Posted on: 5 hours ago
Vacancies: 1 Vacancy

Job Summary

Overview:
TekWissen is a global workforce management provider headquartered in Ann Arbor Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation information technology and services
Position: Data Engineer
Location: Bentonville AR 72712
Duration: 6 Months
Job Type: Temporary Assignment
Work Type: Onsite
Job Description
  • We are seeking a Data Engineer with Spark & Streaming skills builds real-time scalable data pipelines using tools like Spark Kafka and cloud services (GCP) to ingest transform and deliver data for analytics and ML.
Responsibilities:
  • Design develop and maintain ETL/ELT data pipelines for batch and real-time data ingestion transformation and loading using Spark (PySpark/Scala) and streaming technologies (Kafka Flink).
  • Build and optimize scalable data architectures including data lakes data warehouses (BigQuery) and streaming platforms.
  • Performance Tuning: Optimize Spark jobs SQL queries and data processing workflows for speed efficiency and cost-effectiveness
  • Data Quality: Implement data quality checks monitoring and alerting systems to ensure data accuracy and consistency.
Required Skills & Qualifications:
  • Programming: Strong proficiency in Python SQL and potentially Scala/Java.
  • Big Data: Expertise in Apache Spark (Spark SQL DataFrames Streaming).
  • Streaming: Experience with messaging queues like Apache Kafka or Pub/Sub.
  • Cloud: Familiarity with GCP Azure data services.
  • Databases: Knowledge of data warehousing (Snowflake Redshift) and NoSQL databases.
  • Tools: Experience with Airflow Databricks Docker Kubernetes is a plus.
TekWissen Group is an equal opportunity employer supporting workforce diversity.
Overview: TekWissen is a global workforce management provider headquartered in Ann Arbor Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation information technology and services Position: Data En...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala