TekWissen is a global workforce management provider headquartered in Ann Arbor Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation information technology and services
Location: Bentonville AR 72712
Job Type: Temporary Assignment
- We are seeking a Data Engineer with Spark & Streaming skills builds real-time scalable data pipelines using tools like Spark Kafka and cloud services (GCP) to ingest transform and deliver data for analytics and ML.
Responsibilities:
- Design develop and maintain ETL/ELT data pipelines for batch and real-time data ingestion transformation and loading using Spark (PySpark/Scala) and streaming technologies (Kafka Flink).
- Build and optimize scalable data architectures including data lakes data warehouses (BigQuery) and streaming platforms.
- Performance Tuning: Optimize Spark jobs SQL queries and data processing workflows for speed efficiency and cost-effectiveness
- Data Quality: Implement data quality checks monitoring and alerting systems to ensure data accuracy and consistency.
Required Skills & Qualifications:
- Programming: Strong proficiency in Python SQL and potentially Scala/Java.
- Big Data: Expertise in Apache Spark (Spark SQL DataFrames Streaming).
- Streaming: Experience with messaging queues like Apache Kafka or Pub/Sub.
- Cloud: Familiarity with GCP Azure data services.
- Databases: Knowledge of data warehousing (Snowflake Redshift) and NoSQL databases.
- Tools: Experience with Airflow Databricks Docker Kubernetes is a plus.
TekWissen Group is an equal opportunity employer supporting workforce diversity.
Overview: TekWissen is a global workforce management provider headquartered in Ann Arbor Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation information technology and services Position: Data En...
TekWissen is a global workforce management provider headquartered in Ann Arbor Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation information technology and services
Location: Bentonville AR 72712
Job Type: Temporary Assignment
- We are seeking a Data Engineer with Spark & Streaming skills builds real-time scalable data pipelines using tools like Spark Kafka and cloud services (GCP) to ingest transform and deliver data for analytics and ML.
Responsibilities:
- Design develop and maintain ETL/ELT data pipelines for batch and real-time data ingestion transformation and loading using Spark (PySpark/Scala) and streaming technologies (Kafka Flink).
- Build and optimize scalable data architectures including data lakes data warehouses (BigQuery) and streaming platforms.
- Performance Tuning: Optimize Spark jobs SQL queries and data processing workflows for speed efficiency and cost-effectiveness
- Data Quality: Implement data quality checks monitoring and alerting systems to ensure data accuracy and consistency.
Required Skills & Qualifications:
- Programming: Strong proficiency in Python SQL and potentially Scala/Java.
- Big Data: Expertise in Apache Spark (Spark SQL DataFrames Streaming).
- Streaming: Experience with messaging queues like Apache Kafka or Pub/Sub.
- Cloud: Familiarity with GCP Azure data services.
- Databases: Knowledge of data warehousing (Snowflake Redshift) and NoSQL databases.
- Tools: Experience with Airflow Databricks Docker Kubernetes is a plus.
TekWissen Group is an equal opportunity employer supporting workforce diversity.
View more
View less