Data Engineer (AWS EMR)

Chicago, IL - USA

Monthly Salary: Not Disclosed

Posted on: 3 days ago

Vacancies: 1 Vacancy

Job Summary

Role: Senior Data Engineer
Location: Chicago IL (Onsite)

Mandatory skills: AWS EMR Python PySpark
Good to have skills: Spark Kafka/Kinesis

What is in it for you
As a Data Engineer with deep expertise in Python AWS big data ecosystems and SQL/NoSQL technologies driving scalable real-time data solutions with CI/CD and stream-processing frameworks.

Responsibilities:

Proficient developer in multiple languages Python is a must with the ability to quickly learn new ones.
Expertise in SQL (complex queries relational databases preferably PostgreSQL and NoSQL databases - Redis and Elasticsearch).
Extensive big data experience including EMR Spark Kafka/ Kinesis and optimising data pipelines architectures and datasets.
AWS expert with hands-on experience in Lambda Glue Athena Kinesis IAM EMR/PySpark Docker
Proficient in CI/CD development using Git Terraform and agile methodologies.
Comfortable with stream-processing systems (Storm Spark-Streaming) and workflow management tools (Airflow).
Exposure to knowledge graph technologies (Graph DB OWL SPARQL) is a plus.

Role: Senior Data Engineer Location: Chicago IL (Onsite) Mandatory skills: AWS EMR Python PySpark Good to have skills: Spark Kafka/Kinesis What is in it for you As a Data Engineer with deep expertise in Python AWS big data ecosystems and SQL/NoSQL technologies driving scalable real-time...