Data Engineer
Job Summary
We are seeking a Data Engineer to join our team. With expertise in big data solutions cloud technologies and data pipelines you will help design and deploy scalable data architectures. Your experience will enable us to deliver highquality cloudnative data services for our clients.
Key responsibilities
Provide outofthebox custom data solutions pipelines repairs and reprocessing for analytics workloads.
Design and implement data models ingestion pipelines and data warehouses on AWS.
Collaborate with stakeholders to gather requirements and create architecture diagrams.
Develop and maintain largescale modules using Python Spark and SQL.
Lead the migration of onpremises projects to cloud platforms.
Utilize Airflow Docker and Kubernetes for workflow orchestration and deployment.
Ensure data quality and security across all pipelines.
Document processes and maintain version control with Git.
Required qualifications
Bachelors degree in Computer Science ()
Over 8.5 years of professional data engineering experience.
Proficient in Python Spark and AWS services (S3 Glue Lambda EMR).
Strong background in Big Data ecosystems (Hadoop Hive Kafka Spark SQL).
Experience with data modeling ETL and data lake architecture.
Nice to have
Airflow certification or experience.
Knowledge of Docker Kubernetes and CI/CD pipelines.
Java programming and RESTful API development.
Required Skills:
Python Spark AWS Big Data Hadoop Airflow Docker Kubernetes Java SQL NoSQL Data Modeling