Data Engineer SWF

Pune - India

Monthly Salary: Not Disclosed

Posted on: 3 hours ago

Vacancies: 1 Vacancy

Job Summary

Job Title: Data Engineer (Data Engg AWS Python )

Location: Pune
Experience: 2 to 6 Yrs

About the Role

We are looking for a Data Engineer with strong expertise in building scalable ETL pipelines performing data transformations using AWS and Python.

The ideal candidate should have hands-on experience with AWS Cloud services Python and infrastructure automation using Terraform along with experience in containerization and CI/CD pipelines via GitHub workflows.

Key Responsibilities

Design develop and maintain robust ETL jobs to extract transform and load data from diverse sources into the data lake and warehouse.
Write clean efficient and maintainable Python code for data processing and orchestration.
Containerize data applications and jobs using Docker for portability and scalability.
Write and maintain unit and integration tests to ensure code reliability and data quality.
Deploy and manage infrastructure and applications using GitHub Actions workflows for CI/CD.
Work extensively with AWS services including IAM S3 Lambda Snowflake Lake Formation and DynamoDB.
Manage and automate cloud infrastructure using Terraform for consistent version-controlled deployments.
Collaborate with data scientists analysts and business stakeholders to design end-to-end analytical solutions.

Required Skills & Experience

2 years of experience in data engineering or related field.
Strong proficiency in Python including data manipulation and automation.
Deep understanding of ETL design principles and best practices.
Experience with Docker for containerization.
Proficient in AWS CLI and managing AWS resources.
Familiarity with Terraform for infrastructure as code.
Experience writing unit and integration tests using frameworks like pytest.
Experience with GitHub Actions or other CI/CD tools for deployment automation.
Strong problem-solving and analytical skills with attention to detail.

Good to Have

Prior experience in the automotive domain or working with vehicle data and telematics systems.
Familiarity with data governance and security frameworks in AWS.

Education

Bachelors degree in computer science Information Technology or a related field.

Required Experience:

Senior IC

Job Title: Data Engineer (Data Engg AWS Python )Location: PuneExperience: 2 to 6 YrsAbout the RoleWe are looking for a Data Engineer with strong expertise in building scalable ETL pipelines performing data transformations using AWS and Python.The ideal candidate should have hands-on experience wit...