Senior Data Engineer (SWF)

Pune - India

Monthly Salary: Not Disclosed

Posted on: 30+ days ago

Vacancies: 1 Vacancy

Job Summary

Job Title: Senior Data Engineer (AWS Python ETL QuickSight)

Location: Pune
Experience: 7-9 years

About the Role

We are looking for aSenior Data Engineer with strong expertise in building scalableETL pipelines performingdata transformations using AWS Glue and Athena and developinginteractive reporting solutions with Amazon QuickSight.

The ideal candidate should have hands-on experience withAWS Cloud servicesPython andinfrastructure automation using Terraform along with experience incontainerization andCI/CD pipelines via GitHub workflows.

Key Responsibilities

Design develop and maintain robustETL jobs to extract transform and load data from diverse sources into the data lake and warehouse.
Implementdata transformation pipelines usingAWS Glue integrating withAthena for analytical querying and optimization.
Develop and automateQuickSight dashboards and reports for business insights and KPI tracking.
Write clean efficient and maintainablePython code for data processing and orchestration.
Containerize data applications and jobs usingDocker for portability and scalability.
Write and maintainunit and integration tests to ensure code reliability and data quality.
Deploy and manage infrastructure and applications usingGitHub Actions workflows for CI/CD.
Work extensively withAWS services including IAM S3 Lambda Snowflake Lake Formation and DynamoDB.
Manage and automate cloud infrastructure usingTerraform for consistent version-controlled deployments.
Collaborate with data scientists analysts and business stakeholders to design end-to-end analytical solutions.

Required Skills & Experience

6 years of experience indata engineering or related field.
Strong proficiency inPython including data manipulation and automation.
Hands-on experience withAWS GlueAthena andQuickSight.
Deep understanding ofETL design principles and best practices.
Experience withDocker for containerization.
Proficient inAWS CLI and managing AWS resources.
Familiarity withTerraform for infrastructure as code.
Experience writingunit and integration tests using frameworks like pytest.
Experience withGitHub Actions or other CI/CD tools for deployment automation.
Strong problem-solving and analytical skills with attention to detail.

Good to Have

Prior experience in theautomotive domain or working withvehicle data and telematics systems.
Familiarity withdata governance andsecurity frameworks in AWS.

Education

Bachelors degree in computer science Information Technology or a related field.

Required Experience:

Manager

Job Title: Senior Data Engineer (AWS Python ETL QuickSight)Location: PuneExperience: 7-9 yearsAbout the RoleWe are looking for aSenior Data Engineer with strong expertise in building scalableETL pipelines performingdata transformations using AWS Glue and Athena and developinginteractive reporting...