Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
5years
2 - 2
1 Vacancy
Job Description
Job Title: Senior Data Engineer
Location: Coimbatore
Experience: 5 Years
Job Type: Full-Time
Key Responsibilities
Design develop and maintain robust data pipelines using Airflow and AWS services.
Implement and manage data warehousing using Databricks and PostgreSQL.
Automate recurring tasks using Git and Jenkins.
Build and optimize ETL processes leveraging AWS tools like S3 Lambda AppFlow and DMS.
Create interactive dashboards and reports using Looker.
Collaborate with various teams to ensure seamless integration of data infrastructure.
Ensure the performance reliability and scalability of data systems.
Use Jenkins for CI/CD and task automation.
Required Skills & Expertise
Experience as a senior individual contributor on data-heavy projects.
Strong command of building data pipelines using Python and PySpark.
Expertise in relational database modeling ideally with time-series data.
Proficiency in AWS services such as S3 Lambda and Airflow.
Hands-on experience with SQL and database scripting.
Familiarity with Databricks and ThoughtSpot.
Experience using Jenkins for automation.
Nice to Have
Proficiency in data analytics/BI tools such as Power BI Tableau Looker or ThoughtSpot.
Experience with AWS Glue AppFlow and data transfer services.
Exposure to Terraform for infrastructure-as-code.
Experience in data quality testing.
Previous interaction with U.S.-based stakeholders.
Strong ability to work independently and lead tasks effectively.
Qualifications
Bachelor s or Master s degree in Computer Science Data Engineering or related field.
5 years of relevant experience.
Tech Stack
Databricks
PostgreSQL
Python & PySpark
AWS Stack (S3 Lambda Airflow DMS etc.)
Power BI / Tableau / Looker / ThoughtSpot
Git / Jenkns / CI-CD tools
Azure DevOps Terraform Docker Kubernetes CI/CD Automation Cloud Infrastructure Git Bash / PowerShell Python Infrastructure as Code (IaC) Java Deployment Cloud Cost Optimization Monitoring & Logging
Education
Bachelor s degree in Computer Science, Engineering, Information Technology, or a related field (required) Master s degree in a relevant field (preferred, but not mandatory) Relevant certifications in Java, Spring, cloud platforms (AWS, Azure, GCP), or DevOps tools are a plus
Employment Type
Full Time
