Senior Data Engineer

Industry: IT / Technology
Locations: Hyderabad Bengaluru Pune
Experience: Relevant experience in Data Engineering
Key Skills: Apache Airflow DBT Python SQL

We are looking for a skilled and motivated Senior Data Engineer to design develop implement and maintain scalable data pipelines and ETL processes. The ideal candidate will have strong expertise in Python Apache Airflow DBT and SQL along with a solid understanding of data engineering concepts.

The role involves working closely with data scientists analysts and cross-functional stakeholders to ensure data quality reliability accessibility and efficient data processing for analytics and reporting.

• Design develop and maintain robust scalable and efficient data pipelines.

• Build and manage ETL/ELT workflows to process large datasets.

• Develop and maintain data workflows using Apache Airflow.

• Create and manage data transformation models using DBT.

• Write optimized SQL queries for data extraction transformation and analysis.

• Use Python for data processing automation and pipeline development.

• Monitor troubleshoot and optimize data pipelines to ensure reliability and performance.

• Implement data quality checks validations and monitoring mechanisms.

• Collaborate with data scientists analysts and business stakeholders to understand data requirements.

• Work on data modeling data warehousing and database integration.

• Maintain technical documentation for data pipelines workflows and architectures.

• Follow industry best practices for data engineering scalability and data governance.

• Strong hands-on experience with Python for data processing and automation.

• Good experience with Apache Airflow for workflow orchestration and pipeline scheduling.

• Hands-on experience with DBT for data transformation and modeling.

• Strong proficiency in SQL and relational databases such as PostgreSQL and MySQL.

• Understanding of ETL/ELT processes and data pipeline architecture.

• Knowledge of data modeling and data warehousing concepts.

• Familiarity with cloud platforms such as AWS Azure or GCP.

• Strong analytical debugging and problem-solving abilities.

• Good communication and collaboration skills.

• Bachelor's or Master's degree in Computer Science Data Engineering Information Technology or a related field.

• Experience with big data technologies such as Apache Spark or Hadoop.

• Familiarity with data visualization tools such as Tableau or Looker.

• Experience working in Agile and fast-paced development environments.

• Understanding of data quality governance and performance optimization practices.

1. Apache Airflow

2. DBT

3. Python

4. SQL

5. Overall Technical Fitment

Required Skills:

AirflowDBTPythonSQL