Data Engineer-Airflow, Python,Pyspark, Databricks
Share
Job Location:
Monthly Salary:
Posted on:
11-10-2025
Vacancies:
1 Vacancy
Job Summary
Data Engineer Chennai
Were seeking a highly motivated Data Engineer to join our agile cross-functional team and drive end-to-end data pipeline development in a cloud-native big data ecosystem. Youll leverage ETL/ELT best practices and data lakehouse paradigms to deliver scalable solutions. Proficiency in SQL Python Spark and modern data orchestration tools (e.g. Airflow) is essential along with experience in CI/CD DevOps and containerized environments like Docker and Kubernetes. This is your opportunity to make an impact in a fast-paced data-driven culture.
Responsibilities
- Responsible for data pipeline development and maintenance.
- Contribute to development maintenance testing strategy design discussions and operations of the team.
- Participate in all aspects of agile software development including design implementation and deployment.
- Responsible for the end-to-end lifecycle of new product features / components.
- Ensuring application performance uptime and scale maintaining high standards of code quality and thoughtful application design.
- Work with a small cross-functional team on products and features to drive growth.
- Learning new tools languages workflows and philosophies to grow.
- Research and suggest new technologies for boosting the product.
- Have an impact on product development by making important technical decisions influencing the system architecture development practices and more.
Qualifications :
- Excellent team player with strong communication skills.
- . in Computer Sciences or similar.
- 3-5 years of experience in Data Pipeline development.
- 3-5 years of experience in PySpark / Databricks.
- 3-5 years of experience in Python / Airflow.
- Knowledge of OOP and design patterns.
- 3-5 years of server-side technologies such as Java Spring
- Experience with Docker containers Kubernetes and Cloud environments
- Expertise in testing methodologies (Unit-testing TDD mocking).
- Fluent with large scale SQL databases.
- Good problem-solving and analysis abilities.
Requirements - Advantage
- Experience with Azure cloud services.
- Experience with Agile Development methodologies.
- Experience with Git.
Additional Information :
Our Benefits
- Flexible working environment
- Volunteer time off
- LinkedIn Learning
- Employee-Assistance-Program (EAP)
About NIQ
NIQ is the worlds leading consumer intelligence company delivering the most complete understanding of consumer buying behavior and revealing new pathways to 2023 NIQ combined with GfK bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insightsdelivered with advanced analytics through state-of-the-art platformsNIQ delivers the Full View. NIQ is an Advent International portfolio company with operations in 100 markets covering more than 90% of the worlds population.
For more information visit
Want to keep up with our latest updates
Follow us on: LinkedIn Instagram Twitter Facebook
Our commitment to Diversity Equity and Inclusion
At NIQ we are steadfast in our commitment to fostering an inclusive workplace that mirrors the rich diversity of the communities and markets we serve. We believe that embracing a wide range of perspectives drives innovation and excellence. All employment decisions at NIQ are made without regard to race color religion sex (including pregnancy sexual orientation or gender identity) national origin age disability genetic information marital status veteran status or any other characteristic protected by applicable laws. We invite individuals who share our dedication to inclusivity and equity to join us in making a meaningful impact. To learn more about our ongoing efforts in diversity and inclusion please visit the Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
NIQ is the worlds leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holi ... View more
