Python Data Engineer
Job Location:
Monthly Salary:
Posted on:
Vacancies:
Job Summary
Position: Python Data Engineer
Location: Chennai
Working Type: WFO (Full time)
Resource Count: 1
Shift: UK Shift (2:00 – 11:00 PM)
Experience : 6 years overall
Interviews: Assessment 2 Interview rounds.
Key Responsibilities
Design develop and maintain scalable resilient data pipelines and ETL frameworks in cloud environments to support advanced analytics and AI/ML initiatives.
Build optimized data processing solutions database architectures and reusable frameworks for large-scale data ingestion transformation and validation.
Develop high-performance Python- and SQL-based solutions for complex data processing and analytical workloads.
Collaborate with cross-functional teams to translate business requirements into scalable technical solutions and actionable insights.
Ensure data quality governance reliability and operational efficiency through robust testing monitoring and engineering best practices.
Technical Skills and Experience Requirements
Minimum 6 years of hands-on experience designing building deploying testing maintaining monitoring and owning scalable resilient distributed data pipelines.
Strong proficiency in Python for large-scale distributed data processing.
Advanced Python development experience including Python 3.x OOP asynchronous programming performance optimization Airflow orchestration REST APIs cloud SDK integrations (Azure) testing frameworks and Python packaging/dependency management.
Hands-on experience with Pandas SQLAlchemy and PyODBC for data processing and database interactions.
Expert-level ability to write complex optimized queries on large-scale datasets.
Experience with RDBMS and OLAP systems such as MySQL and Snowflake.
Familiarity with Agile methodologies and architectural best practices for scalable data lake solutions.
Required Skills:
Python Advanced Python development Python 3.x OOP asynchronous programming performance optimization Airflow orchestration rest apis cloud SDK integrations Azure testing frameworks Python packaging dependency management Pandas sqlalchemy PyODBC rdbms MySQL Snowflake agile methodologies
