CI Data Engineer

Job Summary We are seeking an experienced Python Developer with deep expertise in workflow orchestration cloud-native data pipelines and AWS services. The ideal candidate will design develop and maintain scalable data processing solutions using Python Apache Airflow and AWS technologies. This role requires strong software engineering skills cloud architecture knowledge and e production-grade data platforms. Key Responsibilities Design develop and maintain scalable data pipelines and workflow orchestration solutions using Apache Airflow. Develop high-quality reusable and maintainable Python applications and libraries. Build and optimize ETL/ELT pipelines for large-scale data processing. Design cloud-native architectures leveraging AWS services. Implement workflow scheduling monitoring alerting and recovery mechanisms. Integrate data from multiple sources APIs databases and enterprise systems. Optimize application and pipeline performance scalability and reliability. Implement automated testing code reviews and CI/CD best practices. Required Qualifications Bachelors or Masters degree in Computer Science Engineering Information Technology or a related field. 6 years of professional software development experience with Python. 3 years of hands-on experience with Apache Airflow. Strong experience with AWS cloud services. Technical Skills Python Advanced Python programming Object-Oriented Design Multithreading and Multiprocessing Exception Handling Apache Airflow DAG Development Custom Operators and Hooks Sensors and Scheduling AWS Services Amazon S3 AWS Lambda Amazon EC2 Databases & Data Technologies SQL and Query Optimization PostgreSQL MySQL DevOps & Cloud Docker Kubernetes CI/CD Pipelines Preferred Qualifications Experience with Apache Spark Databricks dbt AWS certification such as AWS Certified Solutions Architect AWS Certified Developer Experience with data governance security and compliance frameworks. Knowledge of event-driven and microservices Competencies Solution Design and Architecture Cloud-Native Development Data Engineering Workflow Automation Performance Optimization Problem Solving Technical Leadership Stakeholder Management Collaboration and Mentoring This role is ideal for a highly skilled Python professional who can combine software engineering excellence with expertise in Apache Airflow and AWS to build robust scalable and secure cloud-based data platforms.