Design develop and maintain robust data pipelines using AWS AppFlow and AWS Glue
Orchestrate and manage end-to-end data workflows to ensure reliability scalability and high performance
Collaborate with cross-functional stakeholders to understand data requirements and deliver effective business-aligned solutions
Monitor optimize and troubleshoot data pipelines and ETL processes to improve efficiency and stability
Ensure data quality consistency integrity and availability across the entire data platform
Qualifications :
Proficiency in workflow orchestration tools such as Airflow or similar platforms
Hands-on experience working with Snowflake for data warehousing and analytics
Strong understanding of data engineering fundamentals including ETL/ELT processes and scalable pipeline design
Experience with Azure services including Azure Storage Azure Data Factory and Event Grid
Working knowledge of AWS cloud services such as S3 EC2 EKS and Lambda
Strong SQL skills for data transformation and pipeline development along with experience using DBT
Remote Work :
No
Employment Type :
Full-time
Founded in 1997, DataArt is a global software engineering firm and a trusted technology collaborator for market leaders and visionaries. Guided by the People-first principle, our world-class team designs and engineers data-driven, cloud-native solutions that foster progress and delive ... View more