Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
5years
$ 56 - 56
1 Vacancy
Job Description
Position Overview:
A leading IT services provider is seeking a Senior Data Engineer with deep experience in distributed computing ETL design and modern data platforms. This role is ideal for a technically strong professional who enjoys solving complex data problems optimizing performance and leading hands-on development efforts across enterprise-scale data environments.
Key Responsibilities:
Design develop and optimize data integration solutions using Informatica PowerCenter and PowerExchange CDC
Build and manage ETL workflows ensuring high data quality and system reliability
Work with large-scale distributed systems using Apache Spark and PySpark
Develop data pipelines and transformations using Python
Perform complex SQL queries and work with NoSQL databases such as PostgreSQL DB2 and Snowflake
Leverage AWS cloud services for data platform deployments and processing
Utilize workflow schedulers like Airflow for task automation
Lead debugging tuning and troubleshooting of ETL jobs and data flows
Participate in Agile / POD-based development manage tickets and conduct gap analysis
Maintain documentation for mappings sessions workflows and processes
Provide mentorship and technical leadership to junior engineers
Requirements
Required Skills & Experience:
10 years of experience in big data and distributed computing
7 years of hands-on experience with Informatica PowerCenter
Advanced proficiency with PySpark Apache Spark and Python
Strong experience in SQL and NoSQL technologies (e.g. DB2 PostgreSQL Snowflake)
Proficiency in data modeling and designing scalable ETL workflows
Familiarity with Airflow or similar workflow orchestration tools
Hands-on experience with AWS data platforms
Strong analytical and problem-solving skills
Experience in DevOps CI/CD and containerization tools (e.g. Docker Kubernetes) is a plus
10+ years of experience in big data and distributed computing 7+ years of hands-on experience with Informatica PowerCenter Advanced proficiency with PySpark, Apache Spark, and Python Strong experience in SQL and NoSQL technologies (e.g., DB2, PostgreSQL, Snowflake) Proficiency in data modeling and designing scalable ETL workflows Familiarity with Airflow or similar workflow orchestration tools Hands-on experience with AWS data platforms Strong analytical and problem-solving skills Experience in DevOps, CI/CD, and containerization tools (e.g., Docker, Kubernetes) is a plus
Employment Type
Full Time
