Senior Principal consultant-Data Engineer AWS + Databricks + PySpark + Airflow

Genpact

Not Interested
Bookmark
Report This Job

profile Job Location:

Hyderabad - India

profile Monthly Salary: Not Disclosed
Posted on: Yesterday
Vacancies: 1 Vacancy

Job Summary

Ready to build the future with AI
At Genpact we dont just keep up with technologywe set the pace. AI and digital innovation are redefining industries and were leading the charge. Genpacts AI Gigafactory our industry-first accelerator is an example of how were scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale. From large-scale models to agentic AI our breakthrough solutions tackle companies most complex challenges.
If you thrive in a fast-moving innovation-driven environment love building and deploying cutting-edge AI solutions and want to push the boundaries of whats possible this is your moment.
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge operational excellence and cutting-edge solutions we help companies across industries get ahead and stay ahead. Powered by curiosity courage and innovation our teams implement data technology and AI to create tomorrow today. Get to know us at and on LinkedIn X YouTube and Facebook.
Inviting applications for the role of Senior Principal Consultant Senior Data Engineer (Databricks AWS MWAA)
Seeking a Senior Data Engineer with strong Databricks AWS and MWAA (Managed Workflows for Apache Airflow) experience to support and execute a large-scale migration from Amazon Redshift to Databricks Lakehouse. The role is hands-on and critical to ensuring scalable reliable and well-orchestrated data pipelines.
Key Responsibilities
Migrate data pipelines and workloads from Redshift to Databricks on AWS.
Build and optimize ETL/ELT pipelines using Databricks (PySpark / Spark SQL).
Design and manage workflow orchestration using MWAA (Apache Airflow).
Refactor complex Redshift SQL into Databricks SQL / Spark.
Implement Delta Lake for reliability performance and scalability.
Integrate Databricks with AWS services (S3 IAM Glue Lambda etc.).
Ensure data quality reconciliation and post-migration validation.
Monitor troubleshoot and optimize pipelines and Airflow DAGs.
Collaborate with architects BI teams and stakeholders for smooth delivery.
Qualifications we seek in you!
Minimum Qualifications
Strong hands-on experience with Databricks on AWS.
Expertise in Apache Spark (PySpark Spark SQL).
Solid experience with MWAA (Apache Airflow) DAG design scheduling monitoring and error handling.
Good understanding of Amazon Redshift and migration patterns.
Proficiency in AWS services: S3 IAM Glue (mandatory).
Strong SQL and data warehousing fundamentals.
Experience with performance tuning and cost optimization.
Preferred Qualifications
Databricks Workflows CI/CD for data pipelines.
BI tool integration (Tableau / Power BI).
Agile delivery experience and stakeholder interaction.

Why join Genpact
Lead AI-first transformation Build and scale AI solutions that redefine industries
Make an impact Drive change for global enterprises and solve business challenges that matter
Accelerate your careerGain hands-on experience world-class training mentorship and AI certifications to advance your skills
Grow with the best Learn from top engineers data scientists and AI experts in a dynamic fast-moving workplace
Committed to ethical AI Work in an environment where governance transparency and security are at the core of everything we build
Thrive in a values-driven culture Our courage curiosity and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Come join the 140000 coders tech shapers and growth makers at Genpact and take your career in the only direction that matters: Up.
Lets build tomorrow together.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race color religion or belief sex age national origin citizenship status marital status military/veteran status genetic information sexual orientation gender identity physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity customer focus and innovation.
Furthermore please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a starter kit paying to apply or purchasing equipment or training.


Required Experience:

Staff IC

Ready to build the future with AIAt Genpact we dont just keep up with technologywe set the pace. AI and digital innovation are redefining industries and were leading the charge. Genpacts AI Gigafactory our industry-first accelerator is an example of how were scaling advanced technology solutions to ...
View more view more

Key Skills

  • Tomcat
  • Risk Management
  • ICD Coding
  • Solaris
  • Solution Architecture
  • PaaS
  • Middleware
  • Perl
  • Weblogic
  • Jboss
  • NetSuite
  • Oracle

About Company

Company Logo

Artificial Intelligence. Real Outcomes. AI is changing big businesses, and so are we. Discover how cutting-edge AI drives unparalleled value.

View Profile View Profile