Principal Consultant Data Engineer

Genpact

Not Interested
Bookmark
Report This Job

profile Job Location:

Hyderabad - India

profile Monthly Salary: Not Disclosed
Posted on: 22 hours ago
Vacancies: 1 Vacancy

Job Summary

Ready to shape the future of work
At Genpact we dont just adapt to changewe drive it. AI and digital innovation are redefining industries and were leading the charge. Genpacts AI Gigafactory our industry-first accelerator is an example of how were scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale. From large-scale models to agentic AI our breakthrough solutions tackle companies most complex challenges.
If you thrive in a fast-moving tech-driven environment love solving real-world problems and want to be part of a team thats shaping the future this is your moment.
Genpact (NYSE: G) is anadvanced technology services and solutions company that deliverslastingvalue for leading ourdeep business knowledge operational excellence and cutting-edge solutions we help companies across industries get ahead and stay by curiosity courage and innovationour teamsimplementdata technology and AItocreate tomorrow to know us onLinkedInXYouTube andFacebook.
Inviting applications for the role of Manager Data Engineer.
In this role a Data Engineer will leverage cloud technologies to manage and analyze their data. This role demands expertise in Databricks Azure Data Factory (ADF) Python and PySpark and Unity Catalog to efficiently process and analyze large datasets. Data Engineer Is responsible for designing and implementing scalable data pipelines optimizing data workflows ensuring data quality collaborating with cross-functional teams and leveraging cloud technologies to enhance data processing and analytics capabilities.

Responsibilities
Data Pipeline Development:
oArchitect build and optimize data ingestion and transformation pipelines using Azure Data Factory and Azure Databricks.
oImplement data integration and transformation solutions using Azure Databricks.
Data Quality and Governance:
oEnsure data quality frameworks lineage and monitoring are in place.
oImplement data quality checks validation rules and governance policies to ensure accuracy reliability and security of data assets.
Data Management:
oPull data from different sources transform and stitch it for advanced analytics activities.
oDesign implement and deploy data loaders to load data into the engineering sandbox.
oDevelop and deploy data models and solutions using Azure services.
Collaboration and Support:
oCollaborate with machine learning engineers and cloud engineers for the design and implementation of data management solutions.
oWork with data scientists and analysts to support their data requirements.
Performance Optimization:
oMonitor and optimize data pipelines for performance and reliability.
oTroubleshoot and resolve data-related issues promptly.
Security Measures:
oImplement data security and privacy measures to protect sensitive information.
Implement Unity Catalog:
oManage data governance and security using Unity Catalog to ensure compliance and protect sensitive information.
Leadership and Mentorship:
oMentor junior engineers and perform peer reviews.
oParticipate in code reviews and provide feedback to improve data engineering processes
oLeverage data best practices and tools and assist ML engineer in pulling filtering tagging joining parsing and normalizing data sets for use.

Qualifications We Seek in You!
Minimum Qualifications / Skills
A bachelors degree in computer science Information Technology Business or a related field is required
Experience in Databricks Azure ADF Python Pyspark
Experience in working on data ingestion or ETL from Workday or any other HR systems
Experience in RBAC security models in Unity Catalog
Exposure to CI/CD DevOps practices
Expertise in Azure Databricks including its features for big data processing and collaborative notebooks.
Strong programming skills in Python for data manipulation and scripting.
Extensive experience with PySpark and SQL for building scalable data transformation jobs data querying analysis and data modelling
Proficiency in data engineering tools like Databricks Apache Spark and Unity Catalogue
Hands-on experience with Azure Data Factory for pipeline orchestration scheduling and monitoring.

Preferred Qualifications / Skills
Mentoring data engineers and managing specific POD
Certifications in Azure data engineering databrick or related fields


Why join Genpact
Be a transformation leader Work at the cutting edge of AI automation and digital innovation
Make an impact Drive change for global enterprises and solve business challenges that matter
Accelerate your career Get hands-on experience mentorship and continuous learning opportunities
Work with the best Join 140000 bold thinkers and problem-solvers who push boundaries every day
Thrive in a values-driven culture Our courage curiosity and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Come join the tech shapers and growth makers at Genpact and take your career in the only direction that matters: Up.
Lets build tomorrow together.
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race color religion or belief sex age national origin citizenship status marital status military/veteran status genetic information sexual orientation gender identity physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity customer focus and innovation.
Furthermore please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a starter kit paying to apply or purchasing equipment or training.


Required Experience:

Staff IC

Ready to shape the future of work At Genpact we dont just adapt to changewe drive it. AI and digital innovation are redefining industries and were leading the charge. Genpacts AI Gigafactory our industry-first accelerator is an example of how were scaling advanced technology solutions to help global...
View more view more

Key Skills

  • Enterprise Software
  • SAP Warehouse Management
  • AWS
  • Solution Architecture
  • SAP EWM
  • SAP Finance & Controlling
  • SAP Supply Chain Management
  • SAP S/4HANA
  • Enterprise Sales
  • Pre-sales
  • Management Consulting
  • Oracle

About Company

Company Logo

Artificial Intelligence. Real Outcomes. AI is changing big businesses, and so are we. Discover how cutting-edge AI drives unparalleled value.

View Profile View Profile