Lead Consultant, HDP Data Engineer

Genpact

Not Interested
Bookmark
Report This Job

profile Job Location:

Bengaluru - India

profile Monthly Salary: Not Disclosed
Posted on: 2 days ago
Vacancies: 1 Vacancy

Job Summary

Ready to build the future with AI
At Genpact we dont just keep up with technologywe set the pace. AI and digital innovation are redefining industries and were leading the charge. Genpacts AI Gigafactory our industry-first accelerator is an example of how were scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale. From large-scale models to agentic AI our breakthrough solutions tackle companies most complex challenges.
If you thrive in a fast-moving innovation-driven environment love building and deploying cutting-edge AI solutions and want to push the boundaries of whats possible this is your moment.
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge operational excellence and cutting-edge solutions we help companies across industries get ahead and stay ahead. Powered by curiosity courage and innovation our teams implement data technology and AI to create tomorrow today. Get to know us at and on LinkedIn X YouTube and Facebook.
Inviting applications for the role of Lead Consultant HDP Data Engineer
HDP is an analytical big data warehouse based on Azure-Cloud-based data engineering pipelines. It is a Data Foundation for data-driven decision making: a harmonized subset of data from local & global sources enabling local analytics and global products.
HDP Development (Dev) team is responsible for analysing data from sources and document findings about data as metadata. Other main responsibilities of the Dev team are to develop data engineering pipelines which are ingesting transforming and processing data from data sources and identify and develop data tests for tracking data quality in data pipelines.
Responsibilities
Pipeline Building:
Develop SQL based data processing pipelines which includes but not limited SQL functions tables and views
Data Validation:
Create data validation rules on source data to confirm the data has correct and/or expected values.
Perform data profiling of source data (SAP datasets) to identify data quality issues and anomalies business knowledge embedded in data gathering of natural keys and metadata information.
Data Validation Calls:
Interact with client stakeholders and inform about the mismatches observed during validation
Qualifications we seek in you!
Minimum Qualifications
Strong SQL skills for data manipulation and query optimization
Experience in basic python and PySpark Coding
Good experience with version control git system
Knowledge of Azure Devops fundamentals
Hands on experience on unified data analytics platform with Azure Databricks
Experience of Data Build Tool (dbt) or Databricks Delta Live Table is a huge plus
Knowledge of Visual Studio Code development is a plus
Experience in data modelling data integration and data quality
Knowledge of data warehouse architectures design patterns and performance tuning techniques is a plus
Customer/Stakeholder Focus
Functional/Technical skills
Written/Oral Communication
Ability to adapt to different priorities and assignments quickly
Team player with strong communication skills
Excellent analytical and problem-solving skills
Preferred Qualifications/ Skills
Bachelors degree in computer science or related field
Relevant years of relevant professional experience (mainly SQL)
Relevant years experience with python and Pyspark development
Minimum years of experience in Azure Databricks platform

Why join Genpact
Lead AI-first transformation Build and scale AI solutions that redefine industries
Make an impact Drive change for global enterprises and solve business challenges that matter
Accelerate your careerGain hands-on experience world-class training mentorship and AI certifications to advance your skills
Grow with the best Learn from top engineers data scientists and AI experts in a dynamic fast-moving workplace
Committed to ethical AI Work in an environment where governance transparency and security are at the core of everything we build
Thrive in a values-driven culture Our courage curiosity and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Come join the 140000 coders tech shapers and growth makers at Genpact and take your career in the only direction that matters: Up.
Lets build tomorrow together.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race color religion or belief sex age national origin citizenship status marital status military/veteran status genetic information sexual orientation gender identity physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity customer focus and innovation.
Furthermore please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a starter kit paying to apply or purchasing equipment or training.


Required Experience:

Contract

Ready to build the future with AIAt Genpact we dont just keep up with technologywe set the pace. AI and digital innovation are redefining industries and were leading the charge. Genpacts AI Gigafactory our industry-first accelerator is an example of how were scaling advanced technology solutions to ...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Company Logo

Artificial Intelligence. Real Outcomes. AI is changing big businesses, and so are we. Discover how cutting-edge AI drives unparalleled value.

View Profile View Profile