Principal Consultant - Databricks Developer
Principal Consultant - Databricks Developer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125000 people across 30 countries are driven by our innate curiosity entrepreneurial agility and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people we serve and transform leading enterprises including the Fortune Global 500 with our deep business and industry knowledge digital operations services and expertise in data technology and AI.
Inviting applications for the role of Principal Consultant Databricks Developer!
In this role the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and nonfunctional requirements.
Responsibilities
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
Work with architect and lead engineers for solutions to meet functional and nonfunctional requirements.
Demonstrated knowledge of relevant industry trends and standards.
Demonstrate strong analytical and technical problemsolving skills.
Must have experience in Data Engineering domain .
Qualifications we seek in you!
Minimum qualifications
Bachelors Degree or equivalency (CS CE CIS IS MIS or engineering discipline) or equivalent work experience.
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
Work with architect and lead engineers for solutions to meet functional and nonfunctional requirements.
Demonstrated knowledge of relevant industry trends and standards.
Demonstrate strong analytical and technical problemsolving skills.
Must have excellent coding skills either Python or Scala preferably Python.
Must have experience in Data Engineering domain .
Must have implemented at least 2 project endtoend in Databricks.
Must have at least experience on databricks which consists of various components as below
o Delta lake
o dbConnect
o db API 2.0
o Databricks workflows orchestration
Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
Must have good understanding to create complex data pipeline
Must have good knowledge of Data structure & algorithms.
Must be strong in SQL and spraksql.
Must have strong performance optimization skills to improve efficiency and reduce cost.
Must have worked on both Batch and streaming data pipeline.
Must have extensive knowledge of Spark and Hive data processing framework.
Must have worked on any cloud (Azure AWS GCP) and most common services like ADLS/S3 ADF/Lambda CosmosDB/DynamoDB ASB/SQS Cloud databases.
Must be strong in writing unit test case and integration test
Must have strong communication skills and have worked on the team of size 5 plus
Must have great attitude towards learning new skills and upskilling the existing skills.
Preferred Qualifications
Good to have Unity catalog and basic governance knowledge.
Good to have Databricks SQL Endpoint understanding.
Good To have CI/CD experience to build the pipeline for Databricks jobs.
Good to have if worked on migration project to build Unified data platform.
Good to have knowledge of DBT.
Good to have knowledge of docker and Kubernetes.
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race color religion or belief sex age national origin citizenship status marital status military/veteran status genetic information sexual orientation gender identity physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity customer focus and innovation. Get to know us at genpact and on LinkedIn X YouTube and Facebook.
Furthermore please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a starter kit paying to apply or purchasing equipment or training.
Required Experience:
Staff IC
Employment Type
Full-Time
