Databricks Engineer

About Capgemini Group

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 300000 team members in nearly 50 countries. With its strong 50-year heritage and deep industry expertise Capgemini is trusted by its clients to address the entire breadth of their business needs from strategy and design to operations fueled by the fast evolving and innovative world of cloud data AI connectivity software digital engineering and platforms.

REQUIREMENTS

• 6 years of experience in Big Data and Data Engineering.
• Strong expertise inSpark (PySpark) and Azure Databricks for largescale distributed data processing.
• Hands-on experience developingdata pipelines and applying data ingestion patterns within Azure ecosystems.
• Proficiency withorchestration tools such as Azure Data Factory (ADF) or Apache Airflow.
• AdvancedSQL skills including performance tuning for large datasets.
• Experience withdenormalized data modeling for big data platforms.
• Background working inagile methodologies such as Scrum or Kanban.
• Fluent English communication skills both written and verbal.

RESPONSIBILITIES

• Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch distributed) & real-time highly available data data pipeline and technology capabilities
• Build fault-tolerant self-healing adaptive and highly accurate data computational pipelines
• Provide consultation and lead the implementation of complex programs
• Develop and maintain documentation relating to all assigned systems and projects
• Tune queries running over billions of rows of data running in a distributed query engine
• Perform root cause analysis to identify permanent resolutions to software or business process issues

What you will love about working with us:

• At Capgemini were always looking ahead.
• We reimagine possibilities and we innovate with technology to bring ideas to life.
• We encourage flexibility in how when and where people get their work done allowing a better work-life balance and greater empowerment.
• They partner with their managers to find an arrangement that works best for their role and their circumstances.
• We offer game-changing programs to accelerate the growth of our people and the development of their expertise.

What you need to know about what we offer:

• Excellent compensation and benefits
• Career path trainings and real growth opportunities
• Engaging and challenging projects.
• Excellent work environment and culture.
• Open and Effective management.
• Highly professional and collaborative teams.

At Capgemini Mexico we aim to attract the best talent and are committed to creating a diverse and inclusive work environment so there is no discrimination based on race sex sexual orientation gender identity or expression or any other characteristic of a person. All applications welcome and will be considered based on merit against the job and/or experience for the position.