Databricks Engineer

JOB DESCRIPTION

At Capgemini Engineering the world leader in engineering services we bring together a global team of engineers scientists and architects to help the worlds most innovative companies unleash their potential. From autonomous cars to life-saving robots our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

YOUR ROLE

• Design build and maintain data pipelines and ETL processes using Databricks and Apache Spark.
• Optimize data workflows for performance scalability and cost efficiency.
• Implement data lakehouse architecture and manage data ingestion from multiple sources.
• Collaborate with data scientists and analysts to enable advanced analytics and machine learning workloads.
• Ensure data quality governance and security across all data assets.
• Monitor and troubleshoot Databricks clusters jobs and workflows.
• Integrate Databricks with cloud services (AWS Azure or GCP) and other enterprise systems.
• Document processes standards and best practices for data engineering.

YOUR PROFILE

• Bachelors degree in Computer Science Data Engineering or related field.
• Good experience in data engineering or big data technologies using Databricks as a Warehous and PySpark.
• Strong knowledge of SQL Python and data modeling principles.
• Experience managing Data Ingestion Pipelines.
• Experience automating tests for pipelines/notebooks.
• Experience with cloud platforms (AWS Azure or GCP) and their data services.
• Familiarity with Delta Lake Lakehouse architecture and data governance.
• Understanding of CI/CD pipelines and DevOps practices for data workflows.
• Excellent problem-solving and communication skills.
• Proficient English (reading writing and technical communication).

WHAT YOULL LOVE ABOUT WORKING HERE

• At Capgemini Engineering we encourage flexibility in how when and where people get their work done allowing a better work-life balance and greater empowerment. They partner with their managers to find an arrangement that works best for their role and their circumstances.
• At Capgemini Engineering were always looking ahead. Were part of a team that creates opportunities to achieve valuable change. Change that makes a difference. New connections new technologies new ways to work. Its so energizing.
• At Capgemini Engineering we make it easy for you to deepen knowledge and learn new skills while youre still doing the day job.

ABOUT CAPGEMINI

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 300000 team members in nearly 50 countries. With its strong 50-year heritage and deep industry expertise Capgemini is trusted by its clients to address the entire breadth of their business needs from strategy and design to operations fueled by the fast evolving and innovative world of cloud data AI connectivity software digital engineering and platforms.

Get the future you want!

At Capgemini Mexico we aim to attract the best talent and are committed to creating a diverse and inclusive work environment so there is no discrimination based on race sex sexual orientation gender identity or expression or any other characteristic of a person. All applications welcome and will be considered based on merit against the job and/or experience for the position.