Data Engineer (Databricks Focus)

Capgemini

Not Interested
Bookmark
Report This Job

profile Job Location:

Colombo - Sri Lanka

profile Monthly Salary: Not Disclosed
Posted on: 16 hours ago
Vacancies: 1 Vacancy

Job Summary

Data Engineer (Databricks Focus)

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like where youll be supported and inspired by a collaborative community of colleagues around the world and where youll be able to reimagine whats possible. Join us and help the worlds leading organizations unlock the value of technology and build a more sustainable more inclusive world.

YOUR ROLE

We are looking for a Data Engineer with a Databricks focus to join Capgemini Portugals Data & AI consulting team. You will design and implement scalable data pipelines and lakehouse solutions solve delivery challenges in client projects and support commercial initiatives with strong technical solutioning.

In this role you will be responsible for:

  • Design build and maintain robust batch and streaming pipelines using Databricks (Spark/PySpark Databricks Workflows/Jobs).
  • Implement lakehouse best practices with Delta Lake (reliability schema evolution optimization) and data modeling for analytics readiness.
  • Apply governance and security patterns using Unity Catalog (access control lineage/discovery) in coordination with client security requirements.
  • Implement CI/CD practices for notebooks/jobs and promote testing observability and operational reliability.
  • Optimize performance and cost (cluster configuration workload tuning) and troubleshoot production issues.
  • Support pre-sales: contribute to architecture solutioning estimations and technical workshops in a consulting environment.

YOUR PROFILE

  • Minimum of 2 years experience as a Data Engineer (Databricks experience strongly preferred).
  • Strong skills in SQL and Python/PySpark; understanding of distributed processing concepts.
  • Experience with Databricks core components (jobs/workflows Delta patterns; governance concepts).
  • Familiarity with CI/CD and DevOps tooling applied to data engineering.
  • Strong communication and teamwork; proactive problem solving and ownership mindset.
  • Fluency in Portuguese and English.

WHAT YOULL LOVE ABOUT CAPGEMINI

  • At Capgemini Portugal we have a flexible and dynamic work environment. Flexibility enables a better work-life balance and gives more flexibility to the employee to manage the working hours as well if he works at the office or remotely according with the companys hybrid work policy;
  • We have local programs that promote people growth reskill and new skills development (Career Acceleration Programs);
  • We promote an empowering environment with autonomy and peers relationships among the top scores of our Monthly Employees feedback; Next to this we also offer an attractive compensation package and benefits such as Health and Life insurance as well as Referral program with bonuses for talent recommendations and other fringe benefits according with our partnerships in force.
  • Capgemini Portugal is an equal opportunity employer. We promote equality and dignity in all aspects of recruitment and employment as well as employment offers and promotions made according with competence and ability or performance respectively.

AOBUT CAPGEMINI

Capgemini is a global business and technology transformation partner helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340000 team members in more than 50 countries. With its strong over 55-year heritage Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering all fuelled by its market leading capabilities in AI cloud and data combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of 22.5 billion.

Get the future you want

Apply now!

#LI-Hybrid


Required Experience:

IC

Data Engineer (Databricks Focus) Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like where youll be supported and inspired by a collaborative community of colleagues around the world and where youll be able to reimagine whats possible. Jo...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Company Logo

A global leader in consulting, technology services and digital transformation, we offer an array of integrated services combining technology with deep sector expertise.

View Profile View Profile