Big Data Engineer
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like where youll be supported and inspired by a collaborative community of colleagues around the world and where youll be able to reimagine whats possible. Join us and help the worlds leading organizations unlock the value of technology and build a more sustainable more inclusive world.
YOUR ROLE
We are looking for a Big Data Engineer to strengthen Capgemini Portugals Data & AI consulting team. You will play a key role in designing developing and optimising largescale data solutions for complex and highimpact environments. This is an opportunity to work closely with crossfunctional teams contribute to strategic decisionmaking and help shape innovative data platforms built on cuttingedge technologies.
In this role you will be responsible for:
- Analyse functional specifications and translate them into technical requirements.
- Work with stakeholders to define user needs for new or enhanced data and software solutions.
- Identify and assess the most appropriate data sources in terms of functional scope frequency and quality.
- Design technical solutions and perform feasibility studies to validate approaches.
- Propose and validate solution designs with Product Management and business users.
- Develop secure resilient and efficient software components following client standards.
- Build data acquisition modelling cleansing aggregation and processing pipelines.
- Design optimised data models balancing complexity performance and operational cost.
- Stay up to date with Big Data technologies (cloud platforms distributed computing opensource frameworks).
- Master and apply key technical frameworks (e.g. Spark) functional programming languages (Scala) and other relevant languages.
- Execute unit integration and performance tests to ensure alignment with quality standards.
- Participate in product validation phases and contribute to finetuning before release.
- Debug and resolve technical issues in collaboration with Product Managers and Analysts.
- Maintain and update technical documentation for internal and external stakeholders.
- Optimise existing data systems for scalability performance and reliability.
- Contribute to continuous improvement initiatives across engineering practices and tools.
- Collaborate with cybersecurity and Data Governance teams to ensure data protection and compliance.
YOUR PROFILE
- Masters degree in IT Engineering Data Engineering Data Science or related field.
- 2 years of hands-on experience as a Big Data Engineer (such as Spark Kafka Cloud Native and Data-Lakes)
- Experience working on Big Data Architectures independently with deep understanding of big data technology concepts tools features and functions of different approaches available.
- Comfortable Programming/scripting in Spark Scala Java Python or Shell.
- Experience with Databricks and Hadoop HDFS.
- Knowledge of Elasticsearch and SQLbased databases.
- Interest in Generative AI and cybersecurity.
- Pratical experience with Cloud technologies (Azure Google Cloud AWS).
- Creativity initiative and innovation mindset.
- Strong communication skills with the ability to explain technical topics to non-technical stakeholders.
- Ownership mindset strong analytical and structured problem solving ability to work in ambiguous environments and collaboratively in multicultural teams.
- Fluency in Portuguese and English
- Nice-to-have: Databricks Professional Data Engineer; Understanding of statistics mathematics and machine learning is a strong asset.
WHAT YOULL LOVE ABOUT CAPGEMINI
- At Capgemini Portugal we have a flexible and dynamic work environment. Flexibility enables a better work-life balance and gives more flexibility to the employee to manage the working hours as well if he works at the office or remotely according with the companys hybrid work policy;
- We have local programs that promote people growth reskill and new skills development (Career Acceleration Programs);
- We promote an empowering environment with autonomy and peers relationships among the top scores of our Monthly Employees feedback; Next to this we also offer an attractive compensation package and benefits such as Health and Life insurance as well as Referral program with bonuses for talent recommendations and other fringe benefits according with our partnerships in force.
- Capgemini Portugal is an equal opportunity employer. We promote equality and dignity in all aspects of recruitment and employment as well as employment offers and promotions made according with competence and ability or performance respectively.
ABOUT CAPGEMINI
Capgemini is a global business and technology transformation partner helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340000 team members in more than 50 countries. With its strong over 55-year heritage Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering all fuelled by its market leading capabilities in AI cloud and data combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of 22.5 billion.
Get the future you want
Apply now!
#LI-Hybrid
Required Experience:
IC
Big Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like where youll be supported and inspired by a collaborative community of colleagues around the world and where youll be able to reimagine whats possible. Join us and help ...
Big Data Engineer
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like where youll be supported and inspired by a collaborative community of colleagues around the world and where youll be able to reimagine whats possible. Join us and help the worlds leading organizations unlock the value of technology and build a more sustainable more inclusive world.
YOUR ROLE
We are looking for a Big Data Engineer to strengthen Capgemini Portugals Data & AI consulting team. You will play a key role in designing developing and optimising largescale data solutions for complex and highimpact environments. This is an opportunity to work closely with crossfunctional teams contribute to strategic decisionmaking and help shape innovative data platforms built on cuttingedge technologies.
In this role you will be responsible for:
- Analyse functional specifications and translate them into technical requirements.
- Work with stakeholders to define user needs for new or enhanced data and software solutions.
- Identify and assess the most appropriate data sources in terms of functional scope frequency and quality.
- Design technical solutions and perform feasibility studies to validate approaches.
- Propose and validate solution designs with Product Management and business users.
- Develop secure resilient and efficient software components following client standards.
- Build data acquisition modelling cleansing aggregation and processing pipelines.
- Design optimised data models balancing complexity performance and operational cost.
- Stay up to date with Big Data technologies (cloud platforms distributed computing opensource frameworks).
- Master and apply key technical frameworks (e.g. Spark) functional programming languages (Scala) and other relevant languages.
- Execute unit integration and performance tests to ensure alignment with quality standards.
- Participate in product validation phases and contribute to finetuning before release.
- Debug and resolve technical issues in collaboration with Product Managers and Analysts.
- Maintain and update technical documentation for internal and external stakeholders.
- Optimise existing data systems for scalability performance and reliability.
- Contribute to continuous improvement initiatives across engineering practices and tools.
- Collaborate with cybersecurity and Data Governance teams to ensure data protection and compliance.
YOUR PROFILE
- Masters degree in IT Engineering Data Engineering Data Science or related field.
- 2 years of hands-on experience as a Big Data Engineer (such as Spark Kafka Cloud Native and Data-Lakes)
- Experience working on Big Data Architectures independently with deep understanding of big data technology concepts tools features and functions of different approaches available.
- Comfortable Programming/scripting in Spark Scala Java Python or Shell.
- Experience with Databricks and Hadoop HDFS.
- Knowledge of Elasticsearch and SQLbased databases.
- Interest in Generative AI and cybersecurity.
- Pratical experience with Cloud technologies (Azure Google Cloud AWS).
- Creativity initiative and innovation mindset.
- Strong communication skills with the ability to explain technical topics to non-technical stakeholders.
- Ownership mindset strong analytical and structured problem solving ability to work in ambiguous environments and collaboratively in multicultural teams.
- Fluency in Portuguese and English
- Nice-to-have: Databricks Professional Data Engineer; Understanding of statistics mathematics and machine learning is a strong asset.
WHAT YOULL LOVE ABOUT CAPGEMINI
- At Capgemini Portugal we have a flexible and dynamic work environment. Flexibility enables a better work-life balance and gives more flexibility to the employee to manage the working hours as well if he works at the office or remotely according with the companys hybrid work policy;
- We have local programs that promote people growth reskill and new skills development (Career Acceleration Programs);
- We promote an empowering environment with autonomy and peers relationships among the top scores of our Monthly Employees feedback; Next to this we also offer an attractive compensation package and benefits such as Health and Life insurance as well as Referral program with bonuses for talent recommendations and other fringe benefits according with our partnerships in force.
- Capgemini Portugal is an equal opportunity employer. We promote equality and dignity in all aspects of recruitment and employment as well as employment offers and promotions made according with competence and ability or performance respectively.
ABOUT CAPGEMINI
Capgemini is a global business and technology transformation partner helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340000 team members in more than 50 countries. With its strong over 55-year heritage Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering all fuelled by its market leading capabilities in AI cloud and data combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of 22.5 billion.
Get the future you want
Apply now!
#LI-Hybrid
Required Experience:
IC
View more
View less