Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
10 hours ago
Vacancies:
1 Vacancy
Job Summary
Job Description
Data Engineer
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like where youll be supported and inspired by a collaborative community of colleagues around the world and where youll be able to reimagine whats possible. Join us and help the worlds leading organizations unlock the value of technology and build a more sustainable more inclusive world.
Requirements:
Advanced English skills (B2).
Experience inETL and Azuretools: A minimum of 2-5 years of experience in developingETLprocesses usingAzure Data Factory Azure Databricks and other Azure cloud tools.
Knowledge of Apache Spark and Databricks: Experience using Apache Spark for distributed data processing and knowledge of Databricks for data integration and transformation.
Proficiency inPython and SQL: Advanced skills inPythonfor automating processes and manipulating data along with a strong understanding ofSQLfor querying and transforming data.
Handling large volumes of data: Ability to manage transform and optimize large volumes of data using cloud platforms and processing technologies like Spark.
Teamwork and communication: Collaborative skills with multidisciplinary teams and effective communication ability to interact with both technical and non-technical stakeholders.
Responsabilities:
Develop and maintain efficientETLpipelines usingAzure Data Factory and Databricksto process and transform large datasets for analysis.
Analyze large datasets and build machine learning models usingPythonandSparkto extract actionable insights and solve business problems.
Utilize Apache Spark to process and analyze large volumes of data in a distributed environment ensuring scalability and performance.
Deploy machine learning models to production usingAzure and Databricks and monitor their performance for continuous improvement.
Work closely with cross-functional teams (data engineers business analysts etc.) to understand requirements and communicate insights and results effectively to stakeholders.
What Youll Love About Working Here:
We recognize the significance of flexible work arrangements to provide support. Be it remote work or flexible work hours you will get an environment to maintain healthy work life balance.
At the heart of our mission is your career growth. Out array of career growth programs and diverse professions are crafted to support you in exploring a world of opportunities.
Equip yourself with valuable certification in the latest technologies.
#LI-Remote
#LI-LG8
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
A global leader in consulting, technology services and digital transformation, we offer an array of integrated services combining technology with deep sector expertise.
