Data Engineer with French
Data Engineer with French
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are looking for Data Engineers with a high degree of autonomy and strong technical skills. They must be capable of understanding the of an existing project as well as developing based on our specifications. The project operates in a pseudo SAFe environment employing agile practices. The existing teams are already working across multiple sites. Proficiency in French is essential.
The TSN team within this Big Data scope currently consists of approximately 15 people BA and management support) under a customer project manager.
The Data Engineers will be responsible for performing a range of activities including:
- Participating in the design of data ingestion or valorization processes in PySpark based on business rules.
- Designing scripts or encapsulating scripts in PySpark.
- Implementing Oozie pipelines for scheduling processing steps.
- Versioning their work using Git.
- Mastering or at least being familiar with the principles of CI/CD delivery chain implementation.
- Being knowledgeable about the principles and requirements associated with Big Data (component encapsulations queue calls Spark sessions Big Data CI/CD etc..
- Preparing and executing unit tests (UT) including the creation of data sets as needed and utilizing ALM if they work with the tool.
- Documenting their work through deliverables in GIT and/or Confluence and/or .doc/.xls formats
The Big Data clusters are Kerberized with HortonWorks distributions HDP 3.1.5 and HDF 3.5.1 (migration in progress to Cloudera). The main technical components used include:
- Spark/Python
- HDFS
- Hive
- HBase
- Oozie
- YARN
- Atlas
- Jenkins
- Kerberos
Benefits
- Training opportunities
- 24 paid vacation days
- Attractive salary
- Medical care
- Restaurant tickets
- International environment
Employment Type
Full-Time
