Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
Vacancies:
Job Summary
Responsibilities include contributing to the evolution of our data infrastructure and artificial intelligence initiatives.
Responsibilities:
Technical Expertise:
Design and implement a scalable secure and efficient data platform to support large-scale data processing storage and access for AI applications.
Select and implement appropriate tools and technologies for data ingestion transformation storage and retrieval for AI projects.
Develop and maintain data pipelines for efficient movement and processing of data for AI development and training.
Oversee data quality checks and establish data governance practices to ensure data integrity.
Collaborate with data scientists to understand AI requirements and translate them into technical solutions.
Stay up-to-date on the latest advancements in AI machine learning and data engineering technologies.
Communication and Collaboration:
Effectively communicate complex technical concepts to both technical and non-technical audiences.
Document processes and best practices for knowledge transfer.
Qualifications:
Masters degree in Computer Science Artificial Intelligence Data Science or a related field (Bachelors degree with extensive experience may be considered).
5 years of experience in data engineering or a related field.
Strong understanding of machine learning pipelines and experience with AI frameworks (TensorFlow PyTorch etc.) is a plus.
Extensive experience with big data technologies (Hadoop Spark Kafka) and cloud platforms (AWS Azure GCP) is essential.
Expertise in SQL and scripting languages (Python Bash) is required.
Excellent understanding of data modeling principles data governance and data security best practices.
Strong communication collaboration problem-solving and leadership skills.
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Les pneus MICHELIN et services adaptés à votre mobilité. Trouvez le bon pneu pour votre véhicule, les conseils de nos experts, et les revendeurs en France
