Senior Data Engineer
Koerich - Luxembourg
Job Summary
We are looking for a Senior Data Engineer to join our Innovative Tech this role you will be responsible for designing building and optimizing robust data architectures that empower our clients to leverage their data effectively. You will work in a dynamic environment tackling complex data challenges and collaborating with cross-functional teams to deliver scalable high-performance solutions.
What you will do:
- Build: Develop and optimize ETL/ELT pipelines handling both batch and streaming data processing;
- Bridge the sources: Integrate diverse data flows seamlessly from various structured and unstructured sources;
- Design: Contribute to the design of scalable solutions using medallion architecture to ensure high quality and performance;
- Modernize the stack: Implement advanced cloud-based data architectures like Data Lakehouse and Delta Lake;
- Innovate: Evaluate emerging technologies and architectural patterns to continuously upgrade our infrastructure;
- Guarantee quality: Ensure strict adherence to data security governance and performance standards;
- Solve the complex: Tackle difficult data challenges to ensure the reliability of multiple distributed systems;
- Share the knowledge: Animate the Data Community by sharing documentation training and tech updates;
- Collaborate: Work closely with Data Science BI Product and Architecture teams to align on goals.
Qualifications :
What we are looking for
Technical skills:
- Core languages: Proficient in Python with strong SQL expertise;
- Distributed processing: Spark (batch & streaming) Hadoop;
- Orchestration: Workflow orchestration and GitOps: Airflow Kubernetes-native pipelines;
- Lakehouse expertise: Iceberg Delta Lake Parquet S3 / MinIO Polaris Catalog;
- Real-time data processing: Kafka Spark Streaming Flink;
- Modern architectures: trong knowledge of real-time architectures (e.g. Debezium) and databases like PostgreSQL MongoDB or Cassandra;
- Cloud native: Strong experience with Databricks Snowflake GCP or AWS is a major asset.
- Fluent in both English and French (spoken and written)
Softskills : Collaborative Attention to detail Strong communication Analytical Autonomy
Nice to have:
- AI and Machine Learning: Developing and deploying machine learning models;
- AI frameworks and libraries (TensorFlow PyTorch and Scikit-learn);
- Experience in regulated environments (e.g. financial services healthcare critical infrastructure);
- Knowledge of Luxembourgs regulatory environment including CSSF regulations;
- Certifications: Google Cloud Professional Data Engineer or Google Cloud Machine Learning Engineer.
Additional Information :
Life at Devoteam
Join a community where technology meets humanity. We believe that a job should be more than just a to-do list; it should be a place where you grow connect and make an impact. With us you will find:
- A playground for innovation: You will work with the latest Microsoft tech (Fabric Copilot Azure AI) to build future-proof solutions. This is your chance to stay ahead of the curve.
- A culture of connection: We are 140 tech enthusiasts from 30 countries. We dont just work together; we celebrate diversity and win together.
- Continous growth: Between our Training Center certifications and mentoring we take your development seriously. Your ambition sets the pace.
- Meaningful impact: Through the Devoteam Foundation your skills can serve social causes and sustainability initiatives.
Who thrives here
We are looking for problem-solvers who turn challenges into elegant solutions and curious minds who never stop learning. If you love combining deep technical work with human interaction you will fit right in.
Devoteam stands for equal opportunities. We are convinced that diversity contributes to the creativity dynamism and excellence of our organization. All our positions are open to people with disabilities.
Remote Work :
No
Employment Type :
Full-time
About Company
Devoteam is a AI-driven tech consulting firm specialised in cloud platforms, cyber, data, and sustainability. Tech native for almost 30 years, Devoteam guides businesses through sustainable digital transformation to deliver value. With over 11,000 tech architects in more than 25 co ... View more