Senior Python Data Engineer Job ID JP054841

Senior Python Data Engineer (AI-Assisted Data Migration)

We are looking for a Senior Python Data Engineer to support the migration of legacy SAS-based ETL processes to a modern Python data platform using Parquet PyArrow Pandas Polars and Apache Spark. You will play a key role in developing AI-assisted migration solutions optimizing agent-driven workflows and ensuring high-quality scalable data transformation processes.

Key Responsibilities

• Design develop and validate Python-based ETL and data transformation solutions.
• Review and optimize AI-generated Python code for performance quality and maintainability.
• Build and enhance data pipelines using Pandas Polars PyArrow Parquet and PySpark.
• Improve ETL/ELT processes data quality schema management and performance.
• Contribute to AI-assisted software development and multi-agent orchestration workflows.
• Enhance workflow automation validation processes and human-in-the-loop quality assurance.
• Collaborate with architects data engineers and SAS experts to support complex migration scenarios.
• Ensure robust testing documentation and operational reliability of migration solutions.

Required Skills & Experience

• 5 years of experience in Python Data Engineering.
• Strong expertise in Python Pandas Polars PyArrow Parquet Apache Spark/PySpark and Python performance tuning.
• Experience with ETL/ELT data engineering data quality schema management and testing frameworks.
• Experience using AI-assisted development tools (e.g. GitHub Copilot or similar).
• Knowledge of agentic workflows multi-agent systems workflow orchestration and AI-driven automation.
• Familiarity with SAS Base (DATA Step PROC SQL Macros ETL patterns) is a strong advantage.

Languages

• Active knowledge of Dutch French and English.

Location

• Brussels Belgium
• Hybrid working model.