Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
13 hours ago
Vacancies:
1 Vacancy
Job Summary
What will you do
TÜV Austria Belgium is seeking a highly skilled and motivated Senior Data Engineer to join our this role you will design and implement robust data pipelines ensure data quality and governance and enable advanced analytics and AI solutions through scalable data architectures. If you are passionate about building reliable data ecosystems and leveraging modern cloud technologies we invite you to apply.
Key Responsibilities
Data Architecture & Pipelines: Design develop and maintain scalable data pipelines and ETL processes to ingest transform and deliver structured and unstructured data.
Data Governance & Quality: Implement governance frameworks data catalogs and quality assurance processes to ensure compliance integrity and security of all data assets.
Data Integration & Storage: Manage data lakes warehouses and streaming platforms; optimize storage solutions for performance and cost-efficiency.
Enable AI & Analytics: Prepare and curate datasets for machine learning and advanced analytics projects ensuring accessibility and reliability for data scientists and AI engineers.
Performance Optimization: Monitor and optimize data workflows for speed scalability and resilience in cloud and on-prem environments.
Collaboration: Work closely with cross-functional teams (data scientists software engineers project managers) to deliver end-to-end data solutions.
Continuous Improvement: Stay updated on emerging technologies in data engineering big data and cloud platforms; drive adoption of best practices.
Client Interaction: Support clients in understanding data requirements present technical solutions and provide expertise on data-driven strategies.
Who are you
Education: Bachelors or Masters degree in Computer Science Data Engineering Information Systems or related field.
Experience: 35 years in data engineering big data or data platform development.
Technical Skills:
Strong proficiency in Python and SQL; experience with distributed systems (Spark Databricks).
Cloud Platforms:
Microsoft Azure: Azure Data Factory Azure Data Lake Storage Microsoft FabricAzure Cosmos DB.
Other Clouds: AWS (Glue RDS Athena Redshift S3) GCP (BigQuery Dataflow).
Data Orchestration & Workflow: Airflow Prefect Dagster ADF
Data transformation: dbt
Data Warehousing & Modeling: Snowflake DuckDB BigQuery.
Streaming & Real-Time Processing: Kafka Azure Event Hub.
Visualization & BI: Power BI Tableau.
Familiarity with CI/CD pipelines (Azure DevOps GitHub Actions) and containerization (Docker Kubernetes).
Infrastructure as Code: Terraform
Analytical Thinking: Ability to design efficient data workflows and troubleshoot complex data issues.
Communication: Clear and concise communication skills for technical and non-technical stakeholders.
Ethical Standards: Commitment to data privacy security and compliance with relevant regulations.
Bonus: Experience with MLOps and DataOps.
Fluency in both written and spoken Dutch and English is required.
What do we offer you
Opportunity to work on cutting-edge data and AI projects with diverse clients.
Collaborative and supportive work environment.
Continuous learning and professional development opportunities.
Competitive salary and benefits package.
Flexible working hours and work-life balance initiatives.
Download attachment(s)
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
At TÜV Austria Belgium, we are a leading provider of Testing, Inspection, and Certification (TIC) services and solutions. As part of the rapidly growing TUV Austria Group, founded in Vienna in 1872, we operate globally with over 3,400 employees in 34 countries. Our commitment to profe ... View more
