Senior Data Engineer

Cape Town - South Africa

Salary: Not Disclosed

Experience Required: 5-7years

Posted on: 8 hours ago

Vacancies: 1 Vacancy

Job Summary

The Senior Data Engineer is responsible for designing building and maintaining scalable data pipelines and data infrastructure to support data-intensive applications and analytics solutions using Azure Data Factory and Power BI Fabric. The role involves developing and optimising data pipelines Power BI semantic models and reports as well as designing robust data architectures and overseeing data engineering initiatives. Working closely with cross-functional teams the Data Engineer contributes to the strategic direction of data platforms ensuring reliable high-quality data to support business intelligence and analytics needs.

Key Responsibilities and Skills

Translate business requirements into technical data solutions
Understanding and practical experience in the Data Warehouse Life Cycle.
Participate in and contribute to architectural forums within WCG BI team
Data modelling (Dimensional multi-dimensional and Relational)
ETL/Data Pipeline Architecture and implementation.
Process Automation and Architecture.
Understanding of DAX queries and Cubes (semantic models).
Data integration between legacy and modern systems.
Interface with users to understand and agree on specifications
Ad-hoc scripts to facilitate user queries
Cloud Platforms: Deploy and manage data solutions on cloud platforms such as Azure
Batch support
Batch scheduling
TSQL (for database management and querying)
Documentation: Create and maintain technical documentation including data architecture diagrams ETL workflows and system documentation to facilitate understanding and maintainability of data solutions.
Participate in design peer and code reviews
Daily technical functional and operation support for existing Business Intelligence solutions.
Monitoring Optimization and Troubleshooting: Monitor data pipelines and infrastructure performance identify bottlenecks and optimize for scalability reliability and cost-efficiency. Troubleshoot and fix data-related issues.
Contribute to the ideology and growth of moving the architecture to modern platforms on-premise and/or cloud.
Working knowledge of PowerBI reporting.
Ensure technical skills remain relevant to emerging industry or organisational technical strategies e.g. Azure Cloud Solutions Artificial Intelligence initiatives.

Requirements

Qualifications:

Bachelors degree in Computer Science Information Systems Engineering Data Science or a related field
Relevant postgraduate qualification (Honours or Masters) will be advantageous
Microsoft Azure certifications such as:
Azure Data Engineer Associate (DP-203)
Azure Fundamentals (AZ-900)
Strong practical experience with Azure Data Factory and Power BI Fabric

Required Skills:

Understanding and practical experience in the Data Warehouse Life Cycle. Azure Cloud Solutions Artificial Intelligence initiatives.

Required Education:

Bachelors degree in Computer Science Information Systems Engineering Data Science or a related field