drjobs Data Engineer

Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Cape Town - South Africa

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Job Overview

We are seeking an experienced and driven Azure Data Engineer to design build and maintain data pipelines that serve as the backbone of our enterprise data this role you will be responsible for crafting reliable ETL/ELT workflows using Azure Data Factory Python and CData ensuring seamless integration and synchronization across critical systems such as Sage Paylocity and HubSpot.

You will work closely with cross-functional teams to build data flows that support operational efficiency reporting accuracy and scalability. This is an opportunity to have significant impact on high-volume high-visibility data systems in a growing environment.

Key Responsibilities

  • Design develop and manage robust ETL/ELT pipelines using Azure Data Factory Python or orchestration tools like Airflow.

  • Create and maintain staging transformation production workflows in Azure SQL.

  • Develop logic for data validation deduplication and error handling to ensure pipeline reliability and trustworthiness.

  • Manage sync queues for critical systems including Sage (accounting) Paylocity (payroll) HubSpot (CRM) and others.

  • Configure and maintain middleware endpoints using CData or similar platforms for streamlined data flow between systems.

  • Write efficient SQL queries views stored procedures and scripts for analytics transformation and system integration.

  • Collaborate with stakeholders to design data solutions aligned with business processes and compliance standards.

Required Skills & Qualifications

  • 3 years of experience in data engineering or related technical field.

  • Proficiency with Azure Data Factory Airflow or similar orchestration frameworks.

  • Strong command of SQL (preferably Azure SQL but experience with other RDBMS accepted).

  • Hands-on experience with Python scripting for ETL logic and transformations.

  • Experience with CData or equivalent data connectivity/middleware tools.

  • Deep understanding of data validation lineage and audit trail frameworks.

  • Familiarity with ingesting data from various formats (e.g. CSV Excel) and APIs.

Preferred Experience

  • Working on high-volume data workflows involving job-costing payroll ERP or CRM systems.

  • Experience building resilient data sync frameworks with retry logic circuit breaking and error monitoring.

  • Familiarity with role-based data governance logging and compliance standards in enterprise environments.

  • Prior experience in cloud-native architecture and performance optimization.

What Success Looks Like

  • Reliable and scalable data pipelines supporting real-time and batch workloads.

  • Accurate and timely synchronization of critical business systems.

  • High data integrity and auditability across workflows.

  • Clear documentation and reusability of data infrastructure components.

Employment Type

Full Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.