Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Position Overview
We are seeking a highly skilled Senior Data Engineer to lead the migration optimization and governance of data pipelines in Azure Data Factory (ADF)and SQL. The ideal candidate will have extensive experience in Change Data Capture (CDC) performance tuning data security and compliance within a cloudbased architecture.
Key Responsibilities
Architect & optimize CDC pipelines in ADF Data Sync Services and SQL ensuring efficient data ingestion.
Implement performance tuning strategies such as parallel processing indexing partitioning and data archiving.
Enforce security & compliance by implementing RBAC data encryption audit logging and access control best practices.
Define and implement data governance models including roles metadata management and compliance policies.
Develop robust error handling & monitoring with automated alerts logging strategies and retry mechanisms for CDC failures.
Provide technical documentation & best practices for CDC implementation security and performance optimization.
Requirements
Qualifications & Skills
5 years of experience in data engineering with expertise in Azure (ADFSynapse) SQL and CDC implementation.
Strong knowledge of performance tuning techniques including parallel processing and indexing strategies.
Handson experience with data security governance and compliance best practices in a cloud environment.
Experience with error logging monitoring and notification setup for data pipelines.
Ability to troubleshoot performance bottlenecks and implement scalable solutions.
Excellent communication and documentation skills.
Required Experience:
Senior IC
Employment Type
Full-Time
