Azure Data Engineer

Job Description:

We are seeking a talented and experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering with a focus on Microsoft Azure services. The candidate should have a minimum of 510 years of handson experience with Azure Data Factory (ADF) Azure Synapse Analytics Synapse Pipelines Synapse Spark and Synapse SQL Pool.

Responsibilities:

• Data Ingestion and Integration:
  

• Design develop and implement data pipelines using Azure Data Factory to ingest transform and integrate data from various sources.
  
• Implement data integration solutions that meet business requirements and ensure data quality and reliability.
  

• Azure Synapse Analytics:
  

• Work with Azure Synapse Analytics to design and implement data warehousing solutions.
  
• Develop and optimize Synapse SQL Pool (formerly known as SQL Data Warehouse) for efficient querying and reporting.
  

• Synapse Pipelines:
  

• Create and manage Synapse Pipelines to orchestrate endtoend data workflows.
  
• Monitor and optimize pipeline performance to ensure timely and reliable data processing.
  

• Synapse Spark:
  

• Leverage Azure Synapse Spark for big data processing and analytics.
  
• Develop and optimize Spark jobs to handle largescale data processing requirements.
  

• Data Modeling:
  

• Design and implement data models to support analytical and reporting requirements.
  
• Ensure data models are scalable performant and aligned with business needs.
  

• Collaboration:
  

• Collaborate with crossfunctional teams including data scientists analysts and business stakeholders to understand data requirements and deliver effective solutions.
  

• Documentation:
  

• Create and maintain comprehensive documentation for data engineering solutions including design documents process flow diagrams and operational guidelines.
  

• Performance Tuning:
  

• Identify and address performance bottlenecks in data pipelines SQL queries and Spark jobs.
  

Qualifications:

• Bachelors degree in Computer Science Information Technology or a related field.
  
• 35 years of handson experience with Azure Data Factory Azure Synapse Analytics Synapse Pipelines Synapse Spark and Synapse SQL Pool.
  
• Proficient in SQL and TSQL.
  
• Strong understanding of data warehousing concepts and best practices.
  
• Experience with big data technologies and frameworks.
  
• Excellent problemsolving and analytical skills.
  
• Effective communication and collaboration skills.
  
• Microsoft Azure certifications (e.g. DP200 DP201 DP203) are a plus.