Senior Azure Data Engineer (ID3593)

STAFIDE

Job Location:

Amsterdam - Netherlands

Monthly Salary: Not Disclosed

Experience Required: 6-8years

Posted on: 30+ days ago

Vacancies: 1 Vacancy

Job Summary

As a Senior Azure Data Engineer you will:

Design develop and maintain data pipelines and data processing solutions using Azure Databricks and Azure Data Factory.
Build and optimize ETL/ELT pipelines using Python PySpark and SQL for large-scale data processing.
Manage and monitor data workflows and orchestration using tools like Apache Airflow.
Perform data onboarding activities ensuring timely and accurate ingestion of data into enterprise data platforms.
Handle run operations including job monitoring issue identification and resolution within defined SLAs.
Troubleshoot and resolve data pipeline failures performance issues and data quality concerns.
Work within an Agile environment collaborating with cross-functional teams to deliver data solutions.
Ensure adherence to data governance and metadata frameworks including exposure to tools like Apache Atlas.
Continuously improve data processing efficiency scalability and reliability.

What You Bring to the Table:

68 years of experience in data engineering and data platform development.
Strong hands-on experience with Azure Databricks and Azure Data Factory.
Proficiency in Python PySpark and SQL for data processing and transformation.
Experience in building and maintaining ETL/ELT pipelines.
Hands-on experience with workflow orchestration tools such as Apache Airflow.
Exposure to data governance or metadata management frameworks (e.g. Apache Atlas).
Experience in handling production support activities including monitoring and issue resolution.
Familiarity with Agile ways of working and collaboration in cross-functional teams.
Strong problem-solving and analytical skills.

You Should Possess the Ability to:

Manage end-to-end data engineering workflows from ingestion to transformation and delivery.
Handle production support tasks ensuring high system availability and SLA adherence.
Identify and resolve data-related issues proactively with minimal supervision.
Optimize data pipelines for performance scalability and reliability.
Collaborate effectively with data analysts engineers and business stakeholders.
Adapt quickly to new tools technologies and evolving data requirements.

What We Bring to the Table:

Opportunity to work on modern cloud-based data platforms using Azure technologies.
Exposure to large-scale data engineering and real-time data processing environments.
A collaborative and Agile work culture focused on innovation and continuous improvement.
Hands-on experience with cutting-edge tools like Databricks Airflow and data governance frameworks.Lets Connect

Want to discuss this opportunity in more detail Feel free to reach out.

Recruiter: Hema Murali

Phone:; Extn :148

Email:

LinkedIn: Skills:

1. As a Senior Azure Data Engineer you will: Design develop and maintain data pipelines and data processing solutions using Azure Databricks and Azure Data Factory. Build and optimize ETL/ELT pipelines using Python PySpark and SQL for large-scale data processing. Manage and monitor data workflows and orchestration using tools like Apache Airflow. Perform data onboarding activities ensuring timely and accurate ingestion of data into enterprise data platforms. Handle run operations including job monitoring issue identification and resolution within defined SLAs. Troubleshoot and resolve data pipeline failures performance issues and data quality concerns. Work within an Agile environment collaborating with cross-functional teams to deliver data solutions. Ensure adherence to data governance and metadata frameworks including exposure to tools like Apache Atlas. Continuously improve data processing efficiency scalability and reliability. 2. What You Bring to the Table: 68 years of experience in data engineering and data platform development. Strong hands-on experience with Azure Databricks and Azure Data Factory. Proficiency in Python PySpark and SQL for data processing and transformation. Experience in building and maintaining ETL/ELT pipelines. Hands-on experience with workflow orchestration tools such as Apache Airflow. Exposure to data governance or metadata management frameworks (e.g. Apache Atlas). Experience in handling production support activities including monitoring and issue resolution. Familiarity with Agile ways of working and collaboration in cross-functional teams. Strong problem-solving and analytical skills. 3. You Should Possess the Ability to: Manage end-to-end data engineering workflows from ingestion to transformation and delivery. Handle production support tasks ensuring high system availability and SLA adherence. Identify and resolve data-related issues proactively with minimal supervision. Optimize data pipelines for performance scalability and reliability. Collaborate effectively with data analysts engineers and business stakeholders. Adapt quickly to new tools technologies and evolving data requirements. 4. What We Bring to the Table: Opportunity to work on modern cloud-based data platforms using Azure technologies. Exposure to large-scale data engineering and real-time data processing environments. A collaborative and Agile work culture focused on innovation and continuous improvement. Hands-on experience with cutting-edge tools like Databricks Airflow and data governance Connect Want to discuss this opportunity in more detail Feel free to reach out. Recruiter: Hema Murali Phone:; Extn :148 Email: LinkedIn:

As a Senior Azure Data Engineer you will:Design develop and maintain data pipelines and data processing solutions using Azure Databricks and Azure Data Factory.Build and optimize ETL/ELT pipelines using Python PySpark and SQL for large-scale data processing.Manage and monitor data workflows and orch...