Azure Data Engineer

The Position:

We are seeking an Azure Data Engineer to support and optimize our enterprise cloud data operations. The successful candidate will focus heavily on the Microsoft Azure ecosystem managing Databricks clusters developing robust ETL/ELT data pipelines and ensuring the health and performance of data lakes and data warehouses through comprehensive monitoring and logging strategies.

The Responsibilities of the Role:

• Cloud Data Operations: Oversee and manage cloud operations with a strong focus on the Microsoft Azure environment.
• Databricks Administration: Execute hands-on Databricks management including cluster configuration resource scaling and performance optimization for data workloads.
• Data Pipeline Management: Develop maintain and troubleshoot complex ETL/ELT workflows ensuring seamless data flow across data lakes and data warehouses.

• System Monitoring: Implement and manage robust monitoring and logging solutions using Azure Monitor Log Analytics and Datadog to proactively identify and resolve pipeline bottlenecks.

The Requirement for the Role:

Bachelors degree or above majoring in Computer Science or a related technical field

3 to 5 years of professional experience in cloud operations with a strong demonstrable focus on Microsoft Azure.

2 years of hand-on experience working directly with Databricks including cluster management data pipeline development and performance optimization.

Solid familiarity with core data engineering concepts including ETL/ELT workflows data lakes and data warehouses.

Practical experience with monitoring and logging tools such as Azure Monitor Log Analytics and Datadog.

Good written and verbal communication skills in English if know Chinese will be a plus.

The Package:

• Attractive Salary (RM 8000 to RM 10000).
• Performance related bonus for confirmed staff.
• Annual Leave 15 days.
• Medical Leave 14 days.
• Medical and hospitalization coverage.