Data Engineer

Salary Range: MYR 4.800 - 5.900 (Gross)

Weshine is hiring for our client (Handshakes AI) based in Singapore for a role based in Malaysia. Handshakes is an award-winning DataTech company. Enabling our clients to make safer more informed decisions by delivering meaningful insights harnessed from reliable data.

We are looking for a Data Engineer to join our Data & AI Engineering this role you will be responsible for developing maintaining and supporting data ingestion and processing pipelines forlarge-scale news and company data. You will work closely with Product Managers Solution Architects AI Engineers and other stakeholders to deliver reliable data solutions that support business and product requirements.

RESPONSIBILITIES

• Develop maintain and enhance ETL and data processing pipelines.
• Support and monitor production data pipelines to ensure data quality reliability and operational stability.
• Develop and optimize data workflows for ingesting transforming and storing structured and unstructured data.
• Troubleshoot and resolve data pipeline database and infrastructure-related issues.
• Work with stakeholders to understand business and product requirements and translate them into technical solutions.
• Manage and optimize data storage solutions across relational and NoSQL databases.
• Collaborate with cross-functional teams to support any product enhancements and operational improvements.
• Participate in code reviews testing deployment and documentation activities.

REQUIREMENTS

• Diploma or Bachelors degree in Computer Science Software Engineering Data Engineering or a related field.
• 25 years of experience in Data Engineering or a related role.
• Strong SQL skills and experience writing complex queries for data processing and analysis.
• Hands-on experience designing and maintaining ETL/data pipelines.
• Experience with Apache Spark for large-scale data processing.
• Experience working with relational databases such as Microsoft SQL Server or MySQL.
• Experience working with NoSQL databases such as Azure Cosmos DB or MongoDB.
• Experience working with cloud platforms and cloud-based services preferably Microsoft Azure. Familiarity with Azure services such as Cosmos DB Service Bus Blob Storage Function Apps and Virtual Machines is an advantage.
• Strong problem-solving skills and the ability to troubleshoot production issues.