Data Engineer
Share
Job Location:
Johor Bahru - Malaysia
Monthly Salary:
Not Disclosed
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Job Title: Data Engineer
Role Overview
We are seeking an experienced Data Engineer to support end-to-end data lifecycle management within a fast-paced and highly regulated environment. The role involves building scalable data models ensuring data quality and maintaining high-performance data pipelines across multiple platforms. The ideal candidate should have strong domain knowledge in the telecommunications industry and hands-on experience with modern data engineering tools and architectures.
Key Responsibilities
What will you do in this role
Data Modelling & Management
Develop and maintain robust data models (Customer 360 Product Network Usage).
Support metadata management and cataloging for enhanced governance and discoverability.
Data Infrastructure & Platforms
Work with data lakes warehouses and lakehouse platforms (Hadoop Snowflake BigQuery Databricks).
Contribute to the evolution of the data platform architecture (cloud migration microservices event-driven systems).
Data Quality Privacy & Compliance
Implement and maintain data quality checks (validation deduplication reconciliation).
Ensure compliance with data protection and regulatory frameworks (GDPR PDPA CCPA and telco-specific regulations).
Pipeline Development & Optimization
Build monitor and optimize batch and real-time data pipelines for high throughput and low latency.
Ensure data SLAs relating to availability accuracy and freshness are consistently achieved.
Troubleshoot and resolve pipeline failures with quick turnaround times.
Collaboration & Innovation
Partner with data scientists and analysts to deliver clean reliable and well-structured datasets.
Evaluate and adopt emerging data technologies (real-time processing AI-driven data operations).
Automate repetitive engineering tasks including deployment testing and monitoring.
Requirements
Bachelors degree in Business Studies Engineering IT or related field.
510 years of hands-on experience in Data Engineering preferably in the telecommunications domain.
Strong business acumen with excellent technical and solution-oriented insights.
CDMP (Certified Data Management Professional) certification is an added advantage.
Expertise in handling large datasets such as CDRs and network logs.
Proficient in SQL NoSQL and cloud data platforms (Snowflake BigQuery Databricks Hadoop).
Excellent verbal and written communication skills with strong interpersonal abilities.
Company Industry
IT Services and IT Consulting
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
