Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
11 hours ago
Vacancies:
1 Vacancy
Job Summary
Job Description:
Description
The role is responsible for creating and managing trusted data assets for APAC. You will be seen as the primary engineering contact for this area with the expectation of providing expert advice and technical leadership to product squads utilizing data assets under your oversight which will include product leaders data scientists data domain experts and front-end developers.
What are your key responsibilities
Data Engineering
Engineer and orchestrate data flows & pipelines using high quality easily deployable repeatable and extensible codebases that ingest and integrate data from many disparate data sources in a cloud environment using a progressive tech stack.
Responsible for ensuring the quality freshness and usability of regional-specific data for Demand Supply and other relevant domains in trusted zone(s).
Create readable manageable code with proper test and CI/CD managing data transformation and troubleshooting data processing issues as required.
Follow RC Data Engineering best practices and contribute to their reinforcement as well as shared assets such as Data Libraries.
Build simple data models to support efficient and accurate analytical insight creation. Reduce data preparation efforts for solution users to expedite their processes and reduce errors. Perform data pipeline migrations if necessary.
Implement alerting and monitoring capabilities to ensure high platform reliability in compliance with Mars Cyber Security Standards and Privacy Policies.
Technical Leadership
Provide a technical viewpoint for product squads using data in your oversight ensuring proposed solutions are viable and utilize existing tools and processes.
Seek to break complex/functional requirements down into simple/technically manageable elements and with the help of others estimate the efforts required and any risks associated with development.
Partner with the Product Manager and Data Domain Lead to onboarding any new development resources ensuring they adopt coding standards set by the organization. Work with the Data Engineering community to evolve standards over time.
Data Management and Governance
Practice Data Lifecycle Management through Global Metadata and Access Control Management.
Ensure all data models and assets have Data Quality Management standards implemented.
Partner with functions and divisions to ensure the RC data capabilities roadmap operating model and governance principles are best serving the organization data strategy.
What are we looking for
Experience
5 years of experience in an Applied Data Engineering role or equivalent ideally within the CPG Consumer Products Retail Telecom or Financial Services industries.
Must-have: Spark Python SQL Delta Lake / Apache Iceberg
Nice-to-have: Azure basics Databricks Azure Data Lake Storage
Comfortable working both by themselves and in a team setting. Strong planning and prioritization skills.
Awareness of writing code using agile software development methodologies principles such as DevOps CI/CD and unit testing.
Understanding of Data Protection and Privacy principles and practices including GDPR.
Quick learner with flexibility and willingness to adapt to new software and techniques.
Education
Required: Either academic or self-taught background in one or more of the following areas
Preferred: Bachelors degree or higher in Computer Science Data Science Mathematics Statistics or other numerate discipline
Preferred: Professional qualification as Azure Data Engineer Associate Databricks Certified Data Engineer (or similar)
Language
Candidates must be fluent in both Mandarin and English.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Mars proudly makes the treats, nutritious meals, and many of your favorite products. Learn why we’re ready to become a part of your family.
