Data Engineer
Share
Job Location:
Petaling Jaya - Malaysia
Monthly Salary:
Not Disclosed
Posted on:
8 hours ago
Vacancies:
1 Vacancy
Job Summary
At NEXTDC we are building the heart of Australia & Asias high-tech future. We design build and operate world class next generation data centres using cutting edge environmentally efficient infrastructure to service the specific requirements of local international hyperscale customers.
We are expanding our presence globally including a new data centre in PJ meeting the current and future digital needs of Malaysia by accelerating job skills direct investment and economic prosperity.
At NEXTDC we know that our success depends on the talents of our people and we foster a culture of continued learning and development. Our culture is built on collaboration and innovation we are passionate about what we do and we are committed to our mission to be the leading customer-centric data centre services company.
Where Cloud lives and AI thrives
Qualifications :
As our Data Engineer youll be responsible for designing building and maintaining robust data pipelines and data marts within the Azure ecosystem. This role ensures the accuracy consistency and accessibility of data enabling the organisation to make data-driven decisions. Here youll collaborate with various stakeholders to understand data requirements optimise data processing and implement best practices for data management. This position is crucial for leveraging Azure technologies to enhance data quality and support the organisations analytical and operational needs.
Within this position your scope will cover:
- Data Pipeline Development: Design build and maintain ETL (Extract Transform Load) pipelines to move data from various sources to data marts using Azure Fabric
- Data Quality Management: Ensure the accuracy consistency and reliability of data within the data marts implementing data validation and cleansing processes
- Database Design: Develop and optimize the structure of data marts to support efficient data retrieval and analysis leveraging Azure SQL Database and other Azure data services
- Performance Tuning: Optimize data processing and storage to improve performance and reduce costs utilizing Azure Data Factory Azure Databricks and other relevant tools
- Collaboration: Work closely with data analysts BI developers and other stakeholders to understand data requirements and deliver solutions that meet business needs
- Documentation: Maintain comprehensive documentation of data pipelines data marts and related processes to support knowledge sharing and continuity
- Security and Compliance: Ensure that data solutions adhere to security policies and compliance standards implementing best practices for data protection and access control
Additional Information :
- Opportunity to be a vital part of NEXTDC and the expanding Data Centre world
- Inclusive diverse and values-driven working culture
- Great opportunities to progress within our company (grow as we grow)
Our mission is to continue building a diverse and inclusive workforce which represents the communities in which we operate.
Make NEXTDC your next move.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
At NEXTDC we are building the heart of Australia & Asia’s high-tech future. We design, build and operate world class, next generation data centres, using cutting edge, environmentally efficient infrastructure to service the specific requirements of local, international hyperscale cust ... View more
