Senior Data Engineer
Share
Job Location:
Kuala Lumpur - Malaysia
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Senior Data Engineer
Important Information
Location: Kuala Lumpur
Experience: 6 years
Job Mode: Contract
Work Mode: On-site
Job Summary
Highly skilled Senior Data Engineer to lead the development and optimization of our data infrastructure. Will be responsible for building scalable data pipelines designing robust data architectures and enabling analytics and machine learning workflows across the organization. Strong background in data engineering cloud technologies and big data processing frameworks.
Responsibilities & Duties
- Design build and maintain scalable and reliable data pipelines (batch and streaming) to support business intelligence and analytics needs.
- Develop and manage data architectures including data lakes data warehouses and real-time data systems.
- Collaborate with data scientists analysts and software engineers to deliver high-quality data solutions.
- Ensure data quality integrity security and compliance across all stages of data processing.
- Optimize data workflows for performance scalability and cost-efficiency.
- Implement ETL/ELT processes and automate data ingestion from multiple sources (APIs databases files etc.).
- Monitor and troubleshoot data pipeline issues and perform root cause analysis.
- Participate in data modeling schema design and documentation.
- Mentor junior engineers and provide technical leadership on data engineering best practices.
Qualifications & Skills
- Bachelors or Masters degree in Computer Science Data Engineering or a related field.
- 6 years of experience in data engineering or related roles.
- Strong proficiency in programming languages such as Python Scala or Java.
- Hands-on experience with SQL and working with large-scale relational databases.
- Expertise in building data pipelines using tools like Apache Spark Airflow Kafka or Flink.
- Solid understanding of data warehousing concepts and experience with tools like Snowflake Redshift or Databricks.
- Experience with cloud platforms such as AWS Azure or Google Cloud Platform (GCP).
- Familiarity with containerization and orchestration tools (Docker Kubernetes) is a plus.
About Encora
Encora is the preferred digital engineering and modernization partner of some of the worlds leading enterprises and digital native companies. With over 9000 experts in 47 offices and innovation labs worldwide Encoras technology practices include Product Engineering & Development Cloud Services Quality Engineering DevSecOps Data & Analytics Digital Experience Cybersecurity and AI & LLM Engineering.
At Encora we hire professionals based solely on their skills and qualifications and do not discriminate based on age disability religion gender sexual orientation socioeconomic status or nationality.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
As Encora Inc. expands its footprint in Latin America, its acquisition of Nearsoft provides our clients with a unique chance to Nearshore on a global scale.
