Big Data Platform Engineer
Big Data Platform Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
BIG DATA PLATFORM ENGINEER
Important Information
Location: Singapore
KEY FEATURES OF THE POSITION
Operating Global Data Platform components (VM Servers Kubernetes Kafka) and applications (Apache stack Collibra Dataiku and similar).
Implement automation of infrastructure security components and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL).
Develop solutions to build resiliency in data pipelines with platform health checks monitoring and alerting mechanisms quality timeliness recency and accuracy of data delivery are improved
Apply DevSecOps & Agile approaches to deliver the holistic and integrated solution in iterative increments.
Liaison and collaborate with enterprise security digital engineering and cloud operations to gain consensus on architecture solution frameworks.
Review system issues incidents and alerts to identify root causes and continuously implement features to improve platform performance.
Be current on the latest industry developments and technology trends to effectively lead and design new features/capabilities
Technical Skills
Bachelors degree in Computer Science Information Technology or related field
At least 5 years of experience in big data engineering with a focus on cloud-based infrastructure
Strong proficiency in: DevOps tools like Jenkins GitLab CI/CD or similar
Containerization using Docker and Kubernetes
Apache Spark and big data processing
Real-time data integration using Apache Kafka
Distributed SQL engines like Presto and Trino
Data science platforms like Dataiku
Cloud-based object storage solutions like Amazon S3
Ansible Playbooks to automate infrastructure provisioning configuration and deployment
Terraform to manage and provision cloud infrastructure resources
Experience with programming languages like Python
Experience with cloud migration including assessment planning execution and validation
Experience with disaster recovery setup including backup and restore processes replication and failover mechanisms
About Encora
Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services Product Engineering & Application Modernization Data & Analytics Digital Experience & Design Services DevSecOps Cybersecurity Quality Engineering AI & LLM Engineering among others.
At Encora we hire professionals based solely on their skills and do not discriminate based on age disability religion gender sexual orientation socioeconomic status or nationality
Employment Type
Full Time
