Senior Data Engineer
Senior Data Engineer
Posted on :
06-04-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Ninja Van is a latestage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore we have grown rapidly to become one of Southeast Asias largest and fastestgrowing express logistics companies. Since our inception weve delivered to 100 million different customers across the region with added predictability flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities.
More about us:
We process 250 million API requests and 3TB of data every day.
We deliver more than 2 million parcels every day.
100 network coverage with 2600 hubs and stations in 6 SEA markets (Singapore Malaysia Indonesia Thailand Vietnam and Philippines) reaching 500 million consumers.
2 Million active shippers in all ecommerce segments from the largest marketplaces to the individual social commerce sellers.
Raised more than US$500 million over five rounds.
We are looking for worldclass talent to join our team of engineers product managers and designers. We want people who are passionate about creating software that makes a difference to the world. We like people who are brimming with ideas and who take initiative rather than wait to be told what to do. We prize teamfirst mentality personal responsibility and tenacity to solve hard problems and meet deadlines. As part of a small and lean team you will have a very direct impact on the success of the company.
Roles & Responsibilities
- Develop and enforce Ninja Vans data retention policies and backup strategies ensuring data is stored redundantly and securely.
Design develop and maintain Ninja Vans infrastructure for data streaming processing and storage.
Build tools to ensure effective maintenance and monitoring of the data infrastructure.
Contribute to key architectural decisions for data pipelines and lead the implementation of major initiatives.
Collaborate with stakeholders to deliver scalable and highperformance solutions for data requirements including extraction transformation and loading (ETL) from diverse data sources.
Enhance the teams data capabilities by sharing knowledge enforcing best practices and promoting datadriven decisionmaking.
Requirements
- Solid computer science fundamentals excellent problemsolving skills and a strong understanding of distributed computing principles.
- At least 5 years of experience in a similar role with a proven track record of building scalable and highperformance data infrastructure using Python PySpark Spark and Airflow.
- Expertlevel SQL knowledge and extensive experience working with both relational and NoSQL databases.
- Advanced knowledge of Apache Kafka along with demonstrated proficiency in Hadoop v2 HDFS and MapReduce.
- Handson experience with streamprocessing systems (e.g. Storm Spark Streaming) big data querying tools (e.g. Pig Hive Spark) and data serialization frameworks (e.g. Protobuf Thrift Avro).
- Good to have Familiarity with infrastructureascode technologies like Terraform Terragrunt Ansible or Helm. Dont worry if you dont have this experiencewhat matters is your interest in learning!
- Good to have Experience with Change Data Capture (CDC) technologies such as Maxwell or Debezium.
- Bachelors or Masters degree in Computer Science or a related field from a top university.
Tech Stack
Backend: Play (Java 8 Golang Node.js Python FastAPI
Frontend: AngularJS ReactJS
Mobile: Android Flutter React Native
Cache: Hazelcast Redis
Data storage: MySQL TiDB Elasticsearch Delta Lake
Infrastructure monitoring: Prometheus Grafana
Orchestrator: Kubernetes
Containerization: Docker Containerd
Cloud Provider: GCP AWS
Data pipelines: Apache Kafka Spark Streaming Maxwell/Debezium PySpark TiCDC
Workflow manager: Apache Airflow
Query engines: Apache Spark Trino
Submit a job application
By applying to the job you acknowledge that you have read understood and agreed to our Privacy Policy Notice (the Notice) and consent to the collection use and/or disclosure of your personal data by Ninja Logistics Pte Ltd (the Company) for the purposes set out in the Notice. In the event that your job application or personal data was received from any third party pursuant to the purposes set out in the Notice you warrant that such third party has been duly authorised by you to disclose your personal data to us for the purposes set out in the the Notice.
Required Experience:
Senior IC
Employment Type
Full-Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
