drjobs Senior Staff Data Engineer

Senior Staff Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Hyderabad - India

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore we have grown rapidly to become one of Southeast Asias largest and fastest-growing express logistics companies. Since our inception weve delivered to 100 million different customers across the region with added predictability flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities.

More about us:
- We process 250 million API requests and 3TB of data every day.
- We deliver more than 2 million parcels every day.
- 100% network coverage with 2600 hubs and stations in 6 SEA markets (Singapore Malaysia Indonesia Thailand Vietnam and Philippines) reaching 500 million consumers.
- 2 Million active shippers in all e-commerce segments from the largest marketplaces to the individual social commerce sellers.
- Raised more than US$500 million over five rounds.

We are looking for world-class talent to join our crack team of engineers product managers and designers. We want people who are passionate about creating software that makes a difference to the world. We like people who are brimming with ideas and who take initiative rather than wait to be told what to do. We prize team-first mentality personal responsibility and tenacity to solve hard problems and meet deadlines. As part of a small and lean team you will have a very direct impact on the success of the company.

Roles & Responsibilities

    • Design develop and maintain Ninja Vans infrastructure for streaming processing and storage of data.
    • Build tools for effective maintenance and monitoring of the data infrastructure.
    • Contribute to key data pipeline architecture decisions and lead the implementation of major initiatives.
    • Work closely with stakeholders to develop scalable and performant solutions for their data requirements including extraction transformation and loading of data from a range of data sources.
    • Develop the teams data capabilities - share knowledge enforce best practices and encourage data-driven decisions.
    • Develop Ninja Vans data retention policies backup strategies and ensure that the firms data is stored redundantly and securely.

Requirements

    • Bachelors or Masters degree in Computer Science or related field from a top university.
    • Solid Computer Science fundamentals excellent problem-solving skills and a strong understanding of distributed computing principles.
    • At least 8 years of experience in a similar role with a proven track record of building scalable and performant data infrastructure.
    • Expert SQL knowledge and deep experience working with relational and NoSQL databases.
    • Advanced knowledge of Apache Kafka and demonstrated proficiency in Hadoop v2 HDFS and MapReduce.
    • Experience with stream-processing systems (e.g. Storm Spark Streaming) big data querying tools (e.g. Pig Hive Spark) and data serialization frameworks (e.g. Protobuf Thrift Avro).
    • Good to have Experience with infrastructure as code technologies like (Terraform Terragrunt Ansible Helm). Dont sweat it if you dont have it as long as it interests you!
    • Good to have CDC technologies like Maxwell or Debezium.
Tech Stack
Backend: Play (Java 8) Golang Python FastAPI
Frontend: AngularJS ReactJS
Mobile: Android Flutter React Native
Cache: Hazelcast Redis
Data storage: MySQL TiDB Elasticsearch Delta Lake
Infrastructure monitoring: Prometheus Grafana
Orchestrator: Kubernetes
Containerization: Docker Containerd
Cloud Provider: GCP AWS
Data pipelines: Apache Kafka Spark Streaming Maxwell/Debezium PySpark TiCDC
Workflow manager: Apache Airflow
Query engines: Apache Spark Trino

Submit a job application

Required Experience:

Staff IC

Employment Type

Full-Time

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.