Senior Software Engineer, Backend (AI)
Petaling Jaya - Malaysia
Job Summary
Get to Know the Team
Applied AI Team is a group of passionate engineers committed to architecting crafting and maintaining internal tooling systems frameworks and platforms that elevate the very core of our business operations. With unyielding we create functional applications that not only enhance productivity but also redefine efficiency for Grab employees. Join us in this journey of as we pioneer the future of technology pushing the boundaries of whats possible to shape Grabs success.
Get to Know the Role
As a Senior Software Engineer on our team you will be the technical backbone of the AI Gateway (GrabGPT Gateway) Grabs unified LLM API gateway and the single integration point through which every AI initiative in the organization accesses large language models. You will build the systems that give teams secure reliable and cost-accountable access to 60 models across providers such as OpenAI Anthropic Google Vertex AI etc: routing and proxying requests enforcing authentication and rate limits streaming responses tracking token usage and cost and onboarding new models and providers as the LLM landscape evolves.
You will own scalable high-throughput gateway services and the platform capabilities that power them model routing tiered capacity management chargeback and observability for a service that sits in the critical path of all LLM traffic at Grab.
You will report to the Engineering Manager and work onsite at the Grab Office.
This role is onsite based in our Petaling Jaya Malaysia office.
The Critical Tasks You Will Perform
- You will manage gateway features end-to-end. Independently build complex backend features provider integrations unified API endpoints model onboarding API key and identity management rate limiting tiering and cost tracking from conception through deployment.
- You will design multi-provider LLM routing systems that translate a unified OpenAI-compatible API surface into provider-native formats with support for SSE streaming automatic fallback and provider-specific capabilities.
- You will build scalable well-architected backends in Go and Python where appropriate for a low-latency reverse-proxy service handling all LLM traffic at Grab following clean service-layer patterns and consistent API conventions.
- You will build and operate the platforms reliability and governance layers: distributed rate limiting and tiered capacity isolation on Redis API key and OIDC/workload-identity authentication and token-level usage logging cost computation and chargeback pipelines integrated with PostgreSQL and the data lake.
- You will manage CI/CD and cloud resources (AWS/GCP/Azure) Kubernetes deployments database migrations and configuration across staging and production environments including platform migrations such as moving the gateway to Grabs standardized EKS stack.
- You will champion test-driven development and shift-left quality. Write tests first mentor junior engineers and foster a platform-thinking culture so that reliability cost accountability and security are designed in not bolted on.
- You will ensure system reliability for a Tier-critical service. Participate in on-call rotations manage provider capacity and quota incidents conduct root cause analysis and lead post-mortems.
Qualifications :
What Essential Skills You Will Need
- 3 years of professional software development experience with a history of delivering successful solutions.
- Proficiency in server-side programming specifically Go (Golang) and Python.
- Hands-on experience with LLMs (Large Language Models) LangChain and LangGraph for conversational AI development.
- Practical experience with cloud providers (AWS) containerization (Kubernetes) and CI/CD pipelines.
- Grasp of data structures algorithms distributed systems and multi-threading.
- An advocate for automated testing (unit integration) and writing concise technical documentation.
- Experience with a relational database such as MySQL PostgreSQL or Oracle
Additional Information :
Life at Grab
We care about your well-being at Grab here are some of the global benefits we offer:
- We have your back with Term Life Insurance and comprehensive Medical Insurance.
- With GrabFlex create a benefits package that suits your needs and aspirations.
- Celebrate moments that matter in life with loved ones through Parental and Birthday leave and give back to your communities through Love-all-Serve-all (LASA) volunteering leave
- We have a confidential Grabber Assistance Programme to guide and uplift you and your loved ones through lifes challenges.
What We Stand For at Grab
We are committed to building an inclusive and equitable workplace that enables diverse Grabbers to grow and perform at their best. As an equal opportunity employer we consider all candidates fairly and equally regardless of nationality ethnicity religion age gender identity sexual orientation family commitments physical and mental impairments or disabilities and other attributes that make them unique.
Remote Work :
No
Employment Type :
Full-time
About Company
About Grab and Our WorkplaceGrab is Southeast Asia's leading superapp. From getting your favourite meals delivered to helping you manage your finances and getting around town hassle-free, we've got your back with everything. In Grab, purpose gives us joy and habits build excellence, w ... View more