Senior Software Engineer, Backend (AI Platform)
Senior Software Engineer, Backend (AI Platform)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Cresta is on a mission to turn every customer conversation into a competitive advantage by unlocking the true potential of the contact center. Our platform combines the best of AI and human intelligence to help contact centers discover customer insights and behavioral best practices automate conversations and inefficient processes and empower every team member to work smarter and faster. Born from the prestigious Stanford AI lab Crestas cofounder and chairman is Sebastian Thrun the genius behind Google X Waymo Udacity and more. Our leadership also includes CEO Ping Wu the cofounder of Google Contact Center AI and Vertex AI platform and CTO & cofounder Tim Shi an early member of Open AI.
Join us on this thrilling journey to revolutionize the workforce with AI. The future of work is here and its at Cresta.
About the role:
- Own model serving:Design build and maintain lowlatency highlyavailable serving stacks for inhouse ML model serving and integrating with LLM serving partners.
- Automate training pipelines:Orchestrate data prep training evaluation and registry workflows on Kubernetes with solid MLOps practices.
- Optimize at scale:Profile and tune throughput memory and cost; introduce caching sharding batching and GPU/CPU autoscaling where it pays off.
- Build platform primitives:Create reusable SDKs templates and CLI tools that let research and product teams ship models independently and safely.
- Raise the bar:Instrument deep observability (tracing metrics alerts) drive blameless postmortems and mentor engineers on production ML best practices.
- 5 years writing production software; 2 years focused on ML platform or infra.
- Expert Python (async typing packaging performance).
- Working Golang knowledge for systems components.
- Proven experience with one or more serving frameworks (e.g. vLLM Triton TorchServe).
- Kubernetes and cloudnative ops.
- Solid grasp of distributed systems networking and container security.
- Culture of rigorous testing code review and continuous delivery.
- Handson with large language models or realtime streaming inference.
- Terraform Helm or similar IaC tooling.
- Experience in speech or conversational AI domains.
Perks & Benefits:
- We offer Cresta employees a variety of medical dental and vision plans designed to fit you and your familys needs
- Paid parental leave to support you and your family
- Monthly Health & Wellness allowance
- Work from home office stipend to help you succeed in a remote environment
- Lunch reimbursement for inoffice employees
- PTO: 3 weeks in Canada
Compensation for this position includes a base salary equity and a variety of benefits. Actual base salaries will be based on candidatespecific factors including experience skillset and location and local minimum pay requirements as applicable. We are actively hiring for this role in the US and Canada. Your recruiter can provide further details.
We have noticed a rise in recruiting impersonations across the industry where scammers attempt to access candidates personal and financial information through fake interviews and offers. All Cresta recruiting email communications will always come from the @ outreach claiming to be from Cresta via other sources should be ignored. If you are uncertain whether you have been contacted by an official Cresta employee reach out to
Required Experience:
Senior IC
Employment Type
Full Time
