Senior AI Platform Engineer
At Klaviyo we believe the future of software lies not in productivity tools for human users but in software that can run and optimize itself based on outcome or reward metrics. Weve built the infrastructure and application that serve as the interface between businesses and consumers. We now have over 167000 customers billions of consumer profiles and hundreds of billions of customer messages and follow-on conversion data. We have a big opportunity to build state-of-the-art AI and machine learning technologies at Klaviyo to power our products and develop AI agents that can automatically create and execute marketing or customer experiences strategies and campaigns for any business.
As a Senior AI Platform Engineer youll play a key role in designing and scaling the backend systems that power our AI products and agent solutions. This backend-heavy role gives you opportunities to influence architecture async processing and distributed systems. Youll collaborate closely with product managers ML engineers and data scientists to deliver real-world impact at scale.
This role is hybrid and based in Boston.
How youll make a difference:
- Design and build backend systems to scale AI solutions for 167K customers.
- Contribute to our agentic architecture to support performant AI agents.
- Build tools to tune LLM-based features deploy agents MCP and RAG in production and evaluate performance using tools like Arize OpenAI Bedrock LangChain vLLM and Ray.
- Develop reliable scalable data pipelines and APIs for AI systems.
- Foster a culture of ownership experimentation and customer-first thinking.
Who You Are:
We encourage candidates to apply even if they do not meet all the qualifications listed. AI Ops is a rapidly evolving space and we are all constantly learning!
- 5 years of experience as a backend software engineer building scalable distributed systems.
- Strong experience working in production environments and launching ML/AI projects.
- Hands-on experience with generative AI and agentic AI applications in production.
- Proficient in Python (or similar).
- Comfortable collaborating with cross-functional technical partners.
- Curious proactive and eager to learn.
Nice to Have:
- Experience with big data tools (e.g. Apache Spark Ray).
- Familiarity with cloud infrastructure (AWS Terraform Kubernetes).
- Knowledge of ML frameworks (Huggingface PyTorch TensorFlow Keras).
We use Covey as part of our hiring and / or promotional process. For jobs or candidates in NYC certain features may qualify it as an AEDT. As part of the evaluation process we provide Covey with job requirements and candidate submitted applications. We began using Covey Scout for Inbound on April 3 2025.
Please see the independent bias audit report covering our use of Covey here
Required Experience:
Senior IC
Senior AI Platform EngineerAt Klaviyo we believe the future of software lies not in productivity tools for human users but in software that can run and optimize itself based on outcome or reward metrics. Weve built the infrastructure and application that serve as the interface between businesses and...
Senior AI Platform Engineer
At Klaviyo we believe the future of software lies not in productivity tools for human users but in software that can run and optimize itself based on outcome or reward metrics. Weve built the infrastructure and application that serve as the interface between businesses and consumers. We now have over 167000 customers billions of consumer profiles and hundreds of billions of customer messages and follow-on conversion data. We have a big opportunity to build state-of-the-art AI and machine learning technologies at Klaviyo to power our products and develop AI agents that can automatically create and execute marketing or customer experiences strategies and campaigns for any business.
As a Senior AI Platform Engineer youll play a key role in designing and scaling the backend systems that power our AI products and agent solutions. This backend-heavy role gives you opportunities to influence architecture async processing and distributed systems. Youll collaborate closely with product managers ML engineers and data scientists to deliver real-world impact at scale.
This role is hybrid and based in Boston.
How youll make a difference:
- Design and build backend systems to scale AI solutions for 167K customers.
- Contribute to our agentic architecture to support performant AI agents.
- Build tools to tune LLM-based features deploy agents MCP and RAG in production and evaluate performance using tools like Arize OpenAI Bedrock LangChain vLLM and Ray.
- Develop reliable scalable data pipelines and APIs for AI systems.
- Foster a culture of ownership experimentation and customer-first thinking.
Who You Are:
We encourage candidates to apply even if they do not meet all the qualifications listed. AI Ops is a rapidly evolving space and we are all constantly learning!
- 5 years of experience as a backend software engineer building scalable distributed systems.
- Strong experience working in production environments and launching ML/AI projects.
- Hands-on experience with generative AI and agentic AI applications in production.
- Proficient in Python (or similar).
- Comfortable collaborating with cross-functional technical partners.
- Curious proactive and eager to learn.
Nice to Have:
- Experience with big data tools (e.g. Apache Spark Ray).
- Familiarity with cloud infrastructure (AWS Terraform Kubernetes).
- Knowledge of ML frameworks (Huggingface PyTorch TensorFlow Keras).
We use Covey as part of our hiring and / or promotional process. For jobs or candidates in NYC certain features may qualify it as an AEDT. As part of the evaluation process we provide Covey with job requirements and candidate submitted applications. We began using Covey Scout for Inbound on April 3 2025.
Please see the independent bias audit report covering our use of Covey here
Required Experience:
Senior IC
View more
View less