Software Engineer, AI Platform
San Francisco, CA - USA
Job Summary
Software Engineer AI Platform
Location: San Francisco CA
Company Stage of Funding: Seed Stage AI Startup ($6M Raised)
Office Type: Onsite (5 Days Per Week)
Salary: $180000$250000 Competitive Equity
Company Description
Were representing a rapidly growing AI infrastructure startup building the data intelligence layer for the autonomous enterprise. Their platform captures how work happens across organizations transforming massive volumes of enterprise activity into structured AI-ready data that powers automation analytics and intelligent decision-making.
Backed by Accel and DST Global the company works with Fortune 500 customers including CVS Health Aon and PVH. Their platform processes tens of terabytes of LLM inference per customer every week creating one of the largest enterprise AI data platforms operating in production today. As the company continues to scale theyre expanding their AI Platform team to build the infrastructure powering every AI capability across the business.
What You Will Do
- Own and evolve the production data platform that powers every AI feature across the companys products.
- Design build and optimize large-scale AI-enabled ETL pipelines processing terabytes of data continuously in production.
- Develop infrastructure that transforms LLM outputs into structured queryable data used throughout the platform.
- Improve system reliability observability throughput latency and infrastructure costs across AI workloads.
- Build production tooling for monitoring debugging evaluation and operational visibility of distributed AI systems.
- Partner closely with AI engineers to develop scalable platform capabilities supporting new product features.
- Design resilient orchestration workflows for distributed data processing retries backfills and failure recovery.
- Contribute to cloud infrastructure Infrastructure-as-Code and platform automation initiatives.
- Participate in production incident response and on-call rotations while continuously improving system reliability.
- Help define the long-term architecture of a rapidly scaling AI data platform serving enterprise customers.
Ideal Candidate Background
- 38 years of experience in backend infrastructure platform or data engineering.
- Proven experience owning production ETL pipelines or large-scale data platforms end-to-end.
- Strong proficiency with Python and modern backend frameworks such as FastAPI.
- Experience building distributed systems processing high-volume production workloads.
- Familiarity with AWS services including ECS Lambda SQS Step Functions RDS and S3.
- Experience with PostgreSQL orchestration frameworks and Infrastructure-as-Code tools.
- Strong understanding of production reliability observability failure recovery and operational excellence.
- Experience working at early-stage startups or other fast-moving engineering environments.
- Bachelors degree in Computer Science Engineering or equivalent professional experience.
Preferred
- Experience operating LLM-powered production systems with responsibility for cost latency and reliability.
- Familiarity with AI-enabled ETL pipelines vector databases and modern AI infrastructure.
- Experience with orchestration platforms such as Dagster Airflow Prefect or Temporal.
- Infrastructure-as-Code experience using Terraform or similar technologies.
- Strong systems thinking with experience designing resilient distributed architectures.
- Previous experience supporting high-throughput enterprise SaaS platforms.
- Side projects research or technical work demonstrating exceptional engineering curiosity.
- Passion for solving large-scale infrastructure challenges in AI-native environments.
Compensation and Benefits
- Base salary: $180000$250000 (higher for exceptional candidates).
- Competitive equity package.
- Additional paid on-call compensation.
- $10000 annual meal stipend.
- $12000 annual healthcare stipend.
- Five-day onsite collaboration in San Francisco.
- E-3 visa sponsorship available for qualified Australian candidates.
- Opportunity to own the core infrastructure powering every AI product across the company.
- Work alongside a highly technical team solving some of the largest production AI data processing challenges in the industry.
Required Experience:
IC
About Company
Senior software engineering jobs at top AI-native startups. Recruiting from Scratch advocates for candidates — 300+ placements, 29-day avg time to hire, 90+ NPS. Browse open roles.