Software Engineer II Agentic AI, Internal Developer Platforms

What Youll Do

As a Software Engineer II on IDP youll help build the platform and services that enable agentic developer workflows and the control plane for AI developer tooling. Youll work on components across our Agentic Dev Workflow stack helping create well-defined developer tool APIs MCP servers and registry entries high-quality knowledge/context pipelines and safety/observability for agentic experiences used by engineers across CoreWeave. This role is an excellent fit if you enjoy building developer-facing systems integrating LLM-driven features into tooling and shipping reliable production services that other engineers rely on.

In this role you will

• Build and maintain internal developer platforms that power local development automated testing and ephemeral (preview) environments.
• Design implement and operate MCP servers that wrap developer tools (CW-CLI CI/CD env APIs observability etc.) so LLMs and agents can call them in a safe structured way.
• Contribute MCP server templates SDKs and registry metadata (ownership permissions versioning stability safety level) to make it easy for teams to expose services to agents.
• Integrate and harden AI-enabled developer capabilities (code scaffolding test generation post-PR assistance release agents) into our platform while enforcing policy validation and audit trails.
• Implement spec-driven development flows: index specs and docs enable RAG/structured retrieval and ensure agent outputs are validated against specs and policy checks.
• Implement safety guardrails and observability for agent actions: RBAC/scoped tokens logs and traces explainability and deterministic validation checks.
• Partner with Security SRE DevEx and product teams to design endpoints test harnesses dry-run modes and rollback/ idempotency semantics so agent-driven operations are safe and reversible.
  
  

Investing in our people is one of our top priorities and we value candidates who can bring their diversified experiences to our teams. Here are some qualities weve found compatible with our team. Wed love to talk about whether this aligns with your experience and interests and what youre excited to work on next.

Who You Are

• 3 years professional experience building production services or infrastructure.
• Experience operating services at scale including monitoring/alerting and incident response.
• Comfortable usingPython/Go as a primary language with demonstrated strong systems/programming skills and willingness to become productive in Go.
• Experience with containerization and orchestration (Docker Kubernetes) and IaC / CI systems (GitHub Actions ArgoCD Terraform etc.).
• Experience building scalable development/test environments ephemeral preview environments or developer tooling.
• Experience in LLM/AI-powered developer tooling (code suggestion code intelligence RAG pipelines AI Agents and Agentic Workflows).

Preferred Qualifications

• Direct experience integrating LLMs building MCP-style wrappers or creating machine-friendly tool contracts/SDKs.
• Experience with knowledge/context indexing (semantic search Sourcegraph RAG) observability for agent actions and audit trails.
• Familiarity with safety & governance patterns for autonomous workflows (human-in-the-loop defaults explainability requirements environment scoping scoped tokens / RBAC).
• Experience building dashboards / analytics (Grafana) or tooling for usage/spend monitoring is a plus.

The base salary range for this role is $109000 to $160000. The starting salary will be determined based on job-related knowledge skills experience and market location. We strive for both market alignment and internal equity when determining addition to base salary our total rewards package includes a discretionary bonus equity awards and a comprehensive benefits program (all based on eligibility).