Senior AI Engineer APM Integrations

Madrid - Spain

Monthly Salary: Not Disclosed

Posted on: 5 hours ago

Vacancies: 1 Vacancy

Job Summary

IDM is the team that works on Datadog APM integrations: the parts that connect Datadog to the tools and services customers use. The teams job is to make it easier for engineers to build and maintain integrations over time and to keep quality and reliability will build AI-assisted tools that help with day-to-day engineering work like drafting code changes suggesting fixes and checking results with tests and other automated checks. The goal is building tools that engineers can trust in real production work. Youll also work closely with other teams understand how they work and build solutions that fit their will define what good means for these tools measure results and improve them over time. Youll set up evaluation and testing so the AI output stays correct and doesnt silently get worse. This is a senior role with high ownership from early prototypes to production and ongoing support.

At Datadog we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

What Youll Do:

Build agent workflows that take an integration need from plan to implementation and validation with humans approving at the right checkpoints.
Create systems that synthesize context from codebases docs specs telemetry and historical incidents to make changes that match Datadog conventions and customer expectations.
Generate and evolve integration code and tests including end-to-end scenarios that reflect real customer workloads and product features.
Design evaluation harnesses that prevent silent regressions: golden sets scenario baselines semantic checks performance thresholds and release gating.
Build portfolio-level automation: proactive updates for upstream breaking changes tracer feature rollouts across the catalog migrations to new schemas/semantics and targeted coverage expansion.
Partner tightly with PM support engineers and integration-owning teams to make the system adoptable trustworthy and embedded in daily engineering workflows.

Who You Are:

Product-minded engineer who ships AI to production

6 years building backend systems (Go Java ) with strong focus on simplicity correctness and performance.
Proven experience delivering LLM/agent features to production (prompting tooling evals safety/guardrails).
Comfortable navigating ambiguity iterating from prototype to production and measuring impact with clear metrics.

Strong ML fundamentals

Solid grasp of the ML lifecycle (task definition dataset construction modeling evaluation deployment iteration) and statistics for experiments.
Fluency with offline/online evals: golden sets automated regressions and evaluation harnesses that prevent silent quality drift.

Distributed systems & observability savvy

Experience with microservices performance: tracing latency breakdowns concurrency resiliency patterns.
Production operations mindset: monitoring alerting and participating in oncall rotations where applicable.

Bonus Point:

Handson with distributed tracing stacks (OpenTelemetry/Datadog APM) profilers and logs/metrics pipelines.
Experience with planning/agent frameworks tooluse orchestration RAG and retrieval/indexing over large context.
Experience building developer tools (IDEs static analysis compilers code transformation pipelines) or code-generation systems.
Familiarity with semantic conventions / schema migrations scenario-based testing and cross-language porting at scale.

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. Thats okay. If youre passionate about technology and want to grow your skills we encourage you to apply.

Benefits and Growth:

New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
Continuous professional development product training and career pathing
Intradepartmental mentor and buddy program for in-house networking
An inclusive company culture ability to join our Community Guilds (Datadog employee resource groups)
Access to Inclusion Talks our Internal panel discussions
Free global mental health benefits for employees and dependents age 6
Competitive global benefits

Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.

Required Experience:

Senior IC