Sr Generative AI Engineer

Dataiku is the Platform for AI Success the enterprise orchestration layer for building deploying and governing a single environment teams design and operate analytics machine learning and AI agents with the transparency collaboration and control enterprises require. Sitting above data platforms cloud infrastructure and AI services Dataiku connects the full enterprise AI stack empowering organizations to run AI across multi-vendor environments with centralized governance.

The worlds leading companies rely on Dataiku to operationalize AI and run it as a true business performance engine delivering measurable value. For more visit the Dataiku blog LinkedIn X and YouTube.

As a Sr Generative AI Engineer on the ED&A team you will build the agentic AI systems that change how Dataiku runs internally. The role is hands-on and end-to-end youll work close to the business turn real problems into working software and see your solutions through from first conversation to production.

How Youll Make an Impact

Agentic AI Solution Development & Integration

• Design end-to-end AI solutions on Dataikus platform leveraging Dataiku Agent Hub Prompt Studio LLM Mesh and Knowledge Banks (Vector Stores) or Python-based frameworks where needed.

• Build and orchestrate multi-agent systems using Dataikus Visual Agents (simple and structured) as well as code-based frameworks (LangGraph CrewAI Claude Agent SDK OpenAI Agents SDK) as appropriate.

• Integrate and optimize LLM APIs across providers (OpenAI Anthropic Google Gemini AWS Bedrock Azure open-source models via Dataikus LLM Mesh) applying model routing strategies to balance cost latency and quality.

• Implement Retrieval-Augmented Generation (RAG) pipelines including agentic RAG and GraphRAG using Dataikus Knowledge Banks with reranking dynamic filtering and document extraction capabilities.

Stakeholder Engagement & Delivery

• Work primarily with the Revenue organisation Sales BDR Customer Success Solutions Engineering Professional Services Sales Operations and Marketing (approximately 75% of the role) and apply proven solutions and approaches more broadly across the organisation (approximately 25%).

• Engage stakeholders to gather business requirements then go further: identify the underlying user pain those requirements represent and design solutions that address both the stated need and the deeper problem.

• Own projects end-to-end from requirements intake and solution design through to build deployment and handover.

Agent & Tool Development

• Develop autonomous and semi-autonomous AI agents using Dataikus Agent Builder custom Python-based architectures (LangGraph CrewAI Claude Agent SDK etc.) or a combination of both. Exercise judgment on when to leverage platform capabilities and when to build custom solutions.

• Design and build Agent Tools beyond documented examples including custom API integrations data retrieval modules decisioning logic and automated workflows pushing past out-of-the-box patterns to deliver solutions tailored to specific business problems.

• Build publish and consume MCP (Model Context Protocol) servers to enable agent-to-tool integration across systems including designing custom MCP servers where needed.

• Develop evaluation and monitoring approaches for agent systems combining Dataikus built-in capabilities with custom instrumentation to measure reliability accuracy cost and business impact in production.

AI Governance & Evaluation

• Design and maintain evaluation frameworks (evals) for LLM-based systems measuring accuracy latency cost and reliability in production.

• Adhere to data governance security and regulatory compliance requirements (EU AI Act awareness responsible AI practices) for all AI solutions.

• Leverage Dataikus Cost Guard and Quality Guard features to manage LLM spend enforce usage policies and maintain output quality standards.

• Work closely with analytics and data engineering teams to maintain metadata on reference datasets for LLM consumption.

Web Application Development

• Create front-end user interfaces for AI applications using HTML CSS and JavaScript within Dataikus webapps framework Dataiku Answers for chat-based interfaces or standalone applications built with and .

• Collaborate on UX design ensuring internal stakeholders find AI solutions intuitive and responsive.

Continuous Learning

• Provide product feedback to the development team to improve the platform.

• Stay current with the rapidly evolving AI engineering landscape agent frameworks model capabilities evaluation practices governance requirements and tools like MCP and A2A protocols.

What Youll Need to Be Successful

Technical Proficiency

• Must have strong Python skills (including familiarity with typical data science and AI engineering libraries).

• Must have hands-on experience building agentic AI systems multi-agent orchestration tool chaining autonomous decision-making and production deployment of AI agents.

• Experience with modern agent orchestration frameworks (LangGraph CrewAI Claude Agent SDK OpenAI Agents SDK or similar); familiarity with LangChain is still relevant but not sufficient on its own.

• Understanding of RAG architectures (vector databases embedding strategies agentic RAG GraphRAG) and when to apply each approach.

• Familiarity with MCP (Model Context Protocol) for agent-to-tool integration or demonstrated ability to quickly adopt new integration standards.

• Experience with structured outputs function/tool calling and prompt engineering across multiple LLM providers.

• Web development fundamentals (HTML CSS JavaScript); experience with and preferred.

• Exposure to AI evaluation practices building evals monitoring model/agent performance in production and iterating based on metrics.

• Comfort with AI-assisted development tools (GitHub Copilot Cursor Claude Code or similar).

• Familiarity with Dataiku a bonus.

Educational & Professional Background

• Bachelors or Masters in Computer Science Data Science Engineering or a related field; equivalent experience also considered.

• Demonstrated ability to integrate multiple technologies optimize workflows and deliver user-friendly AI solutions in a production setting.

Soft Skills

• Strong communication and presentation skills capable of collaborating effectively with both technical and non-technical stakeholders.

• Problem-solving mindset with a passion for innovation and delivering measurable business value.

• Openness to learning new tools (e.g. Dataiku) and adapting to a rapidly evolving AI landscape.