Staff Product Analyst Agentic AI Tracking

We are seeking a dedicated and detail-oriented Staff Product Analyst to join our Vendor Team on our journey to always deliver amazing experiences.

As part of our Vendor Team youll be the driving force behind the success of thousands of restaurants shops and local businesses. Your contributions will empower vendors with advanced tools to manage their operations boosting their visibility and reach. Every feature you help build will create growth opportunities for businesses of all sizes strengthening Delivery Heros ecosystem and impact.

As a Staff Product Analyst you will collaborate closely with AI Research Data Science Product Analytics and Engineering teams to ensure our tracking infrastructure captures the right signals and produces high-quality actionable insights. Your work will empower stakeholders to analyze agent behavior measure the impact of new agentic features and support the development of scalable evaluation pipelines.

What you need to be successful:

• Collaborate with Product and Engineering to define implement and document tracking requirements for agent actions state transitions and user-agent interactions.

• Develop and maintain monitoring systems dashboards and alerts to ensure correctness and completeness of agentic interaction data.

• Investigate anomalies in agent event logs trace data discrepancies and drive timely resolutions.

• Partner with AI Research and Data Science teams to ensure tracking aligns with evaluation metrics model training needs and simulation goals.

• Collaborate with Product Analytics to validate interaction data for user behavior analysis feature assessment and agent success metrics.

• Create and maintain comprehensive documentation for agent tracking specifications data validation procedures and QA frameworks.

• Identify and implement process improvements to enhance the robustness reliability and scalability of agent data collection pipelines.

Qualifications :

• Proven experience in a similar role (e.g. Product Analyst Data Analyst or related position).

• Familiarity with agentic AI systems LLM orchestration or AI evaluation frameworks.

• Strong understanding of event tracking tools logging frameworks and observability practices (experience with structured event tracking OpenTelemetry or custom agent logging preferred).

• Proficiency in SQL and data visualization platforms (e.g. Looker Tableau Power BI).

• Knowledge of data validation debugging and monitoring techniques.

• Excellent communication and collaboration skills with the ability to translate technical concepts for non-technical stakeholders.
   

Preferred

• Experience with Python for data analysis scripting and log parsing.

• Background in data pipelines ETL processes or real-time event streaming (Kafka Pub/Sub etc.).

• Prior experience working closely with AI or ML teams to validate data for model training or evaluation.

Whats in it for you

Ensuring you and all our Heroes are looked after happy and healthy is always on the menu. Because if youre in good shape then were in good shape.

• Make the most of our hybrid working model and join the team for face-to-face connection and collaboration in our beautiful Berlin campus 2 days a week

• We offer 27 days holiday with an extra day on 2nd and 3rd year of service

• We will support you in developing yourself and your career growth opportunities: 1.000 Educational Budget Language Courses Parental Support and access to the Udemy Business platform to explore a variety of online courses.

• Get moving and release those wonderful mind-boosting endorphins: Health Checkups Meditation Gym & Bicycle Subsidy

• Cash. Dough. Cheddar. Whatever you call it well help you with it: Employee Share Purchase Plan Sabbatical Bank  Public Transportation Ticket Discount Life & Accident Insurance Corporate Pension Plan

• The power of getting together over some food is unrivaled. Here are a few ways to help you do that. All the yum: Digital Meal Vouchers Food Vouchers Corporate Discounts. Courses.

Ready to join our team If youre excited to grow collaborate and be part of the worlds leading delivery platform wed love to hear from you. Apply today!

Additional Information :

We believe diversity and inclusion are key to creating not only an exciting product but also an amazing customer and employee experience. Fostering this starts with hiring - therefore we do not discriminate on the basis of racial identities religious beliefs color national origin gender identities or expressions sexual orientations age marital or disability statuses or any other aspect that makes you you. We encourage you to let us know if you need any accommodations or specific accessibility support to ensure a smooth interview experiencejust include it in your application. Youre welcome to share your pronouns (he/she/they) right from the start so we can address you respectfully from our first contact.

Remote Work :

No

Employment Type :

Full-time