Senior Software Engineer

Our Purpose

At Fiddler we understand the implications of AI and the impact that it has on human lives. Our company was born with the mission of building trust into AI. The rise of Generative AI and Agents has unlocked generalized intelligence but also widened the risk aperture and made it harder to ensure that AI applications are working well. Fiddler enables organizations to get ahead of these issues by helping deploy trustworthy and transparent AI solutions.

Fiddler partners with AI-first organizations to help build a long-term framework for responsible AI practices which in turn builds trust with their user base. AI Engineers Data Science and business teams use Fiddler AI to monitor evaluate secure analyze and improve their AI solutions to drive better outcomes. Our platform enables engineering teams and business stakeholders alike to understand the what why and how behind AI outcomes.

Our Founders

Fiddler AI is founded by Krishna Gade (engineering leader at Facebook Pinterest Twitter and Microsoft) and Amit Paka (product leader at Microsoft Samsung Paypal and two-time founder). We are backed by Insight Partners Lightspeed Venture Partners and Lux Capital.

Why Join Us

Our team is motivated to help build trust into AI to enable society harness the power of AI. Joining us means you get to make an impact by ensuring that AI applications at production scale across industries have operational transparency and are an early-stage startup and have a rapidly growing team of intelligent and empathetic doers thinkers creators builders and everyone in between. The AI and ML industry has a rapid pace of innovation and the learning opportunities here are monumental. This is your chance to be a trailblazer.

Fiddler is recognized as a pioneer in the field of AI Observability and has received numerous accolades including: 2022 a16z Data50 list 2021 CB Insights AI 100 most promising startups 2020 WEF Technology Pioneer 2020 Forbes AI 50 most promising startups of 2020 and a 2019 Gartner Cool Vendor in Enterprise AI Governance and Ethical Response. By joining our brilliant (at least we think so) team you will help pave the way in the AI Observability space.

The Mission

The Backend Engineering team builds and ships the services and APIs that customers interact with every day authorization alerting ingestion monitoring and GenAI evaluation. Were a geographically distributed team working across a Python/Flask microservices architecture with Celery and Kafka powering our async workloads. The problems are cross-disciplinary the pace is fast and no two weeks look the same.

Spread across time zones but united in purpose this crew thrives on solving real problems sharing what they learn and jumping in to help wherever theyre needed. They bring brains grit and a healthy sense of humor to everything they do. Theyre the kind of teammates who fix the issue explain how they did it and still show up to celebrate the win with everyone else.

If you like working on problems that havent been solved before youll thrive here. Fiddlers backend is where GenAI observability becomes real from designing authorization layers for enterprise-scale AI systems to pioneering MCP authorization patterns. The systems you build will directly determine how companies trust and monitor their AI in production.

About The Team

Were a tight-knit team based in the heart of Bengaluru. By day were deep in the weeds of cutting-edge AI tackling problems that actually matter at scale. By lunch were arguing over the latest acquisition rumor debating whether that new model release is overhyped and making weekend plans we may or may not follow through on.

We believe the best ideas dont only come from sprint planning; they come from good conversations (usually over biryani). We work hard think deeply and genuinely enjoy each others company. Happy hours happen. Rabbit holes happen. And shipping something youre really proud of happens.

If you want to do meaningful work alongside people who are as curious about the world as they are about the tech youll feel right at home here.

What Youll Do

• Deliver a production-ready auth layer for GenAI workloads Ship OAuth machine-to-machine (M2M) authorization and an LLM/MCP authorization layer that secures how enterprises connect agentic applications to Fiddler at scale.

• Launch GenAI-specific alerting capabilities Deliver new alert types that detect quality safety and performance issues in LLM applications with notification integrations (PagerDuty webhooks) and the APIs to configure them.

• Ship backend features end-to-end Own features from API design through async processing (Kafka Celery) to production rollout across Fiddlers microservices including monitoring ingestion and LLM evaluation workflows.

• Keep services reliable and observable Maintain SLOs instrument with Prometheus/OpenTelemetry and participate in on-call. When things break you fix them.
  

What Were Looking For

• 6 years of experience building and operating production backend systems

• Strong proficiency in Python; experience with Flask or similar web frameworks

• Experience designing and maintaining RESTful APIs at scale; versioning pagination error handling backward compatibility

• Hands-on experience with relational databases (PostgreSQL preferred) and ORMs (SQLAlchemy)

• Experience with asynchronous/event-driven processing; Celery Kafka or similar message queue and streaming systems

• Production operational experience: debugging live services structured logging metrics on-call

• Comfort with cloud infrastructure (AWS or GCP) and containerized deployments (Docker Kubernetes)

• BS/MS in Computer Science or equivalent practical experience

Nice to Have

• Experience building authentication/authorization systems: OAuth 2.0 RBAC ABAC API key management M2M auth

• Experience with multi-tenant SaaS architectures and data isolation patterns

• Familiarity with LLM application patterns: evaluation guardrails prompt management tool-use authorization

• Experience building alerting or notification systems (alert evaluation engines delivery pipelines PagerDuty/webhook integrations)

• Familiarity with ClickHouse or other OLAP databases for analytics queries

• Experience with schema migration tools (Alembic) and database evolution strategies

• Contributions to open-source projects
  

Benefits & Perks

• Competitive pay equity

• Premium health dental & vision

• Retirement plan

• Generous PTO

• Annual health check

• Paid parental leave

• Team and company events and offsites (this year was Coorg Wilderness Resort)

• Lunch provided for in-office days

The posted range represents the expected salary range for this job requisition and does not include any other potential components of the compensation package and perks previously outlined. Ultimately in determining pay well consider your experience leveling location and other job-related factors.

Fiddler is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. If you require special accommodations in order to complete the interviews or perform job duties please inform the recruiter at the beginning of the process.

Beware of job scam fraud. Our recruiters use @ email addresses the US we do not conduct interviews via text or instant message or ask for sensitive personal information such as bank account or social security numbers.

Required Experience:

Senior IC