Staff Statistics Engineer - Feature Flagging and Experimentation
Staff Statistics Engineer - Feature Flagging and Experimentation
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
The Opportunity
We are looking for a Stats Engineering leader to help us build two new Datadog products from scratch - Feature Flags and Experiments.
Our goal with these products is to help developers and product teams ship features quickly experiment as second-nature and make decisions with confidence. To do this we need to build a world-class experimentation engine backed by state-of-the-art statistical methods like sequential analysis CUPED and change point detection which help to solve the big problems in the experimentation world of early peeking long experiment durations and catching bugs respectively.
Because there is often a technical cultural and linguistic gap between software engineers and statisticians our Stats Engineers are unique in that they dont squarely fall into data science or software engineering. Data scientists typically understand the concepts but may struggle to implement them in production with enterprise grade quality. Software engineers know how to build robust production systems but can get lost implementing methods that dont have off the shelf frameworks. Here we need the rare breed of builder who understands statistical concepts and can implement them in production.
Our experimentation platform will be used for root-cause analysis and decision-making across our 30000 customers of all shapes sizes and industries; well help customers run everything from e-commerce-focused A/B tests on user adoption to infrastructure-based canary deployments in real-time to root cause major incidents and connect the dots together across the worlds of the product manager data person and developer.
This is a rare opportunity to work with senior leaders across engineering product and design to define the foundational components of Datadogs Product Analytics and APM stack from the ground up and develop an experimentation engine in an AI-first world.
At Datadog we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.
What Youll Do:
- Architect and implement the world-class experimentation engine behind Datadog Experiments supporting methods like sequential testing CUPED variance reduction and more
- Bring rigor to experiment analysis at scale (e.g. through diagnostics guardrails for safe shipping)
- Translate complex statistical methods into robust production-ready systems
- Work closely with Product Design and Engineering leadership to influence the direction of the product on both a day-to-day and the big picture vision
- Educate engineers leaders at Datadog and our largest customers on statistical best practices experiment design and practical inference
- Help define standards and frameworks to make experimentation at Datadog trustworthy by default and fast by design
Who You Are:
- You hold a PhD or equivalent experience in Statistics Computer Science Econometrics or a related field. You have deep expertise in statistics causal inference or experimentation methods.
- You have a track record of shipping production-grade software that solves real user problems
- You understand the tradeoffs between statistical elegance and engineering complexity and you know how to strategically make bets
- You have strong software engineering fundamentals and can write clean maintainable code
- You can lead cross-functionally with Engineering Product Design and business teams.
- Bonus: Youve built or worked on experimentation platforms at scale
Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. Thats okay. If youre passionate about technology and want to grow your skills we encourage you to apply.
Benefits and Growth:
- Build tools for engineers like yourself we use our own products everyday to make decisions
- Influence the experimentation and AI-centric roadmap for Product Analytics a budding new sector for Datadog
- Work with kind and knowledgeable teammates who are at the top of their craft and happy to collaborate teach and learn
- Competitive global benefits
- Continuous professional development
Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.
Required Experience:
Staff IC
Employment Type
Full-Time
