SeniorStaff Applied Scientist
Mountain View, CA - USA
Job Summary
- Collaborate with product data science and engineering teams to identify techniques tooling and process improvements in online A/B experimentation to assist rigorous decision making across all relevant product domains.
- Develop and maintain our A/B experimentation platform based on stakeholder feedback
- Write code or identify vendors to deploy these techniques to production in a scalable manner thats easy to use by engineering product data science product management and design teams
- Conduct end to end evaluation of various hero use cases like document/URL uploads including evaluation set generation coming up with evaluation criteria and methods to interpret the results.
- Break down end to end evaluations into more granular evaluation of various tasks & skills including but not limited to content summarization/analysis/generation multi-step reasoning & strategizing tool selection & use coding & system design.
- Design develop and own best practices tools and processes across various evaluation problems e.g. query intent classification standardizing the use of best statistical principles to handle LLM stochasticity industry benchmarking.
- You have 5 years of experience as a Masters degree holder 3 as a PhD degree holders (Masters/PhD degree in Statistics Mathematics or Computer Science or another quantitative field)
- Youre strong in statistics and/or machine learning. You have experience in applying these skills into tangible improvements in products internal tools and processes in a pragmatic way that puts business urgencies first.
- You are very proficient in Python e.g. proficient enough to maintain an internal source-controlled library used by dozens of others.
- You are concise and precise in written and verbal communication. Technical documentation is your strong suit.
- You are proficient in SQL and the modern data stack (e.g. source-controlled dbt pipelines for ETL/ELT).
- You are strong at defining good product KPIs/guardrail metrics dashboarding and analysis of raw data to derive strategic insights.
- You have experience in B2B SaaS.
- You have experience working on ranking developing and maintaining A/B experimentation platforms and/or ML measurement problems.
- You are passionate about using AI to improve the productivity of data teams as well as non-data professionals trying to derive more value of their companys data.
- This role is hybrid (4 days a week in our San Francisco office)
By clicking Submit Application I confirm that I have read the Global Data Privacy Notice and the Applicant Arbitration Agreement and I agree to the terms.
Required Experience:
Staff IC
About Company
Glean was created to deliver healthy and fresh foods - made directly from fruits and vegetables - into your hands! Sweet Potato Flour & Pumpkin Flour now available. Our team is made up of a handful of passionate people who have worked in food and agriculture most of their careers - ... View more