"AB Program Manager"
Share
Job Location:
Sunnyvale, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
5 hours ago
Vacancies:
1 Vacancy
Job Summary
JD for A/B Program Manager:
Proficiency in SQL for data extraction and Python or R for advanced statistical analysis.
Tools: Experience with experimentation platforms (e.g. Optimizely VWO or LaunchDarkly) and web analytics (e.g. Google Analytics 4).
Visualization: Ability to build dashboards in Tableau Power BI or Looker to monitor live tests
Job Description: A/B program Manager (Website Experimentation)
Role Overview
As an A/B Test Program Manager you will be the statistical engine behind our websites optimization strategy. You will design execute and analyze controlled experiments to improve user experience conversion rates and business growth. You will work at the intersection of product engineering and marketing to ensure every website change is backed by rigorous data.
Key Responsibilities
| Phase | Core Duties |
| Strategy & Design | Formulate clear hypotheses and define primary/secondary metrics. Determine required sample sizes power and test duration. |
| Execution | Oversee randomization and user segmentation. Partner with engineers to ensure proper tracking and data integrity. |
| Analysis | Apply statistical methods (p-values confidence intervals) to determine significance. Conduct post-test deep dives to identify segment-specific impacts. |
| Strategy & Reporting | Translate complex data into clear actionable recommendations for stakeholders. Maintain an experimentation roadmap and archive learnings. |
Required Skills & Qualifications
Statistical Expertise: Mastery of hypothesis testing experimental design and probability. Knowledge of Bayesian vs. Frequentist approaches is a plus.
Programming: Proficiency in SQL for data extraction and Python or R for advanced statistical analysis.
Tools: Experience with experimentation platforms (e.g. Optimizely VWO or LaunchDarkly) and web analytics (e.g. Google Analytics 4).
Visualization: Ability to build dashboards in Tableau Power BI or Looker to monitor live tests.
Soft Skills: Strong critical thinking and the ability to explain why a result occurred to non-technical partners.
Experience & Education
Education: Bachelors degree in a quantitative field (Statistics Math CS Economics); Masters or PhD preferred.
Experience: 2 5 years in a Program Manager or product analytics role specifically focused on digital experimentation.
Key Skills
- Project Management Methodology
- Project / Program Management
- Program Management
- Management Experience
- Microsoft Powerpoint
- Project Management
- Microsoft Project
- Budgeting
- DoD Experience
- Leadership Experience
- Supervising Experience
- Contracts
