As the Label Quality Specialist Moderation Trust and Safety you will report to the Senior Director of Trust and Safety and play an essential role in keeping our community and our platform safe. You will be managing the end to end label quality measurement program for our human and automated moderation workflows. You will understand and enforce our community standards and other policies regarding Developer and User activity on our platform. You will engage deeply with our XFN teams across Policy Product Engineering and others to help develop and execute solutions. Protecting our community is important to you.
You will report to the Senior Director Moderation.
You Will:
- Operationalize the label quality measurement workflow at Roblox to deliver high fidelity ground truth data sets for both human and AI/ML based moderation systems
- Work closely with Product Policy Engineering Data Science and Safety Operations teams to ensure high quality ground truth data sets are delivered on a regular basis.
- Identify evaluate prioritize and resolve policy process and tolling gaps through deep root cause analysis
- Manage the end-to-end ground truth dataset creation process including scoping planning reviewer coordination quality checks and final delivery
- Act as the subject matter expert on Roblox policies and processes ensuring accurate and consistent implementation across all product and asset types. Developing a deep understanding of these guidelines.
- Collaborate closely with outsourcing partners to scale ground truth dataset creation and ensure high quality data is being delivered by the outsourced partners.
You Have:
- 4-5 years of experience in managing Trust and Safety programs with a strong interest in quality assurance
- Strong program management skills with experience leading projects at scale
- Experience developing processes to improve operational efficiency
- Experience using data to lead decision-making
- Strong collaboration skills with the ability to work with cross-functional teams specifically Product Policy Engineering Data Science and Operations
Required Experience:
IC
As the Label Quality Specialist Moderation Trust and Safety you will report to the Senior Director of Trust and Safety and play an essential role in keeping our community and our platform safe. You will be managing the end to end label quality measurement program for our human and automated moderati...
As the Label Quality Specialist Moderation Trust and Safety you will report to the Senior Director of Trust and Safety and play an essential role in keeping our community and our platform safe. You will be managing the end to end label quality measurement program for our human and automated moderation workflows. You will understand and enforce our community standards and other policies regarding Developer and User activity on our platform. You will engage deeply with our XFN teams across Policy Product Engineering and others to help develop and execute solutions. Protecting our community is important to you.
You will report to the Senior Director Moderation.
You Will:
- Operationalize the label quality measurement workflow at Roblox to deliver high fidelity ground truth data sets for both human and AI/ML based moderation systems
- Work closely with Product Policy Engineering Data Science and Safety Operations teams to ensure high quality ground truth data sets are delivered on a regular basis.
- Identify evaluate prioritize and resolve policy process and tolling gaps through deep root cause analysis
- Manage the end-to-end ground truth dataset creation process including scoping planning reviewer coordination quality checks and final delivery
- Act as the subject matter expert on Roblox policies and processes ensuring accurate and consistent implementation across all product and asset types. Developing a deep understanding of these guidelines.
- Collaborate closely with outsourcing partners to scale ground truth dataset creation and ensure high quality data is being delivered by the outsourced partners.
You Have:
- 4-5 years of experience in managing Trust and Safety programs with a strong interest in quality assurance
- Strong program management skills with experience leading projects at scale
- Experience developing processes to improve operational efficiency
- Experience using data to lead decision-making
- Strong collaboration skills with the ability to work with cross-functional teams specifically Product Policy Engineering Data Science and Operations
Required Experience:
IC
View more
View less