Critical Harms Intelligence Analyst (Threats of Violent Extremism, Dangerous Orgs)
Critical Harms Intelligence Analyst (Threats of Violent Extremism, Dangerous Orgs)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
The Safety Operations team is focused (okay maybe obsessed) on scaling Robloxs Moderation Operations and redefining our user experience through our multi-year vision and strategy execution. Were seeking a passionate Threats of Violent Extremism (TVE) subject matter expert dedicated to finding malicious actors and supporting the development of scalable solutions to mitigate their activities. Youll join our Critical Harms Intelligence Investigations and Operations (CHIIOPS) team applying expertise to high-risk behaviors and collaborating with Safety Product and Engineering teams to improve detection and enforcement. CHIIOPS Intelligence Analysts are responsible for uncovering unknown unknowns of how malicious actors bypass existing systems educate cross-functional partners on these patterns and support proactive lead identification for automated detection system development.
Please note: This role may review graphic controversial and sometimes offensive content in line with Robloxs handling policies. This role will also require some on-call support.
You will report to the Critical Harms Intelligence Investigations and Operations Manager.
You Will:
- Conduct in-depth analysis of platform content to identify violative or evasive behaviors employed by TVE actors encompassing a wide range of user-generated content types.
- Utilize both internal and open-source data to identify risk leads and gather relevant content samples for specialized moderator review supporting analytic hypothesis testing and Machine Learning (ML) detection development.
- Deliver analytic risk assessments to cross-functional partners highlighting gaps in current detection and enforcement processes and collaborate with these partners to identify effective risk mitigation strategies.
- Develop comprehensive expertise in Robloxs internal and external safety policies and tools leveraging data to drive improvements in the companys overall escalation ecosystem.
You Have
- Demonstrated subject-matter expertise in the online expression of Terrorism/Extremist behavior with a minimum of 4 years of direct experience addressing such behavior in a user-generated content environment.
- Experience combining internal data analysis and subject-matter research to identify behavioral trends and risks and relevant content samples.
- Experience in developing strategic project plans roadmaps for tracking progress and defining success and impact measures.
- Experience supporting scaled solutions for platform risks.
- Competence in data analysis and basic querying including foundational Python or SQL knowledge.
Required Experience:
IC
Employment Type
Full Time
