Safeguards Analyst, Account Abuse

About Anthropic

Anthropics mission is to create reliable interpretable and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers engineers policy experts and business leaders working together to build beneficial AI systems.

About the Role

Anthropic is an AI safety and research company working to build reliable interpretable and steerable AI systems. We want AI to be safe and beneficial for our customers and society as a whole. As a Safeguards Analyst focusing on Account Abuse you will play a critical role in building and scaling the detection enforcement and operational capabilities that protect our platform against scaled abuse.

Important Context: In this position you may be exposed to and engage with explicit content spanning a range of topics including those of a sexual violent or psychologically disturbing nature. There is also an on-call responsibility across the Policy and Enforcement teams.

Responsibilities:

• Develop and iterate on account signals and prevention frameworks that consolidate internal and external data into actionable abuse indicators
• Develop and optimize identity and account-linking signals using graph-based data infrastructure to detect coordinated and scaled account abuse
• Evaluate integrate and operationalize third-party vendor signals assessing whether new data sources provide genuine lift in detection
• Expand internal account signals with new data sources and behavioral indicators to improve detection coverage
• Build and maintain processes that evaluate new product launches for scaled abuse risks working closely with product teams to ensure enforcement readiness
• Operationalize and iterate on enforcement tooling including appeals workflows review processes and user communications to maintain quality and scale with growing volume
• Analyze enforcement performance through operational metrics partnering with the team to keep detection accurate as abuse patterns evolve
• Manage payment fraud and dispute operations to protect revenue and maintain our standing with payment partners
• Coordinate enforcement efforts for policy compliance gaps across products working with relevant teams to build scalable review processes
• Collaborate with cross-functional teams (Engineering Product Legal Data Science) to surface new signals and translate detection capabilities into enforcement workflows
• Maintain detailed documentation of signal development enforcement processes and operational decisions

Qualifications:

• 2 years of experience in risk scoring fraud detection trust and safety or policy enforcement
• Hands-on experience building detection systems risk models or enforcement processes and workflows
• Experience evaluating and integrating third-party data sources into detection or scoring pipelines
• Strong SQL and Python skills this role involves heavy data analysis across complex multi-table data relationships
• Familiarity with identity signals such as device fingerprinting account linking or entity resolution or experience with appeals processes and customer-facing enforcement communications
• Demonstrated ability to analyze complex data problems and translate findings into actionable improvements
• Strong written and verbal communication skills ability to explain technical tradeoffs and navigate cross-functional stakeholder conversations
• Equivalent practical experience or a Bachelors degree in Computer Science Data Science or related field

You might be a good fit if you:

• Have built risk scores detection systems signal pipelines or enforcement processes in a previous role identity verification trust and safety or similar
• Are comfortable working with ambiguous noisy data and extracting meaningful signal
• Think critically about signal quality and enforcement performance evaluating whether new detection signals or processes meaningfully improve outcomes
• Have experience with graph-based data account-linking problems or cross-functional process design
• Are proactive about identifying gaps in existing detection or enforcement and proposing new approaches
• Have experience leveraging generative AI tools to support analytical detection or enforcement workflows
• Can balance deep analytical work with cross-functional collaboration and stakeholder coordination
• Have a background or interest in cybersecurity or threat intelligence (a plus not a requirement)

Logistics

Education requirements: We require at least a Bachelors degree in a related field or equivalent experience.

Location-based hybrid policy: Currently we expect all staff to be in one of our offices at least 25% of the time. However some roles may require more time in our offices.

Visa sponsorship:We do sponsor visas! However we arent able to successfully sponsor visas for every role and every candidate. But if we make you an offer we will make every reasonable effort to get you a visa and we retain an immigration lawyer to help with this.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy so we urge you not to exclude yourself prematurely and to submit an application if youre interested in this work. We think AI systems like the ones were building have enormous social and ethical implications. We think this makes representation even more important and we strive to include a range of diverse perspectives on our team.

Your safety matters to us. To protect yourself from potential scams remember that Anthropic recruiters only contact you some cases we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money fees or banking information before your first day. If youre ever unsure about a communication dont click any linksvisit for confirmed position openings.

How were different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact advancing our long-term goals of steerable trustworthy AI rather than work on smaller and more specific puzzles. We view AI research as an empirical science which has as much in common with physics and biology as with traditional efforts in computer science. Were an extremely collaborative group and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such we greatly value communication skills.

The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic including: GPT-3 Circuit-Based Interpretability Multimodal Neurons Scaling Laws AI & Compute Concrete Problems in AI Safety and Learning from Human Preferences.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits optional equity donation matching generous vacation and parental leave flexible working hours and a lovely office space in which to collaborate with colleagues. Guidance on Candidates AI Usage:Learn aboutour policyfor using AI in our application process