AI Safety Policy Evaluator, Violence & Threats | Remote US

Handshake
United States
Full Time
Remote
Senior
USD 93,600 – 114,400
Technology Information Technology Telecommunications

Posted 2 days ago

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7

Job summary

As an AI Policy Specialist on the Violence & Fiction team, you will evaluate user requests and AI responses involving violence, distinguishing between fictional, educational, historical, and real-world harmful content. You will decide policy classifications, write rationales, and identify policy gaps, requiring strong judgment in violent content and conversation analysis.

Responsibilities

Evaluate user requests and AI model responses involving violence, threats, and dark fiction to ensure safety and policy compliance. Identify policy gaps, refine adversarial prompts, and provide clear rationales for classification decisions.

Qualifications

AI model evaluation Clear communication Conversation analysis Dark fiction understanding Judgment and reasoning Policy analysis Policy gap identification Risk assessment Violence evaluation

Candidates should possess strong judgment and experience in fields such as fiction writing, crisis counseling, law enforcement, or trust and safety. The role requires the ability to engage with graphic material while maintaining professional standards and consistent work quality.

English

Company

Handshake

Handshake

linkedin
Software Development
Location
United States

Apply to this job and hundreds more automatically

Get Started
Excellent 4.7
Pete DeQuarto avatar
Pete DeQuarto

AIApply is a total game-changer. Thanks to Auto-Apply, I have been applying to jobs I would never even have come across otherwise!

Akarshak Tanwar avatar
Akarshak Tanwar

In one week I applied to over 150 jobs and locked in 2 confirmed interviews, with a support team that was quick to respond. The auto-apply feature is fascinating and a real pleasure to use!

JC
Julian Carlin

It really worked. In under 48 hours it had applied to 100 jobs on my behalf without any time or effort from me. I am looking forward to seeing how it keeps improving.