GPT-Red Beats Human Red-Teamers 84% to 13%. The Job Still Pays $300,000.

Send us Fan Mail

OpenAI built an automated red-teamer called GPT-Red whose entire job is trying to break OpenAI's own models. In a head-to-head test, it succeeded 84% of the time. Human red-teamers, on the identical test, succeeded 13% of the time. Carlo and Ainsley open with that number on purpose, because the honest version of "AI trainer, evaluator, red-teamer" — a real job category paying $95,000 to $300,000+ a year — has to include the fact that the machine is already winning at the highest-volume layer of the exact work this episode is about.

What it doesn't win at is judgment: a nurse who can catch a subtly wrong medication interaction in an AI triage tool, a loan officer who knows what discriminatory pricing language actually looks like, a Kenyan evaluator who understands which failure modes are specific to Kenyan social and legal context. That's the real hiring picture — Microsoft's AI Red Team includes a neuroscientist and a linguist alongside engineers, and the accessible entry points (AI Safety Evaluator, AI Governance Analyst) start at $95,000 and don't require a coding background. Carlo also walks through a three-pillar way to think about where this risk actually lives inside a company: infrastructure AI,
employee AI, and customer AI, each with its own blind spots.

The episode doesn't stop at the good news. Data annotators and content moderators in Kenya earn $1.46 to $3.74 an hour for work that, on a resume, sits in the same broad job category as red-team work paying $21 to $27 an hour in the US — a roughly 12-times gap for comparable work. Kenya's own government has a draft occupational-protection policy open for public comment right now. Same industry, wildly different economics, depending entirely on where you live. Ainsley closes with the actual first step: pick one AI tool you already use at work, break it on purpose, and write up five documented findings — that portfolio reportedly opens more doors than a certification.

If you've got real depth in a non-tech field, this might be the clearest on-ramp into AI work we've
mapped this season. Tell us in the comments: what's the one thing you'd document first?

Subscribe: Apple Podcasts | YouTube | Spotify — Surviving AI publishes every Monday and Wednesday.

Please visit our website for more information - Surviving AI: Navigate the Future