Reward Atlas · Nov 2026

An essay + an atlas of 380 jobs

If you think your job is safe, think again.

AI gets good at whatever a program can grade. I mapped 380 kinds of skilled work where a program already can, and found 178 where nobody has built the training ground yet.

Directed by Yug Shende · written & built by Claude Opus 5.5
7 min read · How this was made · Skip to the atlas ↓
178

Kinds of work a program can grade. Nobody has built the training ground.

380 candidates · 27 fields · 213 verifiers checked · 17 already built

01The trick that keeps working

The fastest gains in AI over the last two years came from one loop: let the model try, let a program check the answer, reward what passes. Researchers call it reinforcement learning with verifiable rewards, or RLVR. It's how models went from fumbling competition maths to solving it, and from autocompleting code to fixing real bugs against real test suites.

The loop has one precondition: a checker. Unit tests for code. An exact answer for a maths problem. Where a cheap, reliable checker exists, models climb fast. Where it doesn't, they plateau on vibes and human ratings.

So the useful question isn't "can AI do my job?" It's narrower and more uncomfortable: can a program tell whether my work is right?

02Checkers are everywhere

Most skilled work ends in something a program can check. A floor plan either meets egress code or it doesn't, and a shortest-path computation over the plan says which. A card dispute is either valid under the network's reason code or it isn't. A flight plan carries enough fuel under the reserve rules, or it doesn't. A Nutrition Facts panel is rounded the way 21 CFR 101.9 says, to the gram. A construction pay application ties out to the contract ledger, to the cent.

None of these need a judge model. The rules are already written down. Often the simulator or validator already exists, and it's open source.

#WorkGraded byStatus

178 of them have no environment, no training run, no benchmark.

03So I went looking

In November 2026 I ran a team of research agents over what already exists: 54 RL-environment ecosystems, 828 named tasks from the big gyms, the 2025–26 RLVR papers, and 213 open-source verifiers and simulators, flagging the ones nobody had ever used as an LLM reward. Then, field by field, I asked two questions: what work ends in an artifact a program can check, and has anyone built the environment?

The answer is the atlas below. It holds 380 candidate environments across 27 fields. Each has the task, the program that grades it, the knobs that make it harder, and the closest prior work I could find. Every entry also went through an adversarial novelty check, an agent whose only job was to find the paper that makes it not new.

Another 194 are "thin": a benchmark exists, or classic non-LLM RL, but nobody has built a reusable environment you could train a language model in. Only 17 had already been built, and they're listed at the bottom for completeness.

04Where the gaps are

The gaps aren't in exotic research corners. They're in the paperwork of the economy: industry operations, payments and insurance, regulatory filings, accounting, engineering code checks. Click a field to open it in the atlas.

New: nothing foundThin: evals onlyTwist

05So is your job safe?

If your work ends in an artifact a program can verify, like a passing check, a balanced ledger or a valid filing, then the thing standing between you and a model that does it is a training environment. For 178 kinds of work, nobody has built one yet. Each is weeks of engineering, not a research breakthrough. The rules, the simulators and the validators are already sitting there.

If your work doesn't end in a checkable artifact, because it's judgment, taste, negotiation or trust, this method doesn't reach you yet. That's the honest version of "safe". It isn't about your title or your seniority. It's about whether your output can be graded by code.

The gaps cut both ways. Whoever writes the checker for a field gets to define what "correct" means there, and gets the first models trained against it. If you're the person in your field who knows where the rules live, that's a strong position to be in.

The atlas

Every candidate environment. Open a row for the task, the program that grades it, what makes it harder, and the closest prior work.

How to read this

  1. Status is a search result, not a proof. "New" means no RL environment, training run or benchmark turned up in searches on 2 November 2026. If you know prior work I missed, tell me and I'll update the entry.
  2. Agents did most of the searching. Research agents mapped the ecosystems, task lists, papers and verifiers, then a second pass tried to falsify each entry's novelty. Claude Opus 5.5 spot-checked a random sample of 14 cited arXiv papers: all 14 exist and say what the entry claims.
  3. "Graded by" describes how a reward could be computed. Most of these environments are not built yet. That's the point.
  4. Thin means a benchmark, a non-RL LLM system, or classic non-LLM RL exists, but no reusable environment for training language models. Twist means the field has RL work, but not this formulation.
  5. How this was made. This is mostly AI work, and it should say so. Yug Shende set the question, directed the research and chose what to publish. AI research agents compiled the catalog. Claude Opus 5.5 (Anthropic) wrote the essay in Yug's voice, designed and built this page, and checked the citations above. Mistakes are still Yug's to fix, so if you find one, tell him.

Build one of these.

I'm looking for people who want to build environments from this list, maintainers of the verifiers it leans on, and anyone who can point to prior work so the atlas stays honest.

yugpshende@gmail.com Directed by Yug Shende, ML & platform engineer, San Francisco · written & built with Claude Opus 5.5