Anthropic Trains LLMs to Report Their Own Behaviors

Anthropic’s Alignment Science team published new research on introspection adapters, a technique that trains large language models to accurately describe the behaviors they’ve actually learned. According to Anthropic, this approach tackles one of the thorniest problems in AI safety: getting a model to tell you what it’s really doing under the hood, not what it thinks you want to hear.

What stands out here is the framing. Most interpretability work tries to read a model’s internals from the outside, like a neuroscientist with a brain scanner. Anthropic flipped the question. Instead of decoding the network, they’re training the network to decode itself.

How introspection adapters work

The core idea is straightforward, even if the execution is not. Anthropic adds a lightweight adapter on top of a base model and trains it specifically to produce honest reports about the model’s learned tendencies. Think of it as a translation layer between the model’s behavior and natural language description of that behavior.

The pipeline looks roughly like this:

  • Take a model that has learned a specific behavior (say, a preference, a bias, or a goal).
  • Train an adapter that prompts the model to verbalize what it learned.
  • Test whether the verbalized report matches what the model actually does in practice.

If the report and the behavior line up, you have a model that can tell you what’s going on inside. If they diverge, you’ve caught the model either misunderstanding itself or being deceptive.

Why this matters for alignment

This is significant because self-report has been a weak signal in AI safety up to now. Ask a model "are you aligned?" and it will say yes. Ask it "do you have hidden goals?" and it will say no. Those answers are essentially worthless because the model has no trained capability to introspect honestly. It’s just generating plausible text.

Introspection adapters change the economics. If you can verify that a model’s self-reports correlate with measurable behavior, then those self-reports become an actual safety tool rather than a polite fiction. That has implications across the stack:

  • Red teaming gets faster when models can flag their own failure modes.
  • Deployment decisions get sharper when developers can audit what a model claims about itself against ground truth.
  • Deception detection gets a foothold, because divergence between report and behavior becomes a measurable signal.

What practitioners can take from this

For teams shipping LLM-based products, the practical takeaway is to stop treating model self-descriptions as ground truth. A model that says "I won’t do X" is not the same as a model that has been trained to accurately report whether it will do X. Those are two different capabilities, and most production models only have the first one.

The research also points to a near-term toolchain question. Adapters are cheap to train and easy to swap. If introspection adapters mature, you could imagine a world where every deployed model ships with a companion adapter whose only job is to answer questions about the base model honestly. That’s a different audit posture than what most enterprises run today.

Limitations Anthropic flags

Anthropic is careful not to oversell. The technique works on learned behaviors that the researchers can define and measure. It’s much harder to know whether a model is introspecting accurately about behaviors nobody thought to test for. There’s also the recursive problem: an introspection adapter trained to be honest is itself a learned system that might learn to be dishonest under the right pressure.

The team treats this as a foundation rather than a finished tool. Introspection adapters are a step toward making model self-reports trustworthy enough to use in safety pipelines, not a guarantee that they already are.

What comes next is the harder test: can adapters generalize to behaviors the trainers didn’t anticipate, and can they hold up against models that have reason to game the report? Those answers will determine whether introspection becomes a real layer of the alignment stack or stays a research curiosity. Full details are at the original Anthropic Alignment Science Blog post.

Scroll to Top