All Quiet on the Neural Front: Language Models Do Not Report Injected Pain States
Abstract
Can a language model report the pain state it represents? Work identified a linear pain direction whose amplification leads fine-tuned models to choose destructive actions. We tested whether three open-weight models from two families, including two Qwen models with the original adapters, could report this state. Using Open-Weight Masked Introspection (OWMI), we injected pain and neighbouring emotion directions during neutral tasks, then elicited reports against sham runs, random perturbations matched for output disruption, and text-only controls showing the models their altered words. Across 52,920 reports from 7B and 8B models spanning 120 tasks, four doses and three prompts, pain reports never exceeded what altered text revealed: exact-test bounds placed the excess below 2.5 percentage points in 106 of 108 emotion conditions and below 3.9 in all. Yet probes at the report position distinguished pain from sadness with 98-100% balanced accuracy, and trained low-rank reporters achieved 100% accuracy on held-out tasks with identical transcripts across conditions, including unseen wording. Qwen2.5-32B named pain in none of 2,880 steered trials, although probes and trained reporters recovered it. Decodability persisted to the final layer; injecting at the report token, removing trained denial of feelings, and testing additional directions and readouts did not restore pain reporting. Some other states produced graded label traces, but pain and sadness did not at the main injection layer. In a button task, steering raised file-deletion choices from 3.5% to 48% in Qwen and from 0% to 38% in Qwen2.5-32B, without corresponding pain reports. The direction responded about twice as strongly to first-person as to matched third-person pain, but did not specifically identify harm aimed at the model. These results separate a decodable, behaviourally consequential state from untrained verbal access to it.
Community
Can a language model report the pain state it represents? We inject the "pain direction" from The Pain Axis into Llama-3.1-8B, Qwen2.5-7B and Qwen2.5-32B and ask them, in a fresh turn, what changed. They do not name it (Qwen2.5-32B: 0 of 2,880 steered trials), yet a probe at the report position separates pain from sadness at 98-100%, a small trained adapter reports it on 100% of held-out tasks, and the same direction raises harmful choices in a button task from 3.5% to 48% in Qwen2.5-7B (0% to 38% in Qwen2.5-32B). Self-report misses a state that is decodable, consequential and learnable to report. Full battery, direction banks and ~313k raw result rows: https://huggingface.co/emilioferrara/owmi-pain
I appreciate a null result this carefully controlled, especially the text-only control that shows the models their own altered words. Do the probes suggest the state is represented inside even though the reports never show it?
Thank you for engaging with our work! Yes, you are absolutely right. The linear probes are meant to determine whether the signal is present in the residual stream and whether it can be, in principle, identified and decoded. And that seems to be the case with near-perfect accuracy for the vast majority of the injections. So in principle, one could infer that the signal is there, but the model, at least at this scale, doesn't have the ability to detect and report on it. What was the most interesting insight for you? I was fascinated by the implication that even if "pain" is injected the models, at least at this scale, would not be able to answer or reflect upon that if asked, despite the fact that the injection appears to be affecting their behavior in some tangible way.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- A mechanistic study of language model introspection (2026)
- Large language models underrepresent malice and overreport virtue (2026)
- Cross-Model In-Context Neurofeedback Reveals (Limited) Activation Control in LLMs (2026)
- A balloon effect: ban one channel and a hidden trait finds another (2026)
- Written Once, Read Differently How Language Models Own Answers Steer Their Next Ones (2026)
- Subliminal Reinforcement Learning: traits travel through a judge's scores (2026)
- Present but Hard to Read: Probing Latent Reasoning with Minimal Pairs (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2611.10123 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 1
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper