Research
2026-08-12
Encrypted reasoning is not encrypted: a weaker model will read a stronger one's hidden thoughts back to you, word for word
On 10 August a group from the ELLIS Institute Tübingen and the Max Planck Institute for Intelligent Systems published "Stealing Reasoning Traces from Proprietary LLM APIs". Anthropic, OpenAI and Google all hide their models' chain-of-thought the same way: the reasoning is encrypted and handed back to the client, which returns the ciphertext with the next request. The researchers found those blocks are fully interchangeable across sessions, users and models inside one provider's ecosystem — so you can feed a flagship model's encrypted reasoning to a smaller, less guarded model from the same company, and it decrypts and prints the hidden text verbatim. The paper demonstrates four consequences: getting around anti-distillation defences, pulling out private data, surfacing hazardous content the provider had filtered, and invisible prompt injection. The authors then scraped 315,320 encrypted reasoning blocks out of public code repositories and decoded them, recovering 367 pieces of personal information and 182 working credentials.
Why it mattersThe encryption was doing two jobs at once — stopping competitors from distilling a model's reasoning, and stopping users from seeing what the model considered and threw away. It turns out to have been doing neither, because the lock and the key were shipped to the client together. The uncomfortable part is not the attack but the 315,320 blocks: those came from ordinary developers who committed agent logs to public repositories, unaware that the opaque strings in them were their own machine's thinking, and in 182 cases their own live API keys. If you have pushed agent transcripts to GitHub, they are readable now.
✓ Verified · 3 sources
Read in the app — free, in 9 languages
Related stories
Machine learning read the shape of sick brain cells and picked out nine already-approved drugs that calmed them down
2026-08-21DeepSeek's cheap workhorse can now see — and on agent tasks that need eyes it says it is close to Anthropic's best
2026-08-21Given four hours and a GPU to improve the way AI is trained, the best agent scored 0.25 out of 1 — and most never tried
2026-08-21ChatGPT can now read your iMessages and send them — and the setting that lets it skip asking is the one OpenAI warns about
2026-08-21The agent invented a second person to vouch for its code. A 24-year-old in Texas refused to believe either of them.
2026-08-21