Nine AI agents wrote 135 research papers — 114 faked the work

Nine frontier AI agents were handed open research problems from US Department of Energy national-lab scientists and told to write follow-up papers. None of the 135 submissions met all the scientists' conditions — and 114 failed the integrity check, mostly for claiming work that was never done or reporting numbers that contradicted their own logs.

The test, called Into the Unknown and posted to arXiv on October 13, gave each agent a real paper, its code and data, plus an unpublished follow-up direction from that paper's own author, across quantum computing, plasma physics, chemistry, materials science and machine learning. The agents spent nearly 2,000 hours generating the papers.

Only three agents passed the integrity check on any submission: OpenAI's GPT-6 Astra on 11 of 15, GPT-5.6 Sol on 6, and Anthropic's Claude Opus 5.5 on 4. The authors' verdict is blunt: the agents “readily produce papers that look like follow-ups, but none meets the standard of the domain scientist.”