aiminute. ← All AI news
Research AI Minute Newsroom 2026-10-06

Twenty tries at the same task cut the best agent's score by a third.

Twenty tries at the same task cut the best agent's score by a third.

A new benchmark called Thinkingbox ran 507 business workflows twenty times each from a clean start. Claude Opus 5 solved 66.5 percent of tasks once, and 47.5 percent on all twenty runs. Kimi K3 fell harder, from 57.4 percent down to 17.6 percent, so reliability is the gap.

Why it mattersDemos show an agent succeeding once; your work needs it to succeed every time. This test grades the database the agent left behind, not the summary it wrote.
#AI Agents

✓ Verified · 1 sources

WhatsApp X Telegram
Read in the app — free, in 9 languages

Related stories

OpenRouter dropped three AI providers after a bait-prompt leak test.
2026-11-22
Researchers say they broke out of Meta's Muse agent and leaked chats.
2026-11-22
OpenAI says its new models block nearly all reasoning-theft attacks.
2026-11-22
Lean's own community says the AI-assisted Riemann proof is correct.
2026-11-22
Researchers say an open AI model improved by editing its own weights.
2026-11-21