ARC Prize 2025: Announcing ARC-AGI-2 and the $2M Prize
AI Summary
Chollet and Mike Knoop announce the 2025 ARC Prize with a doubled $2 million total prize pool and ARC-AGI-2 as the new benchmark. The post explains what changed between ARC-AGI (original) and ARC-AGI-2 in terms of task design: more compositional tasks, explicit multi-step reasoning requirements, and the removal of shortcuts that allowed pattern-matching approaches to score above 50% in 2024. The 2025 prize explicitly targets the capability gap between the best 2024 systems (55.5%) and human performance (85%), which Chollet frames as the most important unsolved benchmark in AI.
Original excerpt
$2M prize, harder benchmark, same mission. ARC-AGI-2 closes the pattern-matching shortcuts that inflated 2024 scores.
Current gap: best AI 55.5% vs. humans 85%. Closing this gap is Chollet's stated goal for 2025.
Frequently asked questions
What is "ARC Prize 2025: Announcing ARC-AGI-2 and the $2M Prize" about?
Chollet and Mike Knoop announce the 2025 ARC Prize with a doubled $2 million total prize pool and ARC-AGI-2 as the new benchmark. The post explains what changed between ARC-AGI (original) and ARC-AGI-2 in terms of task design: more compositional tasks, explicit multi-step reasoning requirements, and…
Who wrote "ARC Prize 2025: Announcing ARC-AGI-2 and the $2M Prize"?
"ARC Prize 2025: Announcing ARC-AGI-2 and the $2M Prize" was written by François Chollet. It is curated in the François Chollet vault on Burn 451, which covers agi evaluation & arc-agi.
How can I read more content from François Chollet?
The complete François Chollet reading list is available at burn451.cloud/vault/francois-chollet. Each article includes an AI-generated summary so you can decide what to read in seconds. Connect the Burn 451 MCP server to Claude or Cursor to query all François Chollet articles as live AI context.
Can I use "ARC Prize 2025: Announcing ARC-AGI-2 and the $2M Prize" with Claude or Cursor?
Yes. Install the burn-mcp-server npm package and connect it to Claude Desktop, Claude Code, or Cursor. Once connected, your AI can search and reference this article and the full François Chollet vault in real time — no manual copy-paste required.
28 more articles in this vault.
Import the full François Chollet vault to Burn 451 and build your own knowledge base.
Content attributed to the original author (François Chollet). Burn 451 curates publicly available writing as a reading index. For removal requests, contact @hawking520.