ARC Prize 2024: Launching the $1M Challenge
AI Summary
Chollet and Mike Knoop announce the $1 million ARC Prize to accelerate progress on the ARC-AGI benchmark. The post explains why ARC-AGI remains the hardest publicly available AI benchmark despite years of LLM scaling — GPT-4o achieved only 5% on the test, while humans score 85%. The challenge is structured to specifically reward systems that demonstrate genuine program synthesis and abstraction rather than pattern matching from training data. The post frames ARC not as a game or competition, but as a scientific instrument for measuring a specific type of cognitive capability that current AI systems demonstrably lack.
Original excerpt
Chollet and Mike Knoop launch the $1M ARC Prize. GPT-4o achieves 5% on a test humans score 85% on.
Key framing: ARC-AGI is not about winning a competition — it's a scientific instrument for detecting genuine abstraction capability. The prize is designed to fund research into what Chollet calls "program synthesis" approaches, not further scaling of language models.
Frequently asked questions
What is "ARC Prize 2024: Launching the $1M Challenge" about?
Chollet and Mike Knoop announce the $1 million ARC Prize to accelerate progress on the ARC-AGI benchmark. The post explains why ARC-AGI remains the hardest publicly available AI benchmark despite years of LLM scaling — GPT-4o achieved only 5% on the test, while humans score 85%. The challenge is str…
Who wrote "ARC Prize 2024: Launching the $1M Challenge"?
"ARC Prize 2024: Launching the $1M Challenge" was written by François Chollet. It is curated in the François Chollet vault on Burn 451, which covers agi evaluation & arc-agi.
How can I read more content from François Chollet?
The complete François Chollet reading list is available at burn451.cloud/vault/francois-chollet. Each article includes an AI-generated summary so you can decide what to read in seconds. Connect the Burn 451 MCP server to Claude or Cursor to query all François Chollet articles as live AI context.
Can I use "ARC Prize 2024: Launching the $1M Challenge" with Claude or Cursor?
Yes. Install the burn-mcp-server npm package and connect it to Claude Desktop, Claude Code, or Cursor. Once connected, your AI can search and reference this article and the full François Chollet vault in real time — no manual copy-paste required.
28 more articles in this vault.
Import the full François Chollet vault to Burn 451 and build your own knowledge base.
Content attributed to the original author (François Chollet). Burn 451 curates publicly available writing as a reading index. For removal requests, contact @hawking520.