LeCun on the ARC-AGI Benchmark and François Chollet's Test for Intelligence

BlogYann LeCunMay 14, 2026

AI Summary

LeCun's response to François Chollet's ARC-AGI benchmark — a test designed to measure general fluid intelligence by requiring reasoning from very few examples (few-shot learning on novel visual patterns). LeCun agrees with Chollet that current LLMs do not solve ARC-AGI and that this is significant evidence that LLMs lack something important. Where they differ: Chollet believes the solution to ARC-AGI requires a more explicit, program-synthesis-style architecture (his 'arc prize' research direction). LeCun believes it requires world models and JEPA-style learning — the ability to learn abstract representations from sensory data and then apply them flexibly. Both agree that next-token prediction alone doesn't get there. The conversation between LeCun and Chollet (who debate publicly on Twitter/X and in papers) represents the best technical alternative to the 'just scale LLMs' position, because both have proposed specific architectural alternatives rather than just criticizing current approaches. The ARC discussion also connects to the broader question of what benchmarks measure: ARC-AGI intentionally minimizes knowledge and maximizes fluid reasoning, which makes it a good test for the world-model hypothesis. If JEPA-trained models eventually outperform LLMs on ARC-AGI, it would be strong empirical support for LeCun's framework.

Original excerpt

Two prominent LLM skeptics agree: current AI doesn't pass ARC-AGI, and that matters. They disagree on why and what to do about it. Chollet points to program synthesis and discrete reasoning. LeCun points to world models and JEPA.

The productive disagreement: having two technically rigorous alternative frameworks (rather than just criticism of LLMs) is what makes the LeCun-Chollet axis valuable. Both have made falsifiable predictions about what AI architecture would solve ARC-AGI.

Frequently asked questions

What is "LeCun on the ARC-AGI Benchmark and François Chollet's Test for Intelligence" about?

LeCun's response to François Chollet's ARC-AGI benchmark — a test designed to measure general fluid intelligence by requiring reasoning from very few examples (few-shot learning on novel visual patterns). LeCun agrees with Chollet that current LLMs do not solve ARC-AGI and that this is significant e…

Who wrote "LeCun on the ARC-AGI Benchmark and François Chollet's Test for Intelligence"?

"LeCun on the ARC-AGI Benchmark and François Chollet's Test for Intelligence" was written by Yann LeCun. It is curated in the Yann LeCun vault on Burn 451, which covers ai skepticism · world models · beyond transformers.

How can I read more content from Yann LeCun?

The complete Yann LeCun reading list is available at burn451.cloud/vault/yann-lecun. Each article includes an AI-generated summary so you can decide what to read in seconds. Connect the Burn 451 MCP server to Claude or Cursor to query all Yann LeCun articles as live AI context.

Can I use "LeCun on the ARC-AGI Benchmark and François Chollet's Test for Intelligence" with Claude or Cursor?

Yes. Install the burn-mcp-server npm package and connect it to Claude Desktop, Claude Code, or Cursor. Once connected, your AI can search and reference this article and the full Yann LeCun vault in real time — no manual copy-paste required.

22 more articles in this vault.

Import the full Yann LeCun vault to Burn 451 and build your own knowledge base.

Content attributed to the original author (Yann LeCun). Burn 451 curates publicly available writing as a reading index. For removal requests, contact @hawking520.