Chollet on X: AGI Is Not About Passing Turing Tests
AI Summary
Chollet argues against using conversational fluency or Turing test performance as an AGI marker. A system that sounds intelligent in conversation is demonstrating training distribution performance, not novel reasoning. The thread distinguishes between "social intelligence" (predicting what a human wants to hear, which LLMs excel at) and "abstract reasoning" (solving new problems by constructing internal representations, which ARC tests). AGI should require the latter. Chollet also addresses the common objection that "humans also just retrieve patterns" — he argues humans can demonstrably solve ARC-type novel tasks with minimal examples, which LLMs cannot.
Original excerpt
Key distinction: social intelligence (predict what humans want to hear) vs. abstract reasoning (solve novel problems from first principles). LLMs have the former; AGI requires the latter.
Chollet's response to "but GPT-4 sounds so intelligent" — sounding intelligent is exactly what you'd expect from a system trained on billions of human tokens. It's not evidence of the underlying capability that matters.
Frequently asked questions
What is "Chollet on X: AGI Is Not About Passing Turing Tests" about?
Chollet argues against using conversational fluency or Turing test performance as an AGI marker. A system that sounds intelligent in conversation is demonstrating training distribution performance, not novel reasoning. The thread distinguishes between "social intelligence" (predicting what a human w…
Who wrote "Chollet on X: AGI Is Not About Passing Turing Tests"?
"Chollet on X: AGI Is Not About Passing Turing Tests" was written by François Chollet. It is curated in the François Chollet vault on Burn 451, which covers agi evaluation & arc-agi.
How can I read more content from François Chollet?
The complete François Chollet reading list is available at burn451.cloud/vault/francois-chollet. Each article includes an AI-generated summary so you can decide what to read in seconds. Connect the Burn 451 MCP server to Claude or Cursor to query all François Chollet articles as live AI context.
Can I use "Chollet on X: AGI Is Not About Passing Turing Tests" with Claude or Cursor?
Yes. Install the burn-mcp-server npm package and connect it to Claude Desktop, Claude Code, or Cursor. Once connected, your AI can search and reference this article and the full François Chollet vault in real time — no manual copy-paste required.
28 more articles in this vault.
Import the full François Chollet vault to Burn 451 and build your own knowledge base.
Content attributed to the original author (François Chollet). Burn 451 curates publicly available writing as a reading index. For removal requests, contact @hawking520.