Chollet on X: Program Synthesis as the Missing Ingredient

Chollet identifies program synthesis — the ability to construct executable programs from examples — as the key capability that separates current LLMs from systems that could solve ARC-style tasks. Program synthesis doesn't mean writing code in Python; it means internally constructing a step-by-step procedure that generalizes from input-output examples to unseen inputs. Humans do this effortlessly for simple grid puzzles. LLMs cannot do it reliably because they don't construct internal programs — they do weighted interpolation between memorized examples. The thread explains what "learned program synthesis" research programs like DreamCoder and Chollet's own work are attempting.