nanochat trains GPT-2 for under $100
Original excerpt
nanochat can now train GPT-2 grade LLM for <<$100 (~$73, 3 hours on a single 8XH100 node). GPT-2 is just my favorite LLM because it's the first time the LLM stack comes together in a recognizably modern form. So it has become a bit of a weird & lasting obsession of mine to train
By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.
Andrej Karpathy @karpathy Follow Click to Follow karpathy I like to train large deep neural nets. Previously Director of AI @ Tesla, founding team @ OpenAI, PhD @ Stanford.
Frequently asked questions
What is "nanochat trains GPT-2 for under $100" about?
This article by Andrej Karpathy is part of the Andrej Karpathy reading list on Burn 451, covering ai agents.
Who wrote "nanochat trains GPT-2 for under $100"?
This piece is part of the Andrej Karpathy vault on Burn 451, covering ai agents. The original author is attributed at the source link.
How can I read more content from Andrej Karpathy?
The complete Andrej Karpathy reading list is available at burn451.cloud/vault/karpathy. Each article includes an AI-generated summary so you can decide what to read in seconds. Connect the Burn 451 MCP server to Claude or Cursor to query all Andrej Karpathy articles as live AI context.
Can I use "nanochat trains GPT-2 for under $100" with Claude or Cursor?
Yes. Install the burn-mcp-server npm package and connect it to Claude Desktop, Claude Code, or Cursor. Once connected, your AI can search and reference this article and the full Andrej Karpathy vault in real time — no manual copy-paste required.
37 more articles in this vault.
Import the full Andrej Karpathy vault to Burn 451 and build your own knowledge base.
Content attributed to the original author. Burn 451 curates publicly available writing as a reading index. For removal requests, contact @hawking520.