Autoresearch results — 20 improvements found by agents in 2 days
Original excerpt
Three days ago I left autoresearch tuning nanochat for ~2 days on depth=12 model. It found ~20 changes that improved the validation loss. I tested these changes yesterday and all of them were additive and transferred to larger (depth=24) models. Stacking up all of these changes, today I measured that the leaderboard's "Time to GPT-2" drops from 2.02 hours to 1.80 hours (~11% improvement), this will be the new leaderboard entry. So yes, these are real improvements and they make an actual difference. I am mildly surprised that my very first naive attempt already worked this well on top of what I thought was already a fairly manually well-tuned project. This is a first for me because I am very…
Frequently asked questions
What is "Autoresearch results — 20 improvements found by agents in 2 days" about?
This article by Andrej Karpathy is part of the Andrej Karpathy reading list on Burn 451, covering ai agents.
Who wrote "Autoresearch results — 20 improvements found by agents in 2 days"?
This piece is part of the Andrej Karpathy vault on Burn 451, covering ai agents. The original author is attributed at the source link.
How can I read more content from Andrej Karpathy?
The complete Andrej Karpathy reading list is available at burn451.cloud/vault/karpathy. Each article includes an AI-generated summary so you can decide what to read in seconds. Connect the Burn 451 MCP server to Claude or Cursor to query all Andrej Karpathy articles as live AI context.
Can I use "Autoresearch results — 20 improvements found by agents in 2 days" with Claude or Cursor?
Yes. Install the burn-mcp-server npm package and connect it to Claude Desktop, Claude Code, or Cursor. Once connected, your AI can search and reference this article and the full Andrej Karpathy vault in real time — no manual copy-paste required.
37 more articles in this vault.
Import the full Andrej Karpathy vault to Burn 451 and build your own knowledge base.
Content attributed to the original author. Burn 451 curates publicly available writing as a reading index. For removal requests, contact @hawking520.