Dario Amodei — “We are near the end of the exponential”
Dario Amodei — “We are near the end of the exponential”
Summary
- Dario’s headline claim is that we are near the end of the exponential — the technology has tracked his expectations (“smart high school student to smart college student to beginning to do PhD”), and the genuine surprise is “the lack of public recognition of how close we are.” He puts 90% odds on a “country of geniuses in a data center” within ten years and a 50/50 hunch it lands in one to two, maybe one to three years — “I think it’s crazy to say that this won’t happen by 2035.”
- The scaling thesis is unchanged since his 2017 “Big Blob of Compute Hypothesis”: cleverness doesn’t matter, seven ingredients do, and RL is now showing the same log-linear scaling pre-training did — performance on math contests and “a wide variety of RL tasks” is log-linear in training time. Continual learning “might not be a barrier at all”; long context is “an engineering and inference problem,” not a research problem, possibly solved “in the next year or two.”
- Anthropic’s revenue is the tradeable data point: zero→$100M (2023), $100M→$1B (2024), $1B→$9-10B (2025), with “another few billion” added in January alone. Dario expects the curve to bend “somewhat this year” but stay fast — and says numbers implying ~$200B TAM by 2028 “are too small.” Separate hard call: “It is hard for me to see that there won’t be trillions of dollars in revenue before 2030.”
- The capex discipline argument is the episode’s sharpest risk framing: if you buy $1T/year of compute and revenue comes in at $800B, “there’s no force on earth, there’s no hedge on earth that could stop me from going bankrupt.” Being off by one year on the demand curve is ruinous, which is why Anthropic buys “hundreds of billions, not trillions” — and why he suspects rivals “have not written down the spreadsheet.”
- Industry math for suppliers: compute build-out is ~10-15 GW this year, growing roughly 3x/year — ~30-40 GW next year, ~100 GW in 2028, ~300 GW in 2029 at ~$10-15B per gigawatt, i.e. multiple trillions of dollars a year of capex by 2028-29. Steady-state economics: each model is profitable ("$1B to train, $4B revenue"), companies lose money only because they’re funding the exponentially bigger next model.
- On coding, his 90%-of-lines prediction “happened, at least at some places,” but the spectrum matters: 90% of lines → 100% of lines → 90% of end-to-end SWE tasks → 100% → 90% less SWE demand. He thinks models may do SWE fully end-to-end “in a year or two” — including setting technical direction — and pegs today’s coding-model productivity uplift at 15-20% total factor speedup, up from 5% six months ago, a snowball model.
- Structurally he expects 3-4 players and positive margins, not commoditization: a Cournot-style equilibrium like cloud, except “models are more differentiated than cloud.” Profitability isn’t a scale milestone — it’s a demand-prediction residual: guess demand right with >50% inference gross margins and ~50% of compute on training, and “the underlying economics are profitable.”
- Policy stance: against the 10-year federal moratorium on state AI laws (“10 years is an eternity… a crazy thing to do”) but pro federal preemption done right; transparency standards now, fast targeted action if bioterrorism risk crystallizes “as soon as later this year”; hawkish on chip export controls to China (the counterarguments are “fishy”); and more worried about the FDA pipeline jamming up than about “stupid” chatbot bills.
Deep dive
Not yet available upstream; scheduled sync will retry.