Why AI Labs With Unlimited GPUs Still Fail — Anjney Midha, AMP
Summary
Anjney Midha argues that money and compute do not guarantee shipping; aligned execution and culture are the constraints. He says Google treated roughly 95% node utilization as outage territory, while best-in-class MFU is 60–70%; poorly coordinated labs let small planning errors compound across organizational layers. “AI scaling should be putting a premium on the value of common sense.”
Amp’s proposed answer is a neutral compute grid that pools fragmented supply across clouds and silicon. The goal is to make “megaflops flow like megawatts,” guaranteeing participants base capacity while dynamically allocating spikes. Amp has started securing demand at a stated 1.3-gigawatt scale—roughly $40 billion of cloud spend—but Midha estimates its teams could need 6 gigawatts of spike capacity over four years.
Data centers need an explicit bargain with their host communities or permitting risk becomes infrastructure risk. Swyx relays an estimate that up to 20% of U.S. data centers this year may lack sufficient community support, though he cautions it could be overstated. Scott Nolan’s proposed “new AI deal” would raise compute from $4 to $4.50 an hour and return the incremental $0.50 directly to locals through cash; Swyx also suggests cheaper electricity. As a compute customer, Swyx says he would gladly pay.
Alternative AI chips can expand supply without fragmenting every layer of the stack. Matrox chose NVIDIA’s reference architecture and rack footprint, then concentrated innovation on the logic die and systems co-design: “You just can’t fight on every front.” The deeper constraint is trust—chips take roughly two years to tape out, so designers need early visibility into changing model architectures.
Research hoarding inside vertically integrated labs creates an opening for independent capital and infrastructure. Midha says DeepMind’s six-month internal embargo can become permanent when work appears commercially useful, producing an adverse-selection problem in what gets published. Amp’s Foundry arm therefore backs frontier teams—including a stated few hundred million dollars invested in Anthropic earlier this year—while Amp also donates excess compute to nonprofits and university labs.
End-of-life prediction is Midha’s clearest example of outputmaxxing with public value. He says Stanford’s longitudinal dataset covered at least 12 million patients, while more than 30% of Medicare and Medicaid spending at the time went toward end-of-life care; even regression and simple neural nets appeared technically useful. Regulation, not modeling, remained the block because liability could not shift from physicians to an AI system: “I haven’t been able to get this out of my mind a single day for the last 14 years.”
Culture is the fragile compounding advantage behind Anthropic’s coding breakout. Midha rejects the “lucky dice roll” explanation: Anthropic spent four years becoming prepared under scarcity, made coding its P0 because computer-use capability could advance AGI, and endured “21 noes” that forced clarity. “Culture is not a set of beliefs. It’s a set of actions”—a garden requiring daily reinforcement, not a permanent moat.
Deep dive
Not yet available upstream; scheduled sync will retry.