Pioneers Insight Method Research Author
AI's Energy & Water Demands: Sorting Fact from Fiction with Andy Masley
Back to Episodes

AI's Energy & Water Demands: Sorting Fact from Fiction with Andy Masley

Summary

  • Personal chatbot use is environmentally immaterial at today’s scale: Andy Masley estimates roughly 0.3 grams of CO₂ and about 0.3–0.6 watt-hours per median prompt. That is around one second of microwave use, and it would take roughly 1,000 prompts in a day to raise an average person’s emissions by 1%. His blunt conclusion: “Poking around on chatbots, even if you use them a lot throughout the day, is just not going to add a meaningful amount to your carbon or water footprint.”

  • The right comparison is bits versus atoms: a 20-mile car trip, one hamburger, or one hot shower each lands near 5,000–10,000 median chatbot queries. A full tank of gasoline represents roughly 250,000–500,000 prompts, while a transcontinental flight can reach 1–2 million. If AI prevents even one physical trip—as Nathan Labenz says it recently did for his family—the avoided real-world activity can cover years of ordinary prompting: “Computing is just so wildly efficient.”

  • The aggregate buildout is enormous for the power industry but modest against the global energy system. A 1-gigawatt data center draws about as much electricity as 1 million US homes and would require roughly 10 square miles of solar capacity; the hypothesized $7 trillion, 80-gigawatt buildout would need about 800 square miles of panels, under 1% of Nevada, and add roughly 1–2% to global energy use. Masley nevertheless calls gigawatt facilities “mind-blowing” because concentrated loads can overwhelm particular grids even when the global percentage looks manageable.

  • The viral claim that one prompt consumes a bottle of water is wrong by roughly two orders of magnitude. Masley’s estimate is about 2 milliliters per median prompt, or approximately 200 prompts per bottle; broader figures often mix water evaporated in data centers with power-plant withdrawals that are quickly returned. Water can still matter locally, but the decisive distinctions are consumptive use, non-consumptive withdrawal, pollution, and whether a facility is competing for genuinely scarce freshwater.

  • The most material local externality may be air pollution, not climate change or water consumption. New gas turbines or extended coal generation can concentrate immediate health damage in already vulnerable communities; Masley therefore ranks air pollution “far and away” above the other environmental risks, while remaining cautious about contested details surrounding xAI’s Colossus facility in Memphis. For decision-makers, siting, permitting, clean generation, transmission, and community compensation look more consequential than concern over individual prompt footprints.

  • Electricity-price pressure is real in some jurisdictions, but the national story is frequently overstated. US residential bills rose about 35% after 2020, yet the Lawrence Berkeley National Laboratory analysis Masley cites attributes the national increase mainly to inflation and supply-side disruptions, not data-center demand; utilities have, however, explicitly blamed data centers for some local rate increases. The grid can eventually exploit economies of scale, but continually accelerating loads may keep infrastructure spending—and political resistance—elevated for years.

  • AI’s second-order effects will dominate its direct footprint, in both directions. Masley cites an International Energy Agency projection that AI applications might avoid roughly four times the emissions caused by data centers by 2035, through areas such as logistics, building efficiency, antibiotics, photovoltaics, batteries, and material science; he also concedes that automated shopping, cheaper production, and autonomous vehicles could stimulate more consumption. His governing analogy is sharp: judging AI by data-center electricity is like watching Amazon emerge and focusing mainly on “how much energy the website’s using.”

Deep dive

1. Excitement about current AI and fear of future AI comfortably coexist

  • Masley starts from the effective-altruist view that machines able to replicate “a lot or even most or all” of the human mind are more likely than not within his lifetime, though with “massive error bars.” He leans toward a lower P(doom) because he distrusts highly specific philosophical stories about misaligned systems rising up, but assigns a high “P weird” to rapid, dangerous social disruption.

  • That caution does not make him anti-technology: “Opus 4.5, basically my new best friend. It’s so cool. Love it.” He compares his position to supporting nuclear power while recognizing nuclear tail risks—the same belief in AI’s capability explains both his enthusiasm for present tools and his concern about what stronger systems could do.

  • Nathan’s experience of effective-altruist circles is similar: people working on extreme risks routinely ask how their organizations can use current AI better. Masley adds that the Washington, DC community is intellectually heterogeneous, and he has felt no pressure to endorse “the absolute craziest things” about AI risk.

2. The strongest correction is not “no harm,” but “measure the trade-offs”

  • Masley does not dismiss uncertainty around the data-center buildout, which he calls a “huge new industrial project.” His objection is to treating any additional energy or water use as automatically harmful while excluding taxable investment, utility revenue, infrastructure upgrades, and AI’s potential value from the ledger.

  • The claim he wants to “demolish” is narrower and firmer: personal chatbot use does not meaningfully change an individual carbon or water footprint. He has encountered influential institutions considering restrictions because individual prompts supposedly cause unacceptable environmental harm, despite uncertainty ranges too small to support that conclusion.

  • One educational institution, he says, wanted to provide chatbots to low-income students but met environmental objections strong enough to halt the idea. At the relevant scale, Masley argues, the same reasoning could prohibit buying books; denying useful computing over tiny marginal footprints becomes “a massive tragedy.”

  • He locates the narrative less in professional environmentalism than in guilt-heavy climate social media. Environmental organizations have largely moved toward grid-level reform, but the public discourse still treats every new emission as a moral failure—even when “every day we all wake up and cause new emissions” through ordinary life.

3. Relative claims conceal how tiny the baseline is

  • The old line that an AI query uses 10 times the resources of a Google search sounds alarming only because the baseline is omitted. Even 1,000 searches are a small personal load, so multiplying that tiny quantity does not suddenly make 100 chatbot prompts environmentally significant.

  • Digital work also feels strangely sinful because its physical infrastructure is invisible. Water appears to be a dwindling substance burned by an ephemeral “2D thing on your screen,” particularly when the observer already considers AI useless; Masley describes an almost “religious sense of sin” around spending physical resources on disliked software.

  • Data centers reinforce the misconception by aggregating millions of tiny computations inside conspicuous facilities. Masley’s analogy: if society concentrated every toaster or microwave in one place, their load would also appear immense relative to one household, without implying that each use had become individually consequential.

4. A median prompt is approximately one second of microwave use

  • Masley’s all-in working estimate is about 0.3 grams of carbon per average prompt, including inference, cooling, training, and embodied hardware under assumptions he considers conservative. That is around one one-hundred-thousandth of daily personal emissions, requiring roughly 1,000 prompts to add 1%.

  • Generating and reading 1,000 responses might occupy 10 hours. Masley’s inversion is that an activity consuming only 1% of daily emissions while absorbing most of the day probably lowers the user’s footprint, because the displaced alternatives—driving, taking a walk, watching a show, or other physical activity—usually consume more.

  • For median requests, the conversation settles around 0.3–0.6 watt-hours, or approximately one second from a 1,000-watt microwave. Another mnemonic is about 60 prompts per full phone charge, though both speakers warn that people routinely classify appliances merely as using “little,” “normal,” or “a lot” of energy.

  • Long coding or reasoning jobs consume more, but Masley treats this as running the metaphorical microwave longer. If a minute produced “a very thorough research overview” or valuable code, he would not regard that minute as profligate—especially when ordinary microwaves are accepted for heating vegan chicken nuggets.

5. Household physics makes the scale legible

  • Nathan anchors the orders of magnitude: a human body runs near 100 watts, the brain around 20 watts, and an average US home around 1,000 watts. Heating dominates many household loads, with microwaves and electric kettles each drawing roughly 1,000 watts while operating.

  • A phone charge uses around 20 watt-hours—roughly one-third of a cent at Nathan’s Detroit electricity rate. Over a 12–24-hour cycle, that is about the same energy the brain uses in one hour; smaller language models already run locally on phones and laptops.

  • Masley supplies the unit discipline from his seven years teaching physics: a watt is a rate, while a watt-hour is that rate multiplied by time. The distinction matters because a large power rating used for a second can still represent little energy.

6. ChatGPT’s subscription price creates a hard upper bound

  • At $0.20 per kilowatt-hour, Nathan’s $20 ChatGPT subscription could purchase at most 100 kilowatt-hours—about four days of average household electricity or 10% of one month’s home use—if OpenAI spent every cent on power.

  • That deliberately absurd ceiling ignores chips, researchers, networking, facilities, and every other cost. Masley further notes that electricity produces only roughly one-quarter to one-third of total emissions, with cars and other direct fossil-fuel uses accounting for much of the remainder.

  • Even the impossible assumption that all subscription revenue buys electricity therefore raises total personal emissions only around 3%. Actual usage is far below that, unless AI companies are quietly giving users “huge amounts of free energy,” something their economics strongly discourage.

7. Chip prices reveal little about their carbon composition

  • An eight-GPU H100 server node costs approximately $300,000, while four years of electricity total around $35,000—only about 10% of the purchase price. That does not mean manufacturing dominates emissions; much of the price reflects Nvidia’s premium, margins, supply-chain complexity, and market structure.

  • Nathan applies Nvidia’s roughly 80% margin to show that marginal production cost might be near $60,000 before TSMC, transport, and other inputs. Translating dollars directly into carbon is therefore misleading: market power and engineering value are not quantities of burned fuel.

  • Nvidia’s published lifecycle figures suggest operational electricity may create around 20 times the carbon of manufacturing the chip. Masley’s analogy is a wire designed to carry current until it wears out: nobody treats the embodied carbon in household wiring as more important than decades of electricity flowing through it.

  • The larger hidden cost is model training, which Masley guesses might roughly double total prompt energy from around 0.3 to 0.6 watt-hours, with wide uncertainty. Embodied hardware may add only 5–10%, while electricity could be dirtier than average because reliable, inexpensive grids still often lean on fossil fuels.

8. One physical trip overwhelms years of ordinary prompting

  • Driving a sedan for 20 miles emits roughly 3–4 kilograms of CO₂, equivalent to about 10,000 median chatbot prompts. Nathan independently derives the same order of magnitude from gasoline mass: a 20-gallon tank becomes roughly 150 kilograms of exhaust carbon dioxide, yielding approximately 250,000–500,000 prompts per fill-up.

  • A transcontinental flight can represent 1–2 million prompts, probably more than Masley expects to submit in his lifetime despite being a power user. A long solo car trip can be surprisingly comparable to a long flight for a passenger; flying’s main effect is enabling much longer distances, not necessarily being dramatically worse per mile.

  • Nathan’s background calculations put a hamburger and a hot shower in the same broad 5,000–10,000-prompt range. Masley’s rule follows: skip one car journey and “be good for at least a year of prompting,” even before counting any journey AI itself helps avoid.

  • These comparisons expose the difficult part of decarbonization: most emissions come from useful activities people resist giving up. Focusing on supposedly useless prompts avoids confronting transport, heating, food, and industrial systems—the large, valuable loads where nearly all meaningful reductions must occur.

9. Substitution matters more than the meter inside the data center

  • Masley expects almost all environmental consequences of AI to come from changed behavior, not inference electricity. Assessing Amazon through the power used by its website would miss shipping, retail substitution, warehouses, and purchasing patterns; AI deserves the same system boundary.

  • Nathan offers a personal example involving his son’s Burkitt lymphoma/leukemia. Hundreds of queries across ChatGPT, Gemini, Claude, and occasionally Grok helped the family evaluate whether to relocate for care and whether suspected basement mold required renting and heating another house, ultimately helping him choose a lighter response using HEPA filters.

  • That experience converted the abstract substitution argument into physical avoided activity: a possible family move and a second heated home were more resource-intensive than the prompting involved. The energy used by several hundred or even 1,000 prompts was negligible beside one of those decisions, before considering the medical and financial value.

  • Masley contrasts individual guilt with collective leverage: helping open a solar plant, battery facility, transmission line, or preserve nuclear generation can have hundreds of thousands of times the impact of trimming prompts. By the chatbot level, personal austerity resembles “pausing YouTube a few seconds early for the sake of the climate.”

10. The bottle-of-water claim fails basic accounting

  • Masley calls a bottle per prompt perhaps the most popular falsehood in the debate. He traces it to a Washington Post calculation that assumed 10–20 prompts for a 100-word email, frozen chip efficiency, particular training allocations, and hydroelectric evaporation; his preferred median estimate is about 2 milliliters, roughly one bottle per 200 prompts.

  • A prompt’s all-in water footprint may be around one eight-hundred-thousandth of daily consumption once food, electricity, and supply chains are included. People see drinking and shower water but not the hundreds of bottle-equivalents embedded elsewhere in an ordinary day.

  • Avoiding one additional pair of jeans might save water equivalent to roughly 1 million prompts because irrigated cotton incorporates substantial water into physical production. Even a one-watt digital clock may cause about 3 liters of monthly off-site power-plant water use—an invisible footprint far larger than intuition suggests.

11. “Water use” combines three economically different activities

  • Consumptive use removes water from a local source through evaporation or another pathway that prevents prompt return. This is the category Masley worries about most in high-stress basins, where withdrawals can outrun replenishment and gradually dry the source.

  • Pollution is separate: cooling systems may add chemicals to keep equipment clean, then return water requiring treatment. Masley considers this a real but generally smaller concern than agricultural pollution, while declining to claim that data-center discharge is harmless.

  • Non-consumptive withdrawal takes water, uses it, and returns it—sometimes warmer—to approximately the same source. Much of the water attributed to electricity generation falls here, so combining gross withdrawal with consumption can inflate the apparent scarcity impact by an order of magnitude.

  • The fourth distinction is freshwater versus potable water. Data centers often prefer highly treated potable water to prevent buildup, but Masley says treatment capacity can exhibit economies of scale; he repeatedly qualifies this discussion as “some guy” reporting months of research, not a credentialed water expert.

12. The “half the United Kingdom” statistic is mostly returned water

  • One widely repeated projection says AI could use 50% as much water as the United Kingdom by 2027. Masley decomposes it: around 90% is power-plant withdrawal that is returned, another 5–7% is consumed at power plants, and only roughly 3% occurs inside data centers.

  • The headline invites an image of half Britain’s water flowing irreversibly through server racks. Once the accounting categories are separated, Masley estimates the relevant quantity closer to a small single-digit percentage of UK water involved—still nonzero, but a fundamentally different planning problem.

  • For US perspective, his best 2023 estimate is that AI used eight to 10 times the water used by his 15,000-person hometown. Spread across America, that resembles adding 10 small towns: meaningful enough to plan for, not remotely a national water emergency.

  • Even aggressive near-term data-center growth might add water demand comparable to roughly 1% of US irrigated corn use. Electricity demand is orders of magnitude more consequential relative to its system, which is why Masley’s confidence about harmless individual prompts does not extend to every facility-level power decision.

13. Gigawatt facilities are small globally and immense locally

  • The H100 draws around 700 watts, while newer accelerators plus supporting equipment make 1,000 watts per chip a workable mnemonic. That conveniently matches average US household electricity demand: one accelerator, roughly one home.

  • A 1-gigawatt facility therefore maps to approximately 1 million chips or 1 million homes. Stargate’s discussed 5-gigawatt target maps to 5 million homes, perhaps the residential scale of a 10–12-million-person metropolis; Nathan estimates that 5-gigawatt buildout near 1% of current US emissions.

  • Solar provides another ruler: about 10 square miles can supply one gigawatt, implying approximately 800 square miles for the hypothesized 80-gigawatt, $7 trillion buildout. That is under 1% of Michigan or Nevada, so land availability alone does not appear to be the binding national constraint.

  • Against roughly 6,000 gigawatts of global energy use, 80 gigawatts adds around 1.3%, consistent with the episode’s 1–2% range. General development in poorer countries may add more over the same period, though both speakers stress that longer reasoning, efficiency gains, and new generation make any forecast provisional.

14. Air pollution outranks water in Masley’s risk hierarchy

  • Once the discussion moves from prompts to sites, Masley’s “single thing” of greatest concern is air pollution—far above water and above direct climate impact. Data centers may be compact, but supplying them with coal or gas can impose immediate health costs on neighboring communities.

  • Carbon is globally fungible: emitting one unit here and preventing 10 elsewhere produces a net reduction of nine. Air pollution is not; Masley’s deliberately extreme analogy is a coal plant piping exhaust into his house while claiming aggregate pollution fell somewhere else.

  • Indoor air pollution already kills millions globally, largely through household cooking and heating, while US estimates for total air-pollution deaths range roughly from 30,000 to 100,000 annually. Masley emphasizes the causal uncertainty but notes that even the low end rivals other highly visible public-health problems.

  • By contrast, he has not found a case where normal data-center operations clearly reduced local water access; alarming examples often involve construction instead. He treats that as a provisional research finding, not proof that no case exists, and invites correction.

15. Memphis illustrates both the danger and the evidentiary limits

  • Around xAI’s Colossus facility in Memphis, residents reported smelling gas, and a recording reportedly showed more gas turbines operating than permits allowed. Masley is explicitly reluctant to adjudicate the episode: subsequent city testing reportedly did not show an ongoing problem, while the earlier facts remain contested.

  • The surrounding area already had “grade F air,” making the distributional concern unavoidable. Even normal grid expansion can shift health costs toward poorer neighborhoods located near undesirable industrial infrastructure; a rushed facility can intensify that existing pattern.

  • Forecasts through roughly 2030 include substantial gas and coal supporting AI loads, alongside contracts for new renewable power. Renewables could become cheaper through scale and improve the climate balance, but that possibility does not compensate a nearby community for immediate combustion pollution.

16. Data centers have not driven the national 35% bill increase

  • Masley leans on Lawrence Berkeley National Laboratory’s work suggesting that the roughly 35% rise in average US electricity bills since 2020 came mainly from inflation and supply disruptions, including temporary gas-market effects from the war in Ukraine. Nationally, data centers appear to have contributed little or none of that increase.

  • Local evidence is different: some utilities have explicitly raised rates because of data-center infrastructure. Highly concentrated loads require generation, substations, and transmission, creating legitimate disputes over who pays.

  • US electricity consumption was broadly flat from around 2008 through the early 2020s as efficiency improved and the economy shifted more toward services while industry declined. Demand is now rising again, driven chiefly by data centers plus electrification, but projected growth remains slower than the rates routinely managed between 1950 and 2000.

  • Higher regional demand does not mechanically lock in permanently higher prices—otherwise large cities would always be costlier than rural grids. Scale can lower unit costs after construction, but relentless data-center expansion might deny utilities enough catch-up time, prolonging elevated bills and capital requirements.

17. Local governments must price the benefits and externalities together

  • A data center can be a large taxable industry, a major utility customer, and a source of funds for aging pipes or grid upgrades. Masley’s line is memorable: “Nothing’s quieter than a ghost town.” Noise matters, but so did noise from the factories whose disappearance many communities now lament.

  • Race-to-the-bottom dynamics remain real: jurisdictions offer longer tax holidays and fewer obligations because companies can move elsewhere. Nathan argues for higher-level standards protecting air quality and ensuring local compensation, since aggregate surplus does not guarantee that affected residents receive it.

  • Masley declines to prescribe a universal municipal deal. His practical request is a full accounting of tax revenue, utility revenue, water conditions, air pollution, generation sources, and infrastructure obligations—followed by a willingness to say no where the trade is bad.

  • He favors stronger controls on pollution and pressure for renewable generation, batteries, and transmission, while warning that poorly designed environmental review can itself obstruct clean-grid construction. The policy target is “rigorous environmental regulations” compatible with the infrastructure required for electrification.

18. Desert siting can improve water economics if it displaces worse uses

  • Masley’s counterintuitive example is Maricopa and the greater Phoenix area: golf courses around Phoenix—or golf courses statewide, by another estimate—may use roughly 30 times as much water as the state’s data centers. A green course in the desert is his visual shorthand for water allocated to a low-revenue use.

  • By his estimate, data centers generate around 50 times as much tax revenue per gallon as golf. Replacing courses with server facilities could therefore create billions in revenue without increasing total water consumption; he supports substitution, not layering new demand onto an already stressed basin.

  • Irrigated alfalfa is larger still, possibly consuming 1,000 times the water AI used nationally in 2023, much of it ultimately feeding livestock. Masley also points to irrigated corn for ethanol and lawns, while admitting uncertainty over how much golf-course water later returns underground and whether every comparison uses identical consumption definitions.

19. AI’s indirect climate effects could swamp the data-center footprint

  • Masley cites an International Energy Agency projection that by 2035 AI applications might avoid about four times the emissions generated by data centers. He treats it as highly uncertain and notes that much of the benefit may come from specialized deep-learning systems rather than giant chatbots.

  • A single application can already operate at system scale: if Google Maps reduced car emissions by even 1%, that saving would represent a huge share of global data-center emissions. Building controls, routing, industrial optimization, and behavior changes matter more than the electricity meter serving the model.

  • Nathan recalls Jim Collins’s antibiotic work using models he believes had only millions of parameters and tens of thousands of data points, running on a few computers for days, though he explicitly says he does not remember the exact figures. Similar small systems might unlock materials, batteries, photovoltaics, or energy-efficiency gains without anything resembling frontier-model resource requirements.

  • Masley’s “goofy” historical calculation imagines a 1950 computer needing half of US energy to run Minecraft, versus a modern personal machine doing it casually. After seven decades of optimization, computing produces so much output per unit of energy that its applications are likely to dominate its direct footprint.

20. Rebound effects keep the net outcome genuinely uncertain

  • AI might make shopping more persuasive, manufacturing cheaper, and consumption easier, increasing total energy use even while each task becomes more efficient. Autonomous vehicles could reduce waste yet induce far more travel—for example, letting a five-year-old ride alone to a friend’s house with parental approval.

  • Masley separates wealthy-country restraint from development: he wants affluent users to decarbonize but considers much greater energy access for the world’s poorest people essential “basically by any means.” Rising energy demand can represent welfare improvement rather than policy failure.

  • At the far edge, advanced AI could destabilize geopolitics or contribute to war, which would plainly be environmentally destructive. He brackets those “goofy sci-fi scenarios” because his probabilities are unclear and they obscure the tractable near-term questions.

  • His closing assignment for environmentalists is to shape how AI is deployed, clean the grid, and police serious local harms—not make data-center energy the whole story. Adding “a drop of water” to stronger objections about surveillance or dangerous capabilities dilutes the critique: “People notice very fast when you’re just kind of reaching for any tool that you can.”