The Current Reality of American AI Policy: From ‘Pause AI’ to ‘Build’

Summary

• Washington’s AI posture has flipped from constraining AI amid existential-risk warnings to building a platform the United States intends to lead. The action plan opens with “a new frontier of scientific discovery,” backs open source, and proposes an evaluations ecosystem to measure risk before making grand proclamations. The guests see this as a cultural shift from “PauseAI” toward empirically measuring risks and opportunity costs.
• SB 1047 became the cautionary example of how theoretical harms can create immediate commercial chilling effects. The proposal could have exposed open-weight developers to downstream liability if someone later fine-tuned their work and caused a mass-casualty event; Erik Torenberg recalls one version encompassing three deaths or an overwhelmed medical system. For a developer who “can’t even afford” litigation, merely moving the question into court can suppress experimentation.
• DeepSeek punctured the premise that restricting American open source could preserve a multi-year lead over China. DeepSeekMath-V2 had already signaled proximity to the frontier before R1 surprised Washington, while distillation meant the marginal advantage from withholding weights was limited. Erik Torenberg’s blunt challenge: “Have you actually looked at the author list of any paper in AI?”
• Open weights now have a concrete business case extending well beyond open-source philosophy. Closed models can pioneer frontier capabilities while open models serve governments, regulated industries, and Fortune 50 customers demanding on-prem deployment, control, security, and support—the emerging “sovereign AI market.” Because weights do not include the underlying data and training pipeline, companies can distribute smaller models while retaining larger paid models and core IP.
• The investable market may bifurcate rather than converge on one winning licensing model. Frontier APIs and controlled deployments address different customers, infrastructure, support requirements, and revenue models; the guests expect winners in both. Waiting for the structure to settle is itself risky when founders in their twenties can build businesses with revenue run rates in the “tens to hundreds of millions of dollars” within a few years.
• The action plan’s direction is stronger than its implementation detail, with academia the conspicuous omission. Its call to “build an AI evaluations ecosystem” replaces proclamation with measurement and quickly became a reference point for other governments. Yet Anjney Midha argues that pursuing a major technology initiative without universities leaves the country fighting “with a hand tied behind our back.”
• The guests reject the idea that incomplete interpretability justifies waiting indefinitely at the frontier. Models may be “grown, not coded,” but society routinely extracts value from complex systems it cannot explain atomistically; alignment can improve usefulness without requiring a universal ideological mandate. Their opportunity-cost framing is categorical: “The p(doom) without AI is actually quite a bit greater than the p(doom) with AI,” especially if delay slows disease and scientific discovery.

Deep dive

Not yet available upstream; scheduled sync will retry.