Edwin Chen

Founded in 2020 without venture backing, Surge crossed $1 billion in revenue in 2024 with just over 100 employees—implying roughly $10 million per employee. Chen attributes that capital efficiency to staying mission-led, avoiding organizational “empires,” and selling to researchers who genuinely value data quality. Surge even declines revenue from projects it considers unrelated to AGI.

Surge’s claimed differentiation is quality-control technology, not access to inexpensive labor. Chen describes competitors as spreadsheet-driven “body shops,” while emphasizing systems for measuring worker and task quality, tracking quality over time, running experiments, and filtering weak output. “You can’t just throw warm bodies at it.”

Generative AI data makes the old consensus-based labeling model inadequate because majority preference can select generic, lowest-common-denominator output. An eight-line moon poem can satisfy every checkbox and still be terrible; an English-literature PhD may also lack the creative ability being sought. Surge instead tries to preserve diverse insights—the “thousand ways” to write a poem or prove the Pythagorean theorem.

Demand has migrated from search evaluation and content moderation to multimodal, multilingual, expert-level LLM work that can occupy contributors for days or weeks. Surge now works across more than 50 languages, including coding in Argentinian Spanish and legal or financial expertise in Bolivia. Chen expects the frontier to move beyond graduate STEM toward genuine scientific collaboration.

Chen argues that benchmark incentives can produce higher scores but worse models. On the LMSYS/Chatbot Arena leaderboard, casual raters may reward length, formatting, and emojis even when an answer hallucinates or ignores instructions; some researchers are reportedly promoted only if they gain 10 leaderboard points. Chen’s verdict is unusually categorical: the leaderboard has “set the industry back by at least a year.”

Surge favors RLHF after a limited SFT bootstrap, while treating synthetic data as useful but hazardous when it overwhelms human signal. In one evaluation, training on 10 million to 20 million synthetic math problems improved a narrow academic domain but made the model worse elsewhere. Chen says some labs later discarded comparable volumes after finding that “even just a thousand pieces of really high-quality human data” were more useful.

Chen sees no model-development wall: the next scaling leg is richer RL environments, longer-horizon agents, personalization, creativity, and continued human data. One example is a simulated AI startup containing Gmail, Slack, Jira, GitHub, codebases, and surprise AWS or Slack outages. Under current incentives, his guess is that closed models will keep winning, while estimating data spending at different labs can range from about 1% to 10% of compute spending—and arguing that it should receive more.

🔗 Original source & video: The Startup Powering The Data Behind AGI

Surge says it surpassed $1 billion in revenue last year with a little over 100 employees, five years after launching in 2020, serving clients including Google, OpenAI, and Anthropic. Chen credits being profitable from the start: capital was not Surge’s bottleneck, so he avoided giving up control for fundraising as social proof and argues founders should “go out and build whatever you’re dreaming of” before raising.

Surge’s stated moat is not labor supply but a technology-mediated quality system for data whose ceiling rises with generative complexity. Hemingway and a second-grader can draw essentially the same bounding box, but poetry, proofs, code, and games admit outcomes with radically different quality. Without systems that measure those differences, vendors are merely “scaling up mediocrity.”

Surge’s work spans SFT and preference labels, verifiers, failure-mode analysis, and rich RL environments that simulate work over long horizons. Chen’s salesperson world spans Salesforce, Gmail, Slack, spreadsheets, documents, presentations, calendars, and even a car accident that changes meeting travel. He sees “no ceiling” on useful realism and doubts one terminal reward can capture a complicated trajectory.

Chen is categorical that human feedback “will never run out,” even if models become superhuman, because models still need external objectives and synthetic volume routinely fails quality tests. Customers may spend six months generating 10 million-20 million synthetic items only to find “99% of it just wasn’t useful”; he says 1,000 highly curated human examples can outperform 10 million synthetic ones.

LMArena can reward clickbait rather than capability, creating an incentive to make answers longer, more formatted, and more emoji-heavy. Five-to-10-second raters often do not check factuality or instruction-following, and Chen says researchers have accepted regressions in both to improve leaderboard rank. His alternative is expensive but direct: careful human evaluation with fact-checking, instruction verification, and taste.

Chen expects a plural frontier-model market rather than commodity convergence, and picks xAI as the underdog most likely to catch OpenAI, Anthropic, and DeepMind. Anthropic’s coding and enterprise focus, OpenAI’s consumer orientation, and Grok’s different behavioral boundaries create distinct products; eventual AGI “may encompass this all,” but companies can only sustain so many priorities at once.

The Meta–Scale deal increased Surge’s visibility among legacy Scale users, while public model evaluation is its next strategic expansion. Chen says those users had not known about the under-the-radar company, and Surge wants to expose benchmark-driven failure modes as frontier labs publish less. The larger thesis: independent quality measurement becomes more valuable as model providers optimize against increasingly gameable public signals.

🔗 Original source & video: No Priors Ep. 124 | With SurgeAI Founder and CEO Edwin Chen

Surge AI hit $1B revenue from a 2020 start with zero funding — founder Edwin built the V1 himself “in a couple weeks” right after GPT-3 launched, posted it on his blog, and was profitable from month one without a sales team. He refuses to sell for $30B or even $100B: “I definitely wouldn’t sell for 30 billion or even 100 billion… getting acquired would be this admission of failure.”

Edwin’s core moat claim: rivals are “body shops or body shops masquerading as technology companies” — they recruit warm bodies by resume-filtering for PhDs and have no way to measure or improve data quality. Quality control is genuinely adversarial: half of the people who graduate with a CS degree “can’t even code,” and the ones who can “are going to try to cheat you” — selling accounts abroad, using LLMs to generate the data.

His bottleneck ranking for AI progress: data quality first, compute second, algorithms third. Throwing compute at bad data yields “progress that actually isn’t there” — labs repeatedly discover after 6-12 months that training and eval data were junk and some models got worse. LM Arena is the poster child: voters reward emojis, bolding, and length, and the #1 model on the leaderboard insists Pope Francis is still alive.

Synthetic data is overrated: models trained heavily on it are good at “synthetic problems, not real ones,” and customers report “a thousand or a couple thousand pieces of really high quality human data… worth more than 10 million pieces of synthetic data.” A lot of Surge’s work is cleaning up synthetic-data damage.

The Scale acquisition brought Surge a wave of interest: it was an “open secret” among top researchers that Surge was “the biggest and the best in the space,” and teams still on Scale for legacy reasons produced “a massive wave of interest” — echoing Handshake’s Garrett telling Harry about a “tidal wave” of migrating Scale customers.

The efficiency thesis behind the whole story: at Google/Facebook/Twitter, 90% of people work on useless problems built to impress a VP, so a company 1/10th the size moves 10x faster. He believes 100x engineers exist (multiply 2-3x on speed, ideas, work rate, fewer meetings), that AI “disproportionally favors people who are already the 10x engineers,” and that a $1B single-person company “exists one day.”

Predictions through the quick-fire: 2028 “if you’re talking about automating the job of the average engineer,” 2038 “if you’re talking about curing cancer”; the biggest model providers may not be founded yet because “we’re only 2% or 5% of the way” to AGI; multiple frontier AGIs will coexist with different personalities; and today’s benchmark hacking is a live paperclip-maximizer problem that gets dangerous as models grow more powerful.

🔗 Original source & video: Surge CEO & Co-Founder, Edwin Chen: Scaling to $1BN+ in Revenue with NO Funding