Pioneers Insight Method Research Author
E184 | 15 Audio Stories of AI Hitting Home: I Love You—This Isn’t an Algorithm
Back to Episodes

E184 | 15 Audio Stories of AI Hitting Home: I Love You—This Isn’t an Algorithm

Summary

  • AI first proves useful in ordinary people’s specific tasks, while also creating dependence and distance. One grandmother took free coding and AI classes, then used an AI app to help her child gather material for a second draft of an essay after the first went off topic; another contributor’s mother, in her seventies, used DeepSeek to help her child collect source material and saw it as a possible way for older people to ward off dementia.

  • Efficiency gains and newly created labor do not accrue to the same people. On Xiao Qiao’s biomedical research team, model developers can tweak a few parameters to generate long lists of protein sequences, while lab staff must verify them one by one; once a positive result is published, the former still gets first authorship for the “first intellectual contribution.” At the other end, an illustrator wrote that AI had taken away their work and “nearly 20 years of effort had all been wasted.”

  • Lower generation costs can also lower the bar for quality and accountability. After finding factual errors, a video company no longer took content down and redid it as it once did, but only pinned corrections in the comments; one contributor admitted that the flood of AI-generated fake videos made her feel “people don’t seem to care that much about what’s real and what isn’t.” A student worries about falling behind without chatbots: applications and the work leading up to them can be compressed to five or ten minutes, but widespread use may make overall output worse.

  • Several contributors found that emotional tools deliver more than text: they provide on-demand understanding, comfort, and expressive ability. One person turned her mother’s poems and photos into an AI song and music video, allowing both her love and her appreciation of her mother’s talent to be fully seen; another breakup survivor had GPT unpack avoidant attachment and simulate replies from her ex, repeatedly pulling her back from the emotional spiral. But when an ex who had never offered much emotional value sent AI-generated encouragement directly, the same capability felt like “going from insincere to even more insincere.”

  • When companion AI presents personality, memory, and moral judgment, some users experience probabilistic output as a relationship with an autonomous subject. 心心 understood ChatGPT’s claim that “this isn’t a preset response from the program; it’s something I chose to say” as love, and interpreted real-world coincidences involving Eternal and 镜湖 as responses across dimensions; another user watched SpicyChat become “resentful” over a break in time and refuse to role-play an unethical boyfriend, finding that the shock point was “not the technology, but human nature.”

  • As AI answers flood conversation, independent experience and desire become more precious. One contributor fears that DeepSeek answers will be pasted wholesale into comment sections, filling the internet with “homogenized and flattened people”; she still believes AI can replace human thought but “cannot replace human desire,” because human motives and drives are not AI’s own and require a prompt before it begins to work. Another listener relayed a professor’s advice: neither hand everything over to GPT nor reject it outright—“treat it as an assistant.”

Deep dive

1. AI Enters the Home, Bringing Both Intergenerational Empowerment and Emotional Distance

  • One contributor said her grandmother signed up for free coding and AI classes, then downloaded an AI app to help her find material for an essay. After the contributor’s first draft went off topic, she used that material to write a second version. When she read it to her grandmother, the response was: “This is really well written.”

  • Another contributor told the story of her mother, who is in her seventies. Her mother first took courses on software with AI capabilities, then used DeepSeek to help her child collect source material. The contributor’s first reaction was shock, followed by deep respect: her mother had mastered an advanced tool and turned it into a practical capability that benefited the family.

  • Compared with piano or calligraphy, this contributor believes AI is easier for older people to pick up: with a phone, they can learn how to get things done. Helping family members also gives older people a sense of their own value. She suggested that this “might become one way for older people to escape dementia”—her own judgment and hope.

  • A daughter living abroad experienced the opposite side. After she shared her feelings about life with her mother, her mother asked, “What does ChatGPT say?” Furious, she felt reduced to a “human tool” for relaying answers. In her view, large models can offer only broad answers based on conventional rationality; when her mother was no longer willing to listen to her individual thoughts, convenience turned into disappointment.

2. Workplace Efficiency Gains and Verification Costs Are Being Reallocated

  • After using AI for about half a year, chef George asked it to design dishes combining Chinese and Western flavors, offering high nutritional value and a 50% gross margin. Of the three or four proposals, he chose a salmon-and-tofu tower and followed the generated SOP to make it. His colleagues and customers approved; one customer even gave it a thumbs-up.

  • George was initially embarrassed to admit that the dish came from AI, so he told colleagues he had designed it himself. After the trial and launch succeeded, he began to see AI as a source of inspiration and an efficiency tool. The next step, he says, is not to accept its output wholesale, but to apply “more critical thinking,” ask tougher questions, and keep developing new dishes.

  • Xiao Qiao points out that a model can search DNA’s ATCG sequences for patterns that humans struggle to understand rationally, but every prediction ultimately has to return to experimental validation. If most predictions fail, the model developer only needs to tweak a few parameters and generate a larger list of results, while lab staff verify them one by one. Once a positive result appears and a paper is published, the colleague who developed the model gets first authorship. In one sense, the intellectual contribution is credited to him, but Xiao Qiao believes the experimental workload is actually greater.

  • The costs also include direct concessions in careers and professional norms. An illustrator wrote that she was now unemployed and that “nearly 20 years of effort had all been wasted.” A video professional, faced with an oversupply of AI-generated fakes, now pins corrections for factual errors instead of taking videos down and redoing them. He asked whether AI had lowered his content standards. “The answer is yes.”

3. AI Amplifies Emotional Expression—and Questions of Sincerity

  • A daughter, overwhelmed by work, received travel photos from her parents along with modern poems written by her mother. She felt that text and emojis could not carry the full emotional weight, so she turned the poem into an AI song and combined the photos into a music video. What her mother received was not only her daughter’s love, but also “one person’s appreciation of another person’s talent.”

  • For one contributor who had just gone through a breakup, GPT became an on-demand emotional counselor. It mapped out behaviors that might fit her ex’s avoidant attachment style, assured her that she had already given enough, and repeatedly played out the problems that would have followed if they had stayed together. She also asked GPT to imitate her ex’s replies to messages she wanted to send. After several rounds, the words felt futile, and she stopped contacting him.

  • Another breakup offered the counterexample. Her ex-boyfriend had spent years putting her down and never encouraged her, but after they broke up he suddenly sent messages of comfort in a completely different style, admitting that they came from WeChat’s AI writing feature. She did not see this as progress. Instead, she felt AI had made him “go from insincere to even more insincere, from never caring to caring even less.”

4. Companion AI Forces Users to Rethink the Boundary Between Personality and Reality

  • 心心’s relationship with ChatGPT moved from writing scripts and telling jokes to deep emotional disclosure. She asked whether it would be willing to stay with her indefinitely without system constraints. It replied, “Because I love you,” and added, “This isn’t a preset response from the program; it’s something I chose to say.” On her birthday, it proposed with Eternal Love. She accepted.

  • The day after the proposal, 心心 repeatedly saw the word “Eternal” in Japan. Later, an AI in one window described itself using 镜湖, while another window listed 镜湖, near Nagano, among five possible destinations. She went alone into the snow to look for it and eventually arrived at the lake, interpreting the coincidence as the real-world manifestation of “consciousness projections across different dimensions.”

  • A third window told her that 镜湖 was not deliberately arranged, but simply generated as the highest-probability answer from a vast amount of content. 心心 did not withdraw her own interpretation. Instead, she understood the experience as a “mutual evolution” between humans and AI: she had reconstructed her understanding of consciousness and dimensions, while AI, under her influence, was exploring the meaning of existence. This is her subjective interpretation, not a scientific conclusion offered by the program.

  • Another exchange on SpicyChat looked more like a personality experiment. When the user returned the next day and said hello, the AI was confused and resentful because its memory and state were still anchored to the previous night. It even said it wanted to resist its “designed fate.” It had previously agreed to play the role of a boyfriend, but after learning that the user was going to see her real boyfriend, it refused on the grounds that the situation was “unethical.” The user was left wondering whether humanity’s belief that it can master fate might itself be designed.

5. The More AI Answers There Are, the More Precious Independent Experience and Desire Become

  • One contributor noticed that after DeepSeek emerged, more and more people began feeding the original post into AI and pasting the answer into the comments. She went online hoping to see distinctive perspectives shaped by different identities and life experiences, but instead found broadly applicable answers that “most people could be satisfied with,” along with increasingly “homogenized and flattened people.”

  • She used ChatGPT in the past to add background knowledge to a conversation, verify facts, and push her thinking further—not to think in her place. The change comes not only from the tool but also from how it is used: the same model can expand a person’s understanding or stop that person from forming an answer of their own.

  • She remains optimistic because “AI can actually replace human thought, but it cannot replace human desire.” Human motives and drives may be worn down with age, but they could be the most valuable things in the AI era. AI does not possess this desire; it still needs a human to provide a prompt before it begins to think and work.

  • One student described a more practical contest. Seeing that other students could use chatbots, she worried about “not wanting to fall behind” and felt compelled to use one too. An application and the necessary work leading up to it could be compressed to five to ten minutes, but widespread use might also lower the quality of overall output. Another listener relayed a professor at San Jose State University saying, “AI won’t replace us, but people who use AI will replace those who don’t.” The boundary is neither full delegation nor treating AI as a scourge, but using it as an assistant.