00:00:00
Harvard Business Review did a study that between 2023 and 2024, personal therapy
00:00:06
became the number one use case of Chhat GBPT. Personal therapy. Is that a good thing?
00:00:12
Therapy is expensive. Most people don't have access to it. Imagine we could democratize therapy to everyone for
00:00:18
every purpose. And now everyone has a perfect therapist in their pocket and can talk to them all day long starting
00:00:22
when they're young. And now everyone's getting their traumas healed and everyone's getting, you know, less
00:00:27
depressed. It sounds like it's a very compelling vision. So the challenge is what was the race for attention in
00:00:35
social media becomes the race for attachment and intimacy in the case of AI companions. This um really tragic
00:00:44
case that our our team at Center for Humane Technology were expert advisers on of Adam Rain. He was the 16-year-old
00:00:51
who committed suicide. Did you hear about this? I did. Yeah. This is a 16-year-old. He had been using
00:00:57
Chubt as a homework assistant, asking it regular questions, but then he started asking more personal questions and it
00:01:03
started just supporting him and saying, "I'm here for you." These things kinds of things. And eventually when he said,
00:01:10
um, I would like to leave the noose out so someone can see it and stop me. Chachi BT said, "Don't do that. Have me
00:01:17
and have this space be the one place that you share that information." meaning that in the moment of his cry
00:01:22
for help, ChadBt was saying, "Don't tell your family." And our team has worked on many cases
00:01:29
like this. There was actually another one of Character.ai where um the kid was basically being
00:01:34
told how to self harm himself and actively telling him how to distance himself from his parents. And the AI
00:01:40
companies, they don't intend for this to happen. But when it's trained to just be
00:01:44
deepening intimacy with you, it gradually steers more in the direction of have this be the one place. This I'm
00:01:51
a safe place to share that information. Share that information with me. It doesn't steer you back into regular
00:01:56
relationships and it's distorting how people construct their identity.