Search Captions & Ask AI

Schools Risk Overreliance and Lost Connection with Unrestricted AI in Learning

August 13, 2025 / 08:00

This episode discusses the role of artificial intelligence in education, featuring Hamsa Bastani, an Associate Professor at the Wharton School. Topics include the integration of AI tools in schools, the impact on student learning, and concerns about over-reliance on technology.

Hamsa Bastani shares insights from conversations with high school teachers about using Google Suite and AI tools like Gemini and NotebookLM. He expresses concern that unrestricted access to AI may hinder students' learning and skill development.

He emphasizes the importance of building fundamental skills before using AI, noting that students often seek quick answers instead of engaging with the material. This reliance on AI can diminish students' sense of accomplishment and motivation.

Bastani also discusses the challenges school districts face in implementing AI, including budget constraints and the lack of training for teachers. He argues that simply providing access to AI tools is an easier solution than developing effective pedagogical strategies.

Finally, he warns that the shift towards AI may reduce human interaction in education, leading to a lack of communication between students and teachers, which could have negative consequences for learning.

TL;DR

Hamsa Bastani discusses AI's impact on education, emphasizing concerns about over-reliance and diminished student engagement.

Episode

8:00
00:00:00
Dan Loney: Well as our kids get ready to head back to school, we
00:00:03
need to look at the role that artificial intelligence will be
00:00:07
playing in that learning process. You are seeing quite a
00:00:10
few school districts looking to figure out how they are going to
00:00:15
incorporate it into their processes this year and beyond.
00:00:19
Pleasure to be joined by Hamsa Bastani, who is an Associate
00:00:22
Professor of Operations, Information and Decisions here
00:00:25
at the Wharton School. Hamsa, great to talk to you. How are
00:00:27
you today?
00:00:28
Great. Thank you so much for having me, Dan.
00:00:30
You know, I mean, we have AI conversations so much about so
00:00:34
many different things. This is not a surprise that we're having
00:00:37
one about education. But I guess the question is just how it will
00:00:42
be included— not necessarily in the college process. We're
00:00:45
seeing that already. But in high schools, in grade schools, what
00:00:49
are you starting to see and hear from from some school districts?
00:00:53
Yeah, I actually just got off a conversation with some of
00:00:57
the teachers in in a high school, and they were talking
00:01:00
about how this year they're going to start using Google
00:01:03
Suite in the class. So they'll have Chromebooks for every
00:01:06
student, and they're going to have access to Gemini and other
00:01:10
tools like NotebookLM, which is unfettered access to AI. One of
00:01:15
the things I've talked about in my research is that, you know,
00:01:17
giving students unfettered access to AI can harm their
00:01:20
learning, because they actually tend to over-rely on those
00:01:22
tools. The number one question they always ask is, what's the
00:01:25
answer? So I'm asking them, you know, why are you choosing
00:01:29
that instead of, you know, something like Khan Academy or
00:01:31
one of these ed tech tools that maybe has better built
00:01:35
guardrails to support learning, or a Socratic learning method? And
00:01:39
they said that ultimately, you know, our kids are going to go
00:01:41
into the workplace and use these tools with unfettered access,
00:01:45
and so that's what we're trying to prepare them for.
00:01:47
But are the kids at this point ready to have unfettered access?
00:01:51
Like, have they— have they learned enough about what AI is
00:01:55
and how it can impact them, that we could just go ahead
00:01:59
and let them, you know, kind of get going with this?
00:02:02
I don't think so. So that's what I worry about. So as a
00:02:05
researcher, it's kind of an exciting time. But as a parent
00:02:07
and an educator, it's not a great time. I think it's very
00:02:10
concerning. I mean, I don't think anyone knows the answer,
00:02:13
but what we've seen from at least our research
00:02:15
studies is that students need to build the fundamental skills
00:02:19
first and then they can effectively use AI tools. And
00:02:23
even then, you might have some worries about de-skilling but
00:02:25
if you don't have the basic fundamental skills down, then
00:02:29
it's very difficult to even assess the outputs that AI is
00:02:32
producing. And then it's also a huge cognitive load for them,
00:02:35
because they're trying to process all this new
00:02:36
information, so they can't actually check the outputs and
00:02:39
collaborate effectively with these tools. So I worry about
00:02:42
that. The other thing I worry about is just taking away their
00:02:45
sense of accomplishment, right? One thing that we see is— and
00:02:48
this is so important for kids, you know, that they have to feel
00:02:51
that they have something to contribute, that they did
00:02:53
something that they can be proud of. And when you're just
00:02:55
prompting an AI tool and reporting back those results,
00:03:00
you don't have that. And that's one of the reasons we see
00:03:03
diminished motivation and engagement.
00:03:05
Is there also an element of this, that if they are going to do
00:03:09
unfettered access, that they feel this is the easiest way to
00:03:13
implement it. I'm speaking about school districts.
00:03:15
- Yeah. - Without necessarily having to
00:03:18
make the investment on the teaching side,
00:03:21
on the learning side— because we know, with a lot of school
00:03:23
districts right now, budgets are tight already, and it's hard to
00:03:27
add new things to what they already have in place.
00:03:31
Yeah, I think it's very much the path of least resistance, right?
00:03:36
It takes a lot of work to go figure out, what are the right
00:03:39
guardrails, what are the right pedagogical innovations that you
00:03:42
can use to leverage these tools? And, you know, like Ethan
00:03:45
Mollick and I've also been talking about like, it's
00:03:48
actually difficult that that's an open research question. It
00:03:50
takes a lot of exploration, creativity and work, and school
00:03:54
teachers are not paid enough to do that work. They have no
00:03:58
dedicated time or training to do that. Administrators, like you
00:04:01
said, they have, you know, limited budgets. Just giving
00:04:04
everybody access to, you know, one of these Google Gemini Suite
00:04:08
or OpenAI subscriptions is kind of a cheap investment, right?
00:04:13
And so it's kind of easier and it's less likely to be
00:04:17
criticized. So I think it's kind of just going down the path of
00:04:19
least resistance. And you see teachers reacting the same way.
00:04:22
They're very much going back to— a bunch of them are like, "Can we
00:04:24
find good plagiarism detectors? Can we just have students write
00:04:27
in their blue notebooks?" Also things that are not going to
00:04:30
work. And I think, you know, without creating the time and
00:04:34
space to explore and understand this better, this is what you can get.
00:04:37
But something you said a little bit ago, really, let me circle
00:04:40
back to it, is— there is something about when a kid, a
00:04:44
child, comes up with an idea by themselves, on their own. It
00:04:49
becomes very successful in the classroom. That that's the
00:04:53
similar formula that they need to implement when they're out in
00:04:57
the workplace as well. We can't just rely on AI in the
00:05:01
workplace, because it's — for me, I mean, it's like acting like a
00:05:06
crutch. It's— it's— it will help you along, but it won't serve
00:05:10
the larger good.
00:05:12
I 100% agree with you. I mean, also, if you
00:05:15
could rely on the AI, then why do we need humans? We're going
00:05:17
to end up firing our entire workforce. So we need to train
00:05:22
people to add value above and beyond these AI outputs. And one
00:05:26
of the things that really bothered me was, my
00:05:28
colleagues and I ran a study on chess, right? We hear AI has been
00:05:32
much better than students for a long time, but people still play
00:05:34
chess for the love of the game. And one of the things we found
00:05:37
is that if we gave students— we followed them for about three
00:05:40
months. We gave them different AI tutoring platforms. If we
00:05:43
gave them the ability to click a button that lets you figure out
00:05:46
the answer, or give you the next move without having to think
00:05:49
through it, they kind of started getting addicted to using that
00:05:52
button. And they found chess less fun, because when you
00:05:55
figure out a really complicated move that, you know, gets you a
00:05:58
piece or wins you the game, that's when you feel great, even
00:06:01
though it's a lot of work and a lot of struggle to get there.
00:06:04
And so by illuminating this struggle, it's very difficult to
00:06:07
say no to that, because we don't like the struggle. We're also
00:06:10
removing the sense of accomplishment.
00:06:12
So then is the expectation— and I'll say this just from my
00:06:15
perspective of just talking with you here for a few minutes— that
00:06:19
while schools will implement AI, that this will still be a
00:06:23
learning process for the schools, to some degree, to
00:06:26
understand its uses, its implementation, how it will
00:06:31
impact students, you know, as we move forward? It may not be, you
00:06:35
know, totally 100% just put it in and don't worry about it ever
00:06:39
again. That there will have to be some watch and some
00:06:43
some research on just how it kind of focuses in to what
00:06:47
students deal with in schools?
00:06:49
My perspective is probably a little bit more pessimistic than
00:06:52
that. I guess— okay, so historically, we've had policies
00:06:56
that we've invested lots of money in, like one laptop per
00:06:58
child, or the LA iPad, where we just threw money and technology
00:07:02
at kids and hope they would learn better. And they have not
00:07:04
worked, and sometimes they even have negative effects. The other
00:07:08
especially pernicious thing, I think, about generative AI, is
00:07:10
that now kids are not seeking their teachers for help, so
00:07:14
we're losing the human connection. So we don't even
00:07:16
know what's going on with our students. They don't come to
00:07:19
office hours anymore. They don't ask for questions. They don't—
00:07:21
parents tell me that, you know, their kids don't come and ask
00:07:24
them for help with their math homework anymore, because
00:07:26
they can just ask ChatGPT. So how would we even know what's
00:07:29
going on with our kids? No one's— no one's talking to them, and
00:07:33
that combination, I really worry about.
00:07:36
Hamsa, great to talk with you today. Thanks very
00:07:39
much for your time.
00:07:39
Thank you, Dan.
00:07:41
Thank you. Hamza Bastani,
00:07:42
who's an Associate Professor of Operations, Information and
00:07:45
Decisions here at the Wharton School.

Episode Highlights

  • The Role of AI in Education
    As schools prepare for the new year, the integration of AI tools raises questions about student readiness and learning outcomes.
    “Are the kids ready for unfettered access to AI?”
    @ 01m 47s
    August 13, 2025
  • Concerns Over AI Dependency
    Hamsa Bastani warns that over-reliance on AI tools may harm students' learning and motivation.
    “We're removing the sense of accomplishment.”
    @ 06m 10s
    August 13, 2025

Episode Quotes

  • Students need to build the fundamental skills first before using AI tools.
    Schools Risk Overreliance and Lost Connection with Unrestricted AI in Learning
  • When you're just prompting an AI tool, you don't have that sense of accomplishment.
    Schools Risk Overreliance and Lost Connection with Unrestricted AI in Learning
  • If you could rely on AI, then why do we need humans?
    Schools Risk Overreliance and Lost Connection with Unrestricted AI in Learning

Key Moments

  • AI in Schools00:03
  • Student Readiness01:47
  • Learning Concerns02:10
  • Human Connection Loss07:10

Words per Minute Over Time

Vibes Breakdown

Related Episodes

What Will AI in Education Look Like?
August 13, 2024
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
11:54
What Will AI in Education Look Like?
New Wharton AI & Analytics Initiative – Dean Erika James Interview
May 31, 2024
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
08:18
New Wharton AI & Analytics Initiative – Dean Erika James Interview
Will AI Actually Replace Jobs?
May 15, 2026
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
12:31
Will AI Actually Replace Jobs?
2025 AI Predictions: What Trends Should We Expect?
December 30, 2024
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
13:47
2025 AI Predictions: What Trends Should We Expect?
Inside the Next Phase of AI: Agents and On-Device Intelligence
January 07, 2026
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
08:09
Inside the Next Phase of AI: Agents and On-Device Intelligence
How AI Is Reshaping Jobs, Skills, and Education in Real Time
July 30, 2025
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
10:04
How AI Is Reshaping Jobs, Skills, and Education in Real Time
How AI Is Reshaping Blue-Collar Work and Skills
April 15, 2026
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
10:07
How AI Is Reshaping Blue-Collar Work and Skills
How AI Is Changing the Skills Employers Look For
January 14, 2026
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
14:48
How AI Is Changing the Skills Employers Look For
Decision-Driven Analytics in the Era of AI
June 25, 2024
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
12:41
Decision-Driven Analytics in the Era of AI
How Does AI Impact Education? – Wharton Professor Ethan Mollick | AI in Focus Series
November 10, 2023
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
27:59
How Does AI Impact Education? – Wharton Professor Ethan Mollick | AI in Focus Series
The Future of AI at Wharton – Vice Dean Eric Bradlow on New AI & Analytics Initiative
June 05, 2024
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
16:53
The Future of AI at Wharton – Vice Dean Eric Bradlow on New AI & Analytics Initiative
Can AI Improve Financial Literacy? | Wharton's Ripple Effect Podcast
April 16, 2024
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
12:26
Can AI Improve Financial Literacy? | Wharton's Ripple Effect Podcast