Search Captions & Ask AI

Google Document Leak and AI Failures | Pivot

June 04, 2024 / 07:20

This episode discusses a major leak of 2,200 pages of internal Google documents related to its search division, revealing how Google ranks content and collects data from users. The conversation highlights Google's response to the leak, its AI issues, and the implications for its public image.

The hosts mention that Google claims the leaked documents are out of context, while the documents suggest that user clicks may influence website rankings, contradicting Google's previous statements. This raises questions about transparency and trust in Google's practices.

They also address Google's AI problems, particularly the inaccuracies in AI-generated answers that have appeared in search results, including bizarre suggestions like putting glue on pizza. The hosts express concerns about the impact of these errors on Google's reputation.

Discussion turns to CEO Sundar Pichai's leadership and the perception that Google has been slow to adapt to competition from companies like Microsoft and OpenAI. The hosts argue that while the narrative around Google is negative, the company's financial performance remains strong.

Finally, they emphasize the need for journalists to critically evaluate Google's public statements and not simply accept them as fact, especially in light of the ongoing scrutiny from the Justice Department.

TL;DR

Google faces backlash from leaked documents revealing questionable search practices and AI inaccuracies, raising concerns about transparency and leadership.

Video

00:00:00
Google is dealing with a Fallout from a
00:00:01
massive leak after 2 200 pages of
00:00:04
documents from inside its search
00:00:06
division were shared by SEO experts the
00:00:08
documents detail the data that Google
00:00:10
collects from websites and users they
00:00:12
offer an unprecedented look at the
00:00:14
search process and how content is ranked
00:00:18
uh Google is saying of course that uh
00:00:20
these are out of context um the document
00:00:23
suggest that Google might have misled
00:00:25
the public in terms of ranking content
00:00:27
uh uh it denied in the P that users
00:00:30
click clicks play a role in ranking
00:00:32
websites but leak documents indicate
00:00:34
otherwise they're saying actually it's
00:00:36
not what it says um it's not it's not
00:00:39
the best thing at the same time it has
00:00:41
an AI problem on its hands speaking of
00:00:43
the current days that's its old business
00:00:45
the company is scaling back on the new
00:00:48
uh AI overviews feature the one that put
00:00:50
some wildly incorrect AI generated
00:00:52
answers at the top of search results
00:00:54
some are correct let's be fair uh some
00:00:56
of the major reported errors included
00:00:57
users being told to put glue on Pizza
00:00:59
that was the famous one on a claim that
00:01:01
John F Kennedy graduated from college in
00:01:03
1993 um wow there's a lot going on at
00:01:06
Google um they're going to disable the
00:01:09
misleading advice uh limiting answers
00:01:12
from some sites um they had a similar
00:01:15
problem with their image tool if you
00:01:16
remember it was too woke whatever um you
00:01:20
know these things work themselves out my
00:01:22
issue with these companies
00:01:24
is away from the the leaked documents is
00:01:27
they're always beta testing on users
00:01:29
without about putting out products that
00:01:31
are fully baked that's always been my
00:01:33
experience with Silicon Valley um I
00:01:35
don't think this is a good look for
00:01:36
Google it makes it look like they're not
00:01:38
competitive with Microsoft openi and
00:01:40
meta um thoughts I'll turn it back to
00:01:42
you and my only observation because I
00:01:44
think you know more about this than I do
00:01:45
my only observation is that it feels
00:01:47
from an observations of a bystander that
00:01:50
Google got caught flat-footed and their
00:01:53
investors and the entire world said let
00:01:54
me get this it was invented here and
00:01:56
everyone's making trillions but us and I
00:01:59
think that the ultimate like hurry up
00:02:02
and catch up like you better hurry up
00:02:04
has resulted in kind of a ready ready
00:02:07
fire aim mentality that's haunting them
00:02:09
a little bit because I think they feel
00:02:10
real pressure to catch up and they do
00:02:15
people internally I I just can't imagine
00:02:17
that QA hasn't been a little bit more
00:02:18
promiscuous here because they need to
00:02:19
show their investors that they are
00:02:21
catching up but you know there so much
00:02:23
better than I do I I know nothing about
00:02:25
this well you know these leaks these
00:02:27
search leaks is Google has always sort
00:02:29
of been such a formative company in
00:02:30
terms of We're the better people we're
00:02:32
the you know don't be evil they always
00:02:34
had that nonsense when you knew you know
00:02:37
they were doing all kinds of stuff
00:02:39
behind the scenes that weren't in line
00:02:40
with what they said they were doing um
00:02:43
this search leak is interesting and it's
00:02:44
an important and big deal that they had
00:02:47
been sort of doing search in a different
00:02:49
way now again it's only 2 200 Pages
00:02:52
they're older some of them um the fact
00:02:55
that they were doing whether user clicks
00:02:57
played a role in ranking websites um
00:03:00
they had in they had insisted they were
00:03:02
giving you the best things versus what
00:03:03
was most popular as I recall um I'm not
00:03:06
sure if the leak is that damaging but it
00:03:09
does suggest you know that they weren't
00:03:11
being fully honest with people which is
00:03:13
I think a disease of all these companies
00:03:16
completely disease all these companies
00:03:18
I'm not so much focused on that although
00:03:19
it is interesting um but you're right
00:03:22
this is this they they have been slow
00:03:24
slow slow and I think a lot of people
00:03:25
are complaining about CEO Sundar Pai as
00:03:28
being indecisive I think that's been a
00:03:30
take on him for many years now um and
00:03:33
not being fast enough and I you know
00:03:35
I've had that experience when he when he
00:03:37
they were very slow to Cloud I had lunch
00:03:39
with him I'm like why exactly are you
00:03:41
letting at AWS dominate when you have
00:03:43
much this is your area you know and he
00:03:45
was like well you know he's a very
00:03:48
considered person and I think in this
00:03:50
case they shouldn't be putting out
00:03:52
products that that are embarrassing
00:03:54
because they're a worldwide I mean
00:03:56
they're they're the most consumer facing
00:03:58
of all these companies more than
00:04:00
Microsoft meta I suppose um but they're
00:04:03
the most consumer facing and they're
00:04:05
known what I thought was amazing is this
00:04:08
is a company known for searching and
00:04:10
getting you the answer you want by
00:04:12
pointing you to the answer then they
00:04:14
give you the answer and it's wrong it
00:04:16
ruins the brand in seconds right isn't
00:04:18
that their whole promise of being
00:04:20
correct or being helpful I I don't know
00:04:23
from a brand perspective I think it's
00:04:25
disastrous yeah but narratives have
00:04:27
momentum and the momentum is against
00:04:29
cator in alphabet right now they're seen
00:04:31
as they're seen as uh being disrupted in
00:04:34
the classic case of the innovators
00:04:35
dilemma where they didn't want to
00:04:36
challenge this to booth called Surge and
00:04:39
let other people come around them and
00:04:41
disrupt it but so so the The Narrative
00:04:44
is negative and some of the things you
00:04:45
were talking about uh where he's he
00:04:48
quote unquote doesn't make decisions
00:04:49
quickly if the narrative was positive
00:04:51
everyone would be saying that he's a
00:04:52
thoughtful mature business leader that
00:04:54
the world needs right now because if you
00:04:55
look at the numbers the actual numbers
00:04:58
the stock is up 37% in the last 12
00:05:00
months I mean the company continues to
00:05:03
perform it's touching I'm I think the
00:05:05
stock is at an all-time high it's
00:05:08
outperformed even the
00:05:10
S&P I I think quite frankly I think
00:05:13
these stories are a little bit
00:05:14
I think they make for clickbait I think
00:05:16
they're embarrassing interesting but and
00:05:18
you're right it might impact the brand
00:05:20
because the media picks up on it because
00:05:21
they're funny and it's like seeing it's
00:05:24
tabloid but the reality is they continue
00:05:26
to perform this was this was my big Tech
00:05:28
stock pick for 24 they are firing on
00:05:32
they have not given up any ground on
00:05:34
search their Cloud business is you know
00:05:37
firing on all 12,000 cylinders YouTube
00:05:39
is the most dominant video platform
00:05:41
among young people and they are trying
00:05:44
fast to catch up and AI I I don't The
00:05:47
Narrative right now is is is bad and
00:05:50
momentum is against them but the the
00:05:53
data gets in the way of the narrative
00:05:54
here this company is performing really
00:05:56
well y That's a fair point that's a fair
00:05:58
point I just don't think a thing like
00:05:59
this this leak comes out when they're
00:06:00
under the justice department scrutiny
00:06:03
and this idea it works well for the
00:06:05
people that are trying to slow them down
00:06:06
for definitely for the justice
00:06:08
department right it shows it shows them
00:06:11
you know saying one thing and doing
00:06:14
another I think it's um someone the guy
00:06:17
who one of the people who leaked this
00:06:18
information I think or he had this
00:06:20
information where's this guy's name
00:06:21
fishkin is a veteran search engine
00:06:23
optimization industry told the the The
00:06:26
Verge um you know here's the last part
00:06:29
which I thought was important
00:06:30
journalists and Publishers of
00:06:31
information about SEO and Google search
00:06:33
need to stop uncritically repeating
00:06:35
Google's public statements and take a
00:06:36
much harsher more adversarial view of
00:06:38
the search Giants Representatives when
00:06:39
Publications repeat Google's claims as
00:06:41
though they're a fact they're helping
00:06:42
Google spin a story that's only useful
00:06:44
the company and not to practitioners
00:06:45
users are public the reason why that is
00:06:48
important is because everybody that is a
00:06:50
black box nobody gets to see the inside
00:06:51
of and they're just starting to see it
00:06:54
right and that's and it you know it's
00:06:55
not what they did a lot of people get
00:06:57
those sort of erroneous answers I mean
00:06:59
how many consumers were actually exposed
00:07:01
to that yeah I don't know I don't know
00:07:03
it's just I I don't know and in this
00:07:05
case this is the about the leak
00:07:07
documents I think it just it's not a
00:07:09
it's not a great Public Image for a
00:07:10
company in the middle of a of a justice
00:07:12
department thing so we'll see where it
00:07:14
goes

Badges

This episode stands out for the following:

  • 70
    Most shocking
  • 70
    Most talked-about
  • 60
    Most surprising
  • 60
    Most controversial

Episode Highlights

  • Google's Document Leak
    A massive leak reveals Google's internal documents, suggesting they misled the public about search rankings.
    “Google might have misled the public in terms of ranking content.”
    @ 00m 23s
    June 04, 2024
  • AI Overviews Feature Scaling Back
    Google is scaling back on its AI overviews feature after generating wildly incorrect answers.
    “Users were told to put glue on pizza!”
    @ 00m 57s
    June 04, 2024
  • Public Image Under Scrutiny
    The leaked documents raise concerns about Google's public image amidst ongoing scrutiny from the Justice Department.
    “It's not a great Public Image for a company in the middle of a Justice Department thing.”
    @ 07m 10s
    June 04, 2024

Episode Quotes

Key Moments

  • AI Errors00:48
  • Public Image Crisis07:10

Words per Minute Over Time

Vibes Breakdown

Related Episodes