Search Captions & Ask AI

This tool detects media bias using OpenAI's GPT-4

November 01, 2024 / 02:02

This episode discusses misinformation and media bias, featuring the Media Bias Detector developed by the CSS Lab at Penn. The project analyzes stories from ten prominent publishers across the political spectrum.

The conversation highlights how bias manifests in journalism through selection and framing of stories. It explains how journalists choose which facts to present and how they can influence the tone of the narrative.

Listeners learn about the role of GPT-4 in classifying news articles by topics, events, tone, and political leanings. The episode emphasizes the importance of understanding these biases, especially in the context of the upcoming US presidential election.

The Media Bias Detector serves as a free resource for consumers to better grasp the media's choices and the underlying biases in news coverage.

TL;DR

This episode covers the Media Bias Detector and its role in analyzing media bias during the US presidential election.

Episode

2:02
00:00:00
[Music]
00:00:03
everybody knows that misinformation is a
00:00:06
big problem in the world right now but
00:00:09
when we talk about misinformation we
00:00:11
almost always mean false information our
00:00:14
work leads us to believe that in fact
00:00:16
bias can be a much bigger problem so
00:00:19
that's what this project is really
00:00:22
intended to uncover developed by the CSS
00:00:25
Lab at Penn a joint venture between
00:00:27
Warden pen engineering and the annenburg
00:00:29
school for community ation the media
00:00:31
bias detector tracks and classifies the
00:00:33
top stories published by 10 prominent
00:00:34
Publishers spending the political
00:00:36
Spectrum in close to real time articles
00:00:38
are fed into GPT 4 the large language
00:00:41
model developed by open AI that
00:00:42
underlies Chad GPT and classified by
00:00:44
topics and events news type tone and
00:00:47
political lean every week research
00:00:50
assistants then monitor a random sample
00:00:51
of the gpt's labels to ensure the
00:00:53
model's accuracy remains high and
00:00:55
identify any necessary
00:00:57
adjustments there are two highlevel ways
00:00:59
in which uh we think bias can manifest
00:01:02
itself in journalism one is selection
00:01:06
which stories journalists choose to
00:01:07
write about which facts they choose to
00:01:10
highlight which people they choose to
00:01:11
quote and also framing how they spin the
00:01:14
evidence that they present to you you
00:01:16
can make your tone positive you can make
00:01:18
your tone negative and both these forms
00:01:20
of bias can have lot of impact on the
00:01:23
way the story reads and on the takeaway
00:01:25
that the reader gets from the story even
00:01:28
to the point where one can get a highly
00:01:30
misleading or even false impression of
00:01:33
what is going on even though every
00:01:35
sentence in the story might be correct
00:01:38
this year's US presidential election
00:01:40
presents a real-time high stakes
00:01:41
environment to observe and analyze the
00:01:43
choices media Publications are making
00:01:45
every day in their coverage the media
00:01:48
bias detector is a free resource
00:01:49
designed to help you as a consumer
00:01:51
better understand those choices and the
00:01:53
biases that exist behind them
00:01:56
[Music]

Episode Highlights

  • Understanding Media Bias
    The Media Bias Detector helps consumers recognize biases in news coverage.
    “Designed to help you as a consumer better understand those choices and the biases that exist behind them.”
    @ 01m 49s
    November 01, 2024

Episode Quotes

  • Bias can be a much bigger problem than false information.
    This tool detects media bias using OpenAI's GPT-4
  • One can get a highly misleading or even false impression of what is going on.
    This tool detects media bias using OpenAI's GPT-4

Key Moments

  • Misinformation Challenge00:03
  • Bias in Journalism00:16
  • Media Bias Detector01:49

Related Episodes

AI Bias Detection in Image Generators
January 27, 2025
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
19:20
AI Bias Detection in Image Generators
Clickable News
August 10, 2015
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
10:53
Clickable News
Big Brother is Watching Your Browsing
April 05, 2012
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
23:34
Big Brother is Watching Your Browsing
How Economic Modeling Can Identify Trends with Wharton Prof. Kent Smetters — Ripple Effect Podcast
October 10, 2023
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
14:49
How Economic Modeling Can Identify Trends with Wharton Prof. Kent Smetters — Ripple Effect Podcast
How Disinformation Spreads Online
November 18, 2025
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
20:49
How Disinformation Spreads Online
The Real Political Divide isn’t Democrat vs Republican
May 26, 2026
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
16:05
The Real Political Divide isn’t Democrat vs Republican
AI biases "are harder to hide" than human biases, says Wharton's Kartik Hosanagar
December 17, 2024
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
00:55
AI biases "are harder to hide" than human biases, says Wharton's Kartik Hosanagar
AI Agents Are Rewriting Marketing
May 01, 2026
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
13:18
AI Agents Are Rewriting Marketing
Who Made That Decision: You or an Algorithm?
March 25, 2019
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
31:49
Who Made That Decision: You or an Algorithm?
Diversity Is Critical for the Future of AI — Leading Diversity at Work
November 09, 2023
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
46:36
Diversity Is Critical for the Future of AI — Leading Diversity at Work
Building Better Recommendation Engines
December 04, 2015
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
13:19
Building Better Recommendation Engines
Baseball, Bias and Decision-Making
October 13, 2016
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
09:46
Baseball, Bias and Decision-Making