Search Captions & Ask AI

This tool detects media bias using OpenAI's GPT-4

November 01, 2024 / 02:02

This episode discusses misinformation, media bias, and the Media Bias Detector project developed by the CSS Lab at Penn. Key topics include the classification of news stories, the role of GPT-4 in analyzing media content, and the impact of selection and framing in journalism.

The Media Bias Detector tracks articles from ten prominent publishers across the political spectrum, classifying them by topics, tone, and political leanings. Researchers monitor the accuracy of the model's classifications weekly, ensuring it remains reliable.

Listeners learn how bias can manifest in journalism through story selection and framing. The episode highlights the importance of understanding these biases, especially in the context of the upcoming US presidential election.

The project aims to provide consumers with a better understanding of media choices and the biases that influence news coverage.

TLDR

The episode covers media bias and the Media Bias Detector project at Penn.

Episode

2:02
00:00:00
[Music] everybody knows that misinformation is a big problem in the world right now but
00:00:09
when we talk about misinformation we almost always mean false information our work leads us to believe that in fact
00:00:16
bias can be a much bigger problem so that's what this project is really intended to uncover developed by the CSS
00:00:25
Lab at Penn a joint venture between Warden pen engineering and the annenburg school for community ation the media
00:00:31
bias detector tracks and classifies the top stories published by 10 prominent Publishers spending the political
00:00:36
Spectrum in close to real time articles are fed into GPT 4 the large language model developed by open AI that
00:00:42
underlies Chad GPT and classified by topics and events news type tone and political lean every week research
00:00:50
assistants then monitor a random sample of the gpt's labels to ensure the model's accuracy remains high and
00:00:55
identify any necessary adjustments there are two highlevel ways in which uh we think bias can manifest
00:01:02
itself in journalism one is selection which stories journalists choose to write about which facts they choose to
00:01:10
highlight which people they choose to quote and also framing how they spin the evidence that they present to you you
00:01:16
can make your tone positive you can make your tone negative and both these forms
00:01:20
of bias can have lot of impact on the way the story reads and on the takeaway that the reader gets from the story even
00:01:28
to the point where one can get a highly misleading or even false impression of what is going on even though every
00:01:35
sentence in the story might be correct this year's US presidential election presents a real-time high stakes
00:01:41
environment to observe and analyze the choices media Publications are making every day in their coverage the media
00:01:48
bias detector is a free resource designed to help you as a consumer better understand those choices and the
00:01:53
biases that exist behind them [Music]

Episode Highlights

  • Understanding Media Bias
    This project uncovers how bias manifests in journalism, beyond just misinformation.
    “Bias can be a much bigger problem than false information.”
    @ 00m 16s
    November 01, 2024
  • The Media Bias Detector
    A tool to help consumers understand media choices and biases in real-time.
    “The media bias detector is a free resource designed to help you.”
    @ 01m 49s
    November 01, 2024

Episode Quotes

  • Misinformation is a big problem in the world right now.
    This tool detects media bias using OpenAI's GPT-4
  • Bias can be a much bigger problem than false information.
    This tool detects media bias using OpenAI's GPT-4
  • You can make your tone positive, you can make your tone negative.
    This tool detects media bias using OpenAI's GPT-4
  • One can get a highly misleading or even false impression of what is going on.
    This tool detects media bias using OpenAI's GPT-4
  • The media bias detector is a free resource designed to help you.
    This tool detects media bias using OpenAI's GPT-4

Key Moments

  • Misinformation Problem00:06
  • Bias Uncovered00:16
  • Election Stakes01:40
  • Resource for Consumers01:49