Search Captions & Ask AI

Rogg David SF

February 25, 2016 / 08:15

This episode features discussions on forecasting, decision-making, and the importance of understanding causal mechanisms. The guest emphasizes the need for daily engagement with forecasting questions and the significance of balancing probabilities among scenarios.

The conversation highlights the insights of Phil Tetlock regarding the inside and outside views in forecasting. The guest shares personal experiences in the forecasting community, including connections with teammates from various countries.

Key points include the value of research, statistics, and probability in making accurate forecasts. The guest also reflects on the rewarding nature of engaging with reality and the feedback loop that enhances rational thinking.

TL;DR

The episode discusses effective forecasting techniques and the importance of research and probability in decision-making.

Episode

8:15
00:00:08
I think
00:00:12
who can look at things a lot of
00:00:14
different ways and I'm not the most
00:00:17
adept at it among the forecasters but
00:00:19
that's definitely my type so I was a
00:00:23
good fit but I was also driven because
00:00:26
I'm acutely aware of the trouble the
00:00:29
world is in and I think the as much as
00:00:35
they have a dark side us organizations
00:00:38
like I ARPA and the intelligence
00:00:41
community in general that need all the
00:00:44
help they can get we are basically the
00:00:47
good guys and so so there's plenty of
00:00:54
you know driving force behind my
00:00:57
interest
00:01:02
it's painfully clear that the more the
00:01:09
wiser and more thoughtful and rational
00:01:13
you are the better you're going to do
00:01:14
and so I'm afraid you know that this
00:01:18
kind of the same people who would do
00:01:23
better a lot of different things that
00:01:25
require mental effort are the ones that
00:01:27
rise to the top and forecasting I think
00:01:32
what's special about forecasting is that
00:01:37
if you're a really natural researcher
00:01:41
that can get you quite far and I just
00:01:47
completely admire and am grateful to
00:01:55
those of us who are so good at it and
00:01:59
who have you know far-flung connections
00:02:02
to decision centers in the world it's
00:02:11
i'm sort of a free rider in that way so
00:02:15
there are two things that are really
00:02:16
important and so I come from one side of
00:02:20
that I'm a person who was a natural for
00:02:25
computer programming for example but not
00:02:29
a natural for writing or researching
00:02:36
easy-to-follow tip is do it every day
00:02:40
and every question that you're
00:02:43
forecasting have a look every day to see
00:02:45
if anything has changed you when things
00:02:52
do change it significantly tends to come
00:02:56
as a surprise and if you missed that day
00:02:58
well you blew that forecast for that day
00:03:01
the my approach is to try to think
00:03:07
through causal mechanisms and and try to
00:03:12
think of all the influential factors
00:03:14
that I can think of and and try to
00:03:16
visualize scenarios and and balance
00:03:19
probabilities among scenarios things
00:03:21
like that this is a little different
00:03:23
than what I think most of us are led to
00:03:26
do by the training we've had which is
00:03:30
it's not that the training doesn't cover
00:03:32
probability and that's critical but it's
00:03:36
to look at the categories of the
00:03:41
questions we're forecasting and try to
00:03:43
find parallels in the past and look for
00:03:47
rates of occurrence and try to use those
00:03:50
rates I I think that's helpful as a
00:03:55
starting place but it's not going to get
00:03:58
you a very good score if that's all you
00:04:02
do and I think the difference between
00:04:10
you know sort of phoning it in and and
00:04:14
getting a good score is understanding
00:04:17
the situation as well as you possibly
00:04:19
can and and that's the what phil has
00:04:22
Phil tetlock has called the inside view
00:04:24
as opposed to the outside view he
00:04:27
emphasizes the people neglect the
00:04:29
outside view but i think it's the inside
00:04:32
view that that really matters to get you
00:04:38
exceptional forecast that that actually
00:04:40
could add could give real value
00:04:43
anyway that's the inside view
00:04:49
become comfortable with researching
00:04:54
problems have a great interest in what
00:04:55
you're forecasting don't hesitate to dig
00:05:00
right in two you know study something
00:05:02
new just get into it don't don't neglect
00:05:12
if you have any bent at all for
00:05:15
statistics and probability bring it into
00:05:18
play you know but that's kind of obvious
00:05:19
anyone who has that choice I guess
00:05:26
actually that the this might come up in
00:05:29
your last question I didn't forget but
00:05:32
part of the muscle you want is the
00:05:36
muscle you want to strengthen
00:05:39
intuitively is the muscle for balancing
00:05:43
scenarios against each other and sort of
00:05:47
averaging out probabilities intuitively
00:05:49
waiting them properly things like that
00:05:52
balancing things against each other
00:05:55
intuitively that are things that are
00:05:56
pointing in opposite directions this is
00:05:59
this is something to get better at and
00:06:01
feel easier about by practicing
00:06:07
it's been huge and for first off you get
00:06:15
exposed to a lot of wonderful people
00:06:18
whom you tend to maintain some degree of
00:06:22
contact with I've had a couple of of my
00:06:27
teammates visit me at my house one who's
00:06:30
from South Africa the other ones from
00:06:32
Spain it's true they were on washington
00:06:34
for other reasons but that's an example
00:06:37
and I I'm glad to stay in touch with a
00:06:42
lot of the four can factor there have
00:06:45
been others as well from the DC area
00:06:48
anyways I'm glad to stay in touch with
00:06:50
these new friends that's that's see
00:06:54
that's a big thing and just as big is
00:06:59
there's nothing like reality focusing on
00:07:03
reality and how it works out and you
00:07:05
tried to see the future and maybe it
00:07:09
worked and maybe it didn't end you you
00:07:13
sort of mentally record it's there's
00:07:15
feedback going on that's it's extremely
00:07:18
good feedback for turning you into a
00:07:21
more rational person it's it makes you a
00:07:25
more balanced person a more rational
00:07:28
person easier to live with perhaps I
00:07:32
don't know but it's all good it's been
00:07:36
very rewarding and this doesn't mean
00:07:40
that the forecaster shouldn't also be
00:07:42
rewarded in other ways but this myself
00:07:45
is rewarding and I'm and I'm sure that
00:07:48
the others feel much much the same
00:08:06
you

Episode Highlights

  • The Importance of Perspective
    Understanding different perspectives is crucial for effective forecasting.
    “I think who can look at things a lot of different ways...”
    @ 00m 12s
    February 25, 2016
  • The Role of Rationality
    Being thoughtful and rational significantly improves forecasting outcomes.
    “It's painfully clear that the wiser and more thoughtful you are, the better you'll do.”
    @ 01m 02s
    February 25, 2016
  • The Inside View
    Phil Tetlock emphasizes the importance of the inside view for exceptional forecasts.
    “The inside view really matters to get you exceptional forecasts.”
    @ 04m 32s
    February 25, 2016
  • Continuous Learning
    Embrace new knowledge and research to enhance your forecasting skills.
    “Don't hesitate to dig right in and study something new.”
    @ 04m 55s
    February 25, 2016
  • Feedback and Growth
    Real-world experiences provide valuable feedback for becoming more rational and balanced.
    “It's extremely good feedback for turning you into a more rational person.”
    @ 07m 18s
    February 25, 2016

Episode Quotes

  • I'm acutely aware of the trouble the world is in.
    Rogg David SF
  • It's painfully clear that the wiser and more thoughtful you are, the better you'll do.
    Rogg David SF
  • The inside view really matters to get you exceptional forecasts.
    Rogg David SF
  • Don't hesitate to dig right in and study something new.
    Rogg David SF
  • It's extremely good feedback for turning you into a more rational person.
    Rogg David SF

Key Moments

  • Awareness of Trouble00:26
  • Wiser Decisions01:02
  • Inside View Importance04:32
  • Embrace Learning04:55
  • Valuable Feedback07:18

Words per Minute Over Time

Vibes Breakdown

Related Episodes

Superforecaster Full Video
February 26, 2016
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
01:01:33
Superforecaster Full Video
Chang Welton SF
February 25, 2016
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
08:57
Chang Welton SF
Roth Steve SF
February 25, 2016
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
06:12
Roth Steve SF
Building Better Forecasters
May 18, 2015
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
12:14
Building Better Forecasters
Why an Open Mind Is Key to Making Better Predictions
October 02, 2015
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
26:30
Why an Open Mind Is Key to Making Better Predictions
Rich Elaine SF
February 25, 2016
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
06:53
Rich Elaine SF
McCullough David SF
February 25, 2016
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
06:46
McCullough David SF
Beugoms, Jean Pierre
February 26, 2016
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
11:26
Beugoms, Jean Pierre
Untangling Skill and Luck in Business
March 06, 2013
Captions not detected. You can watch the video, but not search it. If you think this is an error, contact support.
21:21
Untangling Skill and Luck in Business