Search Captions & Ask AI

Rogg David SF

February 25, 2016 / 08:15

This episode discusses forecasting methods, the importance of research, and insights from Phil Tetlock. The guest shares experiences from the intelligence community and personal growth.

The conversation highlights the significance of understanding causal mechanisms and balancing probabilities when making forecasts. The guest emphasizes the value of daily engagement with forecasting questions to improve accuracy.

Connections made through forecasting are also discussed, including friendships formed with teammates from diverse locations such as South Africa and Spain. The guest reflects on the rewarding nature of the forecasting process and its impact on personal development.

Overall, the episode provides practical tips for aspiring forecasters and underscores the importance of a rational approach in predicting future events.

TLDR

The episode covers forecasting techniques, personal growth, and the importance of research in making accurate predictions.

Episode

8:15
00:00:08
I think who can look at things a lot of different ways and I'm not the most adept at it among the forecasters but
00:00:19
that's definitely my type so I was a good fit but I was also driven because I'm acutely aware of the trouble the
00:00:29
world is in and I think the as much as they have a dark side us organizations like I ARPA and the intelligence
00:00:41
community in general that need all the help they can get we are basically the good guys and so so there's plenty of
00:00:54
you know driving force behind my interest it's painfully clear that the more the
00:01:09
wiser and more thoughtful and rational you are the better you're going to do
00:01:14
and so I'm afraid you know that this kind of the same people who would do better a lot of different things that
00:01:25
require mental effort are the ones that rise to the top and forecasting I think what's special about forecasting is that
00:01:37
if you're a really natural researcher that can get you quite far and I just completely admire and am grateful to
00:01:55
those of us who are so good at it and who have you know far-flung connections to decision centers in the world it's
00:02:11
i'm sort of a free rider in that way so there are two things that are really
00:02:16
important and so I come from one side of that I'm a person who was a natural for
00:02:25
computer programming for example but not a natural for writing or researching easy-to-follow tip is do it every day
00:02:40
and every question that you're forecasting have a look every day to see if anything has changed you when things
00:02:52
do change it significantly tends to come as a surprise and if you missed that day
00:02:58
well you blew that forecast for that day the my approach is to try to think through causal mechanisms and and try to
00:03:12
think of all the influential factors that I can think of and and try to visualize scenarios and and balance
00:03:19
probabilities among scenarios things like that this is a little different than what I think most of us are led to
00:03:26
do by the training we've had which is it's not that the training doesn't cover
00:03:32
probability and that's critical but it's to look at the categories of the
00:03:41
questions we're forecasting and try to find parallels in the past and look for
00:03:47
rates of occurrence and try to use those rates I I think that's helpful as a
00:03:55
starting place but it's not going to get you a very good score if that's all you
00:04:02
do and I think the difference between you know sort of phoning it in and and getting a good score is understanding
00:04:17
the situation as well as you possibly can and and that's the what phil has Phil tetlock has called the inside view
00:04:24
as opposed to the outside view he emphasizes the people neglect the outside view but i think it's the inside
00:04:32
view that that really matters to get you exceptional forecast that that actually
00:04:40
could add could give real value anyway that's the inside view become comfortable with researching
00:04:54
problems have a great interest in what you're forecasting don't hesitate to dig
00:05:00
right in two you know study something new just get into it don't don't neglect
00:05:12
if you have any bent at all for statistics and probability bring it into play you know but that's kind of obvious
00:05:19
anyone who has that choice I guess actually that the this might come up in your last question I didn't forget but
00:05:32
part of the muscle you want is the muscle you want to strengthen intuitively is the muscle for balancing
00:05:43
scenarios against each other and sort of averaging out probabilities intuitively
00:05:49
waiting them properly things like that balancing things against each other intuitively that are things that are
00:05:56
pointing in opposite directions this is this is something to get better at and feel easier about by practicing
00:06:07
it's been huge and for first off you get exposed to a lot of wonderful people
00:06:18
whom you tend to maintain some degree of contact with I've had a couple of of my
00:06:27
teammates visit me at my house one who's from South Africa the other ones from
00:06:32
Spain it's true they were on washington for other reasons but that's an example
00:06:37
and I I'm glad to stay in touch with a lot of the four can factor there have
00:06:45
been others as well from the DC area anyways I'm glad to stay in touch with these new friends that's that's see
00:06:54
that's a big thing and just as big is there's nothing like reality focusing on
00:07:03
reality and how it works out and you tried to see the future and maybe it worked and maybe it didn't end you you
00:07:13
sort of mentally record it's there's feedback going on that's it's extremely
00:07:18
good feedback for turning you into a more rational person it's it makes you a
00:07:25
more balanced person a more rational person easier to live with perhaps I don't know but it's all good it's been
00:07:36
very rewarding and this doesn't mean that the forecaster shouldn't also be
00:07:42
rewarded in other ways but this myself is rewarding and I'm and I'm sure that
00:07:48
the others feel much much the same you

Episode Highlights

  • The Importance of Forecasting
    Understanding the world’s troubles drives effective forecasting. 'We are basically the good guys.'
    @ 00m 44s
    February 25, 2016
  • Daily Research Habit
    A daily look at forecasts can prevent missed opportunities. 'If you missed that day, you blew that forecast.'
    @ 02m 40s
    February 25, 2016
  • Inside vs Outside View
    Phil Tetlock emphasizes the inside view for exceptional forecasts. 'The inside view really matters.'
    @ 04m 22s
    February 25, 2016
  • Reality as Feedback
    Engaging with reality enhances rationality and balance. 'It's extremely good feedback for turning you into a more rational person.'
    @ 07m 18s
    February 25, 2016

Episode Quotes

  • I'm acutely aware of the trouble the world is in.
    Rogg David SF
  • It's painfully clear that the wiser you are, the better you'll do.
    Rogg David SF
  • Don't hesitate to dig right in and study something new.
    Rogg David SF
  • There's nothing like reality focusing on reality and how it works out.
    Rogg David SF
  • It's extremely good feedback for turning you into a more rational person.
    Rogg David SF

Key Moments

  • Awareness of World Issues00:26
  • Daily Research Tips02:40
  • Inside View Importance04:22
  • Reality Check06:59

Tension Over Time

Words per Minute Over Time

Vibes Breakdown