Search Captions & Ask AI

Why Happiness Isn't Everything

December 19, 2014 / 11:36

This episode discusses the relationship between happiness data and decision-making, featuring a study on medical students during the residency match process.

The conversation highlights how economists are using happiness data to forecast choices, particularly in public policy valuation. The guest explains that happiness data can predict decisions about 70 to 80% of the time.

However, the episode also reveals a significant limitation: happiness data does not accurately reflect the trade-offs individuals make when choosing between options, such as prestige versus location in residency choices.

The guest shares insights from a large-scale survey conducted with 23 medical schools in the U.S., where students reported their preferences and predicted happiness levels for different residency programs.

Ultimately, the discussion emphasizes the complexity of using happiness data in economic analysis, suggesting that while it can aid in forecasting, it falls short in understanding nuanced trade-offs.

TLDR

Happiness data can forecast decisions but fails to accurately reflect trade-offs in choices, as shown in a study of medical students.

Episode

11:36
00:00:05
and so for the group of us uh at a very high level we're interested in understanding the relationship between
00:00:10
the trade-offs people are willing to choose to make and the trade-offs that determine their happiness or a little
00:00:15
more practically we're interested in thinking about situations where you have
00:00:18
data on what makes people happy but you don't have data on what people choose
00:00:22
and you want to try to use this happiness data to forecast things about their their decision- Mak process uh so
00:00:27
to give you a little bit of background uh there's an increasing practice in economics of trying to use happiness
00:00:32
data to augment uh typical choice-based analysis uh so to give you a you particular example let's say we were
00:00:38
trying to think about how we should uh value a public policy and figure out how much a particular person would be
00:00:43
willing to pay to have that public policy in place so one way of approximating this is by taking uh
00:00:49
existing happiness data estimating how policies like this affect happiness in the past estimating how money plays into
00:00:56
determining happiness and then figuring out the trade-off between these two things and we could use that to
00:01:01
basically determine uh the amount of money a person would be willing to pay to put that policy in place under the
00:01:06
assumption that choices and happiness are aligned right so that people are choosing whatever makes them most happy
00:01:12
so that's the practice that's currently being followed uh by by some economists
00:01:16
and we're basically interested in assessing that trying to figure out if these two trade-offs really do reflect
00:01:20
one another uh so to get at that we ran a large scale study of medical students as they were participating in the
00:01:26
medical residency match uh so in case you're unfamiliar with the training of
00:01:30
doctors in the United States uh after uh young doctors uh graduate from medical school they go through a period of
00:01:37
several years uh where they get really intensive Hands-On training in their specialty called a medical residency
00:01:42
they have to go through an elaborate process to match from their medical school to a residency and so at this
00:01:47
point you're probably asking well why are we talking about medical students now and we were just talking about
00:01:51
happiness and happiness data and the reason why we're looking at this particular setting is because it has
00:01:56
these really nice properties that allow us to get really high quality Cho data side by side with really high quality
00:02:02
happiness data so in order to go through this matching process I just described medical students have to basically uh go
00:02:08
through a period of interviewing with medical schools and consider really carefully the trade-offs they're willing
00:02:13
to make about say The Prestige of a school versus a city location or things like this and then determine their
00:02:19
choice ordering over those schools and say this is my first choice school this is my second choice school and so on and
00:02:25
actually make a list like that and submit it to a centralized matching agency and that list is to determine the
00:02:30
final assignment of where everyone will go uh and that mechanism was designed very carefully to make sure that
00:02:35
students uh it's in their own best interest to report their preferences truthfully so basically we'll be
00:02:41
piggybacking off of that existing field mechanism we'll be seeing their choice
00:02:44
ordering uh and pairing that up with excellent survey data about how happy they think they'll be at these different
00:02:50
options and the trade-offs they're making as they're making this decision
00:02:53
so to generate that happiness data I just described we ran a large large scale survey of medical students as they
00:02:59
participated in the 2012 residency match uh so in the leadup to that residency match I contacted basically all the
00:03:06
medical schools in the United States uh and uh you know due to my uh my my uh requests I got 23 schools to agree to
00:03:14
participate and at those schools students going through the matching process uh were given the opportunity to
00:03:19
participate in a web survey where they could uh basically report their top four choices we get to see their choice
00:03:25
ordering over them we also get to ask them how happy do you think you would be if you went to this res how happy do you
00:03:30
think you would be if you went to this other residency and also for these residencies we collect all the features
00:03:34
that they're trading off when they're making this decision things like Prestige or stady quality or how much
00:03:39
their spouse cares about being in that location things like that so with this data we now have everything we need to
00:03:45
basic uh to basically put happiness data and choice data side by side and uh kind
00:03:50
of compare the analysis that you could do with with each of these these types of data so our main results from this uh
00:03:55
are basically twofold so the first main one is that uh Happy data is actually reasonably useful for forecasting
00:04:02
choices in this setting uh so if you were to say know that some resident or some future medical Resident was
00:04:08
considering between two options we don't know which one he chooses but we just
00:04:11
know that one of them uh he thinks will make him happier 70 to 80% of the time that's the one he will choose um now on
00:04:19
one hand you know we know that people like to be happy right that's not that
00:04:21
shouldn't be surprising but on the other hand this is a particular setting where
00:04:24
we don't really think decisions are are necessarily made just to be happy right
00:04:29
no one's going to to a medical residency to have fun uh this is a big investment
00:04:33
and important decision in their lives and even in this situation uh happiness data is very useful for forecasting so
00:04:38
that's you know a positive uh spin on how to use happiness data in economic settings there's a bit of a negative
00:04:44
side uh in our data too that's the second main result and that's if you try
00:04:47
to use happiness data to infer the tradeoffs people are willing to make so again like how how they tradeoff
00:04:53
Prestige against City quality for example we find that the trade-offs you would estimate from happiness data are
00:04:59
pretty dramatic rically different than the trade-offs you would estimate from Choice data uh these different factors
00:05:04
wait very different uh very differently in determining these two things uh and that's a bit of a problem for a lot of
00:05:09
economic analysis because for uh you know many questions economists are asking understanding tradeoffs is really
00:05:15
the key thing we're trying to understand how we how we price various things you
00:05:18
know how we trade off one attribute of a of a good versus another things like that and for these types of questions
00:05:24
happiness data is not getting us the kind of answers we need um so kind of overall our main goal in this entire
00:05:30
project was trying to get a better sense of how to how to use happiness data in economic applications and how far you
00:05:36
can go with that and we found some positive results that it is actually useful for just raw forecasting of
00:05:41
choices uh but some negative results that it doesn't do a great job in answering nuanced questions about how
00:05:46
you trade off different attributes of a of an option you face so one way or one dimension where
00:05:55
you can see differences in the way trade-offs are made across happiness data and across Choice data is looking
00:06:00
at the importance of say considerations about your family's wellbeing or your
00:06:03
spouse's well-being uh so if we compare how important uh you know say your spouse's happiness is in determining
00:06:10
your choices it's actually dramatically more important uh in determining your
00:06:15
choices than it is in determining your predictions about how happy you'll be so
00:06:18
if we're thinking about trading off say going to a more prestigious residency in
00:06:22
a location that your spouse likes less you're more likely to choose that and
00:06:25
you're more likely to wait your spouse's uh your spouse's opinion more heavily in
00:06:29
your choice then you would in your forecast about how happy you'll be in the future so in some sense this could
00:06:33
be evidence that people are willing to uh to sacrifice their own happiness uh you know to to benefit their spouse in
00:06:39
these kind of decisions I came at this problem from the point of view of an economist but it
00:06:47
does have a lot of implications for how people uh conduct you know General exercises and marketing so uh reasonably
00:06:53
commonly uh you know both economists and marketers find themselves in situations
00:06:57
where we have lots of data about say customer satisfaction consumer satisfaction happiness things like that
00:07:02
and we're trying to infer from that how people you know value different attributes of a product we're trying to
00:07:06
sell uh how people make trade-offs in various economic environments and the results I was discussing for economists
00:07:12
translate immediately to the kind of same kind of decisions in marketing environments so basically if you're
00:07:17
trying to forecast what your consumers will choose or what they will like our results suggest that happiness data can
00:07:23
help you make those kind of forecasting uh forecasts accurately however uh if you're trying to infer more nuanced
00:07:29
question questions about how say customers are trading off different attributes of a product you're trying to
00:07:33
sell our results suggest that happiness data doesn't really get you all the way
00:07:37
there to estimating those kind of uh tradeoffs so I think this study speaks to uh to to countering misperceptions on
00:07:47
two ends of a spectrum right on on one end of the spectrum uh some people believe that happiness is basically
00:07:52
everything that maximizing happiness is the ultimate goal of all of our actions and our research suggests that at least
00:07:58
when we're thinking about how happiness is currently measured in surveys and
00:08:01
things like that that's not the case that happiness is something that's very
00:08:04
important to people and it's an important goal they're pursuing uh but people will explicitly trade off the
00:08:09
pursuit of happiness against uh you know to to pursue other goals uh now on the other end of the spectrum I think some
00:08:15
people believe that happiness is not particularly informative for economic analysis uh this is a view held by by
00:08:20
many economists this is sort of a frivolous psychological variable that isn't really fundamentally related to
00:08:25
how we make choices and our results actually suggest that's not quite right either um so even in this setting that
00:08:32
is unambiguously you know a very serious decision a very important decision not made for fun by any by any stretch of
00:08:37
the imagination uh understanding or having access to happiness data really helps us understand how the decision
00:08:42
process is made and helps us forecast the choices people will make so there are a few things that set
00:08:50
my research apart from uh other analysis done looking at the alignment between choice and happiness and I think the
00:08:56
main thing is we're coming at it from a little bit of a different attitude uh so
00:08:59
there's a great deal of research out there demonstrating that people don't
00:09:02
always choose what'll make them happy but the way that's typically discussed
00:09:06
and the way that's typically presented is as evidence that people are making
00:09:09
some sort of mistake or or they're bad at forecasting so the idea is that they
00:09:13
would they're trying to to maximize their happiness and the only thing that's stopping them is either they they
00:09:18
messed up the decision somehow or they they guessed wrong about what would make them most happy and so on and thus we
00:09:24
can attribute the entire gap between Choice data and happiness data just to these mispredictions
00:09:29
we were coming at it from a little bit of a different a different kind of Bas background we were thinking well okay
00:09:34
you know maybe mispredictions are important but also it could be that people aren't even necessarily trying to
00:09:39
maximize happiness maybe they could just be thinking of it as one of many goals they're pursuing and explicitly trade
00:09:44
off that goal uh against other goals and so this led us to look at a situation where people are making uh a decision
00:09:51
that's very considered very deliberated very high stakes where we're not
00:09:55
particularly worried about mistakes driving any deviations we see uh and basically trying to see if we
00:10:01
still see a wedge in that setting uh and of course we did and by by looking in this particular type of environment we
00:10:07
were better able to get at uh how much of this wedge between choice and happiness is driven by people's initial
00:10:13
intentions versus just their uh their mispredictions about what actually makes them
00:10:21
happy in terms of what's next we're thinking about continuing this line of
00:10:24
research uh by continuing to investigate basically the relationship between happiness data
00:10:29
uh and choice data which is the more typical object in economic analysis we want to continue to think about uh how
00:10:35
much you can infer about how choices are made based only on happiness data uh a particular Dimension that I'm interested
00:10:41
in is in trying to build build happiness data into a more standard price theoretic economic analysis so rather
00:10:47
than thinking about happiness as just a way of approximating the thing people are trying to maximize think of it as
00:10:52
this kind of abstract good that people are willing to uh you know in some sense buy and also trade uh and explicitly
00:10:58
trade off against other goals in their life and uh we're starting to work on a
00:11:02
theoretical approach to uh to modeling that and thinking about how we can uh better use that type of framework to
00:11:08
import uh psychological data and happiness data into economic analysis [Music]

Episode Highlights

  • The Role of Happiness Data
    Happiness data can effectively forecast choices, even in high-stakes decisions like medical residency.
    “Happiness data is actually reasonably useful for forecasting choices.”
    @ 04m 00s
    December 19, 2014
  • Trade-offs in Decision Making
    People often prioritize family well-being over their own happiness when making choices.
    “People will explicitly trade off the pursuit of happiness against other goals.”
    @ 08m 09s
    December 19, 2014

Episode Quotes

  • Happiness data is actually reasonably useful for forecasting choices.
    Why Happiness Isn't Everything
  • People will explicitly trade off the pursuit of happiness against other goals.
    Why Happiness Isn't Everything
  • Understanding happiness data helps us forecast the choices people will make.
    Why Happiness Isn't Everything

Key Moments

  • Happiness Forecasting04:00
  • Decision Trade-offs08:09

Tension Over Time

Words per Minute Over Time

Vibes Breakdown