What Does Your Writing Style Say About You?
Ask about Knowledge at Wharton
Episode Description
Wharton marketing professor Jonah Berger discusses his published study, “Topography of Thought,” which was co-authored with Olivier Toubia, business professor at Columbia Business School. The paper examines how someone's writing style can be indicative of their future success, and where generative AI might come into the picture.
#writing #marketing #writer #ai #generativeai ----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.
Launched in 1999, Knowledge at Wharton offers free access to:
- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox
Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU
Brief Summary
Jonah Berger discusses how writing style predicts future success in his research on college application essays.
Key points
- The Importance of Ground Covered. Covering more ground in writing correlates with greater academic success.
- Topography of Thought. Jonah Berger's research reveals how writing style can predict future success.
Episode highlights
- The Importance of Ground CoveredCovering more ground in writing correlates with greater academic success.“Covering more ground is linked to greater success.”5:49Jul 23, 2024
- Topography of ThoughtJonah Berger's research reveals how writing style can predict future success.“Writing reveals something about the way we think.”8:49Jul 23, 2024
Transcript
Speaker: This podcast is brought to you by Knowledge@Wharton. Angie Basiouny: Welcome to Knowledge@Wharton. I'm Angie Basiouny. I'm here with Wharton Marketing Professor Jonah Berger, and we're going to talk about his latest research paper. It's titled "Topography of Thought," co-authored with Olivier Toubia, who's a professor at Columbia Business School. Now this research is about how someone's writing style can be indicative of their future success. Jonah, thanks for coming on. - Jonah Berger: Thanks so much for having me back. - So I really was hoping you would give us an overview of this paper by way of explaining your title, which is great. What is typography of thought?
- You know, I don't have to tell you that we all use language all the time, right? We write emails, we make presentations, we write college essays when we're younger, we write job applications when we're older. We use language all the time. And people have often thought that language in some sense is a fingerprint. It reveals or reflects something about the people that produce it. So people that use a certain type of language, for example, it might indicate something about them. There's research, for example, that shows we can guess how much someone is an extrovert, for example, about the language that they use when they -- when they talk or write. But one thing we wondered is, okay, beyond the individual
words people use, whether they use a word, for example, that indicates they do extroverted things, might the power of ideas they put out there, the way the ideas they share organize beyond the words, but the way they organize ideas, tell us something interesting about them and their likely future success. And so I think it's important to talk a little about what I mean about the pattern of ideas, right? When someone talks about something, they can cover a small amount of ground, or a large amount of ground. If you ask someone about their work history, for example, they can talk about a variety of different things they've done, or a smaller set of things they've done. So they can cover a lot of ground or a little bit of
ground. If you want to use an analogy here, you can almost think about someone going for a run, for example. You know, someone can go for a run and go all the way around the city, or they can take the same length of run, they can go for the same number of miles, but just go around the block a number of times. And so in both cases, they did the same distance of things, right? But they covered more ground in one than the other. And so one way we express ideas is the amount of ground we cover. We cover more ground with our ideas or less. We can talk about sort of more ideas, more topics, more themes, more things that are disparate from one another, or things that are related to one another. But it's not just that.
It's also the speed with which we move between adjoining ideas. So imagine -- think about a movie, for example. A movie could cover more or less ground across the whole course of the movie. But it can also move faster or slower between ideas, right? If a movie has one scene, for example, that's in a city, let's say, and it's the beginning of a wedding, if the next scene is the later part in a wedding, that's related to the first part, right? Different things may happen, but it's -- it's pretty closely related. Whereas if you jump from a wedding, for example, to a completely different city and an action scene, that would be really different sorts of ideas. They're not very related. They're moving further across those two points. And so we
wonder, are these two ideas, the -- the ground cover, or sort of the volume of of content someone produces, does it cover a lot of ground or not a lot of ground? And how quickly it moves. Does it move very quickly between ideas that aren't so related, or does it move more slowly between ideas that are more related? Could that tell us something about their likelihood of being successful in the future? - So I just want to be clear, you're not talking about like the length of the piece of writing, you're not talking about whether it's a 500 word essay, or a 1,000 word essay. It's really about how they use that space to move through their ideas, correct? - Really --
yeah, really great points. It's not about the length, it's about the ground. And so I think that ground sort of makes sense, right? Are they covering a lot of ground in their 100 or 1,000 words or whatever it is, or are they covering less ground in their 100 or 1,000 words, right? You could imagine if someone tells you about their vacation, they could cover a lot of ground talk about a variety of different things, and use 1,000 words to do it, or they could talk at length about a smaller set of things, right? They could only talk about the restaurants they went to. It might be different restaurants, but they'd be more closely related than talking about the restaurant they went to, and the hotel they went to, an amusement park they did, or a day
they had at the ocean. Those more disparate, less related things would involve covering more ground even using the same amount of words to do it. - So how did you go about studying this? - Yeah, so we looked at this in a really consequential setting, which is college application essays. And to be clear, we're not particularly interested in college application essays. The same ideas could be applied to job application essays, they could be applied to in other work we're doing at the moment, for example, apply to things like online reviews. In the past, we've looked at things like movies, books, and television shows, and the content of those things as well. So, same ideas can be applied to any type of content. But here we looked
at college application essays. And so we took 40,000 college application essays from a variety of different folks that were applying to school. And we looked at what they wrote, and the topography of thought of what they wrote, sort of how much ground they covered in that essay. Again, similar length, but how much ground they covered. And how quickly they move between ideas. And we looked at whether that related to their future success. In a sense, how well did they do in school? What was their GPA once they got there? And we were interested in seeing whether, hey, does how they write, and again, not just the individual words they use, but the way they express ideas, might that reveal something or predict how likely
they are to be successful in the future? - That is a really interesting dataset. What did you find? - Yeah, so we found two -- two very important things. So first, covering more ground. So again, that idea of sort of doing -- covering a broad array of things in the same amount of length was linked to greater success. But importantly, doing so while moving rather slowly was also important. So you could think about covering a lot of ground, right? Almost think about the points on a clock, think about the numbers arrayed on a circular clock, right? You could cover a lot of ground, either by moving in a circle, right? Going sort of from twelve to one to two to three to four, around that circle, which wouldn't require
much movement at each step, right? At each step it would just be a little. Or you could traverse that same aground going from like twelve to six to one to seven to three to eleven. And again, you'd cover the same amount of ground, you'd have covered the surface of that regular sort of circular clock, but you'd have taken much more of a longer route between each individual point. And so what we found is that folks that are successful in school are able to blend these two things that might seem mutually exclusive, right? It might seem like covering a lot of ground requires moving really quickly between points to get to a lot of different points. But folks doing well in school figured out a way to cover that ground really efficiently. They're able
to do so by moving slowly between these points so they don't have to take a lot of big jumps along the way. - I think that's a really important note for anybody who does writing. As an editor, I always tell folks, write until the car runs out of gas, don't get out and push. So it's this idea that your thoughts are more concise, and you move from one topic to the other, you cover that ground efficiently. Tell me a little bit about, you in this paper, in this experiment, you controlled for some socioeconomic factors. Can you touch on that a little bit? I think that's important. - Yeah, so someone could wonder, okay, so you found that people did well in school, and you found that they wrote a certain
way, but is that indicating they're thinking the way they're thinking, right? You're using writing as a way to indicate sort of how they think? Or does it indicate something else, right? Maybe it's just, hey, people who do better on the SATs also have higher grades, and also tend to write a certain way. Maybe that, hey, people who have parents that are more educated tend to write a certain way, and also do better in school. Or maybe people that have parents that are more educated can afford to pay for, you know, an essay consult, who helps them write a certain way, and also helps them do better in school. And so it's -- it's driven by that. And so we controlled for a variety of different things. We controlled for what
they wrote about, right? So maybe certain types of people tend to write about certain types of things rather than other types of things. And maybe it's not about, you know, how they write, it's about what they wrote about, the topics or themes that they discussed. Nope, it wasn't that. Maybe it's parent's education. Nope, we controlled for that. Maybe it's SAT score. Nope, we controlled for that. And so what this suggests is that the topography of thought goes beyond things related to just socioeconomic factors or family background. It's not just that people who might have had wealthier families, for example, tend to write a certain way, or have application consultants and do better in school because they
get tutoring as well. No, it really suggests, hey, writing reveals something about the way we think, which can reveal or predict our likelihood of being successful in the future. - Let's put this in the business context. Because there are other really critical forms of writing that we do every day in business, like cover letters, resumes, anything, press release, a communication to the c-suite. How can you take this research and translate it into that context? - You know, what I find fascinating about these ideas is, yes, we looked at the case of college application essays in this particular case. But it doesn't have to be only about application essays. These same ideas should apply more broadly
to a variety of different sorts of contexts. Whether it's a cover letter that someone writes, whether it's an online review that someone puts together, whether it's the emails they write at the office. All these things provide insight into who people are, and what they're likely to do in the future. I think on a previous episode when you had me on, I talked about a paper I loved recently where they can tell whether someone's going to default on a loan or not by the -- by the language they use in their application. So sometimes when applying for a loan, you need to write -- particularly in these online sort of marketplaces, peer to peer loans, you have to write a little bit about why someone should give you money.
And you can predict -- beyond controlling for all those financial factors, control for those, you can predict how likely someone is to default based on the language they use in their application essay. Or similarly, you can predict whether someone's going to get promoted, or fired, or leave a job for better opportunity elsewhere based on the language they use in their email. And so most of this work that I just mentioned uses individual words. But I think what our work suggests is beyond the individual words someone uses, you can get insight into who they are, how they think, and how well they're going to do in the future, based on the pattern of ideas that they have, or their topography of thought. - Yeah, the
manager gives you an indication of how they're going to do their work. You know, how they move through their written work is indicative of how they might move through their physical work or their knowledge work. But -- - Yeah, one thing we're looking at right now actually is looking at, as people learn more, does that change the way their topography of thought works, right? - I would hope so. - So obviously, as we gain more knowledge in a given domain, we may talk differently, we may think about ideas differently. One thought we have is, well, hey, if if people who are able to cover a lot of ground really efficiently by moving slowly between points, right? Not moving quickly between points. If that's true,
wait, how did they get there? Are they naturally that way? Probably not, right? Probably they may have gained more knowledge along the way that allows them to represent their ideas differently. So one thing we're doing right now actually is looking at online forums where people write multiple reviews over time. So someone, for example, may write wine reviews, hundreds of wine reviews over the years from the beginning, when they started tasting wine, as they've learned more about wine years later. And so we're looking at, well, how do they represent ideas differently as they gain knowledge? And that made -- that helped us understand why people who represent ideas certain ways end up doing better.
- I would think that as a college professor, you have a little bit of insight into that, because you've been able to watch the evolution of the writing of many of your students, I would hope, over time. But listen -- - I wish I got this data over a bigger window, but yes. - So there's there's a theory question here. Because ChatGPT, artificial intelligence, has entered the conversation, right? So now people have access to these free tools that can help them perfect their cover letters and their writing assignments and their written business communication. How do we discern, as managers, as editors? How does this change things? We can't really tell how good someone's topography of
thought is if they have an AI assisted piece of writing. What do we do? - Yeah, so I'd say a couple things. So I agree with much of what you said except one word, which is I'm not sure they allow you to perfect your writing, right? What they do is they allow you to write something. They -- I should be careful here. Because maybe you are not writing. Something is -- they allow you to produce content that's pretty good, right? You didn't have to write it. You give it a prompt and it produces content that's pretty interesting, right? It does a pretty good job of doing something that might have been difficult for you to use. And to the degree it is -- uses your own content somehow, right? Like you
could say, take my CV and use it to put together a cover letter based on my past experiences. So that is based on you, and someone else's might look different to the degree that their CV is different. But I wouldn't say it necessarily perfects anything. I was recently reviewing a paper of a colleague where they look at AI generated ads. So they take ads that are generated by AI as well as not. And the AI ads are pretty good, right? If you look at them on the surface, and you say, hey, you know, is this a pretty good ad, you look at one, it makes sense, it's cogent. It's not like the version two or three years ago where it didn't make any sense, right? Now, it looks amazing, right? It looks quite good. The copy can be
good, the images can be good, and so on. But what they found is, first of all, in general it didn't seem like AI ads did better. In fact, it looked like they did worse. And part of the reason why is they use language differently than humans use language. So they may use less concrete language, for example, or they may use other types of language that humans tend not to use. And so it's not that it's not pretty good. It's -- it is pretty good. But is it as good as the best humans? I don't think we're -- I don't think we're there yet. And for these systems to get as good as the best humans, it depends on what they're trained on, right? So if they're trained on, hey, what do cover letters look like in general, then they're going to
do a good job of representing what a cover letter looks like. If you had a dataset of really effective cover letters, and you trained it only on the really effective cover letters, well, then maybe it would produce really effective cover letters. But I don't think we're there yet. And so certainly, tools like ChatGPT and others have made the production of content much easier. And I can certainly imagine a time down the road where we do use them for many, many tasks rather than writing ourselves. But I still think there's a lot to be understood about how language reflects the people that produce it, and how to write more effective content based on understanding what makes language impactful.
- Jonah, thanks for being here. - Thanks so much for having me. - The paper is called "Topography of Thought." You can find it online. I also encourage you to check out Jonah's latest book on persuasive communication. It's called<i> Magic Words: What to Say</i> <i>to Get Your Way.</i> Love that title. And if you'd like to check out more of our content, we invite you to go to Knowledge@Wharton. Just type ua into your search bar. I'm Angie Basiouny. Thanks for listening. - For more insight from Knowledge@Wharton, please visit Knowledge.Wharton.UPenn.edu.





