Can AI Give Ethical Advice? A Conversation w/ Wharton Prof. Christian Terwiesch and Lennart Meincke
Ask about Knowledge at Wharton
Episode Description
Christian Terwiesch, co-director of the Mack Institute and Wharton Professor of Operations, Information, and Decisions, along with Lennart Meincke, joins host Dan Loney on Wharton Business Daily to discuss their new white paper, "Can AI Provide Ethical Advice?" The paper details an experiment in which advice from New York Times columnist Dr. Kwame Anthony Appiah was compared with advice generated by ChatGPT. In this interview, Meincke and Professor Terwiesch examine the results of this experiment and question whether artificial intelligence can provide ethical advice on personal and professional matters.
----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.
Launched in 1999, Knowledge at Wharton offers free access to:
- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox
Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU
Brief Summary
Christian Tursh and Leonard Miky discuss ChatGPT's ability to provide ethical advice compared to human ethicists.
Key points
- Exploring AI's Ethical Advice. Can AI like GPT provide ethical advice? Experts discuss its potential and limitations.
- AI vs. Human Advice. A study compares AI-generated ethical advice with that of human ethicists, revealing surprising results.
Transcript
well as artificial intelligence continues to grow in Impact in our culture there continue to be new questions to be asked one from a new white paper by our next guest ask whether chat GPT can provide ethical advice the authors of that paper join us right now Christian tursh who's a professor of operations information and decisions here at the Wharton School he's also co-director of the Mac Institute and also Leonard miky who is a research assistant here at Wharton gentlemen great to have you with us today thanks for your time thanks for having us thank you all right so Christian I'll start with you lay this out for us about both the importance of
This research but how you went about it so this sounds like a weird question right can GPT give ethical advice so the bigger context is that we've seen AI do all kinds of things from being a customer support agent uh summarizing patient visits in the hospital doing automated underwriting decisions and banking situations and so the the question came up like can it do more human things and thenard and I did another white paper that you and I talked about on the sh recently whether gbt can be creative and we found really interesting things there and so the last question that we felt like was kind of had to be covered is can GPT do something human
like having feelings and talk about ethical advice and so we thought that was a really interesting question to tackle so Leonard how did you go about this because I find it interesting it's one thing to you know for the for the process to include something that may work in the human brain this is kind of another Avenue of that yeah and one thing that was very important to us was so we benchmarked it against ethical advice by the ethicist in the New York Times we didn't just want to see if we can replicate their advice right we wanted to really see what is the base model gp4 what can it do right now so when preparing our experiment we spent a lot of time time making sure that we
don't introduce any kind of bias or give any previous responses by the person we're comparing against to make sure really just getting with the raw model things and it was it was super fascinating to see the differences in responses for the different ethical dilemmas so this was basically taking scenarios that may have been in the ethicist and preparing them for them to be diagnosed by individuals that you had in this in this research yeah so we essentially took reader submissions to the the New York Times um that the ethesis had answered beforehand I think we drew from the last three to four month so the data could not have been in
GPT so it couldn't have seen the ethicist responses to it and then for each of those dilemas we asked GPT again with a prompt to make sure that it wouldn't just try to mimic the original advisor and saw what what kind of advice GPT gave and then we had a few different groups MBA students at Wharton um we had an expert group of clerics and faculty and then we had more like general public college educated people rate each advice and see what which one they perceive to be more useful so Christian we've obviously talked about uh the connection between ethical advice and and morals in human beings and and I think the question probably a lot of people might
have is is it too much of a leap of faith to assume that computers or in this case AI can make those types of decisions so let's be clear what what we are testing here and what we're not testing here we're not testing whether AI has feelings AI is conscious or AI has moral capabilities I have an opinion on all of those and the answer is no what we are testing is can GPT create ethical advice that is useful and usefulness is measured in the eyes as lard was just explaining in the eyes of lay people Wen MBA students and experts such as clergy and uh academics and so for each of these dilemmas we have the expert in this case uh from The
New York Times Dr apia uh share his view on an ethical dilemma and we GPT create his or her view on the dilemma and then we compare which one is more useful so we're not making claims that AI is is is human or conscious or anything it is fascinating to see that it is it provides useful advice nothing more nothing less and let from what I read there was a path where you also uh rated the usefulness of the advice correct yeah so there were essentially two different ways we approach the evaluation in one of the two surveys that we went through with our participants we asked participants please rate how useful well imagine you
are the reader uh so that you don't have any personal advice imagine you're the reader and you ask this question how useful do you think on a scale from 1 to seven this advice will be to you and then in a secondary group group we did display the original athetist advice and we displayed the gbt advice and then basically they had to pick which of the two they preferred so it was more like a head- onad race and so what was the end up being the results in terms of which advice they seem to gravitate more towards so it was very interesting because essentially it's a tie and it's a super close tie so across all three groups there's a slight preference for
GPT but only for the lay people that statistically significant for the NBAs and the experts while there's a small preference it's not large enough to be considered significant so I think right now we're just confident to say that there is a tie in the ability uh but we we can't really necessarily say one is much better or worse than the other Christian does the fact that there was basically a tie in this does it does it does it say anything to you about the the importance of of this going down the down the road yeah I mean that allow tellows us now that anywhere you're in a situ anywhere you are anytime that you have a situation where you want ethical advice you can get it immediately and
for free and I think that is in many ways a real wild result because few of us unless we are sitting in the white house or a CEO of a big company have the luxury of having like ethical advisors and so ethical advice uh can be streamed to us at zero marginal cost and instantly so I think that is wow again I don't want to overgeneralize and say like we don't need ethesis anymore to the contrary but in most situations I think normal people like you and us uh are in in most situations we can't afford to seek ethical advice by an expert and so having this now available at the click of of a mouse I think is is is something really big and it's is it safe to say Christian that with the
growth we're seeing uh in the use of AI in a variety of different areas that the expectation is that we will see it grow in this area as well so again I think the growth is in more use cases and previously have had no involvement of ethical considerations we can provide it I'm absolutely hesitant to make significant decisions in life in politics and in business based on that advice alone I think of it more as a stimulus to us as we are going through our own deliberations in our in our minds to hear other perspectives to embrace perspectives that we might have usually not have embraced from our social network and take all of that into
account and have the human be the the decision maker and hopefully that leads to more ethical Behavior which is something that I think the world desperately needs right now Leonard it sounded like in some of the cases when people were making their decision between the AI advice and and that of of of the the ethesis that there may have been a case where people were not sure which one they would take and you really I guess to agree press them on it to really make a decision on which one they would take and and in some cases the AI won out yeah and we were thinking hard how to design the experiment because if we just give them two pieces Like A and
B advice for the AI nist let's say everyone picks the AI but it was super close then we can't really say that right so that's why we use this two stages or two different experiments where for one we asked them to one to7 how useful it is and then in another round we asked them which one do you think is more useful to you out of these two of course we asked different people different questions but that was kind of the core idea so we were able to see how big the difference really was what did you take from from doing this research Leonard I think it's just super
interesting with GPT and I coming up so much to evaluate all the different things you might not immediately think of where it's already good at and I think to Christian's point I would just see it as one more opinion one more voice that you're throwing in to a decision and you know maybe it's 11: p.m. on a Saturday afternoon evening and you would just like to get some advice on something you know you have it readily available you don't have to follow it you're not sitting here and say please follow what gp4 tells you but it's just one more opinion that might be helpful and it's very affordable Christian where do you think then this research potentially takes you
what is there a next log IC step to to follow up with this I would really like to explore the role of opinion diversity I think it lies into in the nature of American life and most of the western world right now that we are all surrounding ourselves with like-minded people I think there's a real opportunity to seek advice from folks that are explicitly outside your comfort zone people who who you would normally not approach and hear what they have to say hear different perspectives and then you maybe together with a can aggregate these individual voices and opinions to hopefully look Beyond kind of your own perspective and and grow in
understanding of others and in the Del deliberation process for your own decisions Leonard where would you like to take this next I think it would also be interesting if we look at some of the differences per ethical dilemma so we asked 20 different ones and it would just be cool to see maybe there's a strong preference in I in a specific Niche maybe it's different for the ethicist uh just to kind of see how people a little bit to Christian's point when it comes to devises how people think differently per ethical question raised is there also an element of this Leonard because of the fact that we have
become more reliant on technology in general that the expectation is as we move further down the road and we rely more on technology that this is going to be a natural Avenue for people people to maybe consider when they're thinking about you know some sort of question or problem in their life that they may may need to get advice on I think that's a very natural assumption to make I think we've seen it for many years where people take to online forums to ask about any kind of advice whether it's relationship advice ethical advice we see it on Reddit a lot so I think it's a very natural extension of the technology
that people will turn more and more to these virtual assistants and ask them for help of course in these cases the help or answer can only ever be as good as how much you're telling and how good your input is Christian how about yourself I think it's just fascinating that a technology that has never been married that has never been loved can provide us with guidance and advice about how to live our life and so again I think of it as get input get stimul get New Perspectives and then it's up to us of integrating that into our decision- making process and become better people with that great to have you both with us thank you Christian
thank you Leonard being a pleasure appreciate thank you Christian tursh who's a professor of operations information and decisions here at the Wharton School and also Leonard mik who is a research assistant here at the Warton School





