EUVIMEDEUVIMED entdecken
Crossref

Chatbots and mental health: Insights into the safety of generative AI

Julian De Freitas, Ahmet Kaan Uğuralp, Zeliha Oğuz‐Uğuralp, Stefano Puntoni

Journal of Consumer Psychology · 2024-07 · 34 (3) · 481-491

DOI: 10.1002/jcpy.1393 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Consumer Psychology, online erschienen am 19.12.2023. Verfasst von Julian De Freitas und 3 weiteren Autor:innen. Die Arbeit wurde bisher 211-mal zitiert (Crossref) und nennt 42 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Chatbots are now able to engage in sophisticated conversations with consumers. Due to the “black box” nature of the algorithms, it is impossible to predict in advance how these conversations will unfold. Behavioral research provides little insight into potential safety issues emerging from the current rapid deployment of this technology at scale. We begin to address this urgent question by focusing on the context of mental health and “companion AI”: Applications designed to provide consumers with synthetic interaction partners. Studies 1a and 1b present field evidence: Actual consumer interactions with two different companion AIs. Study 2 reports an extensive performance test of several commercially available companion AIs. Study 3 is an experiment testing consumer reaction to risky and unhelpful chatbot responses. The findings show that (1) mental health crises are apparent in a nonnegligible minority of conversations with users; (2) companion AIs are often unable to recognize, and respond appropriately to, signs of distress; and (3) consumers display negative reactions to unhelpful and risky chatbot responses, highlighting emerging reputational risks for generative AI companies.

Zitieren

APA

Freitas, J. D., Uğuralp, A. K., Oğuz‐Uğuralp, Z., & Puntoni, S. (2024). Chatbots and mental health: Insights into the safety of generative AI. Journal of Consumer Psychology, 34(3), 481-491. https://doi.org/10.1002/jcpy.1393

Vancouver

Freitas JD, Uğuralp AK, Oğuz‐Uğuralp Z, Puntoni S. Chatbots and mental health: Insights into the safety of generative AI. Journal of Consumer Psychology. 2024;34(3):481-491. doi:10.1002/jcpy.1393

BibTeX
@article{Freitas2024,
  author = {Freitas, Julian De and Uğuralp, Ahmet Kaan and Oğuz‐Uğuralp, Zeliha and Puntoni, Stefano},
  title = {Chatbots and mental health: Insights into the safety of generative AI},
  journal = {Journal of Consumer Psychology},
  year = {2024},
  volume = {34},
  number = {3},
  pages = {481--491},
  doi = {10.1002/jcpy.1393}
}
Kostenlos starten →