Ads that Talk Back: Implications and Perceptions of Injecting Personalized Advertising into LLM Chatbots
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · 02.12.2025 · 9 (4) · 1-47
DOI: 10.1145/3770640 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, online erschienen am 02.12.2025. Verfasst von Brian Jay Tang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 95 Literaturangaben. Gefördert von: NSF.
Abstract (Originalsprache)
Recent advances in large language models (LLMs) have enabled the creation of highly effective chatbots. However, the compute costs of widely deploying LLMs have raised questions about profitability. Companies have proposed exploring ad-based revenue streams for monetizing LLMs, which could serve as the new de facto platform for advertising. This paper investigates the implications of personalizing LLM advertisements to individual users via a between-subjects experiment with 179 participants. We developed a chatbot that embeds personalized product advertisements within LLM responses, inspired by similar forays by AI companies. The evaluation of our benchmarks showed that ad injection only slightly impacted LLM performance, particularly response desirability. Results revealed that participants struggled to detect ads, and even preferred LLM responses with hidden advertisements. Rather than clicking on our advertising disclosure, participants tried changing their advertising settings using natural language queries. We created an advertising dataset and an open-source LLM, Phi-4-Ads, fine-tuned to serve ads and flexibly adapt to user preferences.
Förderung
- NSF
Zitieren
APA
Tang, B. J., Sun, K., Curran, N. T., Schaub, F., & Shin, K. G. (2025). Ads that Talk Back: Implications and Perceptions of Injecting Personalized Advertising into LLM Chatbots. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 9(4), 1-47. https://doi.org/10.1145/3770640
Vancouver
Tang BJ, Sun K, Curran NT, Schaub F, Shin KG. Ads that Talk Back: Implications and Perceptions of Injecting Personalized Advertising into LLM Chatbots. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2025;9(4):1-47. doi:10.1145/3770640
BibTeX
@article{Tang2025,
author = {Tang, Brian Jay and Sun, Kaiwen and Curran, Noah T. and Schaub, Florian and Shin, Kang G.},
title = {Ads that Talk Back: Implications and Perceptions of Injecting Personalized Advertising into LLM Chatbots},
journal = {Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies},
year = {2025},
volume = {9},
number = {4},
pages = {1--47},
doi = {10.1145/3770640}
}
EUVIMED