Vulnerabilities and Defenses in Audio-Visual Attacks: A Survey From Audio to Multimodal Models
ACM Computing Surveys · 31.01.2027 · 59 (1) · 1-34
DOI: 10.1145/3857219 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 30.10.2026. Verfasst von Jinming Wen und 4 weiteren Autor:innen. Die Arbeit nennt 148 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
With the rapid development of multimodal large language models (MLLMs) and the cost of large amounts of data and resources, researchers are more inclined to use public datasets and fine-tune open-source MLLMs to achieve excellent performance in audiovisual related tasks 1 . While this trend accelerates progress, it also introduces security risks. Empirical studies demonstrate that the latest MLLMs can be manipulated to generate harmful content through crafted inputs, including adversarial perturbations and malicious queries, bypassing internal safeguards. To gain a deeper comprehension of the inherent security vulnerabilities associated with audio-visual-based multimodal models, a series of surveys investigates various types of attacks, including adversarial and backdoor attacks. While existing surveys on audio-visual attacks provide a comprehensive overview, they are limited to specific types of attacks, which lack a unified review of various types of attacks. To bridge this gap, this article presents a comprehensive and systematic review of audio-visual attacks, which include adversarial, backdoor, and jailbreak attacks. Furthermore, we also review various types of attacks in the latest audio-visual-based MLLMs, a dimension notably absent in existing surveys. Drawing from extensive literature, this article delineates both challenges and emergent trends for future research on audio-visual attacks and defenses.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Wen, J., Wu, X., Li, Y., Jia, Y., & Zhao, S. (2027). Vulnerabilities and Defenses in Audio-Visual Attacks: A Survey From Audio to Multimodal Models. ACM Computing Surveys, 59(1), 1-34. https://doi.org/10.1145/3857219
Vancouver
Wen J, Wu X, Li Y, Jia Y, Zhao S. Vulnerabilities and Defenses in Audio-Visual Attacks: A Survey From Audio to Multimodal Models. ACM Computing Surveys. 2027;59(1):1-34. doi:10.1145/3857219
BibTeX
@article{Wen2027,
author = {Wen, Jinming and Wu, Xinyi and Li, Yuwen and Jia, Yanhao and Zhao, Shuai},
title = {Vulnerabilities and Defenses in Audio-Visual Attacks: A Survey From Audio to Multimodal Models},
journal = {ACM Computing Surveys},
year = {2027},
volume = {59},
number = {1},
pages = {1--34},
doi = {10.1145/3857219}
}
EUVIMED