Adversarial Attack and Defense for Commercial Black-box Chinese-English Speech Recognition Systems
ACM Transactions on Privacy and Security · 28.02.2025 · 28 (1) · 1-27
DOI: 10.1145/3701725 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Privacy and Security, online erschienen am 11.12.2024. Verfasst von Xuejing Yuan und 6 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 36 Literaturangaben. Gefördert von: National Natural Science Foundation of China, NSFC, CAS Project for Young Scientists in Basic Research.
Abstract (Originalsprache)
The attacker can generate adversarial examples (AEs) to stealthily mislead automatic speech recognition (ASR) models, raising significant concerns about the security of intelligent voice control (IVC) devices. Existing adversarial attacks mainly generate AEs to mislead ASR models to output specific target English commands (e.g., open the door). However, it remains unknown whether AEs can be used to issue commands in other languages to attack commercial black-box ASR models. In this article, taking Chinese phrases (e.g., 支付宝付款) and “Chinese–English code-switching” phrases (e.g., 关闭GPS) as the target commands, we propose adversarial attacks for commercial multilingual ASR models. In particular, if a multilingual speech recognition model can recognize Chinese and English, we call it a Chinese–English speech recognition model. In English, the meaning of “支付宝付款” and “关闭GPS” are “Alipay payment” and “turn off GPS”, respectively. In detail, we generate transferable AEs based on the open-sourced conventional DataTang Mandarin ASR model. Given 55 target commands, the success rate for generating AEs of them is up to 96% and 80% for Aliyun ASR API and Tencentyun ASR API, respectively. Our AEs can trigger actual attack actions on voice assistants (e.g., Apple Siri, Xiaomi Xiaoaitongxue) or spread malicious messages through ASR API services, while the target commands in the AEs are inaudible to human beings. 1 Finally, by analyzing the spectrum differences between benign audio clips and AEs, we propose a general defense against adversarial audio attacks.
Förderung
- National Natural Science Foundation of China
- NSFC
- CAS Project for Young Scientists in Basic Research
- Youth Innovation Promotion Association CAS
Zitieren
APA
Yuan, X., Zhang, J., Chen, K., Wei, C., Li, R., Ma, Z., & Ling, X. (2025). Adversarial Attack and Defense for Commercial Black-box Chinese-English Speech Recognition Systems. ACM Transactions on Privacy and Security, 28(1), 1-27. https://doi.org/10.1145/3701725
Vancouver
Yuan X, Zhang J, Chen K, Wei C, Li R, Ma Z, et al. Adversarial Attack and Defense for Commercial Black-box Chinese-English Speech Recognition Systems. ACM Transactions on Privacy and Security. 2025;28(1):1-27. doi:10.1145/3701725
BibTeX
@article{Yuan2025,
author = {Yuan, Xuejing and Zhang, Jiangshan and Chen, Kai and Wei, Cheng'an and Li, Ruiyuan and Ma, Zhenkun and Ling, Xinqi},
title = {Adversarial Attack and Defense for Commercial Black-box Chinese-English Speech Recognition Systems},
journal = {ACM Transactions on Privacy and Security},
year = {2025},
volume = {28},
number = {1},
pages = {1--27},
doi = {10.1145/3701725}
}
EUVIMED