DeepMark: A Scalable and Robust Framework for DeepFake Video Detection
ACM Transactions on Privacy and Security · 29.02.2024 · 27 (1) · 1-26
DOI: 10.1145/3629976 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Privacy and Security, online erschienen am 05.02.2024. Verfasst von Li Tang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 66 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Research Grants Council, Hong Kong SAR, China.
Abstract (Originalsprache)
With the rapid growth of DeepFake video techniques, it becomes increasingly challenging to identify them visually, posing a huge threat to our society. Unfortunately, existing detection schemes are limited to exploiting the artifacts left by DeepFake manipulations, so they struggle to keep pace with the ever-improving DeepFake models. In this work, we propose DeepMark, a scalable and robust framework for detecting DeepFakes. It imprints essential visual features of a video into DeepMark Meta (DMM) and uses it to detect DeepFake manipulations by comparing the extracted visual features with the ground truth in DMM. Therefore, DeepMark is future-proof, because a DeepFake video must aim to alter some visual feature, no matter how “natural” it looks. Furthermore, DMM also contains a signature for verifying the integrity of the above features. And an essential link to the features as well as their signature is attached with error correction codes and embedded in the video watermark. To improve the efficiency of DMM creation, we also present a threshold-based feature selection scheme and a deduced face detection scheme. Experimental results demonstrate the effectiveness and efficiency of DeepMark on DeepFake video detection under various datasets and parameter settings.
Förderung
- National Natural Science Foundation of China
- Research Grants Council, Hong Kong SAR, China
Zitieren
APA
Tang, L., Ye, Q., Hu, H., Xue, Q., Xiao, Y., & Li, J. (2024). DeepMark: A Scalable and Robust Framework for DeepFake Video Detection. ACM Transactions on Privacy and Security, 27(1), 1-26. https://doi.org/10.1145/3629976
Vancouver
Tang L, Ye Q, Hu H, Xue Q, Xiao Y, Li J. DeepMark: A Scalable and Robust Framework for DeepFake Video Detection. ACM Transactions on Privacy and Security. 2024;27(1):1-26. doi:10.1145/3629976
BibTeX
@article{Tang2024,
author = {Tang, Li and Ye, Qingqing and Hu, Haibo and Xue, Qiao and Xiao, Yaxin and Li, Jin},
title = {DeepMark: A Scalable and Robust Framework for DeepFake Video Detection},
journal = {ACM Transactions on Privacy and Security},
year = {2024},
volume = {27},
number = {1},
pages = {1--26},
doi = {10.1145/3629976}
}
EUVIMED