EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

EVBench: A Comprehensive Benchmark of Video Generative Models for E-commerce Scenarios

Haofeng Chen, Jinkai Zheng, Kun Liu, Xinchen Liu, Liangqiong Qu, Ming Li, Wu Liu, Chenggang Yan

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.10.2026 · 22 (10) · 1-23

DOI: 10.1145/3830242 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 08.10.2026. Verfasst von Haofeng Chen und 7 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 63 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Fundamental Research Funds for the Provincial Universities of Zhejiang.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Assessing the quality of videos generated by video generation models plays an important role in improving the capability of these models. Existing video generation benchmarks like VBench and EvalCrafter mainly focus on general aspects of video quality and video–text consistency, but they could be ineffective for the unique requirements of e-commerce video generation, such as the consistency of fine-grained product categories and details, the usage of products, camera movements, and so on. To solve this issue, we introduce EVBench , a comprehensive E -commerce V ideo Bench mark to evaluate the capability of video generation models for e-commerce scenarios. Our EVBench contains two parts, i.e., EVBench-T2V and EVBench-I2V, to evaluate the text-to-video models and image-to-video models, respectively. EVBench-T2V contains 300 structured prompts covering 300 fine-grained product categories and various backgrounds, while EVBench-I2V has 120 image–prompt pairs of 120 categories with diverse instructions like camera movements and usage scenarios. Moreover, a set of novel evaluation metrics is designed to quantitatively measure the capability of video generation models from 10 dimensions. Furthermore, we conduct human preference annotation to validate the alignment between our benchmark and human perception. Finally, based on EVBench, we comprehensively evaluate 15 mainstream open source and closed-source models to discover their capabilities and provide valuable insights for e-commerce video generation.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Provincial Universities of Zhejiang
  • “Pioneer” and “Leading Goose” R&D Program of Zhejiang Province

Zitieren

APA

Chen, H., Zheng, J., Liu, K., Liu, X., Qu, L., Li, M., Liu, W., & Yan, C. (2026). EVBench: A Comprehensive Benchmark of Video Generative Models for E-commerce Scenarios. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(10), 1-23. https://doi.org/10.1145/3830242

Vancouver

Chen H, Zheng J, Liu K, Liu X, Qu L, Li M, et al. EVBench: A Comprehensive Benchmark of Video Generative Models for E-commerce Scenarios. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(10):1-23. doi:10.1145/3830242

BibTeX
@article{Chen2026,
  author = {Chen, Haofeng and Zheng, Jinkai and Liu, Kun and Liu, Xinchen and Qu, Liangqiong and Li, Ming and Liu, Wu and Yan, Chenggang},
  title = {EVBench: A Comprehensive Benchmark of Video Generative Models for E-commerce Scenarios},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2026},
  volume = {22},
  number = {10},
  pages = {1--23},
  doi = {10.1145/3830242}
}
Kostenlos starten →