EUVIMEDEUVIMED entdecken
Crossref

Toward Understanding Deep Learning Framework Bugs

Junjie Chen, Yihua Liang, Qingchao Shen, Jiajun Jiang, Shuochuan Li

ACM Transactions on Software Engineering and Methodology · 30.11.2023 · 32 (6) · 1-31

DOI: 10.1145/3587155 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 29.09.2023. Verfasst von Junjie Chen und 4 weiteren Autor:innen. Die Arbeit wurde bisher 85-mal zitiert (Crossref) und nennt 82 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

DL frameworks are the basis of constructing all DL programs and models, and thus their bugs could lead to the unexpected behaviors of any DL program or model relying on them. Such a wide effect demonstrates the necessity and importance of guaranteeing DL frameworks’ quality. Understanding the characteristics of DL framework bugs is a fundamental step for this quality assurance task, facilitating designing effective bug detection and debugging approaches. Hence, in this work, we conduct the most large-scale study on 1,000 bugs from four popular and diverse DL frameworks (i.e., TensorFlow, PyTorch, MXNet, and DL4J). By analyzing the root causes and symptoms of DL framework bugs associated with five components decomposed from DL frameworks, as well as measuring test coverage achieved by three state-of-the-art testing techniques, we obtain 12 major findings for the comprehensive understanding of DL framework bugs and the current status of existing DL framework testing practice, and then provide a series of actionable guidelines for better DL framework bug detection and debugging. Finally, based on the guidelines, we design and implement a prototype DL-framework testing tool, called TenFuzz , which is evaluated to be effective and finds three unknown bugs on the latest TensorFlow framework in a preliminary study, indicating the significance of our guidelines.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Chen, J., Liang, Y., Shen, Q., Jiang, J., & Li, S. (2023). Toward Understanding Deep Learning Framework Bugs. ACM Transactions on Software Engineering and Methodology, 32(6), 1-31. https://doi.org/10.1145/3587155

Vancouver

Chen J, Liang Y, Shen Q, Jiang J, Li S. Toward Understanding Deep Learning Framework Bugs. ACM Transactions on Software Engineering and Methodology. 2023;32(6):1-31. doi:10.1145/3587155

BibTeX
@article{Chen2023,
  author = {Chen, Junjie and Liang, Yihua and Shen, Qingchao and Jiang, Jiajun and Li, Shuochuan},
  title = {Toward Understanding Deep Learning Framework Bugs},
  journal = {ACM Transactions on Software Engineering and Methodology},
  year = {2023},
  volume = {32},
  number = {6},
  pages = {1--31},
  doi = {10.1145/3587155}
}
Kostenlos starten →