EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Scenario-Guided LLM-Based Mobile App GUI Testing

Shengcheng Yu, Yuchen Ling, Chunrong Fang, Quan Zhou, Yi Zhao, Chunyang Chen, Shaomin Zhu, Zhenyu Chen

ACM Transactions on Software Engineering and Methodology · 30.11.2026 · 35 (11) · 1-39

DOI: 10.1145/3816025 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 04.11.2026. Verfasst von Shengcheng Yu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The assurance of mobile application (app) GUI has become increasingly important, as the GUI serves as the primary medium of interaction between users and apps. Although numerous automated GUI testing approaches have been developed with diverse strategies, a substantial gap remains between these approaches and the underlying app business logic. Most existing approaches focus on general exploration rather than the completion of specific testing scenarios, often resulting in missed coverage of critical functionalities. Inspired by the manual testing process, which treats business logic, driven testing scenarios as the fundamental unit of testing, this article introduces an approach that leverages large language models (LLMs) to comprehend the semantics expressed in app GUIs and their contextual relevance to given testing scenarios. Building upon this capability, we propose ScenGen , a novel scenario-guided LLM-based GUI testing framework that employs a multi-agent collaboration mechanism to simulate and automate the phases of manual testing. Specifically, ScenGen integrates five agents: the Observer , Decider , Executor , Supervisor , and Recorder . The Observer perceives the app GUI state by extracting and structuring GUI widgets and layouts, thereby interpreting the semantic information presented in the GUI. This information is then passed to the Decider , which makes scenario-driven decisions with the guidance of LLMs to identify target widgets and determine appropriate actions toward fulfilling specific testing goals. The Executor executes the decided operations on the app, while the Supervisor verifies whether the execution results align with the intended testing scenario completion, ensuring traceability and consistency in test generation and execution. Finally, the Recorder records the corresponding GUI operations into the context memory as a knowledge base for subsequent decision-making and concurrently monitors runtime bug occurrences. Comprehensive evaluations demonstrate that ScenGen effectively generates scenario-guided GUI tests guided by LLM collaboration, achieving higher relevance to app business logic and improving the completeness of automated GUI testing.

Förderung

  • National Key Research and Development Program of China

Zitieren

APA

Yu, S., Ling, Y., Fang, C., Zhou, Q., Zhao, Y., Chen, C., Zhu, S., & Chen, Z. (2026). Scenario-Guided LLM-Based Mobile App GUI Testing. ACM Transactions on Software Engineering and Methodology, 35(11), 1-39. https://doi.org/10.1145/3816025

Vancouver

Yu S, Ling Y, Fang C, Zhou Q, Zhao Y, Chen C, et al. Scenario-Guided LLM-Based Mobile App GUI Testing. ACM Transactions on Software Engineering and Methodology. 2026;35(11):1-39. doi:10.1145/3816025

BibTeX
@article{Yu2026,
  author = {Yu, Shengcheng and Ling, Yuchen and Fang, Chunrong and Zhou, Quan and Zhao, Yi and Chen, Chunyang and Zhu, Shaomin and Chen, Zhenyu},
  title = {Scenario-Guided LLM-Based Mobile App GUI Testing},
  journal = {ACM Transactions on Software Engineering and Methodology},
  year = {2026},
  volume = {35},
  number = {11},
  pages = {1--39},
  doi = {10.1145/3816025}
}
Kostenlos starten →