EUVIMEDEUVIMED entdecken
Crossref

Towards Human–AI Synergy in UI Design: Supporting Iterative Generation with LLMs

Mingyue Yuan, Jieshan Chen, Yongquan Hu, Sidong Feng, Mulong Xie, Gelareh Mohammadi, Zhenchang Xing, Aaron Quigley

ACM Transactions on Computer-Human Interaction · 28.02.2026 · 33 (1) · 1-45

DOI: 10.1145/3773035 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Computer-Human Interaction, online erschienen am 25.02.2026. Verfasst von Mingyue Yuan und 7 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 75 Literaturangaben. Gefördert von: Dieter Schwarz Foundation and the Technical University of Munich—Institute for Advanced Study, Germany.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In automated UI design generation, a key challenge is the lack of support for iterative processes, as most systems focus solely on end-to-end output. This stems from limited capabilities in interpreting design intent and a lack of transparency for refining intermediate results. To better understand these challenges, we conducted a formative study that identified concrete and actionable requirements for supporting iterative design with Generative Tools. Guided by these findings, we propose PrototypeFlow, a human-centered system for automated UI generation that leverages multi-modal inputs and models. PrototypeFlow takes natural language descriptions and layout preferences as input to generate the high-fidelity UI design. At its core is a theme design module that clarifies implicit design intent through prompt enhancement and orchestrates sub-modules for component-level generation. Designers retain full control over inputs, intermediate results, and final prototypes, enabling flexible and targeted refinement by steering generation and directly editing outputs. Our experiments and user studies confirmed the effectiveness and usefulness of our proposed PrototypeFlow.

Förderung

  • Dieter Schwarz Foundation and the Technical University of Munich—Institute for Advanced Study, Germany

Zitieren

APA

Yuan, M., Chen, J., Hu, Y., Feng, S., Xie, M., Mohammadi, G., Xing, Z., & Quigley, A. (2026). Towards Human–AI Synergy in UI Design: Supporting Iterative Generation with LLMs. ACM Transactions on Computer-Human Interaction, 33(1), 1-45. https://doi.org/10.1145/3773035

Vancouver

Yuan M, Chen J, Hu Y, Feng S, Xie M, Mohammadi G, et al. Towards Human–AI Synergy in UI Design: Supporting Iterative Generation with LLMs. ACM Transactions on Computer-Human Interaction. 2026;33(1):1-45. doi:10.1145/3773035

BibTeX
@article{Yuan2026,
  author = {Yuan, Mingyue and Chen, Jieshan and Hu, Yongquan and Feng, Sidong and Xie, Mulong and Mohammadi, Gelareh and Xing, Zhenchang and Quigley, Aaron},
  title = {Towards Human–AI Synergy in UI Design: Supporting Iterative Generation with LLMs},
  journal = {ACM Transactions on Computer-Human Interaction},
  year = {2026},
  volume = {33},
  number = {1},
  pages = {1--45},
  doi = {10.1145/3773035}
}
Kostenlos starten →