Recent Progress in Automated Code Generation from GUI Images Using Machine Learning Techniques

Daniel de Souza Baulé; Christiane Gresse von Wangenheim; Aldo von Wangenheim; Jean Carlo Rossa Hauck

doi:10.3897/jucs.2020.058

Research Article

JUCS - Journal of Universal Computer Science 26(9): 1095-1127
https://doi.org/10.3897/jucs.2020.058 (28 Sep 2020)

Other versions:

(Verbatim name)

(Catalog Number)

DES

Invalid DOI was provided, please try again

(14)

(17)

Thisaranie Kaluarachchi (2025)
From Mock-ups to Code: A Conceptual Synthesis of AI-Driven Automatic Website Generation. International Journal of Innovative Science and Research Technology : 305.

DOI: 10.38124/ijisrt/25nov339

Åsne Stige, Efpraxia D. Zamani, Patrick Mikalef, Yuzhen Zhu (2024)
Artificial intelligence (AI) for user experience (UX) design: a systematic literature review and future research agenda. Information Technology & People 37: 2324.

DOI: 10.1108/ITP-07-2022-0519

Ting Zhou, Yanjie Zhao, Xinyi Hou, Xiaoyu Sun, Kai Chen, Haoyu Wang (2025)
DeclarUI: Bridging Design and Development with Automated Declarative UI Code Generation. Proceedings of the ACM on Software Engineering 2: 219.

DOI: 10.1145/3715726

Areeg Ahmed, Shahira Azab, Sherin M. Moussa, Yasser Abdelhamid (2025)
ViT-DtC: vision transformer-based design-to-code framework for code generation from generated UI designs and hand-drawn sketches. Neural Computing and Applications 37: 24243.

DOI: 10.1007/s00521-025-11565-z

Jialiang Wei, Anne-Lise Courbis, Thomas Lambolais, Binbin Xu, Pierre Louis Bernard, Gérard Dray (2023)
Boosting GUI Prototyping with Diffusion Models. 2023 IEEE 31st International Requirements Engineering Conference (RE) : 275.

DOI: 10.1109/RE57278.2023.00035

Minhazul Arefin, Kazi Mojammel Hossen, Robin Khan (2023)
pic2code: Generating HTML Code from Handwritten Picture. 2023 26th International Conference on Computer and Information Technology (ICCIT) : 1.

DOI: 10.1109/ICCIT60459.2023.10441098

Fabrício L. Soares, Thiago A. Falcão, Tafarel B. F. Souza, Jordan S. Queiroz, Phillip M. Furtado, José L. R. Neto, Barbara A. T. Silva, Erick C. Bezerra (2023)
A React Style Guide Library for MUI Web Apps. 2023 9th International HCI and UX Conference in Indonesia (CHIuXiD) : 77.

DOI: 10.1109/CHIuXiD59550.2023.10452729

Padamjit Sandhu, Pankaj Khurana, Jimmy Singla (2026)
A Review of Screenshot-to-Code Generation Systems. 2026 5th International Conference on Communication, Computing and Electronics Systems (ICCCES) : 1454.

DOI: 10.1109/ICCCES62661.2026.11436626

Nathalia da Cruz Alves, Leonardo Kreuch, Christiane Gresse von Wangenheim (2022)
Analyzing structural similarity of user interface layouts of Android apps using deep learning. Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems : 1.

DOI: 10.1145/3554364.3559111

Yifei Wang, Jacky Keung, Zhenyu Mao, Jingyu Zhang, Yuchen Cao (2025)
Chart2Code-MoLA: Efficient Multi-Modal Code Generation via Adaptive Expert Routing. 2025 32nd Asia-Pacific Software Engineering Conference (APSEC) : 575.

DOI: 10.1109/APSEC66846.2025.00061

Yueming He, Xinyue Xu (2024)
Design of Automatic Production Algorithm for Ceramic Patterns Based on Machine Learning. 2024 International Conference on Electrical Drives, Power Electronics & Engineering (EDPEE) : 359.

DOI: 10.1109/EDPEE61724.2024.00074

Yovita Tunardi, Budi Yulianto, Rita Layona (2024)
Web-Based Application for GUI Programming Learning Through Reverse Engineering Method. 2024 International Conference on Information Technology Systems and Innovation (ICITSI) : 531.

DOI: 10.1109/ICITSI65188.2024.10929136

Daniel de Souza Baulé, Christiane Gresse von Wangenheim, Aldo von Wangenheim, Jean C. R. Hauck, Edson C. Vargas Júnior (2021)
Using Deep Learning to Support the User Interface Design of Mobile Applications with App Inventor. Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems : 1.

DOI: 10.1145/3472301.3484340

Jingbin Liang, Jing Liang, Shuang Li (2025)
Computer Animation and Social Agents. Chapter 19: 267.

DOI: 10.1007/978-981-96-2684-7_19