JUCS - Journal of Universal Computer Science 32(6): 763-797, doi: 10.3897/jucs.136861
Choosing the Right Test Generation Tool: A Guide for Software Practitioners
expand article infoEdna Dias Canedo, Gabriel Matheus da Rocha de Oliveira§, Fabiana Freitas Mendes|, Heloise Acco Tives Bedin
‡ Federal University of Pernambuco (UFPE), Recife, Brazil§ University of Brasília (UnB), Brasília, Brazil| Department of Computer Sciences and Information Technology, Palmerston North, New Zealand¶ Federal Institute of Paraná (IFPR), Palmas, Brazil
Open Access
Abstract
Context: As software systems become increasingly complex, testing automation plays a critical role in ensuring product quality and reliability. However, the wide variety of available test generation tools with distinct purposes, features, and approaches makes it difficult for practitioners to select the most appropriate option for their projects. Goal: This study aims to identify, analyze, and compare test generation tools reported in both academic and industrial contexts, providing a practical reference guide to support software professionals in tool selection decisions. Method: We conducted a Multivocal Literature Review (MLR) complemented by a two-round survey with 87 software practitioners. The MLR identified tools and features reported in white and grey literature, while the survey assessed practitioners’ familiarity, usage, and perceptions of advantages and challenges associated with these tools. Results: The findings reveal a persistent gap between academic proposals and industrial adoption. While tools such as Postman, Selenium, and Cypress are among the most widely used tools in practice, academic tools like Monkey and Dynodroid remain rarely adopted. Practitioners value visibility, integration, and traceability as key features, whereas inconsistency and maintenance effort are seen as primary challenges. Conclusions: The study contributes a structured reference guide to assist professionals in selecting tools suitable for specific testing contexts. It also provides insights for researchers aiming to align future tool development with industry needs, fostering better usability, integration, and sustainability of automated testing solutions.
Keywords
Software Testing, Software Testing Tools, Test Generation Tools, Tools Comparison, Multivocal Literature Review
login to comment