AUITestAgent：自动需求导向GUI功能测试

AUITestAgent: Automatic Requirements Oriented GUI Function Testing

July 12, 2024

作者: Yongxiang Hu, Xuan Wang, Yingchuan Wang, Yu Zhang, Shiyu Guo, Chaoyi Chen, Xin Wang, Yangfan Zhou

cs.AI

摘要

图形用户界面（GUI）是用户与移动应用程序进行交互的方式。为了确保其正常运行，测试工程师必须根据通常用自然语言撰写的测试需求，确保其按照预期功能。虽然广泛采用的手动测试和基于脚本的方法是有效的，但由于现代移动应用程序中GUI页面众多且迭代速度快，因此需要大量工作量。本文介绍了AUITestAgent，这是第一个自动化、基于自然语言驱动的移动应用程序GUI测试工具，能够完全自动化整个GUI交互和功能验证过程。由于测试需求通常包含交互命令和验证规则，AUITestAgent可以通过动态组织的代理从测试需求中提取GUI交互。然后，AUITestAgent采用多维数据提取策略从交互跟踪中检索与测试需求相关的数据并进行验证。在定制基准测试中的实验表明，AUITestAgent在生成的GUI交互质量方面优于现有工具，并实现了94%的验证准确性。此外，在美团的现场部署中，AUITestAgent显示出了实际可用性，它在两个月内的10次回归测试中检测到了4个新的功能性错误。

English

The Graphical User Interface (GUI) is how users interact with mobile apps. To ensure it functions properly, testing engineers have to make sure it functions as intended, based on test requirements that are typically written in natural language. While widely adopted manual testing and script-based methods are effective, they demand substantial effort due to the vast number of GUI pages and rapid iterations in modern mobile apps. This paper introduces AUITestAgent, the first automatic, natural language-driven GUI testing tool for mobile apps, capable of fully automating the entire process of GUI interaction and function verification. Since test requirements typically contain interaction commands and verification oracles. AUITestAgent can extract GUI interactions from test requirements via dynamically organized agents. Then, AUITestAgent employs a multi-dimensional data extraction strategy to retrieve data relevant to the test requirements from the interaction trace and perform verification. Experiments on customized benchmarks demonstrate that AUITestAgent outperforms existing tools in the quality of generated GUI interactions and achieved the accuracy of verifications of 94%. Moreover, field deployment in Meituan has shown AUITestAgent's practical usability, with it detecting 4 new functional bugs during 10 regression tests in two months.