When testing applications that run on diverse client devices, operating systems, and browsers, it is necessary to check whether application screens display correctly in various environments and ensure that there is no...
详细信息
ISBN:
(纸本)9781538663523
When testing applications that run on diverse client devices, operating systems, and browsers, it is necessary to check whether application screens display correctly in various environments and ensure that there is no presentation failure. Applications are typically composed of many screens, and there are many types and combinations of environments in which they may run. Accordingly, it is very labor intensive to visually confirm large numbers of such screens, and there is a strong possibility of missing presentation failures. Finding a way of efficiently confirming large numbers of application screen images is hence a challenge facing real-world testing and industry. Here, we propose a method to support discovery of presentation failures. It detects differences in screen elements, e.g., a disappearance of or change in the position of a button, by comparing the images of the correct screen and the target screen by utilizing computer vision techniques and displays those differences to the tester in an easy-to-understand way. As a result, the tester can quickly confirm the differences and find presentation failures efficiently. Our method uses only images of the application screen, therefore it does not depend on a specific implementation technology. Thus, it can be utilized for confirming the test results of various implementations (Web, android, iOS, etc.). In experiments with application screens in which presentation failures were intentionally embedded, we measured how much the proposed method increases failure discovery rate and determined whether it reduces the amount of labor.
Software testing is an important and expensive part of software projects. Test automation has potential to reduce this cost by automating especially regression testing. The goal of this thesis was to evaluate ways to ...
详细信息
Software testing is an important and expensive part of software projects. Test automation has potential to reduce this cost by automating especially regression testing. The goal of this thesis was to evaluate ways to automate user interface testing. The literature review compares different automated user interface testing methods and discusses test execution and reporting practices. In an empirical case study, a user interface test automation system was developed in the T-LOIK project of the Finnish Transport agency for automating regression testing. The test automation system also included a system for automatically executing tests and reporting results. Structure based testing and visual gui testing were used for building the test automation system and both of the methods are also recommended in literature. Results indicate that structure based tests are more reliable and cheaper to main- tain, but require understanding of the internal user interface structure and having access to it. visual gui testing is not dependent on the type of user interface used. In addition to developing tests, the test execution and reporting practices need to be considered as well. It is important that the tests are executed regularly in order to notice errors early. In addition, error reports need to be clear and contain enough information for evaluating the reason of the error. In conclusion, especially regression testing should be automated as much as pos- sible, because the existing features change less often reducing the need for main- tenance. Either structure based tests or visualgui tests should be used for this. In addition, it is important to ensure that the tests are useful for developers by concentrating on good execution and reporting practices.
visual gui testing (VGT) is an emerging technique that provides software companies with the capability to automate previously time-consuming, tedious, and fault prone manual system and acceptance tests. Previous work ...
详细信息
ISBN:
(纸本)9780769549682
visual gui testing (VGT) is an emerging technique that provides software companies with the capability to automate previously time-consuming, tedious, and fault prone manual system and acceptance tests. Previous work on VGT has shown that the technique is industrially applicable, but has not addressed the real-world applicability of the technique when used by practitioners on industrial grade systems. This paper presents a case study performed during an industrial project with the goal to transition from manual to automated system testing using VGT. Results of the study show that the VGT transition was successful and that VGT could be applied in the industrial context when performed by practitioners but that there were several problems that first had to be solved, e.g. testing of a distributed system, tool volatility. These problems and solutions have been presented together with qualitative, and quantitative, data about the benefits of the technique compared to manual testing, e.g. greatly improved execution speed, feasible transition and maintenance costs, improved bug finding ability. The study thereby provides valuable, and previously missing, contributions about VGT to both practitioners and researchers.
System- and acceptance-testing are primarily performed with manual practices in current software industry. However, these practices have several issues, e.g. they are tedious, error prone and time consuming with costs...
详细信息
ISBN:
(纸本)9780769549682
System- and acceptance-testing are primarily performed with manual practices in current software industry. However, these practices have several issues, e.g. they are tedious, error prone and time consuming with costs up towards 40 percent of the total development cost. Automated test techniques have been proposed as a solution to mitigate these issues, but they generally approach testing from a lower level of system abstraction, leaving a gap for a flexible, high system-level test automation technique/tool. In this paper we present JAutomate, a visual gui testing (VGT) tool that fills this gap by combining image recognition with record and replay functionality for high system-level test automation performed through the system under test's graphical user interface. We present the tool, its benefits compared to other similar techniques and manual testing. In addition, we compare JAutomate with two other VGT tools based on their static properties. Finally, we present the results from a survey with industrial practitioners that identifies test-related problems that industry is currently facing and discuss how JAutomate can solve or mitigate these problems.
visual gui testing (VGT) is an emerging technique that provides software companies with the capability to automate previously time-consuming, tedious, and fault prone manual system and acceptance tests. Previous work ...
详细信息
ISBN:
(纸本)9781467359610
visual gui testing (VGT) is an emerging technique that provides software companies with the capability to automate previously time-consuming, tedious, and fault prone manual system and acceptance tests. Previous work on VGT has shown that the technique is industrially applicable, but has not addressed the real-world applicability of the technique when used by practitioners on industrial grade systems. This paper presents a case study performed during an industrial project with the goal to transition from manual to automated system testing using VGT. Results of the study show that the VGT transition was successful and that VGT could be applied in the industrial context when performed by practitioners but that there were several problems that first had to be solved, e.g. testing of a distributed system, tool volatility. These problems and solutions have been presented together with qualitative, and quantitative, data about the benefits of the technique compared to manual testing, e.g. greatly improved execution speed, feasible transition and maintenance costs, improved bug finding ability. The study thereby provides valuable, and previously missing, contributions about VGT to both practitioners and researchers.
暂无评论