检索结果-内蒙古大学图书馆

SleepReplacer: a novel tool-based approach for replacing thread sleeps in selenium WebDriver test code

SOFTWARE QUALITY JOURNAL 2022年第4期30卷 1089-1121页

作者： Olianas, Dario Leotta, Maurizio Ricca, Filippo Univ Genoa Dipartimento Informat Bioingn Robot & Ingn Sistem Genoa Italy

Assuring quality of web applications is fundamental, given their relevance in the today's world. A possible way to reach this goal is through end-to-end (E2E) testing, an approach in which a web application is automatically tested by performing the actions that a user would do. With modern web applications (for example, single-page applications), it is of great importance to properly handle asynchronous calls in the test suite. In E2E Selenium WebDriver test suites, asynchronous calls are usually managed in two ways: using thread sleeps or explicit waits. The first is easier to use, but is inefficient and can lead to instability (also called flakiness, a problem often present in test suites that makes us lose confidence in the testing phase), while the second is usually more efficient but harder to use because, if the correct kind of wait is not carefully selected, it can introduce flakiness too. To help testers, who often opt for the first strategy, we present in this work a tool-based approach to automatically replace thread sleeps with explicit waits in an E2E Selenium WebDriver test suite without introducing new flakiness. We empirically validated our tool named SleepReplacer on four different test suites, and we found that it can correctly replace in an automatic way from 81 to 100% of thread sleeps, leading to a significant reduction of the total execution time of the test suite (i.e., from 13 to 71%).

关键词： Web testing Thread sleeps Explicit waits test code Selenium WebDriver

来源：评论

学校读者我要写书评

暂无评论

An Analysis of Complex Industrial test code using Clone analysis 18

An Analysis of Complex Industrial Test Code using Clone anal...

引用

18th IEEE International Conference on Software Quality, Reliability, and Security (QRS)

作者： Hasanain, Wafa Labiche, Yvan Eldh, Sigrid Carleton Univ Dept Syst & Comp Engn Ottawa ON Canada Ericsson AB Kista Sweden

ISBN: (纸本)9781538677575

Many companies, including Ericsson, experience increased software verification costs. Agile cross-functional teams find it easy to make new additions of test cases for every change and fix. The consequence of this phenomenon is duplications of test code. In this paper, we perform an industrial case study that aims at better understanding such duplicated test fragments or as we call them, clones. In our study, 49% (LOC) of the entire test code are clones. The reported results include figures about clone frequencies, types, similarity, fragments, and size distributions, and the number of line differences in cloned test cases. It is challenging to keep clones consistent and remove unnecessary clones during the entire testing process of large-scale commercial software.

关键词： clone detection test code industrial case study test smell refactoring test code code duplications

来源：评论

学校读者我要写书评

暂无评论

PHANTA: Diversified test code Quality Measurement for Modern Software Development 34

PHANTA: Diversified Test Code Quality Measurement for Modern...

引用

34th IEEE/ACM International Conference on Automated Software Engineering (ASE)

作者： Tokumoto, Susumu Takayama, Kuniharu Fujitsu Labs Ltd Kawasaki Kanagawa Japan

ISBN: (纸本)9781728125084

test code is becoming more essential to the modern software development process. However, practitioners often pay inadequate attention to key aspects of test code quality, such as bug detectability, maintainability and speed. Existing tools also typically report a single test code quality measure, such as code coverage, rather than a diversified set of metrics. To measure and visualize quality of test code in a comprehensive fashion, we developed an integrated test code analysis tool called Phanta. In this show case, we posit that the enhancement of test code quality is key to modernizing software development, and show how Phanta's techniques measure the quality using mutation analysis, test code clone detection, and so on. Further, we present an industrial case study where Phanta was applied to analyze test code in a real Fujitsu project, and share lessons learned from the case study.

关键词： Mutation testing Software testing test code

来源：评论

学校读者我要写书评

暂无评论

Exploring and Improving code Completion for test code 32

Exploring and Improving Code Completion for Test Code

引用

32nd IEEE/ACM International Conference on Program Comprehension (ICPC)

作者： Zhu, Tingwei Liu, Zhongxin Xu, Tongtong Tang, Ze Zhang, Tian Pan, Minxue Xia, Xin Nanjing Univ State Key Lab Novel Software Technol Nanjing Peoples R China Zhejiang Univ Hangzhou Peoples R China Huawei Hangzhou Peoples R China

ISBN: (纸本)9798400705861

code completion is an important feature in Integrated Development Environments (IDEs). These years, researchers have been making efforts for intelligent code completion. However, existing work on intelligent code completion either only considered production code, or did not distinguish between production code and test code. It is unclear how effective existing completion models are for test code completion, nor whether we can further improve it. In this work, we focus on the completion of test code. We first find through experiments that completion models for production code are suboptimal for test code completion. Then we analyze the specific characteristics of test code, and observe that test code has interand intra-project similarities, and a strong relationship with its focal class and other production classes depending on the focal class (i.e., focal-related code). By incorporating test code from other projects to fine-tune existing models, we leverage the inter-project similarity of test code to improve the completion of tokens specific to test code. By introducing a local component and constructing existing test code as well as the focal-related code in the project as references, we enhance existing code completion models with the intra-project similarity and the focal-related code of test code. Experiments show that each characteristic of test code we exploit can bring substantial improvement to test code completion and our integrated framework outperforms other baseline frameworks. Compared to the base completion model, on token-level completion, our optimal model for test code completion relatively improves all-token and identifier completion accuracy by 7.68% and 19.96%, respectively;on line-level completion, it relatively improves editdistance similarity and exact-match metrics by 8.89% and 22.82%, respectively. Moreover, we perform error analysis and point out potential directions for future work.

关键词： code Completion test code Retrieval Augmentation

来源：评论

学校读者我要写书评

暂无评论

Extending Refactoring Guidelines to Perform Client and test code Adaptation

Extending Refactoring Guidelines to Perform Client and Test ...

引用

11th International Conference on Agile Software Development (XP2010)

作者： Basit, Wafa Lodhi, Fakhar Bhatti, Usman Natl Univ Comp & Emerging Sci Lahore Pakistan

ISBN: (纸本)9783642130533

Refactoring is a disciplined process of applying structural transformations in the code such that the program is improved in terms of quality and its external behavior is preserved. Refactoring includes evaluation of its preconditions, execution of its mechanics and corrective actions required to retain the behavior of the program. These transformations affect various locations throughout a program which includes its clients and unit tests. Due to the complex dependencies involved within the program, preservation of program behavior often becomes nontrivial. The guidelines on refactoring by Fowler lack precision and leave opportunities for developers to err. In this paper, we analyze and present an exhaustive categorization of refactoring guidelines based on their impact on production and test code together. In addition, we present extended refactoring guidelines that adapt the clients and unit tests to keep it syntactically and semantically aligned with the refactored code.

关键词： Refactoring guidelines unit testing production code test code adaptation

来源：评论

学校读者我要写书评

暂无评论

A Proposal of test code Generation Tool for Java Programming Learning Assistant System 31

A Proposal of Test Code Generation Tool for Java Programming...

引用

31st IEEE International Conference on Advanced Information Networking and Applications (IEEE AINA)

作者： Funabiki, Nobuo Kusaka, Ryota Ishihara, Nobuya Kao, Wen-Chung Okayama Univ Dept Elect & Commun Engn Okayama Japan Natl Taiwan Normal Univ Dept Elect Engn Taipei Taiwan

ISBN: (纸本)9781509060290

To advance Java programming educations, we have developed the Java programming learning assistant system (JPLAS) that can verify the correctness of the code from a student automatically using the test-driven development (TDD) method. Then, to register a new assignment in JPLAS, teachers are required to write the test code in addition to the reference source code. Unfortunately, most teachers at schools are not accustomed to writing test codes. In this paper, we propose a test code generation tool that automatically generates the test cases from the reference source code by extracting the outputs for given inputs using functions in JUnit. As assignments for Java novice students, the code that contains standard inputs/outputs is emphasized. For evaluation, we collected 97 codes containing standard inputs/outputs from Java programming text books or Web sites. The experimental result has shown that the proposed tool correctly generated the test codes for them except for one code using a random generator.

关键词： Java programming JPLAS test code test case automatic generation JUnit

来源：评论

学校读者我要写书评

暂无评论

Mining API Usage Examples from test code 30

Mining API Usage Examples from Test Code

引用

30th IEEE International Conference on Software Maintenance and Evolution (ICSME)

作者： Zhu, Zixiao Zou, Yanzhen Xie, Bing Jin, Yong Lin, Zeqi Zhang, Lu Peking Univ Sch Elect Engn & Comp Sci Software Inst Beijing 100871 Peoples R China Minist Educ Key Lab High Confidence Software Technol Beijing 100871 Peoples R China

ISBN: (纸本)9780769553030

Lack of effective usage examples in API documents has been proven to be a great obstacle to API learning. To deal with this issue, several approaches have been proposed to automatically extract usage examples from client code or related web pages, which are unfortunately not available for newly released API libraries. In this paper, we propose a novel approach to mining API usage examples from test code. Although test code can be a good source of usage examples, the issue of multiple test scenarios might lead to repetitive and interdependent API usages in a test method, which make it complicated and difficult to extract API usage examples. To address this issue, we study the JUnit test code and summarize a set of test code patterns. We employ a code pattern based heuristic slicing approach to separate test scenarios into code examples. Then we cluster the similar usage examples for recommendation. An evaluation on four open source software libraries demonstrates that the accuracy of our approach is much higher than the state-of-art approach eXoaDoc on test code. Furthermore, we have developed an Eclipse plugin tool UsETeC.

关键词： API usage example test code code patterns code slicing

来源：评论

学校读者我要写书评

暂无评论

What Do We Know About Readability of test code? - A Systematic Mapping Study 29

What Do We Know About Readability of Test Code? - A Systemat...

引用

29th IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)

作者： Winkler, Dietmar Urbanke, Pirmin Ramler, Rudolf TU Wien Inst Inf Syst Engn CDL SQI Vienna Austria Software Competence Ctr Hagenberg GmbH SCCH Hagenberg Austria

ISBN: (纸本)9781665437868

The readability of software code is a key success criterion for understanding and maintaining software systems and tests. In industry practice, a limited number of guidelines aim for improving and assessing the readability of software (test) code. Although several studies focus on investigating the readability of software code, we observed limited research work that focuses on the readability of software test code. In this paper we focus on systematically investigating the characteristics, factors, and assessment criteria that have an impact on the readability of test code. We build on a Systematic Mapping Study (SMS) to identify key characteristics, factors, and assessment criteria that have an impact on test code readability, legibility, and understandability to support and improve maintenance tasks. The result set includes 16 studies for further analysis. The majority of publications focuses on readability investigations of automatically generated test code (88%), often evaluated with surveys to access the readability of test code (44%). Although several approaches aim at assessing the readability with focus on isolated factors, a combination of different readability aspects within an assessment framework can help to better assess and justify the readability of test code with focus on improving software and system test maintenance.

关键词： Software testing test code Readability Understandability Maintainability Systematic Mapping Study

来源：评论

学校读者我要写书评

暂无评论

An Empirical Study of Bugs in test code 31

An Empirical Study of Bugs in Test Code

引用

IEEE 31st International Conference on Software Maintenance and Evolution (ICSME)

作者： Vahabzadeh, Arash Fard, Amin Milani Mesbah, Ali Univ British Columbia Vancouver BC Canada

ISBN: (纸本)9781467375320

testing aims at detecting (regression) bugs in production code. However, testing code is just as likely to contain bugs as the code it tests. Buggy test cases can silently miss bugs in the production code or loudly ring false alarms when the production code is correct. We present the first empirical study of bugs in test code to characterize their prevalence and root cause categories. We mine the bug repositories and version control systems of 211 Apache Software Foundation (ASF) projects and find 5,556 test-related bug reports. We (1) compare properties of test bugs with production bugs, such as active time and fixing effort needed, and (2) qualitatively study 443 randomly sampled test bug reports in detail and categorize them based on their impact and root causes. Our results show that (1) around half of all the projects had bugs in their test code;(2) the majority of test bugs are false alarms, i.e., test fails while the production code is correct, while a minority of these bugs result in silent horrors, i.e., test passes while the production code is incorrect;(3) incorrect and missing assertions are the dominant root cause of silent horror bugs;(4) semantic (25%), flaky (21%), environment-related (18%) bugs are the dominant root cause categories of false alarms;(5) the majority of false alarm bugs happen in the exercise portion of the tests, and (6) developers contribute more actively to fixing test bugs and test bugs are fixed sooner compared to production bugs. In addition, we evaluate whether existing bug detection tools can detect bugs in test code.

关键词： Bugs test code empirical study

来源：评论

学校读者我要写书评

暂无评论

POSTER: Seccomp profiling with Dynamic Analysis via ChatGPT-assisted test code Generation 19

POSTER: Seccomp profiling with Dynamic Analysis via ChatGPT-...

引用

19th ACM Asia Conference on Computer and Communications Security (ACM AsiaCCS)

作者： Song, Somin Kundu, Ashish Tak, Byungchul Cisco Res San Jose CA USA Kyungpook Natl Univ Daegu South Korea

ISBN: (纸本)9798400704826

The effectiveness of Seccomp kernel feature depends on how tightly and accurately the necessary system calls are specified in the seccomp policy. Static code analysis may miss out or over-approximate required system calls. With dynamic analysis, it is difficult to cover all possible execution paths. In this work, we aim to advance the state-of-the-art dynamic analysis approach by enabling it to increase the coverage of the target application's functionalities. Our approach takes as input the application's online documentation and leverages ChatGPT to generate a large number of test codes for functionalities in the documentation. This automated process eliminates the barrier to manually writing a large number of test codes for conducting dynamic analysis. Through our preliminary evaluation, we confirmed that ChatGPT can be used effectively to automatically generate a large number of test codes. Also, we observed early evidence that the seccomp policy generated from running the test codes could be more sound than the ones generated by static analysis.

关键词： Seccomp ChatGPT Static analysis Dynamic analysis test code

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：