检索结果-内蒙古大学图书馆

Empirical Analysis of Object-Oriented Software Test Suite Evolution

INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS 2019年第11期10卷 89-98页

作者： Alsolami, Nada Obeidat, Qasem Alenezi, Mamdouh Al Imam Mohanunad Ibn Saud Islamic Univ Comp Sci Dept Riyadh Saudi Arabia Univ Bahrain Comp Sci Dept Sakheer Bahrain Prince Sultan Univ Comp Sci Dept Riyadh Saudi Arabia

The software system is evolving over the time, thus, the test suite must be repaired according to the changing code. Updating test cases manually is a time-consuming activity, especially for large test suites, which motivate the recent development of automatically repairing test techniques. To develop an effective automatic repair technique that reduces the effort of development and the cost of evolution, the developer should understand how the test suite evolves in practice. This investigation aims to conduct a comprehensive empirical study on eight Java systems with many versions of these systems and their test suites to find out how the test suite is evolving, and to find the relationship between the change in the program and the corresponding evolution in the test suite. This study showed that the test suite size is mostly increased, where the test suite complexity is stabilized. The increase (or decrease) in the code size will mostly increase (or decrease) the test suite size. However, the increasing or decreasing in the code complexity is offset by stabilizing the test suite complexity. Moreover, the percentage of the code coverage tends to be increased more than decreased, but in the mutation coverage, the opposite is true.

关键词： Software test code complexity code coverage test evolution

来源：评论

学校读者我要写书评

暂无评论

White-box software test generation with Microsoft Pex on open source C# projects: A dataset

引用

DATA IN BRIEF 2020年 31卷 105962页

作者： Honfi, David Micskei, Zoltan Budapest Univ Technol & Econ Dept Measurement & Informat Syst Budapest Hungary

The paper presents a dataset on software tests generated using the Microsoft Pex (IntelliTest) test generator tool for 10 open source projects. The projects were selected randomly from popular GitHub repositories written in C#. The selected projects contain 7187 methods from which Pex was able to generate tests for 2596 methods totaling 38,618 lines of code. Data collection was performed on a cloud virtual machine. The dataset presents metrics about the attributes of the selected projects (e.g., cyclomatic complexity or number of external method calls) and the test generation (e.g., statement and branch coverage, number of warnings). This data is compared to an automated isolation technique in the paper Automated Isolation for White-box Test Generation [1] . To the best of our knowledge, this is the largest public dataset about the test generation performance of Microsoft Pex on open source projects. The dataset highlights current practical challenges and can be used as a baseline for new test generation techniques. (C) 2020 The Author(s). Published by Elsevier Inc.

关键词： Software testing Test generation Symbolic execution code coverage White-box testing

来源：评论

学校读者我要写书评

暂无评论

Non-Intrusive Structural coverage for Objective Caml

引用

ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE 2010年第4期264卷 59-73页

作者： Wang, Philippe Jonquet, Adrien Chailloux, Emmanuel Univ Pierre & Marie Curie Paris 6 CNRS UMR 7606 Lab Informat Paris 6Equipe APR 4 Pl Jussieu F-75005 Paris France

This paper presents a non-intrusive method for Objective Caml code coverage analysis. While classic methods rewrite the source code to an instrumented version that will produce traces at runtime, our approach chooses not to rewrite the source code. Instead, we use a virtual machine to monitor instructions execution and produce traces. These low-level traces are used to create a machine code coverage report. Combined with control-flow debug information, they can be analyzed to produce a source code coverage report. The purpose of this approach is to make available a method to generate code coverage analysis with the same binary for testing and for production. Our customized virtual machine respects the same semantics as the original virtual machine;one of its original aspects is that it is implemented in the Objective Caml, the very language we build the tool for. This work is part of the coverage project, which aims to develop open source tools for safety-critical embedded applications and their code generators.

关键词： Certification Tools Design code coverage Objective Caml Virtual Machine

来源：评论

学校读者我要写书评

暂无评论

Regression Test Case Prioritization: A Systematic Literature Review

引用

INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS 2021年第2期12卷 655-663页

作者： Samad, Ali Mahdin, Hairulnizam Kazmi, Rafaqut Ibrahim, Rosziati Univ Tun Hussein Onn Malaysia UTHM Fac Comp Sci & Informat Technol Batu Pahat 86400 Johor Malaysia Islamia Univ Bahawalpur Fac Comp Bahawalpur 63100 Pakistan

The techniques associated with the Test Case Prioritization (TCP) are used to reduce the cost of regression testing to achieve the objectives that the modifications in the target code would not impact the functionality of updated software. The effectiveness of the TCP is measured based on the cost, the code coverage, and fault detection ability. The regression testing techniques proposed so far are focusing on one or two effectiveness parameters. In this paper, we presented a state-of-art review of the approaches used in regression testing in detail. The second objective is to combine these effective adequacy measures into a single or multi-objective TCP task. This systematic literature review is conducted to identify the state-of-the-art research in regression TCP from 2007 to 2020. The research identifies fifty-two (52) relevant studies that were focusing on these three selection parameters to justify their findings. The results reveal that there were six families of regression TCP in which meta-heuristic regression TCP were reported in 38% and generic regression TCP techniques in 31%. The parameters used as prioritization criteria were cost, code coverage, and fault detection ability. The code coverage is reported by 38%, cost in 17%, and cost and code coverage in 31%. There were three sources for datasets were identified named Software artefact Infrastructure Repository (SIR), Apache Software Foundation, and Git Hub. The measurement and metrics used to validate the effectiveness are inclusiveness, precision, recall, and retest-all.

关键词： Software testing regression testing test case prioritization cost code coverage fault detection ability

来源：评论

学校读者我要写书评

暂无评论

Analysis of Static and Dynamic Test-to-code Traceability Information

引用

ACTA CYBERNETICA 2018年第3期23卷 903-919页

作者： Gergely, Tamas Balogh, Gergo Horvath, Ferenc Vancsics, Bela Beszedes, Arpad Gyimothy, Tibor Univ Szeged Dept Software Engn Szeged Hungary Univ Szeged MTA SZTE Res Grp Artificial Intelligence Szeged Hungary

Unit test development has some widely accepted guidelines. Two of them concern the test and code relationship, namely isolation (unit tests should examine only a single unit) and separation (they should be placed next to this unit). These guidelines are not always kept by the developers. They can however be checked by investigating the relationship between tests and the source code, which is described by test-to-code traceability links. Still, these links perhaps cannot be inferred unambiguously from the test and production code. We developed a method that is based on the computation of traceability links for different aspects and report Structural Unit Test Smells where the traceability links for the different aspects do not match. The two aspects are the static structure of the code that reflects the intentions of the developers and testers and the dynamic coverage which reveals the actual behavior of the code during test execution. In this study, we investigated this method on real programs. We manually checked the reported Structural Unit Test Smells to find out whether they are real violations of the unit testing rules. Furthermore, the smells were analyzed to determine their root causes and possible ways of correction.

关键词： test-to-code traceability unit testing code coverage test smells refactoring

来源：评论

学校读者我要写书评

暂无评论

Selection and Prioritization of Test Cases by Combining White-Box and Black-Box Testing Methods

Selection and Prioritization of Test Cases by Combining Whit...

引用

Eastern European Regional Conference on the Engineering of Computer Based Systems

作者： Sandra Kukolj Vladimir Marinkovi? Miroslav Popovi? Szabolcs Bognár University of Novi Sad Faculty of Technical Sciences Novi Sad Serbia University of Szeged Institute of Informatics Department of Software Engineering Szeged Hungary

ISBN: (纸本)9781479908530

In this paper, we present a methodology that combines both white-box and black-box testing, in order to improve testing quality for a given class of embedded systems. The goal of this methodology is generation of test cases for the new functional testing campaign based on the test coverage information from the previous testing campaign, in order to maximize the test coverage. Test coverage information is used for selection of proper test cases in order to improve the quality of testing and save available resources for testing. As an output, a set of test cases is produced. Generated test cases are processed by the test Executor application that decides whether results have passed or failed, based on the results of image grabbing, OCR text extraction, and comparison with expected text. The presented methodology is finally validated by means of a case-study targeting an Android device. The results of the case study are affirmative and they indicate that the proposed methodology is applicable for testing embedded systems of this kind.

关键词： embedded systems quality assurance black-box testing white-box testing code coverage

来源：评论

学校读者我要写书评

暂无评论

Test-suite Reduction Based on K-medoids Clustering Algorithm

Test-suite Reduction Based on K-medoids Clustering Algorithm

引用

第九届网络分布式计算与知识发现国际会议( 2017 International Conference on Cyber-enabled distributed computing and knowledge discovery)

作者： Feng Liu Jun Zhang Er-zhou Zhu School of Computer Science and Technology Anhui University Hefei China

Software testing is a key approach to guarantee the software *** is the objective unremittingly pursed by virtue of effective testing cases in the shortest *** test suite optimization method is a NP-complete *** some people apply k-means clustering algorithm to the test suite reduction,the algorithm is unstable and seldom considers the coverage rate of such test cases;as a result,it will waste many unnecessary testing time in redundant cases and always result in high ***,this paper introduces k-medoids thought of the clustering algorithm and then proposes a method of parameter generation test suite characterized by cyclomatic complexity and code coverage *** method utilizes the greedy algorithm to process the streamlined test suite while guaranteeing the cases coverage rate and the error detection rate finally gain the minimal test *** indicated by the stimulation experimental results,our method features higher coverage rate with lower complexity under the streamlined test suite of the same quantity.

关键词： test suite reduction k-medoids code coverage cluster analysis

来源：评论

学校读者我要写书评

暂无评论

Does Unit-Tested code Crash? A Case Study of Eclipse 2021

Does Unit-Tested Code Crash? A Case Study of Eclipse

引用

25th Pan-Hellenic Conference on Informatics

作者： Efstathia Chioteli Ioannis Batas Diomidis Spinellis Athens University of Economics and Business Greece

ISBN: (纸本)9781450395557

Context: Software development projects increasingly adopt unit testing as a way to identify and correct program faults early in the construction process. code that is unit tested should therefore have fewer failures associated with it. Objective: Compare the number of field failures arising in unit tested code against those arising in code that has not been unit tested. Method: We retrieved 2 083 979 crash incident reports associated with the Eclipse integrated development environment project, and processed them to obtain a set of 126 026 unique program failure stack traces associated with a specific popular release. We then run the JaCoCo code test coverage analysis on the same release, obtaining results on the line, instruction, and branch-level coverage of 216 392 methods. We also extracted from the source code the classes that are linked to a corresponding test class so as to limit test code coverage results to 1 263 classes with actual tests. Finally, we correlated unit tests with failures at the level of 9 523 failing tested methods. Results: Unit-tested code does not appear to be associated with fewer failures. Conclusion: Unit testing on its own may not be a sufficient method for preventing program failures.

关键词： crash incident reports code coverage stack traces software reliability Unit-testing

来源：评论

学校读者我要写书评

暂无评论

On automatic generation of RTL validation test benches using circuit testing techniques 03

On automatic generation of RTL validation test benches using...

引用

Proceedings of the 13th ACM Great Lakes symposium on VLSI

作者： Indradeep Ghosh Srivaths Ravi Fujitsu Laboratories of America Sunnyvale CA NEC Laboratories America Princeton NJ

In this paper, we examine how good validation test benches can be automatically generated starting from the RTL description of a circuit. We develop our methodology based on extensive experiments performed with severa... 详细信息

ISBN: (纸本)9781581136777

关键词： coverage metrics RTL testing test test sets branch coverage universal test sets fault coverage path coverage OCCOM toggle coverage RTL ATPG design validation small validation testing generation ATPG testbench code coverage

来源：评论

学校读者我要写书评

暂无评论

Binary-oriented Hybrid Fuzz Testing

Binary-oriented Hybrid Fuzz Testing

引用

2015 6th IEEE International Conference on Software Engineering and Service Science(ICSESS 2015)

作者： DONG Fangquan DONG Chaoqun ZHANG Yao LIN Teng Jiang Nan Institute of Computing technology

In software security testing, fuzz testing and symbolic execution are two main testing techniques. Fuzz testing finds program bugs by executing the target program with random inputs it generates while monitoring the execution for abnormal behaviors. Though fuzz testing is able to explore deep into a program's state space efficiently, it usually cannot guarantee the code coverage ratio in many situations. Symbolic execution treats a program's input as symbols and executes the program with such symbolic input. Symbolic execution tries to explore the whole state space of a program by analyzing all of the program's paths. Symbolic execution always guarantees the code coverage ratio in theory, but for real programs it has many problems such as path explosion. Our new method, hybrid fuzz testing, combines the benefits of fuzz testing and symbolic execution. Symbolic execution will start to work and to generate new program input when fuzz testing cannot increase the code coverage ratio. The experiment result implies that our hybrid fuzz testing method can obviously increase the code coverage ratio efficiently in reasonable resources using.

关键词： fuzz testing symbolic execution code coverage case generation

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：