检索结果-内蒙古大学图书馆

HSP: A hybrid selection and prioritisation of regression test cases based on information retrieval and code coverage applied on an industrial case study

引用

JOURNAL OF SYSTEMS AND SOFTWARE 2020年 159卷 110430-000页

作者： Magalhaes, Claudio Andrade, Joao Perrusi, Lucas Mota, Alexandre Barros, Flavia Maia, Eliot Univ Fed Pernambuco UFPE Ctr Informat CIn Av Jornalista Anibal FernandesS-N Cidade Univ BR-50740560 Recife PE Brazil Motorola Mobil LLC 222 West Merchandise Mart Plaza Chicago IL 60654 USA

The usual way to guarantee quality of software products is via testing. This paper presents a novel strategy for selection and prioritisation of Test Cases (TC) for Regression testing. In the lack of code artifacts from where to derive Test Plans, this work uses information conveyed by textual documents maintained by Industry, such as Change Requests. The proposed process is based on Information Retrieval techniques combined with indirect code coverage measures to select and prioritise TCs. The aim is to provide a high coverage Test Plan which would maximise the number of bugs found. This process was implemented as a prototype tool which was used in a case study with our industrial partner (Motorola Mobility). Experiments results revealed that the combined strategy provides better results than the use of information retrieval and code coverage independently. Yet, it is worth mentioning that any of these automated options performed better than the previous manual process deployed by our industrial partner to create test plans. (C) 2019 Elsevier Inc. All rights reserved.

关键词： Test cases selection and prioritisation Regression testing Static analysis Information retrieval code coverage

来源：评论

学校读者我要写书评

暂无评论

Evaluating code coverage for Kernel Fuzzers via Function Call Graph

引用

IEEE ACCESS 2021年 9卷 157267-157277页

作者： Cho, Mingi Jin, Hoyong An, Dohyeon Kwon, Taekyoung Yonsei Univ Grad Sch Informat Seoul 03722 South Korea

The OS kernel, which has full system privileges, is an attractive attack surface. A kernel fuzzer that targets system calls in fuzzing is a popular tool for discovering kernel bugs that can induce kernel privilege escalation attacks. To the best of our knowledge, the relevance of code coverage, which is obtained by fuzzing, to the system call has not been studied yet. For instance, modern coverage-guided kernel fuzzers, such as Syzkaller, estimate code coverage by comparing the entire set of executed basic blocks (or edges) regardless of the system call relevancy. Our insight is that the system call relevancy could be an essential performance indicator for realizing kernel fuzzing. In this regard, this study aims to assess the system call-related code coverage of kernel fuzzers. For this purpose, we have developed a practical assessment system that leverages the Intel PT and KCOV and assessed the Linux kernel fuzzers, such as Syzkaller, Trinity, and ext4 fuzzer. The experiments on different kernel versions demonstrated that approximately 32,000-47,000 functions are implemented in the Linux kernel, and approximately 9.7-15.2% are related to the system call. Our finding is that fuzzers that achieve higher code coverage in conventional metrics do not execute more basic blocks related to system calls. Thus, we recommend that kernel fuzzers use both system call-related functions and regular basic blocks in coverage metrics to assess fuzzing performance or to improve coverage feedback.

关键词： Kernel codes Computer bugs Fuzzing Linux Tools Licenses Fuzzing kernel fuzzing evaluation system call code coverage

来源：评论

学校读者我要写书评

暂无评论

Statement frequency coverage: A code coverage criterion for assessing test suite effectiveness

引用

INFORMATION AND SOFTWARE TECHNOLOGY 2021年 129卷 106426-106426页

作者： Aghamohammadi, Alireza Mirian-Hosseinabadi, Seyed-Hassan Jalali, Sajad Sharif Univ Technol Dept Comp Engn Tehran Iran

Context: Software testing is a pivotal activity in the development of high-quality software. As software is evolving through its life cycle, the need for a fault-revealing criterion assessing the effectiveness of the test suite grows. Over the years, researchers have proposed coverage-based criteria, including statement and branch coverage, to solve this issue. In literature, the effectiveness of such criteria is attested in terms of their correlations with the mutation score. Objective: In this paper, we aim at proposing a coverage-based criterion named statement frequency coverage, which outperforms statement and branch coverage in terms of correlation with mutation score. Method: To this end, we incorporated the frequency of executed statements into statement coverage and created a coverage-based criterion for assessing test suite effectiveness. Statement frequency coverage assigns a continuous value to a statement whose value is proportional to the number of times executed during test execution. We evaluated our approach on 22 real-world Python projects with more than 118 000 source lines of code (without blank lines, comments, and test cases) and 21 000 test cases through measuring the correlation between statement frequency coverage and corresponding mutation score. Results: The results show that statement frequency coverage outperforms statement and branch coverage criteria. The correlation between it and the corresponding mutation score is higher than the correlation of statement and branch coverage with their mutation score. The results also show that unlike statement and branch coverage, there is no statistical difference between statement frequency coverage and mutation score. Conclusion: Statement frequency coverage is a better choice compared to statement and branch coverage in assessing test suite effectiveness in the real-world setting. Furthermore, we demonstrate that although statement frequency coverage subsumes statement coverage, it is incomparab

关键词： Software testing code coverage Test suite effectiveness Mutation testing

来源：评论

学校读者我要写书评

暂无评论

Automatic self-validation for code coverage profilers 19

Automatic self-validation for code coverage profilers

引用

Proceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering

作者： Yibiao Yang Yanyan Jiang Zhiqiang Zuo Yang Wang Hao Sun Hongmin Lu Yuming Zhou Baowen Xu Nanjing University Nanjing China and Huazhong University of Science and Technology Wuhan China Nanjing University Nanjing China

ISBN: (纸本)9781728125084

code coverage as the primitive dynamic program behavior information, is widely adopted to facilitate a rich spectrum of software engineering tasks, such as testing, fuzzing, debugging, fault detection, reverse engineering, and program understanding. Thanks to the widespread applications, it is crucial to ensure the reliability of the code coverage ***, due to the lack of research attention and the existence of testing oracle problem, coverage profilers are far away from being tested sufficiently. Bugs are still regularly seen in the widely deployed profilers, like gcov and llvm-cov, along with gcc and llvm, *** paper proposes Cod, an automated self-validator for effectively uncovering bugs in the coverage profilers. Starting from a test program (either from a compiler's test suite or generated randomly), Cod detects profiler bugs with zero false positive using a metamorphic relation in which the coverage statistics of that program and a mutated variant are *** evaluated Cod over two of the most well-known code coverage profilers, namely gcov and llvm-cov. Within a four-month testing period, a total of 196 potential bugs (123 for gcov, 73 for llvm-cov) are found, among which 23 are confirmed by the developers.

关键词： metamorphic testing coverage profilers bug detection code coverage

来源：评论

学校读者我要写书评

暂无评论

An observability-based code coverage metric for functional simulation 96

An observability-based code coverage metric for functional s...

引用

Proceedings of the 1996 IEEE/ACM international conference on Computer-aided design

作者： Srinivas Devadas Abhijit Ghosh Kurt Keutzer Department of EECS MIT Cambridge Sunnyvale R&D Laboratory Mitsubishi ITA Advanced Technology Group Synopsys Mountain View

ISBN: (纸本)9780818675973

Functional simulation is the most widely used method for design verification. At various levels of abstraction, e.g., behavioral, register-transfer level and gate level, the designer simulates the design using a large number of vectors attempting to debug and verify the design. A major problem with functional simulation is the lack of good metrics and tools to evaluate the quality of a set of functional vectors. Metrics used currently are based on instruction counts and are quite simplistic. Designers are forced to use ad-hoc methods to terminate functional simulation, e.g. CPU time limitations. We propose a new metric for measuring the extent of design verification provided by a set of functional simulation vectors. This metric is universal, and can be used uniformly for all designs. Our metric computes observability information to determine whether effects of errors that are activated by the program stimuli can be observed at the circuit outputs. We provide preliminary experimental evidence that supports the validity of the proposed metric. We believe that using this metric in design verification will result in higher-quality functional checking. tests and improved correctness

关键词： code coverage

来源：评论

学校读者我要写书评

暂无评论

Distributed T-Way Test Suite Execution with code coverage on Multiple Machines

Distributed T-Way Test Suite Execution with Code Coverage on...

引用

IEEE Symposium on Industrial Electronics and Applications

作者： Zainal Hisham Che Soh Syahrul Afzal Che Abdullah Kamal Zuhairi Zamli Universiti Teknologi MARA Shah Alam Selangor MY Faculty of Computer Systems and Software Engineering Universiti Malaysia Pahang Malaysia

This paper present a distributed test suite execution in term of code coverage analysis for testing a t-way test suite data using tuple space technology with Map and Reduce mechanism. The generated t-way test suite data and software under test (SUT) source code are preloaded into their respective partition using hash based routing algorithm. Each partition parsed each test case within the test suite into actual test data file. The code coverage of SUT source code is tested with each test case in actual test data and produces a test coverage result at their respective partition in term of class, method, block and line coverage. A case study of CGPA calculator as SUT is done to measure the test suite execution performance in term of test coverage with varying interaction strength on single and multiple machine environments. The scalability analysis of distributed test suite execution is also done in term of speedup gained while running on a multiple machine environments. An encouraging result is obtained on test coverage and speedup for multiple machine environments as compared to single machine environment. Higher test coverage and more speedup is obtained in higher machine environments.

关键词： T-way Testing Test Suite Generation and Execution code coverage Map and Reduce Tuple Space Technology

来源：评论

学校读者我要写书评

暂无评论

Efficient use of code coverage in large-scale software development 03

Efficient use of code coverage in large-scale software devel...

引用

Proceedings of the 2003 conference of the Centre for Advanced Studies on Collaborative research

作者： Yong Woo Kim IBM Canada

Due to the increasing growth in complexity and size of software being developed, and the nature of large-scale software development, performing code coverage analysis is not an easy task despite the benefits to quality improvement. Our goal is to find an efficient way to perform code coverage analysis for large industrial software systems using the results from defect distribution of previous releases and the release under current development. Empirical verification of several software metrics in large-scale software development were investigated to reduce efforts required for coverage analysis and to identify error-prone modules. The metrics examined were: • coarse coverage analysis versus detailed coverage analysis • block versus decision coverage • Pareto-like defect distribution by releases, and components • cyclomatic complexity versus defect and module size The results suggested that detailed coverage analysis of all modules is not desirable and it is not cost effective. Therefore, we present a systematic approach of coverage analysis based on the findings. It will minimize the amount of effort needed for coverage analysis while maximizing the possibility of catching bugs.

关键词： cyclomatic complexity Pareto-like defect distribution large-scale software development software quality assurance code coverage

来源：评论

学校读者我要写书评

暂无评论

An Effective Android code coverage Tool 18

An Effective Android Code Coverage Tool

引用

Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security

作者： Aleksandr Pilgun Olga Gadyatskaya Stanislav Dashevskyi Yury Zhauniarovich Artsiom Kushniarou University of Luxembourg Esch-sur-Alzette Luxembourg Qatar Computing Research Institute Doha Qatar

ISBN: (纸本)9781450356930

The deluge of Android apps from third-party developers calls for sophisticated security testing and analysis techniques to inspect suspicious apps without accessing their source code. code coverage is an important metric used in these techniques to evaluate their effectiveness, and even as a fitness function to help achieving better results in evolutionary and fuzzy approaches. Yet, so far there are no reliable tools for measuring fine-grained bytecode coverage of Android apps. In this work we present ACVTool that instruments Android apps and measures the smali code coverage at the level of classes, methods, and instructions. Tool repository: https://***/pilgun/acvtool

关键词： android instrumentation smali automated testing black box code coverage dynamic analysis

来源：评论

学校读者我要写书评

暂无评论

NQC²: A Non-Intrusive QEMU code coverage Plugin 24

NQC²: A Non-Intrusive QEMU Code Coverage Plugin

引用

Proceedings of the 16th Workshop on Rapid Simulation and Performance Evaluation for Design

作者： Nils Bosbach Alwalid Salama Lukas Jünger Mark Burton Niko Zurstraßen Rebecca Pelke Rainer Leupers Institute for Communication Technologies and Embedded Systems RWTH Aachen University Germany RWTH Aachen University Germany MachineWare GmbH Germany Qualcomm Technologies Inc. France

ISBN: (纸本)9798400717918

code coverage analysis has become a standard approach in software development, facilitating the assessment of test suite effectiveness, the identification of under-tested code segments, and the discovery of performance bottlenecks. When code coverage of software for embedded systems needs to be measured, conventional approaches quickly meet their limits. A commonly used approach involves instrumenting the source files with added code that collects and dumps coverage information during runtime. This inserted code usually relies on the existence of an operating and a file system to dump the collected data. These features are not available for bare-metal programs that are executed on embedded systems. To overcome this issue, we present NQC², a plugin for QEMU. NQC² extracts coverage information from QEMU during runtime and stores them into a file on the host machine. This approach is even compatible with modified QEMU versions and does not require target-software instrumentation. NQC² outperforms a comparable approach from Xilinx by up to 8.5 x.

关键词： code coverage Performance Optimization QEMU TCG Plugin

来源：评论

学校读者我要写书评

暂无评论

An Automatic Testing Platform for Object-oriented Software based on code coverage 2019

An Automatic Testing Platform for Object-oriented Software b...

引用

Proceedings of the 2019 the 9th International Conference on Communication and Network Security

作者： Bo Liu Honghe Ge Jinfu Chen Qihao Bao Jiangsu University School of Computer Science and Communication Engineering Zhenjiang China

ISBN: (纸本)9781450376624

The development of automatic object-oriented software testing tools is a challenging and realistic subject in the field of software engineering. A testing prototype system named ARTCovPS (Adaptive Random Testing coverage-based testing Prototype System) is designed and implemented for the widely used object-oriented method software. ARTCovPS mainly performs automated testing from two aspects, dynamic test case generation of object-oriented software based on coverage and adaptive random testing method based on coverage. To a certain extent, ARTCovPS testing prototype system realizes the software test automation, and the system has a high running efficiency and can automatically run different comparison methods. The experimental results are satisfactory, and the feasibility of the system is also verified.

关键词： test case generation testing tool adaptive random testing object-oriented software code coverage

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：