检索结果-内蒙古大学图书馆

UCov: a user-defined coverage criterion for test case intent verification

SOFTWARE TESTING VERIFICATION & RELIABILITY 2016年第6期26卷 460-491页

作者： Abou Assi, Rawad Masri, Wes Zaraket, Fadi Amer Univ Beirut Elect & Comp Engn Dept Beirut 11072020 Lebanon

The goal of regression testing is to ensure that the behaviour of existing code, believed correct by previous testing, is not altered by new program changes. This paper argues that the primary focus of regression testing should be on code associated with (1) earlier bug fixes and (2) particular application scenarios considered to be important by the developer or tester. Existing coverage criteria do not enable such focus, for example, 100% branch coverage does not guarantee that a given bug fix is exercised or a given application scenario is tested. Therefore, there is a need for a new and complementary coverage criterion in which the user can definea test requirement characterizing a given behaviour to be covered as opposed to choosing from a pool of pre-defined and generic program elements. This paper proposes this new methodology and calls it UCov, a user-defined coverage criterion wherein a test requirement is an execution pattern of program elements, and possibly predicates, that a test case must satisfy. The proposed criterion is not meant to replace existing criteria, but to complement them as it focuses the testing on important code patterns that could go untested otherwise. UCov supports test case intent verification. For example, following a bug fix, the testing team may augment the regression suite with the test case that revealed the bug. However, this test case might become obsolete due to code modifications not related to the bug. But if a test requirement characterizing the bug was defined by the user, UCov would determine that test case intent verification failed. The UCov methodology was implemented for the Java platform, was successfully applied onto 10 real-life case studies and was shown to have advantages over JUnit. The implementation comprises the following tools: (1) TRSpec: allows the user to easily specify complex test requirements;(2) TRCheck: checks whether user-defined test requirements were satisfied, that is, supports test case intent

关键词： software testing code coverage regression testing validation testing user-defined coverage criterion test case intent verification test case intent preservation

来源：评论

学校读者我要写书评

暂无评论

Cause reduction: delta debugging, even without bugs

引用

SOFTWARE TESTING VERIFICATION & RELIABILITY 2016年第1期26卷 40-68页

作者： Groce, Alex Alipour, Mohammad Amin Zhang, Chaoqiang Chen, Yang Regehr, John Oregon State Univ Corvallis OR 97331 USA Univ Utah Salt Lake City UT 84112 USA

What is a test case for? Sometimes, to expose a fault. Tests can also exercise code, use memory or time, or produce desired output. Given a desired effect, a test case can be seen as a cause, and its components divided into essential (required for effect) and accidental. Delta debugging is used for removing accidents from failing test cases, producing smaller test cases that are easier to understand. This paper extends delta debugging by simplifying test cases with respect to arbitrary effects, a generalization called cause reduction. Suites produced by cause reduction provide effective quick tests for real-world programs. For Mozilla's JavaScript engine, the reduced suite is possibly more effective for finding faults. The effectiveness of reduction-based suites persists through changes to the software, improving coverage by over 500 branches for versions up to 4months later. Cause reduction has other applications, including improving seeded symbolic execution, where using reduced tests can often double the number of additional branches explored. Copyright (c) 2015 John Wiley & Sons, Ltd.

关键词： test case minimization regression testing delta debugging code coverage software testing

来源：评论

学校读者我要写书评

暂无评论

Test-suite Reduction Based on K-medoids Clustering Algorithm

Test-suite Reduction Based on K-medoids Clustering Algorithm

引用

第九届网络分布式计算与知识发现国际会议( 2017 International Conference on Cyber-enabled distributed computing and knowledge discovery)

作者： Feng Liu Jun Zhang Er-zhou Zhu School of Computer Science and Technology Anhui University Hefei China

Software testing is a key approach to guarantee the software *** is the objective unremittingly pursed by virtue of effective testing cases in the shortest *** test suite optimization method is a NP-complete *** some people apply k-means clustering algorithm to the test suite reduction,the algorithm is unstable and seldom considers the coverage rate of such test cases;as a result,it will waste many unnecessary testing time in redundant cases and always result in high ***,this paper introduces k-medoids thought of the clustering algorithm and then proposes a method of parameter generation test suite characterized by cyclomatic complexity and code coverage *** method utilizes the greedy algorithm to process the streamlined test suite while guaranteeing the cases coverage rate and the error detection rate finally gain the minimal test *** indicated by the stimulation experimental results,our method features higher coverage rate with lower complexity under the streamlined test suite of the same quantity.

关键词： test suite reduction k-medoids code coverage cluster analysis

来源：评论

学校读者我要写书评

暂无评论

UTTOS: A Tool for Testing UEFI code in OS Environment 28th

UTTOS: A Tool for Testing UEFI Code in OS Environment

引用

28th IFIP WG 6.1 International Conference on Testing Software and Systems (ICTSS)

作者： Gomes, Eder C. M. Amora, Paulo R. P. Teixeira, Elvis M. Lima, Antonio G. S. Brito, Felipe T. Ciocari, Juliano F. C. Machado, Javam C. Univ Fed Ceara Dept Comp Sci Fortaleza Ceara Brazil Hewlett Packard Corp Porto Alegre RS Brazil

ISBN: (纸本)9783319474434;9783319474427

Unit tests are one of the most widely used tools to assure a minimal level of quality and compliance during development. However, they are not used in many projects where development takes place at low-level contexts. The main reason is that unit test development itself demands more time and becomes expensive in this context and tools that assist test creation are rare or absent. In UEFI development this scenario matches the reality of most teams and unit testing as well as other testing techniques are often not used. To address this fault we propose UTTOS, a tool that parses EDKII build configuration files, mocks the UEFI-specific functions for C development and enables UEFI test suite code to run in the operating system. We show that UTTOS is able to run the test suit in the operating system and save development time.

关键词： UEFI Unit test C code coverage Embedded systems

来源：评论

学校读者我要写书评

暂无评论

Are My Unit Tests in the Right Package? 16

Are My Unit Tests in the Right Package?

引用

16th IEEE International Working Conference on Source code Analysis and Manipulation (SCAM)

作者： Balogh, Gergo Gergely, Tamas Beszedes, Arpad Gyimothy, Tibor Univ Szeged Software Engn Dept Szeged Hungary

ISBN: (纸本)9781509038497

The software development industry has adopted written and de facto standards for creating effective and maintainable unit tests. Unfortunately, like any other source code artifact, they are often written without conforming to these guidelines, or they may evolve into such a state. In this work, we address a specific type of issues related to unit tests. We seek to automatically uncover violations of two fundamental rules: 1) unit tests should exercise only the unit they were designed for, and 2) they should follow a clear packaging convention. Our approach is to use code coverage to investigate the dynamic behaviour of the tests with respect to the code elements of the program, and use this information to identify highly correlated groups of tests and code elements (using community detection algorithm). This grouping is then compared to the trivial grouping determined by package structure, and any discrepancies found are treated as "bad smells." We report on our related measurements on a set of large open source systems with notable unit test suites, and provide guidelines through examples for refactoring the problematic tests.

关键词： code coverage unit testing clusterization pack-age hierarchy community detection test smells and refactoring

来源：评论

学校读者我要写书评

暂无评论

Addressing the Regression Test Problem with Change Impact Analysis for Ada 21st

Addressing the Regression Test Problem with Change Impact An...

引用

21st Ada-Europe International Conference on Reliable Software Technologies (Ada-Europe)

作者： Jones, Andrew V. Vector Software Inc London England

ISBN: (纸本)9783319390833;9783319390826

The regression test selection problem-selecting a subset of a test-suite given a change-has been studied widely over the past two decades. However, the problem has seen little attention when constrained to high-criticality developments and where a "safe" selection of tests need to be chosen. Further, no practical approaches have been presented for the programming language Ada. In this paper, we introduce an approach to solving the selection problem given a combination of both static and dynamic data for a program and a change-set. We present a change impact analysis for Ada that selects the safe set of tests that need to be re-executed to ensure no regressions. We have implemented the approach in the commercial, unit-testing tool VectorCAST, and validated it on a number of open-source examples. On an example of a fully-functioning Ada implementation of a DNS server (IRONSIDES), the experimental results show a 97% reduction in test-case execution.

关键词： Ada Change impact analysis Regression testing Unit testing Test-case selection code coverage Change-based testing Safety-critical software

来源：评论

学校读者我要写书评

暂无评论

Will My Tests Tell Me If I Break This code? 1

Will My Tests Tell Me If I Break This Code?

引用

1st International Workshop on Continuous Software Evolution and Delivery (CSED)

作者： Niedermayr, Rainer Juergens, Elmar Wagner, Stefan CQSE GmbH Garching Germany Univ Stuttgart Stuttgart Germany

ISBN: (纸本)9781450341578

Automated tests play an important role in software evolution because they can rapidly detect faults introduced during changes. In practice, code-coverage metrics are often used as criteria to evaluate the effectiveness of test suites with focus on regression faults. However, code coverage only expresses which portion of a system has been executed by tests, but not how effective the tests actually are in detecting regression faults. Our goal was to evaluate the validity of code coverage as a measure for test effectiveness. To do so, we conducted an empirical study in which we applied an extreme mutation testing approach to analyze the tests of open-source projects written in Java. We assessed the ratio of pseudo-tested methods (those tested in a way such that faults would not be detected) to all covered methods and judged their impact on the software project. The results show that the ratio of pseudo-tested methods is acceptable for unit tests but not for system tests (that execute large portions of the whole system). Therefore, we conclude that the coverage metric is only a valid effectiveness indicator for unit tests.

关键词： Regression Testing Test Suite Effectiveness code coverage Mutation Testing

来源：评论

学校读者我要写书评

暂无评论

Automated Test Input Generation for Android: Are We Really There Yet in an Industrial Case? 24

Automated Test Input Generation for Android: Are We Really T...

引用

24th ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE)

作者： Zeng, Xia Li, Dengfeng Zheng, Wujie Xia, Fan Deng, Yuetang Lam, Wing Yang, Wei Xie, Tao Tencent Inc Shenzhen Peoples R China Univ Illinois Urbana IL USA

ISBN: (纸本)9781450342186

Given the ever increasing number of research tools to automatically generate inputs to test Android applications (or simply apps), researchers recently asked the question "Are we there yet?" (in terms of the practicality of the tools). By conducting an empirical study of the various tools, the researchers found that Monkey (the most widely used tool of this category in industrial practices) outperformed all of the research tools that they studied. In this paper, we present two significant extensions of that study. First, we conduct the first industrial case study of applying Monkey against WeChat, a popular messenger app with over 762 million monthly active users, and report the empirical findings on Monkey's limitations in an industrial setting. Second, we develop a new approach to address major limitations of Monkey and accomplish substantial code-coverage improvements over Monkey, along with empirical insights for future enhancements to both Monkey and our approach.

关键词： Android GUI testing test generation code coverage

来源：评论

学校读者我要写书评

暂无评论

Integrated Formal Methods for Constructing Assurance Cases 27

Integrated Formal Methods for Constructing Assurance Cases

引用

27th IEEE International Symposium on Software Reliability Engineering (ISSRE)

作者： Carlan, Carmen Beyene, Tewodros A. Ruess, Harald Tech Univ Munich Fortiss An Inst D-80290 Munich Germany

ISBN: (纸本)9781509036011

The use of formal methods in verification activities is well established in various dedicated safety standards. Deficits in the verification process may have a negative impact on the confidence of verification results. Safety standards promote the use of integrated formal methods when a single method cannot achieve the verification objective without specifying how. In this paper, we take on the problem of using outputs from integrated formal methods as evidence in assurance cases, which are used in certification of safety-critical systems. We first present two workflows that employ integrated formal methods - code review workflow and code coverage workflow - corresponding to two of the most important activities of the verification phase. Then, we show how each workflow and the outputs from its integrated formal methods can be used in creating an assurance argument. These assurance arguments offer evidence for undeveloped goals identified in previous works from the field.

关键词： Assurance cases Assurance deficits code coverage code review Confidence Integrated formal methods Testing

来源：评论

学校读者我要写书评

暂无评论

Higher accuracy and lower run time: efficient mutation analysis using non-redundant mutation operators

引用

SOFTWARE TESTING VERIFICATION & RELIABILITY 2015年第5-7期25卷 490-507页

作者： Just, Rene Schweiggert, Franz Univ Washington Dept Comp Sci & Engn Seattle WA 98195 USA Univ Ulm Dept Appl Informat Proc D-89069 Ulm Germany

Mutation analysis is a powerful but computationally expensive method to measure the effectiveness of a testing or debugging technique. The high cost is due, in part, to redundant mutants generated by commonly used mutation operators. A mutant is said to be redundant if its outcome can be predicted based on the outcome of other mutants. The execution of those redundant mutants is unnecessary and wastes CPU resources. Moreover, the inclusion of redundant mutants may lead to a skewed mutant detection rate and therefore misrepresent the effectiveness of the assessed testing or debugging technique. This paper extends previous work and makes the following contributions. First, it defines and provides non-redundant versions of the conditional operator replacement, unary operator insertion, and relational operator replacement mutation operators. Second, it reports on a conducted empirical study using 10 real-world programmes that comprise a total of 410000 lines of code. The empirical study used developer-written and generated test suites. The results show how prevalent redundant mutants are and how their elimination improves the efficiency and accuracy of mutation analysis. In summary, the total mutation analysis run time decreased by more than 20% by removing redundant mutants, and the inclusion of redundant mutants led to an overestimated mutation score for all analysed test suites. Copyright (C) 2014 John Wiley & Sons, Ltd.

关键词： mutation analysis redundant mutants test adequacy code coverage

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：