检索结果-内蒙古大学图书馆

Testing relative to Usage Scope: Revisiting Software coverage Criteria

ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY 2020年第3期29卷 18-18页

作者： Miranda, Breno Bertolino, Antonia Univ Fed Pernambuco Av Jornalista Anibal Fernandes S-N BR-50740540 Recife PE Brazil ISTI CNR Via Moruzzi 1 I-56124 Pisa Italy

coverage criteria provide a useful and widely used means to guide software testing;however, indiscriminately pursuing full coverage may not always be convenient or meaningful, as not all entities are of interest in any usage context. We aim at introducing a more meaningful notion of coverage that takes into account how the software is going to be used. Entities that are not going to be exercised by the user should not contribute to the coverage ratio. We revisit the definition of coverage measures, introducing a notion of relative coverage. According to this notion, we provide a definition and a theoretical framework of relative coverage, within which we discuss implications on testing theory and practice. Through the evaluation of three different instances of relative coverage, we could observe that relative coverage measures provide a more effective strategy than traditional ones: we could reach higher coverage measures, and test cases selected by relative coverage could achieve higher reliability. We hint at several other useful implications of relative coverage notion on different aspects of software testing.

关键词： coverage testing relative coverage

来源：评论

学校读者我要写书评

暂无评论

Comparing confidence limits for short-run process incapability index C_pp

引用

PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS 2008年第13期387卷 3227-3238页

作者： Ke, Jau-Chuan Chu, Yunn-Kuang Lin, Jer-Yan Natl Taichung Inst Technol Dept Appl Stat Taichung 404 Taiwan Feng Chia Univ Dept Stat Taichung Taiwan

Process incapability index C-pp has been proposed in the manufacturing industry to assess process incapability. In industries it is sometimes unable to get large samples, and, hence, the CAN (consistent and asymptotically normal) property of the unbiased estimator for Cpp is missing. In this paper, six bootstrap methods are applied to construct upper confidence bounds (UCBs) of Cpp for short-urn production processes where sample size is small;standard bootstrap (SB), Bayesian bootstrap (BB), bootstrap pivotal (BP), percentile bootstrap (PB), bias-corrected percentile bootstrap (BCPB), and bias-corrected and accelerated bootstrap (BCa). A numerical simulation study is conducted in order to demonstrate the performance of the six various estimation methods. We further investigate the accuracy of the six methods by calculating the relative coverage (defined as the ratio of coverage percentage to average length of UCB). Detailed discussions of simulation results for seven short-run processes are presented. Finally, one real example from Ford Company's Windsor Casting Plant is used to illustrate the six interval estimation methods. (c) 2008 Elsevier B.V. All rights reserved.

关键词： bootstrap resampling coverage percentage Bayesian bootstrap bootstrap pivotal upper confidence limit process incapability index relative coverage

来源：评论

学校读者我要写书评

暂无评论

An assessment of operational coverage as both an adequacy and a selection criterion for operational profile based testing

引用

SOFTWARE QUALITY JOURNAL 2018年第4期26卷 1571-1594页

作者： Miranda, Breno Bertolino, Antonia Univ Fed Pernambuco BR-50740540 Recife PE Brazil CNR ISTI Via Moruzzi 1 I-56124 Pisa Italy

While the relation between code coverage measures and fault detection is actively studied, only few works have investigated the correlation between measures of coverage and of reliability. In this work, we introduce a novel approach to measuring code coverage, called the operational coverage, that takes into account how much the program's entities are exercised so to reflect the profile of usage into the measure of coverage. Operational coverage is proposed as (i) an adequacy criterion, i.e., to assess the thoroughness of a black box test suite derived from the operational profile, and as (ii) a selection criterion, i.e., to select test cases for operational profile-based testing. Our empirical evaluation showed that operational coverage is better correlated than traditional coverage with the probability that the next test case derived according to the user's profile will not fail. This result suggests that our approach could provide a good stopping rule for operational profile-based testing. With respect to test case selection, our investigations revealed that operational coverage outperformed the traditional one in terms of test suite size and fault detection capability when we look at the average results.

关键词： coverage testing Operational coverage Operational profile-based testing Program Spectra relative coverage

来源：评论

学校读者我要写书评

暂无评论

Estimation comparison on busy period for a controllable M/G/1 system with bicriterion policy

引用

SIMULATION MODELLING PRACTICE AND THEORY 2008年第6期16卷 645-655页

作者： Ke, Jau-Chuan Ko, Ming Yang Sheu, Shey-Huei Natl Taichung Inst Technol Dept Appl Stat Taichung 404 Taiwan Natl Taiwan Univ Sci & Technol Dept Ind Management Taipei 106 Taiwan

We propose an estimator for the expected busy period (denoted by beta) of a controllable M/G/1 queueing system in which the server applies a bicriterion (p,N) policy during his idle period. Using this estimator, we construct new confidence intervals for beta, which are based on five bootstrap methods: standard bootstrap (SB), percentile bootstrap (PB), bootstrap pivotal (BP), bias-corrected percentile bootstrap (BCPB), bias-corrected and accelerated bootstrap (BCa). A numerical simulation study is conducted in order to demonstrate performance of the proposed estimator (beta) over cap and bootstrap confidence intervals for beta. From the simulation results, we show that (beta) over cap is a consistent estimator for beta, which agrees with the theoretical results. In addition, we also investigate the accuracy of the five bootstrap confidence intervals by calculating the coverage percentage and the relative coverage (defined as the ratio of coverage percentage to average length of confidence interval). Detailed discussions of simulation results for three queueing models are presented. (c) 2008 Elsevier B.V. All rights reserved.

关键词： ANOVA table busy period -policy coverage probability main effects relative coverage

来源：评论

学校读者我要写书评

暂无评论

Characterizing and measuring bias in sequence data

引用

GENOME BIOLOGY 2013年第5期14卷 R51-R51页

作者： Ross, Michael G. Russ, Carsten Costello, Maura Hollinger, Andrew Lennon, Niall J. Hegarty, Ryan Nusbaum, Chad Jaffe, David B. 7 Cambridge Ctr Broad Inst Cambridge MA 02142 USA

Background: DNA sequencing technologies deviate from the ideal uniform distribution of reads. These biases impair scientific and medical applications. Accordingly, we have developed computational methods for discovering, describing and measuring bias. Results: We applied these methods to the Illumina, Ion Torrent, Pacific Biosciences and Complete Genomics sequencing platforms, using data from human and from a set of microbes with diverse base compositions. As in previous work, library construction conditions significantly influence sequencing bias. Pacific Biosciences coverage levels are the least biased, followed by Illumina, although all technologies exhibit error-rate biases in high- and low-GC regions and at long homopolymer runs. The GC-rich regions prone to low coverage include a number of human promoters, so we therefore catalog 1,000 that were exceptionally resistant to sequencing. Our results indicate that combining data from two technologies can reduce coverage bias if the biases in the component technologies are complementary and of similar magnitude. Analysis of Illumina data representing 120- fold coverage of a well-studied human sample reveals that 0.20% of the autosomal genome was covered at less than 10% of the genome-wide average. Excluding locations that were similar to known bias motifs or likely due to sample-reference variations left only 0.045% of the autosomal genome with unexplained poor coverage. Conclusions: The assays presented in this paper provide a comprehensive view of sequencing bias, which can be used to drive laboratory improvements and to monitor production processes. Development guided by these assays should result in improved genome assemblies and better coverage of biologically important loci.

关键词： relative coverage Pacific Bioscience Sequencing Bias Deletion Rate Bias Motif

来源：评论

学校读者我要写书评

暂无评论

Comparison on five estimation approaches of intensity for a queueing system with short run

引用

COMPUTATIONAL STATISTICS 2009年第4期24卷 567-582页

作者： Ke, Jau-Chuan Chu, Yunn-Kuang Natl Taichung Inst Technol Dept Appl Stat Taichung 404 Taiwan

Traffic intensity is an important measure for assessing performance of a queueing system. In this paper, we propose a consistent and asymptotically normal estimator (CAN) of intensity for a queueing system with distribution-free interarrival and service times. Using this estimator and its estimated variance, a 100(1 - alpha)% asymptotic confidence interval of the intensity is constructed. Also, four bootstrap approaches-standard bootstrap, Bayesian bootstrap, percentile bootstrap, and bias-corrected and accelerated bootstrap are also applied to develop the confidence intervals of the intensity. A comparative analysis is conducted to demonstrate performances of the five confidence intervals of the intensity for a queueing system with short run data.

关键词： Bayesian bootstrap Bias-corrected and accelerated bootstrap coverage percentage Percentile bootstrap relative coverage Slutsky's theorem Standard bootstrap

来源：评论

学校读者我要写书评

暂无评论

Improving Test coverage Measurement for Reused Software 41

Improving Test Coverage Measurement for Reused Software

引用

41st Euromicro Conference on Software Engineering and Advanced Applications 2015

作者： Miranda, Breno Bertolino, Antonia Univ Pisa Largo B Pontecorvo 3 I-56127 Pisa Italy ISTI CNR I-56124 Pisa Italy

ISBN: (纸本)9781467375856

Test coverage adequacy measures provide a widely used stopping criterion. Engineering of modern software-intensive systems emphasizes reuse. In the case that a program uses reused code or third-party components in a context that is different from the original one, some of their entities (e.g. branches) might never be exercised, thus producing a code coverage level far from full and not meaningful anymore as a stopping rule for the program at hand. We introduce a new coverage criterion, called "Relevant coverage", that in each testing context in which a code is reused calculates coverage measures over the set of relevant entities for that context. We provide an approach for identifying relevant entities using dynamic symbolic execution. The introduced coverage adequacy criterion is assessed in an exploratory study against traditional coverage in terms of test suite size reduction factor, cost-effectiveness ratio and rate of fault detection. The results of our study showed that relevant coverage can considerably reduce the test suite size while preserving a high cost-effectiveness ratio with respect to the traditional approach.

关键词： coverage Measurement relative coverage Software Testing program testing Defect detection coverage test coverage Codes branches

来源：评论

学校读者我要写书评

暂无评论

Does code coverage provide a good stopping rule for operational profile based testing? 11

Does code coverage provide a good stopping rule for operatio...

引用

11th IEEE/ACM International Workshop in Automation of Software Test (AST)

作者： Miranda, Breno Bertolino, Antonia Univ Pisa Largo B Pontecorvo 3 I-56127 Pisa Italy ISTI CNR Via Moruzzi 1 I-56127 Pisa Italy

ISBN: (纸本)9781450341516

We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered. Operational coverage is proposed as an adequacy criterion for operational profile based testing, i.e., to assess the thoroughness of a black box test suite derived from the operational profile. To validate the approach we study the correlation between operational coverage of branches, statements, and functions, and the probability that the next test input will not fail. On the three subjects considered, we observed a moderate correlation in all cases (except a low correlation for function coverage for one subject), and consistently better results than traditional coverage measure.

关键词： coverage Testing Operational coverage Operational Profile Based Testing Program Spectra relative coverage

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：