In this paper we identify special quality assurance and test requirements of software for safety systems and show that even the best currently available practices meet these requirements only at very high cost and by ...
详细信息
In this paper we identify special quality assurance and test requirements of software for safety systems and show that even the best currently available practices meet these requirements only at very high cost and by application of empirical rather than technically rigorous criteria. Redundancy can help but is expensive and the reduction in failure probability due to software redundancy is uncertain. We identify a qualitative approach to test data interpretation, particularly the examination of rare events in the conditions that precipitated an observed failure, as a possible avenue for a more economical reliability assessment. This can be used as an alternative or as a supplement to redundancy for meeting the reliability requirements for software in safety systems. Further research in this area is recommended.
In this paper we discuss the advantages and limitations of a specification-based software testing technique we call CEG-BOR. There are two phases in this approach. First, informal software specifications are converted...
详细信息
In this paper we discuss the advantages and limitations of a specification-based software testing technique we call CEG-BOR. There are two phases in this approach. First, informal software specifications are converted into cause-effect graphs (CEG). Then, the Boolean OperatoR (BOR) strategy is applied to design and select test cases. The conversion of an informal specification into a CEG helps detect ambiguities and inconsistencies in the specification and sets the stage for design of test cases. The number of test cases needed to satisfy the BOR strategy grows linearly with the number of Boolean operators in CEG, and BOR testing guarantees detection of certain classes of Boolean operator faults. But, what makes the approach especially attractive is that the BOR based test suites appear to be very effective in detecting other fault types. We have empirically evaluated this broader aspect of the CEG-BOR strategy on a simplified safety-related real-time control system, a set of N-version programs, and on elements of a commercial data-base system. In all cases, CEG-BOR testing required fewer test cases than those generated for the applications without the use of CEG-BOR. Furthermore, in all cases CEG-BOR testing detected all faults that the original, and independently generated, application test-suites did. In two instances CEG-BOR testing uncovered additional faults. Our results indicate that the CEG-BOR strategy is practical, scalable, and effective across diverse applications. We believe that it is a cost-effective methodology for the development of systematic specification-based software test-suites.
In this paper we discuss ways in which coverage analysis, obtained during execution of test cases over a rule-base, can be used to highlight problems in both the test suite and the rule-base, thereby pointing to areas...
详细信息
In this paper we discuss ways in which coverage analysis, obtained during execution of test cases over a rule-base, can be used to highlight problems in both the test suite and the rule-base, thereby pointing to areas in which we cannot guarantee or predict the system's performance. In particular, we present a series of heuristics which use coverage information and meta-knowledge about the larger population to select additional test cases from the population, in the event that the initial test set is incomplete. This forms the basis of an incremental approach to rule-base testing which allows us to both increase completeness of the test set and improve coverage of the rule-base, thereby increasing the kinds of cases for which the rule-base has been executed during testing. We demonstrate this heuristic approach to test data selection using information generated by TRUBAC, a tool which implements the coverage analysis methods, applied to analyze a prototype system for diagnosis of rheumatological diseases.
software risk management can be defined as an attempt to formalise risk oriented correlates of development success into a readily applicable set of principles and practices. Earlier research suggests that it can reduc...
详细信息
software risk management can be defined as an attempt to formalise risk oriented correlates of development success into a readily applicable set of principles and practices. Earlier research suggests that it can reduce the likelihood of a system failure. Using a survey instrument we investigate this claim further. The investigation addresses the following questions: (1) which characteristics of risk management practices;and (2) which other environmental and process factors (such as development methods, manager's experience) relate to improved performance in managing software risks? Our findings support in general the claim that the use of risk management methods improves system development performance. Yet, little support was found for the claim that specific risk management methods are instrumental in attacking specific software risks. Overall, risks are better managed with combined measures of having experienced project managers, selecting a correct project size, and investing in and obtaining experience in risk management deliberations.
This paper characterizes the testing environment for large commercial software systems, matches reliability model assumptions with the application environment, examines alternative test workload measurements that capt...
详细信息
This paper characterizes the testing environment for large commercial software systems, matches reliability model assumptions with the application environment, examines alternative test workload measurements that capture software usage information during testing, and uses two such measurements, test runs and transactions, as our usage dependent time measurements in reliability modeling. Our previous research using test runs, execution time, and test input information for reliability analysis and improvement is extended to ensure better test workload measurements for reliability assessment and prediction. This paper also identifies conditions under which different test workload measurements are appropriate, and presents reliability modeling results using these measurements in several products developed in the IBM software Solutions Toronto Laboratory.
Many statistical methods for estimating software quality rely on representative testing: they assume a program is tested in an environment that simulates the environment where it will be used. Often, however, a softwa...
详细信息
Many statistical methods for estimating software quality rely on representative testing: they assume a program is tested in an environment that simulates the environment where it will be used. Often, however, a software tester's aim is to uncover defects as soon as possible, and representative testing may not be the best way to do this. Instead, tests are often selected according to some plan that is believed to result in an efficient but thorough examination of the software's behavior. This raises the question of how practical measurements of software quality, like software probability-of-failure, can be obtained from directed testing. In this paper, we discuss some factors affecting the ability of directed tests to predict software quality when quality is measured in the environment where the software operates, but the directed tests do not simulate that environment. We consider a number of ways to measure the power of a directed test method, and show how these affect the tester's ability to predict software quality.
This paper presents a method for test case selection that allows a formal approach to testing software. The two main ideas are (1) that testers create stochastic models of software behavior instead of crafting individ...
详细信息
This paper presents a method for test case selection that allows a formal approach to testing software. The two main ideas are (1) that testers create stochastic models of software behavior instead of crafting individual test cases and (2) that specific test cases are generated from the stochastic models and applied to the software under test. This paper describes a method for creating a stochastic model in the context of a solved example. We concentrate on Markov models and show how non-Markovian behavior can be embedded in such models without violating the Markov property.
This article presents the methods and outcomes of a semester-long course in hypermedia authoring and instructional strategies for preservice teachers. Participants were required to learn a hypermedia authoring program...
详细信息
This article presents the methods and outcomes of a semester-long course in hypermedia authoring and instructional strategies for preservice teachers. Participants were required to learn a hypermedia authoring program and work in cooperative learning groups to produce a hypermedia software product for use with children with special needs. Data were collected from process logs;semi-structured, open-ended interviews;questionnaires;and pretest and posttest measures of computer anxiety. During the development of their projects, participants spent nearly an equal amount of time planning their software as they did in the mechanics of producing the software. Posttest findings revealed that participants showed a decrease in computer anxiety through their involvement in the course, and the lowest levels of anxiety were associated with graduate rank and prior teaching experience. Following the course, participants expressed confidence in their abilities to author hypermedia software and an interest in future involvement in hypermedia authoring as teachers.
Two universities were selected to evaluate music fundamentals software developed for prospective nursery-school through sixth-grade teachers. Using folk songs as examples, the investigator designed computer-assisted i...
详细信息
Two universities were selected to evaluate music fundamentals software developed for prospective nursery-school through sixth-grade teachers. Using folk songs as examples, the investigator designed computer-assisted instructional (CAI) software to supply future teachers with a repertoire of songs and related music concepts for classroom use. Subjects at the first university (N = 148) were enrolled in a music fundamentals and performance skills course, the first of two music courses for preservice teachers. Subjects at the second university (N = 95) were enrolled in a music methods and materials course, the only music course for preservice teachers offered at this site. A comparison of posttest scores of control (in-class lecture) and experimental (CAI) groups yielded no significant differences in either experiment. Students in both experiments thought the song examples were helpful. Furthermore, reducing class time spent with music theory allowed instructors to spend more time with other instructional tasks, potentially enabling students to improve in other performance areas.
作者:
Persico, DCNR
INST EDUC TECHNOLVIA DE MARINI 6I-16149 GENOAITALY
The author draws on her practical experience in courseware development as well as her research experience in the development of authoring systems to suggest that, in spite of the significant changes currently taking p...
详细信息
The author draws on her practical experience in courseware development as well as her research experience in the development of authoring systems to suggest that, in spite of the significant changes currently taking place in this field, some of the old models proposed for courseware development maintain their validity from a methodological point of view The paper analyses the common denominator among several models for courseware development (the methodological constants) and discusses in detail both the design and the validation phases.
暂无评论