Traditional coverage metrics measure the ability of test cases to fully exercise the source code. The assumption is that fully covered code will better test the correct behavior of the software. Unfortunately, there is no guarantee that the software will meet its specification. In this paper, we present a new coverage metric which measures the ability of the test cases to fully exercise the spe...

Regression testing is used to ensure the validity of the changed software. Due to time budget and entire test suite could not be executed. Hence it becomes an essential to minimize the test suite and choose a subset of test cases from test suite which will be executed in least time and has the capability to cover all the faults. Hence reordering the test case on the basis of time fault, test ca...

Test suite minimization techniques attempt to reduce the cost of saving and reusing tests during software maintenance, by eliminating redundant tests from test suites. A potential drawback of these techniques is that in minimizing a test suite, they might reduce the ability of that test suite to reveal faults in the software. A recent study showed that minimization can reduce test suite size wi...

We propose a complete methodology for the automatic generation of test cases in the context of digital circuit validation. Our approach is based on a software model of the system to verify in which some modules are written in the Esterel language. An initial test suite is simulated and the state coverage is computed. New test sequences are automatically generated to reach the missing states. We...

This paper presents a method for minimizing test suites for embedded, nondeterministic Finite State Machines. The method preserves the fault coverage of the original test suite, and can be used in conjunction with any technique for generating test suites. The minimization is achieved by detecting and deleting redundant test cases in the test suite. The proposed method is an extension of the wor...

The selection of appropriate test cases is an important issue in software engineering. A number of methods are known for the selection of a test suite based on the specification and an implementation under test given in the form of a finite state machine (FSM). In realistic applications, this specification evolves incrementally throughout incorporating frequent modifications. In this paper, we ...

Combination strategies are test case selection methods that identify test cases by combining values of the different test object input parameters based on some combinatorial strategy. This survey presents 16 different combination strategies, covering more than 40 papers that focus on one or several combination strategies. This collection represents most of the existing work performed on combina...

We propose an approach to testing that combines formal methods with practical criteria, close to the testing engineer’s experience. It can be seen as a framework to evaluate and select test suites using formal methods, assisted by informal heuristics. We also introduce the formalism of enriched transition systems to store information obtained during the testing phase, and to adapt classical tes...

Estimating the quality of test suites is an important and difficult task. Mutation analysis is one approach to measure test quality by injecting faults in a correct version of the system under test and measuring the percentage of faulty systems that are detected by the tests. There are several automatic mutation analysis tools. Each of them, however, is restricted to a comparatively small range...

Mutation testing is a well known fault-based testing technique that is normally used to assess the quality of a test suite. In this paper we use the mutation operation to derive test cases that demonstrate the absence of certain faults in an implementation: In difference to conventional mutation testing, which mutates program code, we mutate program contracts and generate test-input data that i...