Test purposes have been presented as a solution to avoid the state space explosion when selecting test cases from formal models. Although such techniques work very well with regard to the speed of the test derivation, they leave the tester with one important task that influences the quality of the overall testing process: test purposes have to be formulated manually. In this paper, we present a...

Extensive testing of modern communicating systems often involve large and complex test suites that need to be maintained throughout the life cycle of the tested system. For this purpose, quality assurance of test suites is an inevitable task that eventually has an impact on the quality of the system under test as well. In this work, we present a means to analyze response inconsistencies in test...

Among the many different kinds of program repair techniques, one widely studied family of techniques is called test suite based repair. Test-suites are in essence input-output specifications and are therefore typically inadequate for completely specifying the expected behavior of the program under repair. Consequently, the patches generated by test suite based program repair techniques pass the...

One of the challenges for students is to come up with appropriate test cases to test the applications they develop. The challenge for instructors is to come up with a small test suite, yet one that is adequate to thoroughly test student’s projects. This paper describes two testing techniques to aid instructors in reducing test cases, while still ensuring effective testing. The first technique u...

Mutation testing attempts to assess the quality of a test set by its ability to distinguish the program under test from its mutants. One of the main difficulties faced in practice is due to the large number of mutants that can be generated for a program under test. Earlier research to solve this problem has suggested variants of mutation testing, and finding an effective set of mutation operato...

This paper describes the structure of a test suite for evaluation of clinical question answering systems; presents several manually compiled resources found useful for test suite generation; and describes the adaptation of these resources for evaluation of a clinical question answering system.

Impact analysis – determining the potential effects of changes on a software system – plays an important role in helping engineers re-validate modified software. In previous work we presented a new impact analysis technique, PathImpact, for performing dynamic impact analysis at the level of procedures, and we showed empirically that the technique can be cost-effective in comparison to prominent...

The issue of developer-oriented evaluation of MT systems has received little attention in the past. We assume that one of the main tools at the developer’s disposal is a test suite of sentences. The best known appears in [2], and this particular suite of sentences is investigated here, together with discussions regarding the number of suites required and the usefulness of test suites in general.

Der Glassboxtest kann mehr liefern als nur eine Prozentangabe der Programmcode-Überdeckung. Wenn das Glassboxtest-Werkzeug Informationen zum Ablauf der Testdurchführung erhält, ist eine wirksame Hilfestellung bei der Testsuite-Optimierung möglich. In diesem Artikel werden diese Hilfestellungen vorgestellt und am Beispiel des Glassboxtest-Werkzeugs CodeCover beschrieben.

In this paper we expand our work in our specification formalism UIOLTSs. We present three implementation relations and provide alternative characterizations of these relations in terms of the tests that the implementation under test successfully passes. In addition, we present the main ideas to obtain an algorithm to derive complete test suites from