Object-oriented tests consist of sequences of method invocations. Behavior of an invocation depends on the state of the receiver object and method arguments at the beginning of the invocation. Existing tools for automatic generation of object-oriented test suites, such as Jtest and JCrasher for Java, typically ignore object states. These tools generate redundant tests that exercise the same met...

This paper outlines the design of ATS (the APART Test Suite) for evaluating (automatic) performance analysis tools with respect to their effectiveness in detecting actual performance problems, with focus on the ATS test programs related to OpenMP. It reports on results from applying two OpenMP performance analysis tools to the test cases generated from ATS.

The prioritization of interaction test suites has received more attention in the field of combinatorial interaction testing, especially when testing resources are limited to allow the part of combinatorial test cases to be executed. Many strategies have been proposed to prioritize interaction test suites according to different evaluation measures. However, most of these strategies may face a ch...

Mutation analysis evaluates test suites and testing techniques by measuring how well they detect seeded defects (mutants). Even though well established in research, mutation analysis is rarely used in practice due to scalability problems — there are multiple mutations per code statement leading to a large number of mutants, and hence executions of the test suite. In addition, the use of mutatio...

Database-driven software has been widely adopted in many areas of software applications. In this type of software, the database is an integrated part of the system. Traditional testing techniques have focused either on the software or on the databases, but ignored the interactions between the two core components of the system. Recently, the importance of testing database-driven applications has...

Testing is the most commonly used method for debugging software. We survey here several techniques that are used for assisting the tester in generating a test suite that reflects his intuition about potential problems in the software. Then we show how to enfore and monitor these test cases.

We examine the effectiveness on the multilingual WebCLEF 2006 test set of light-weight methods that have proved successful in other web retrieval settings: combinations of document representations on the one hand and query reformulation techniques on the other. We investigate a range of approaches to crosslingual web retrieval using the test suite of the mixed monolingual CLEF 2006 WebCLEF trac...

A test suite for a key interface within a dimensional measuring system (coordinate measuring machine or CMM) is presented. The test suite consists of test procedures, test definitions, and various testing utilities. A real-time, distributed test utilizing the test suite has been performed and is described. Keywords— conformance test, coordinate measuring machine, distributed testing, interface ...

A test suite for a key interface within a dimensional measuring system (coordinate measuring machine or CMM) is presented. The test suite consists of test procedures, test definitions, and various testing utilities. A real-time, distributed test utilizing the test suite has been performed and is described. Keywords— conformance test, coordinate measuring machine, distributed testing, interface ...