Checking Inside the Black Box: Regression Fault Exposure and Localization Based on Value Spectra Differences

نویسندگان

  • Tao Xie
  • David Notkin
چکیده

We present a new fault exposure and localization approach intended to increase the effectiveness of regression testing. In particular, we extend traditional regression testing, which strongly focuses on black box comparisons, to compare internal program states. These value spectra differences allow a more detailed comparison of executions of the new and old versions of a program. In particular, our approach checks inside the program black box to observe unit behaviors and further checks inside the unit black box to observe some internal variable values besides the ones propagated outside the unit. This approach exposes faults without requiring the faults to be propagated to the outputs of the system or unit. Two heuristics are proposed to locate regression faults based on a fault propagation model. An experiment is conducted to assess their effectiveness. The initial results show our value-spectra-comparison approach can increase the regression fault exposure probability effectively and identify the locations of regression faults accurately.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Testing and Model-Checking Techniques for Diagnosis

Black-box testing is a popular technique for assessing the quality of a system. However, in case of a test failure, only little information is available to identify the root-cause of the test failure. In such cases, additional diagnostic tests may help. We present techniques and a methodology for efficiently conducting diagnostic tests based on explicit fault models. For this, we rely on Model-...

متن کامل

Black-box testing using flowgraphs: an experimental assessment of effectiveness and automation potential

A black-box testing strategy based on Zweben et al.’s specification-based test data adequacy criteria is explored. The approach focuses on generating a flowgraph from a component’s specification and applying analogues of white-box strategies to it. An experimental assessment of the fault-detecting ability of test sets generated using this approach was performed for three of Zweben’s criteria us...

متن کامل

XML-manipulating test case prioritization for XML-manipulating services

A web service may evolve autonomously, making peer web services in the same service composition uncertain as to whether the evolved behaviors are compatible with its original collaborative agreement. Although peer services may wish to conduct regression testing to verify the agreed collaboration, the source code of the former service may be inaccessible to them. Owing to the black-box nature of...

متن کامل

Test case selection for black-box regression testing of database applications

Context: This paper presents an approach for selecting regression test cases in the context of large-scale, database applications. We focus on a black-box (specification-based) approach, relying on classification tree models to model the input domain of the system under test (SUT), in order to obtain a more practical and scalable solution. We perform an industrial case study where the SUT is a ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2002