ویراساینس.
سند علمی

The Mosaic Test: Benchmarking Colour-based Image Retrieval Systems Using Image Mosaics

William Plant, Joanna Lumsden, Ian T. Nabney

چکیده

Evaluation and benchmarking in content-based image retrieval has always been a somewhat neglected research area, making it difficult to judge the efficacy of many presented approaches. In this paper we investigate the issue of benchmarking for colour-based image retrieval systems, which enable users to retrieve images from a database based on lowlevel colour content alone. We argue that current image retrieval evaluation methods are not suited to benchmarking colour-based image retrieval systems, due in main to not allowing users to reflect upon the suitability of retrieved images within the context of a creative project and their reliance on highly subjective ground-truths. As a solution to these issues, the research presented here introduces the Mosaic Test for evaluating colour-based image retrieval systems, in which test-users are asked to create an image mosaic of a predetermined target image, using the colour-based image retrieval system that is being evaluated. We report on our findings from a user study which suggests that the Mosaic Test overcomes the major drawbacks associated with existing image retrieval evaluation methods, by enabling users to reflect upon image selections and automatically measuring image relevance in a way that correlates with the perception of many human assessors. We therefore propose that the Mosaic Test be adopted as a standardised benchmark for evaluating and comparing colour-based image retrieval systems.

اسناد مشابه

  • MOSAIC: A fast multi-feature image retrieval system

    سند علمی۲۰۰۰Data Knowl. Eng.Shen-Tat Goh, Kian-Lee Tan

    Content-based image retrieval plays an important role in many multimedia applications. Images are typically retrieved based on a given sample image, a sketch or a simple description of the content. The rate of this retrieval is undeniably gaining importance as databases increase

  • A Benchmark for Image Retrieval using Distributed Systems over the Internet: BIRDS-I

    سند علمی۲۰۰۰CoRRNeil J. Gunther, Giordano B. Beretta

    Comparing the performance of CBIR (Content-Based Image Retrieval) algorithms is difficult. Private data sets are used, so it is controversial to compare CBIR algorithms developed by different researchers. Also, the performance of CBIR algorithms is usually measured on an isolated

  • Global Interior Robot Localisation by a Colour Content Image Retrieval System

    سند علمی۲۰۰۸EURASIP J. Adv. Sig. Proc.Anis Chaari, Sylvie Lelandais, Christophe Montagne, Mohamed Ben Ahmed

    We propose a new global localisation approach to determine a coarse position of a mobile robot in structured indoor space using colour-based image retrieval techniques. We use an original method of colour quantisation based on the baker’s transformation to extract a two-dimension

  • Content-Based Image Retrieval Systems - Reviewing and Benchmarking

    سند علمی۲۰۱۰JDIMHarald Kosch, Paul Maier

    The last detailed review of Content-based Image Retrieval Systems (CBIRS) is that from Veltkamp and Tanase [VT02], updated in 2002. Since then, many new systems emerged, other systems were improved, but many systems are no longer supported. This paper reconsiders the systems desc

  • A Simple but Efficient Scheme for Colour Image Retrieval Based on Statistical Tests of Hypothesis

    سند علمی۲۰۱۱K. Seetharaman, T. Hemalatha

    This paper proposes a simple but efficient scheme for colour image retrieval, based on statistical tests of hypothesis, namely test for equality of variance, test for equality of mean. The test for equality of variance is performed to test the similarity of the query and target i

  • Field-test results of an image retrieval system for semiconductor yield learning

    سند علمی۲۰۰۴T. P. Karnowski, K. W. Tobin, L. F. Arrowood, R. K. Ferrell

    Images of semiconductor defects are maintained in semiconductor yield management systems to diagnose problems that arise during the manufacturing process. A semiconductor -specific content-based image retrieval system was developed by Oak Ridge National Laboratory (ORNL) under th