Benchmarking Content Based Image Retrieval (CBIR) systems allows researchers and developers to compare the strengths of different approaches, and is an essential step towards establishing the credibility of CBIR systems for commercial applications. Here we introduce the problem of developing a benchmark, discuss some of the issues involved, and provide a review of current and recent benchmarkin...