Over its 40 year history information retrieval evaluation evolved with an emphasis on laboratory experimentation, the “Cranfield paradigm”, in response to early demands for experimental rigour. The current and highly successful TREC experiments follow this model. However the demand for results that are robust and scalable has caused an emphasis on system-centered evaluation at the expensive of ...

six web search engines, namely, altavista, excite, go, google, hot bot and lycos, were compared and evaluated in terms of their search capabilities (i.e., duplicate, false drops, mirror sites, dead links) and retrieval performances (i.e., precision) using sample queries drawn from real reference questions from the reference desk of the central library of shiraz university (mirzay-e-shirazi libr...

The current paper explores designing a web information retrieval system regarding the searching behavior of users in real and everyday life. Designing an information system that is closely linked to human behavior is equally important for providers and the end users.  From an Information Science point of view, four approaches in designing information retrieval systems were identified as system-...

Research in information retrieval deals with the theories and models that constitute the foundations for any kind of service that provides access or pointers to particular elements of a collection of documents in response to a submitted information need. The specific field of information retrieval evaluation is concerned with the critical assessment of the quality of search systems. Empirical e...

Evaluation is crucial for the success of most research domains, and image retrieval is no exception to this. Recently, several benchmarks have been developed for visual information retrieval such as TRECVID, ImageCLEF, and ImagEval to create frameworks for evaluating image retrieval research. An important part of evaluation is the creation of a ground truth or gold standard to evaluate systems ...