This paper aims at measuring the performance of an information retrieval system named HYKIS. HYKIS (HYbrid Knowledge-based Information retrieval System) is a knowledge-based information retrieval system that allows a naive user to retrieve relevant documents effectively, without any help of a domain expert. According to an experiment with the CACM data set, it turns out that HYKIS achieves much...

The Cross-Language Evaluation Forum (CLEF) promotes research into the development of truly multilingual systems capable of retrieving relevant information from collections in many languages and in mixed media. The paper discusses some of the main results achieved in the first six years of activity.

This thesis describes the evaluation of the system SiteSeeker Enterprise, which has been developed by Euroling AB specifically for information retrieval on organisations’ intranets. The system is currently incorporated and used by several organisations on their intranets, and this evaluation was conducted at one of these organisations, Landstinget i Uppsala Län in Uppsala, Sweden. The purpose o...

The batch evaluation of information retrieval systems typically makes use of a testbed consisting of a collection of documents, a set of queries, and for each query, a set of judgements indicating which documents are relevant. This paper presents a probabilistic model for predicting IR system rankings in a batch experiment when using document relevance assessments from different judges, using t...

due to the lack of users knowledge of the collections used by search engines and in general retrieval systems, users can not express their information need appropriately in queries. in other words, they do not have enough experience to formulate their needs to find related documents. the idea of user’s query expansion aims to help users to improve and correct the queries. in fact, retrieval sys...

One of the challenges of modern information retrieval is to adequately evaluate Information Retrieval System (IRS) in order to estimate future performance in a specified application domain. Since there are many algorithms in literature the decision to select one for usage depends mostly on the evaluation of the systems’ performance in the domain. This paper presents how visual and scalar evalua...

Formal models of dialogue systems and related notions (dialogue, dialogue strategy, evaluation function, dialogue communication, goal of dialogue) are introduced in the paper. A model of the information retrieval dialogue systems based on the dialogue strategies described by the Mealy-type automata and information systems (in the sense of Pawlak) is introduced and discussed.