An Evaluative Model for Information Retrieval System Evaluation: A User- centered Approach

The key technology for knowledge management that guarantees access to large corpora of both structured and unstructured data is Information retrieval (IR) Systems. The ones commonly used on an everyday basis are search engines. This study developed and validated an evaluative model from user’s perspective meant to assess these systems using the user-centered approach. Items used and validated in other related studies were used to elicit responses from over 250 users. The reliability and validity of the measurement instrument (MI) was demonstrated using statistics such as internal consistency, composite reliability and convergent validity. After assessing the reliability and validity of the MI, the resultant evaluative model was estimated for goodness-of-fit using the structural equation modeling (SEM) technique. Results confirmed that the suggested model is valid and will be useful to researchers who wish to use it. Thus, this study suggests both the parameters and methods employed to formulate the model for use in user-centered studies for the evaluation of IR system. Both the evaluative model, factor analytic methods of data analysis, could be used to understand and present more factors (parameters) that will be usable for IR system evaluation using the user-centered approach.