In this paper we describe the Image Fidelity Assessor (IFA), a model of the human visual system designed to evaluate perceived fidelity. In particular, we describe the structure of the model, present results from a contrast discrimination experiment used within the model, and demonstrate preliminary results of the model. The IFA is designed to be both physiologically and psychophysically plausi...

We present an empirically grounded method for evaluating content selection in summarization. It incorporates the idea that no single best model summary for a collection of documents exists. Our method quantifies the relative importance of facts to be conveyed. We argue that it is reliable, predictive and diagnostic, thus improves considerably over the shortcomings of the human evaluation method...

storytelling. One of two methods was used for the storytelling: the Storyline method or the Associations Pyramid method. Seventy five-year-old children took part in the study. The results show that children are able to use different strategies to create a story together, the language and communication competence of the children is already well developed, and the children are ready for effective...

The pyramid evaluation effort for the 2006 Document Understanding Conference involved twenty-two sites on twenty document sets. Each pyramid content model (one per document set) was constructed from four human summaries. Peer systems were scored using the modified pyramid score introduced in DUC 2005. ANOVAs with score as the independent variable and nine factors yielded three significant facto...