To date comparative studies have not convinced the HCI community about the reliability of results from usability evaluations. User testing of the same products by different usability teams found different problems (Molich et al., 1999). Discount methods also have the same problem. With heuristic evaluation method, for example, overlaps between evaluators’ results are often as low as 10% (Molich...

Introduction. Evaluation is one of the most important phase in educational (teaching) system. During evaluation, the student scale (rate) of learning is discovered. In this study we tried to substitute a new method called the final functional evaluation, that is mostly popular to a code – name OSCE. Methods. This is a descriptive – comparative study. The statistical population are the family h...

ticals, e-commerce comparison sites and cyber intelligence. Schema matching lifts data integration—traditionally focused on well-structured data—to highly. Comparative Evaluation of Microarray-based Gene Expression Databases. BTW 2003: 482-501 Erhard Rahm: Comparison of Schema Matching Evaluations. will raise the bar for empirical evaluation and comparison of data integration Integration tasks ...

Performance evaluation of vision algorithms is a necessary step during a research process. It may supports inter and intra technique comparisons. A fair evaluation process requires of a methodology. Disparity estimation evaluation involves multiple aspects. However, conventional approaches rely on the use of a single value as an indicator of comparative performance. In this paper a non-linear q...

In this paper, we report our work on automatic image annotation by combining several textual features drawn from the text surrounding the image. Evaluation of our system is performed on a dataset of images and texts collected from the web. We report our findings through comparative evaluation with two gold standard collections of manual annotations on the same dataset.

This paper summarizes the definition, resources, evaluation methodology and metrics, participation and comparative results for the second task of the WEPS-3 evaluation campaign. The so-called OnlineReputation Management task consists of filtering Twitter posts containing a given company name depending of whether the post is actually related with the company or not. Five research groups submitte...

reliability evaluation of a large-scale composite power system faces to numerous events/outage and consequently imposes an extensive burden of calculations. in order to simplify the problem, determination of an equivalent system for large-scale power system is inevitable. this paper proposes a framework as reduction technique to separate a composite power system to three areas: external area, o...

Although there is an increasing shift towards evaluating Natural Language Generation (NLG) systems, there are still many NLG-specific open issues that hinder effective comparative and quantitative evaluation in this field. The paper starts off by describing a task-based, i.e., black-box evaluation of a hypertext NLG system. Then we examine the problem of glass-box, i.e., module specific, evalua...

Many multi-agent systems development methodologies appeared and disappeared in recent years. This work presents a comparative study among four multi-agent systems development methodologies in order to identify gaps within these proposals that should be addressed for those who intend to apply them in a near future. The comparative study was based on the results of a controlled experiment divided...