Peer assessment is the most common approach to evaluating scientific work, and it is also gaining popularity for scaling evaluation of student work in large and distributed classes. The key idea is that each peer reviewer or grader rates a relatively small subset of the items, and that some method of manual, semiautomatic, or fully-automatic aggregation of all assessments defines the eventual r...

A rating scale was designed to measure performance in interviewing techniques in primary care. Peer review of audiovisual recordings of their consultations showed that a group of experienced general practitioners achieved significantly higher scores on the rating scale compared with a group of similarly experienced general practitioners who did not observe their recordings. The higher scores we...

In a controlled experiment using Comrade, a computer-supported peer review system, student reviewers offered feedback to student authors on their written analyses of a problem scenario. In each condition, reviewers received a different type of rating prompt: domain-related writing composition prompts or problem/issue specific prompts. We found that the reviewers were sensitive to the type of ra...

few, if any, studies have investigated the effect of professional experience as a rater variable and type of assessment as a task variable on raters’ criteria in the assessment of speech acts. this study aimed to explore the impact of nonnative teachers’ professional experience on the use of criteria in monologic and dialogic assessment of 12 role-plays of 3 apology speech acts. to this end, 60...

Peer-to-Peer systems are a new paradigm for information sharing and some systems have successfully been deployed. It has been argued that current Peer-to-Peer systems suffer from the lack of semantics. The SWAP project (Semantic Web and Peer-to-Peer) aims at overcoming this problem by combining the Peer-to-Peer paradigm with Semantic Web technologies. In the course of our investigations it turn...

With the prevalence of online reviews, consumers are more inclined to be exposed to an unwieldy glut of information. In contrast to the research on the outcomes of online reviews, recent studies have shifted attention to the antecedents of online reviews, particularly investigating what characteristics lead to a review that is perceived more helpful by online consumers. Our research model of on...

This research presents a privacy preserving peer-to-peer communication mechanism that allows peers using their personal agents to obtain reputation information of each other through a pair of trustworthy mediator proxies. A mediator proxy is considered trustworthy, if even when it is compromised, it can guarantee three conditions: (1) the anonymity of the identity of the responders and the targ...

We examined whether a same-sex peer's vegetable consumption would predict the number of vegetable pieces eaten by the participant. A total of 116 Dutch women (M age = 20.28; M BMI = 21.68) participated. Their nutrient-dense food intake was measured during a 15-min break between two tasks, consisting of rating television advertisements. Participants consumed more vegetables when exposed to a pee...

This paper is investigating if it is possible to predict source code quality based on static analysis and machine learning. The proposed approach includes a plugin in Eclipse, uses a combination of peer review/human rating, static code analysis, and classification methods. As training data, public data and student hand-ins in programming are used. Based on this training data, new and uninspecte...

This position paper analyzes the current situation in the scholarly publishing and peer review practices and presents three thesis: (i) we are going to run out of peer reviewers; (ii) it is possible to replace referees with readers, an approach that is named Readersourcing; and (iii) it is possible to avoid potential weaknesses in the Readersourcing model by adopting an appropriate quality cont...