Background The clinical practice examination (CPX) was introduced in 2010, and the Seoul-Gyeonggi CPX Consortium developed the patient-physician interaction (PPI) assessment tool in 2004. Both institutions use rating scales on classified sections of PPI but differ in their scoring of key components. This study investigated the accuracy of standardized patient scores across rating scales by comp...

We conduct beauty contest experiments, using close to 2,000 subjects to study the facial traits of CEOs. In one experiment we use pairs of photographs and find that subjects rate CEO faces as appearing more “competent” and less “likable” than non-CEO faces. Another experiment matches CEOs from large firms against CEOs from smaller firms and finds large-firm CEOs look more competent and likable....

This report is in the public domain. Permission to reproduce is not necessary. Overview This Brief compares three hypothetical Quality Rating and Improvement Systems (QRIS) that use different rating structures: block, points, and hybrid. Because the quality standards in the hypothetical QRIS are held relatively constant across structures, analyses can be conducted to determine how structure rel...

The analytic hierarchy process (AHP) provides a structure on decision-making processes where there are a limited numbers of choices but each has a number of attributes. This paper explores the use of AHP for deciding on car purchase. In the context of shopping, it is important to include elements that provide attributes that make consumer decision-making easier, comfortable and therefore, lead ...

In this paper, we demonstrate the importance of combinations of facial expressions and their timing, in explaining a person's conversational skills in a series of brief non-romantic conversations. Video recordings of 365 fourminute conversations before and after a randomized intervention were analyzed in which facial action units (AUs) were examined over different time segments. Male subjects (...

Rating scales are a widely used method for data annotation; however, they present several challenges, such as difficulty in maintaining interand intra-annotator consistency. Best–worst scaling (BWS) is an alternative method of annotation that is claimed to produce high-quality annotations while keeping the required number of annotations similar to that of rating scales. However, the veracity of...

In all clinical and research work, it is important not only to have uniform diagnostic criteria but also some means of objectively quantifying the presence and severity of the illness being studied. For this purpose, a number of ra t ing scales have been devised for depressive disorders, probably the single most commonly used one being the Hamilton Ra t ing Scale (Hamil ton, 1960). The total sc...

English language practitioners have long relied on intuition-based scales for rating EFL/ESL writing. As these scales lack an empirical basis, the scores they generate tend to be unreliable, which results in invalid interpretations. Given the significance of the genre of description and the fact that the relevant literature does not introduce any data-based analytic scales for rating EFL descri...

A new measure for reliability of a rating scale is introduced, based on the classical definition of reliability, as the ratio of the true score variance and the total variance. Clinical trial data can be employed to estimate the reliability of the scale in use, whenever repeated measurements are taken. The reliability is estimated from the covariance parameters obtained from a linear mixed mode...

Instructors often incorporate selfand peer evaluations when they use teamwork in their classes, which is common in management education. However, the process is often time consuming and frequently does not match well with guidance provided by the literature. We describe the development of a web-based instrument that efficiently collects and analyzes selfand peer-evaluation data. The instrument ...