This study aimed to examine the effect of rater training on differential function (rater error) in process assessing academic writing skills higher education students. The was conducted with a pre-test and post-test control group quasi-experimental design. research consisted 45 raters, whom 22 came from experimental, 23 groups. raters were pre-service teachers who did not participate any before...

BACKGROUND In Zambia the vast majority of chest radiographs (CXR) are read by clinical officers who have limited training and varied interpretation experience, meaning lower inter-rater reliability and limiting the usefulness of CXR as a diagnostic tool. In 2010-11, the Zambian Prison Service and Ministry of Health established TB and HIV screening programs in six prisons; screening included dig...

We tried to develop itemized evaluation criteria and a clinical rater qualification system through rating training of inter-rater consistency for experienced clinical dental hygienists and dental hygiene clinical educators. A total of 15 clinical dental hygienists with 1-year careers participated as clinical examination candidates, while 5 dental hygienists with 3-year educations and clinical c...

This study addresses the high stakes nature of teacher performance assessments and consequential outcomes of passing versus failing based on decisions of those who subjectively score them. Specifically, this study examines the inter-rater reliability of an emerging national model, the Performance Assessment for California Teachers (PACT). Current reports on the inter-rater reliability of PACT u...

BACKGROUND Semi- structured interviews are the core of the Dutch selection procedure for postgraduate general practice (GP) training. A staff member, trainer and trainee independently assess personal qualities. Aiming to improve the selection procedure we were interested in the reliability aspects of these interviews. We investigated the inter-rater reliability of the interview for groups of tw...

[Purpose] To determine the intra- and inter-rater agreement of a mobile application, PostureScreen Mobile® (PSM), that assesses static standing posture. [Subjects and Methods] Three examiners with different levels of experience of assessing posture, one licensed physical therapist and two untrained undergraduate students, performed repeated postural assessments of 10 subjects, fully clothed or ...

Classroom observations increasingly inform high-stakes decisions and research in education, including the allocation of school funding and the evaluation of school-based interventions. However, trends in rater scoring tendencies over time may undermine the reliability of classroom observations. Accordingly, the present investigations, grounded in social psychology research on emotion and judgme...

BACKGROUND AND OBJECTIVES There are multiple procedural skills common to all residency programs. This study had two main objectives: (1) Use an interdisciplinary team to develop a procedural competency checklist for adult endotracheal intubation that could be shared across specialty programs and levels of training and (2) Evaluate the validity and reliability of the checklist. METHODS Clinica...

This study developed and evaluated a brief training program for grant reviewers that aimed to increase inter-rater reliability, rating scale knowledge, and effort to read the grant review criteria. Enhancing reviewer training may improve the reliability and accuracy of research grant proposal scoring and funding recommendations. Seventy-five Public Health professors from U.S. research universit...