PURPOSE The purpose of this study is to test the reliability of the clinical performance examination (CPX) using Generalizability theory (G-theory). Through G-theory, the effects of not only students and tasks but also the school will be analyzed as primary sources of error, which can affect the interpretation of the reliability of the CPX. METHODS One thousand three hundred nineteen students...

Historically, reliability issues in psychology and education have been addressed principally using classical test theory (CTT), which postulates that an observed score can be decomposed into a “true” score and a single, undifferentiated random error term, E (Feldt & Brennan, 1989). Generalizability (G) theory liberalizes CTT by providing models and methods that allow an investigator to disentan...

For some years, the limits of classic reliability theory have been recognized in favor of the Generalizability Theory, which deals simultaneously with multiple sources of error. This measurement model can be particularly useful when applied to research in cognitive psychophysiology. Indeed, studies in this field often deal with estimated measures whose reliability is rarely taken into account. ...