article distributed under the terms of the Creative Commons Attribution License which permits unrestricted use of work provided the original work is properly cited. General Medical Council (GMC) in the UK has emphasized the importance of internal consistency for students' assessment scores in medical education. 1 Typically Cronbach's alpha is reported by medical educators as an index of interna...

Adapted from the Early Childhood Environment Rating Scale–Revised, the Chinese Early Childhood Program Rating Scale (CECPRS) is a culturally comparable measure for assessing the quality of early childhood education and care programs in the Chinese cultural/social contexts. In this study, 176 kindergarten classrooms were rated with CECPRS on eight dimensions of program quality. Multivariate gene...

Of increasing interest to the educational assessment researchers is the reliability of scores obtained by various measurement procedures like tests, rating scales, surveys, and observation forms. Traditional methods of reliability based on Classical Test Theory (CTT) consider only one source of measurement errors. Generalizability Theory (GT) extends CTT by providing a flexible and practical fr...

Although social support is integral to the coaching process, there is only a limited understanding of the antecedents of perceived coach support. We applied generalizability theory to examine perceived coach support and its antecedents at perceiver, provider, and relational levels of analysis. Two studies were conducted in which athletes rated the degree to which they identified with a selectio...

Parenting was observed in videotaped interactions in 30 families referred for child conduct problems. Generalizability coefficients and the impact of varying numbers of raters were estimated. Two measurement designs were compared: All raters observed all families ("crossed" design) and a different rater observed each family ("nested" design). The crossed design provided higher generalizability ...

We propose that the continuing controversies over the use of quasi-F-ratios in psycholinguistic research might be circumvented, if not resolved, by the judicious application of Generalizability Theory (GT) analyses. We argue that GT is a logical extension of the basic rationale behind repeated measures Analysis of Variance (ANOVA) and the variance components model upon which GT is ultimately ba...

This paper presents a Generalizability Theory (GT) analysis of the dependability of measures obtained using the Seevers, Dormody and VanLeeuwen (1998) SET instrument. The analysis of Seevers , et al. (1998) data suggests that both student means and class means are sufficiently reliable measuresfor most purposes. These data are used to illustrate the GT estimation of reliabilities for both stude...

ABSTRACT: Using the generalizability theory (G-theory) as a theoretical framework, this study aimed at investigating variability and reliability of holistic scores assigned by human raters e-rater to same EFL essays. Eighty argumentative essays written on two different topics tertiary level Turkish students were scored holistically eight who received detailed rater training. The results showed ...

This study examined the number of writing samples needed to obtain a reliable estimate of young struggling writers’ capabilities. It further assessed if performance in one genre was reflective of performance in other genres for these children. Secondand third-grade students (81 boys, 56 girls), who were identified as struggling writers in need of special assistance by their teacher and scored a...

Quiet standing balance and postural control are often assessed by drawing information from center of pressure (COP) data collected with a force platform. Efforts to better understand the underlying processes involved in postural control have lead to methods that examine the dynamic or stochastic characteristics of the COP. One method that has recently gained popularity is Stabilogram Diffusion ...