The present article addresses reliability issues in light of recent studies and debates focused on psychometrics versus datametrics terminology and reliability generalization (RG) introduced by Vacha-Haase. The purpose here was not to moderate arguments presented in these debates but to discuss multiple perspectives on score reliability and how they may affect research practice, editorial polic...

In this paper, we define the generalization problem, summarize various approaches in generalization, identify the credit assignment problem, and present the problem and some solutions in measuring generalizability. We discuss anomalies in the ordering of hypotheses in a subdomain when performance is normalized and averaged, and show conditions under which anomalies can be eliminated. To general...

The study illustrates the application of generalizability theory (G-theory) to identify measurement protocols that optimize reliability of two clinical methods for assessing spine curvatures in women with osteoporosis. Triplicate measures of spine curvatures were acquired for 9 postmenopausal women with spine osteoporosis by two raters during a single visit using a digital inclinometer and a fl...

It is incorrect and even harmful that many information systems researchers typically criticize their own intensive (qualitative, interpretive, critical, and case) research as lacking “generalizability.” We untangle and distinguish the numerous concepts now confounded in the single term “generalizability,” which are generality, generalization, generalize, general, and generalizing. These clarifi...

How the probands are recruited also can affect the quality of a study’s conclusions. One potential source of bias is the influence of environmental factors on the selection of proband adoptees in the adoptees’ family method. For example, psychological or social problems in an adoptive family may contribute to the adoptee’s psychopathology. Simultaneously, these problems may prompt the family an...