We develop a permutation test for assessing a difference in the areas under the curve (AUCs) in a paired setting where both modalities are given to each diseased and nondiseased subject. We propose that permutations be made between subjects specifically by shuffling the diseased/nondiseased labels of the subjects within each modality. As these permutations are made within modality, the permutat...

In a common ROC study design, several readers are asked to rate diagnostics of the same cases processed under different modalities. We describe a Bayesian hierarchical model that facilitates the analysis of this study design by explicitly modelling the three sources of variation inherent to it. In so doing, we achieve substantial reductions in the posterior uncertainty associated with estimates...

∗Department of Physics and Materials Science Center, National Tsing Hua University, Hsinchu, Taiwan, ROC †Department of Materials Science and Engineering, National Tsing Hua University, Hsinchu, Taiwan, ROC ‡Institute of Astronomy and Astrophysics, Academia Sinica, Taipei, Taiwan, ROC §Department of Materials Science Engineering, Feng-Chia University, Taichung, Taiwan, ROC ††Institute of physic...