Introduction Classification models and in particular binary classification models are ubiquitous in many branches of science and business. Consider, for example, classification models in bioinformatics that classify catalytic protein structures as being in an active or inactive conformation. As an example from the field of medical informatics we might consider a classification model that, given...

In this paper we investigate methods to detect and repair concavities in ROC curves by manipulating model predictions. The basic idea is that, if a point or a set of points lies below the line spanned by two other points in ROC space, we can use this information to repair the concavity. This effectively builds a hybrid model combining the two better models with an inversion of the poorer models...

• This work overviews some developments on the estimation of the Receiver Operating Characteristic (ROC) curve. Estimation methods in this area are constantly being developed, adjusted and extended, and it is thus impossible to cover all topics and areas of application in a single paper. Here, we focus on some frequentist and Bayesian methods which have been mostly employed in the medical setti...

This paper is devoted to thoroughly investigating how to bootstrap the ROC curve, a widely used visual tool for evaluating the accuracy of test/scoring statistics in the bipartite setup. The issue of confidence bands for the ROC curve is considered and a resampling procedure based on a smooth version of the empirical distribution called the ”smoothed bootstrap” is introduced. Theoretical argume...

The accurate medical diagnostic of a disease condition is fundamental for a correct medical decision. Disease screening programs are based, in general, in diagnostic tests which provide a binary response: a subject is classified as positive, if the test result is above a given threshold, and negative, otherwise. Therefore, false positive and false negative classifications can be generated. The ...

The limitations of diagnostic "accuracy" as a measure of decision performance require introduction of the concepts of the "sensitivity" and "specificity" of a diagnostic test. These measures and the related indices, "true positive fraction" and "false positive fraction," are more meaningful than "accuracy," yet do not provide a unique description of diagnostic performance because they depend on...

Assessment of predictive accuracy is a critical aspect of evaluating and comparing models, algorithms or technologies that produce the predictions. In the field of medical diagnosis, receiver operating characteristic (ROC) curves have become the standard tool for this purpose and its use is becoming increasingly common in other fields such as finance, atmospheric science and machine learning. T...

Regression models are introduced into the receiver operating characteristic (ROC) analysis to accommodate effects of covariates, such as genes. If many covariates are available, the variable selection issue arises. The traditional induced methodology separately models outcomes of diseased and nondiseased groups; thus, separate application of variable selections to two models will bring barriers...

| This paper reports the diagnostic performance of observers in detecting abnormalities in computer-generated mammogram-like images. A mathematical model of the human breast is deened in which breast tissues are simulated by spheres of diierent sizes and densities. Images are generated by casting rays from a speciied source, through the model, and onto an image plane. Observer performance when ...

Department of Dietetics, Kaohsiung Municipal United Hospital, Kaohsiung, Taiwan, ROC Department of Seafood Science, National Kaohsiung Marine University, Kaohsiung, Taiwan, ROC Medical Laboratory, Kaohsiung Municipal United Hospital, Kaohsiung, Taiwan, ROC Doctoral Program in Physical Education, Taipei Physical Education College, Taipei, Taiwan, ROC Sport Science Research Center, National Taiwa...