Statistical Tools for Replicable and Reproducible Research Recent technology advances have changed the practice of scientific research. More studies are conducted in each research field, and large-scale data are recorded in each study, such that many hypotheses are examined. Data processing and analysis pipelines become more complex, and there are convenient tools for storing and distributing c...

We show that publishing results using the statistical significance filter—publishing only when the p-value is less than 0.05—leads to a vicious cycle of overoptimistic expectation of the replicability of results. First, we show through a simple derivation that when true statistical power is relatively low, computing power based on statistically significant results will lead to overestimates of ...

"This article reviews the experience of two pilot projects in Bangladesh that have addressed the question of how [operations] research can be designed to foster its utilization. In a rural field experiment [begun in 1972] in Matlab subdistrict, research has demonstrated that contraceptive services, if carefully designed and properly implemented, can influence demographic dynamics even where so...

It is well known that, although psychophysical scaling produces good qualitative agreement between experiments, precise quantitative agreement between experimental results, such as that routinely achieved in physics or biology, is rarely or never attained. A particularly galling example of this is the fact that power function exponents for the same psychological continuum, measured in different...

Traditional null hypothesis significance testing does not yield the probability of the null or its alternative and, therefore, cannot logically ground scientific decisions. The decision theory proposed here calculates the expected utility of an effect on the basis of (1) the probability of replicating it and (2) a utility function on its size. It takes significance tests--which place all value ...

Amplified fragment length polymorphisms (AFLPs) are polymerase chain reaction (PCR)-based markers for the rapid screening of genetic diversity. AFLP methods rapidly generate hundreds of highly replicable markers from DNA of any organism; thus, they allow high-resolution genotyping of fingerprinting quality. The time and cost efficiency, replicability and resolution of AFLPs are superior or equa...

Three major personality prototypes were derived on the basis of a Big Five instrument (NEO-PI) by means of replicated cluster analysis in two Spanish samples (a sample from the general population and a student sample). The replicability of the three prototypes within and their consistency between the two samples were evaluated. In addition, subtypes were analysed in a similar way. Finally, the ...