We study and compare two classes of statistical criteria to assess the significance of exceptional words. Indeed, the Z-score-like criteria, or the normal approximation that is a strict equivalent, suffer from several drawbacks in terms of sensitivity and specificity. Thanks to the combinatorial structure of words, a computation of the exact P-value has been made possible by recent mathematical...

Most theories in the areas of personality, clinical, and social psychology predict no more than the direction of a correlation, group difference, or treatment effect. Since the null hypothesis is never strictly true, such predictions have about a SO-SO chance of being confirmed by experiment when the theory in question is false, since the statistical significance of the result is a function of ...

This article takes issue with a recent book by Ziliak and McCloskey (2008) of the same title. Ziliak and McCloskey argue that statistical significance testing is a barrier rather than a booster for empirical research in economics and should therefore be abandoned altogether. The present article argues that this is good advice in some research areas but not in others. Taking all issues which hav...

A statistically significant research finding should not be defined as a P-value of 0.05 or less, because this definition does not take into account study power. Statistical significance was originally defined by Fisher RA as a P-value of 0.05 or less. According to Fisher, any finding that is likely to occur by random variation no more than 1 in 20 times is considered significant. Neyman J and P...

Erick Turner Emma Veitch cites my PLoS Medicine Essay [1] about how the Food and Drug Administration’s (FDA’s) review of documents can serve as a source of clinical trials data, but she follows it up with the statement, “However, it is diffi cult to have confi dence in data released by sponsors when the data have not been subjected to external, independent peer review. Furthermore, this informa...

With the increase in genomewide experiments and the sequencing of multiple genomes, the analysis of large data sets has become commonplace in biology. It is often the case that thousands of features in a genomewide data set are tested against some null hypothesis, where a number of features are expected to be significant. Here we propose an approach to measuring statistical significance in thes...

Inductive learning systems search for regularities that therefore be applied with some assurance to an example describe environmental observations, These systems often use which does not belong to the learning set. In other numeri~~l heu~stics to guide this search, The~ also sele~t words, statistical significance may be used to assess regulantles which are good, or the best, according to certai...