In recent years, various model selection procedures (criteria) that can be used for the selection of the best possible model have been proposed. The AIC criterion (Akaike, 1973) is considered the most popular tool for model selection although many competitors have been introduced over the years. One of the main drawbacks of AIC is its tendency to favor high dimensional models namely to overesti...

In this paper, we propose a clustering method by SOM and information criteria. In this method, initial cluster-candidates are derived by SOM, and then these candidates are merged appropriately based on information criterion such as BIC or AIC (Akaike Information Criterion). Through the clustering experiments for the artificial datasets and UCI Machine Learning Repository’s datasets, we confirm ...

In this paper I present a Minimum Description Length Estimator for number of sources in an anechoic mixture of sparse signals. The criterion is roughly equal to the sum of negative normalized maximum log-likelihood and the logarithm of number of sources. Numerical evidence supports this approach and compares favorabily to both the Akaike (AIC) and Bayesian (BIC) Information Criteria. 1 Signal a...

This paper concerns a method of selecting a subset of features for a logistic regression model. Information criteria, such as the Akaike information criterion and Bayesian information criterion, are employed as a goodness-offit measure. The feature subset selection problem is formulated as a mixed integer linear optimization problem, which can be solved with standard mathematical optimization s...

We discuss how to characterize entanglement sources with finite sets of measurements. The measurements do not have to be tomographically complete and may consist of POVMs rather than von Neumann measurements. Our method yields a probability that the source generates an entangled state as well as estimates of any desired calculable entanglement measures, including their error bars. We apply two ...

The mixed model approach to the analysis of repeated measurements allows users to model the covariance structure of their data. That is, rather than using a univariate or a multivariate test statistic for analyzing effects, tests that assume a particular form for the covariance structure, the mixed model approach allows the data to determine the appropriate structure. Using the appropriate cova...

The author introduced the “geometric AIC” and the “geometric MDL” as model selection criteria for geometric fitting problems. These correspond to Akaike’s “AIC” and Rissanen’s “BIC”, respectively, well known in the statistical estimation framework. Another criterion well known is Schwarz’ “BIC”, but its counterpart for geometric fitting has been unknown. This paper introduces the corresponding ...