Semantic Rank Reduction of Music Audio

Audio understanding and classification tasks are often aided by a reduced dimensionality representation of the source observations. For example, a supervised learning system trained to detect the genre or artist of a piece of music performs better if the input nodes are statistically de-correlated, either to prevent overfitting in the learning process or to ‘anchor’ similar observations to cluster centroids in the observation space. We provide an alternate approach that decomposes audio observations of music into semantically significant dimensions where each resultant dimension corresponds to the perceived meaning of the audio, and only the most significant meanings (those which are most effective in describing music audio) are kept. We show a fundamentally unsupervised method to automatically obtain this decomposition and compare its performance in a music understanding task against statistical de-correlation approaches such as PCA and non-negative matrix factorization (NMF).