•We overcome a major limitation in using deep neural networks on small sample sizes•Our approach achieves state-of-the-art interpretability scores of complex features•The presented framework integrates analytical, virtual, and experimental approaches We present fully featured to studying natural images that approaches. Our framework, decontextualized hierarchical representation learning (DHRL),...