We describe a set of probability distributions, dubbed compressible priors, whose independent and identically distributed (iid) realizations result in p-compressible signals. A signal x ∈ R is called p-compressible with magnitude R if its sorted coefficients exhibit a power-law decay as |x|(i) . R · i−d, where the decay rate d is equal to 1/p. p-compressible signals live close to K-sparse signa...