The article proposes an improved method of auxiliary mixture sampling for count data, binomial data and multinomial data. In constrast to previously proposed samplers the method uses a limited number of latent variables per observation, independent of the intensity of the underlying Poisson process in the case of count data, or of the number of experiments in the case of binomial and multinomia...