We show how to construct a linearly independent set of antisymmetrized geminal power (AGP) states, which allows us rewrite our recently introduced replacement models as linear combinations non-orthogonal AGPs. This greatly simplifies the evaluation matrix elements and permits introduce an AGP-based selective configuration interaction method, can reach arbitrary excitation levels relative refere...