We study the time evolution of two wave packets prepared at the same initial state, but evolving under slightly different Hamiltonians. For chaotic systems, we determine the circumstances that lead to an exponential decay with time of the wave packet overlap function. We show that for sufficiently weak perturbations, the exponential decay follows a Fermi golden rule, while by making the differe...