For the analysis of the dynamics of game playing populations, it is common practice to assume infinitely large populations. Infinite models yield predictions of fixed points and their stability properties. However, these models cannot demonstrate the influence of genetic drift, caused by stochastic sampling in small populations. Instead, we propose Markov models of finite populations for the an...