We investigate propagation of chaos for mean field Markov Decision Process with common noise (CMKV-MDP), and when the optimization is performed over randomized open-loop controls on infinite horizon. first state a rate convergence order MNγ, where MN in Wasserstein distance empirical measure, γ ∈ (0,1] an explicit constant, limit value functions N-agent control problem asymmetric controls, towa...