Fictitious Play in Markov Games with Single Controller (Proceedings of the 23rd ACM Conference on Economics and Computation)