Runyu Zhang, Zhaolin Ren, and Na Li. Submitted. “Gradient Play in Stochastic Games: Stationary Points and Local Geometry.” In 25th International Symposium on Mathematical Theory of Networks and Systems (MTNS 2022). Supplementary materials