Pure Stationary Nash Equilibria for Discounted Stochastic Positional Games

Authors

  • Dmitrii Lozovanu Institute of Mathematics and Computer Science of Moldova Academy of Sciences
  • Stefan Pickl Universitat der Bundeswehr Munchen

Abstract

A discounted stochastic positional game is a stochastic game with discounted payoffs in which the set of states is divided into several disjoint subsets such that each subset represents the position set for one of the player and each player control the Markov decision process only in his position set. In such a game each player chooses actions in his position set in order to maximize the expected discounted sum of his stage rewards. We show that an arbitrary discounted stochastic positional game with finite state and action spaces possesses a Nash equilibrium in pure stationary strategies. Based on the proof of this result we present conditions for determining all optimal pure stationary strategies of the players.

Keywords:

stochastic positional games, discounted payoffs, pure stationary strategies, mixed stationary strategies, Nash equilibria

Downloads

Download data is not yet available.

References

Boyd, S. and Vandenberghe, L. (2004). Convex optimization. Cambridge University Press.

Dasgupta, P. and Maskin, E. (1986). The existence of equilibrium in discontinuous economic games. Rev. Econ. Stud. 53, 1–26.

Debreu, G. (1952). A social equilibrium existence theorem. Proceedings of the National Academy of Sciences, 38, 886–893.

Fink, A. (1964). Equilibria in a stochastic n-person game. Journal of Science of Hiroshima University, Series A-I, 28, 89–93.

Gurvich, V. Karzanov, A. and Khachiyan, L. (1988). Cyclic games and an algorithm to find minimax cycle means in directed graphs. USSR Comput. Math. Math. Phis., 28, 85–91.

Lozovanu, D. and Pickl, S. (2015). Optimization of Stochastic Discrete Systems and Control on Complex Networks. Springer.

Puterman, M. (2005). Markov Decision Processes: Discrete Dynamic Programming. Wiley, Hoboken.

Shapley, L. (1953). Stochastic games. Proc. Natl. Acad. Sci. USA, 39, 1095–1100.

Sobol, M. (1971). Non-cooperative stochastic games. Ann. Math. Statist., 42, 1930–1935.

Solan, E. (1998). Discounted stochastic games. Mathematics of Operation Research, 23(4), 1010–1021.

Takahashi, M. (1964). Equilibrium points of stochastic, noncooperative n-person games. J. Sci. Hiroshima Univ., Series A-I, 28, 95–99.

Downloads

Published

2022-02-23

How to Cite

Lozovanu, D., & Pickl, S. (2022). Pure Stationary Nash Equilibria for Discounted Stochastic Positional Games. Contributions to Game Theory and Management, 12. Retrieved from https://gametheory.spbu.ru/article/view/12960

Issue

Vol. 12 (2019)

Section

Articles

License

Articles of "Contributions to Game Theory and Management" are open access distributed under the terms of the License Agreement with Saint Petersburg State University, which permits to the authors unrestricted distribution and self-archiving free of charge.