Parametric Resonance in Primal-Dual Learning for Slowly Non-Stationary Constrained MDPs

Primal-dual methods for constrained Markov decision processes are analyzed under a two-timescale assumption, with non-stationarity entering through two channels.