Error message

Deprecated function: Array and string offset access syntax with curly braces is deprecated in include_once() (line 20 of /home/makcnsproj/public_html/includes/file.phar.inc).

Perturbed Markov Chains with Damping Component

TitlePerturbed Markov Chains with Damping Component
Publication TypeJournal Article
Year of Publication2020
AuthorsSilvestrov, D, Silvestrov, S, Abola, B, Biganda, PSeleka, Engström, C, Mango, JMagero, Kakuba, G
JournalMethodology and Computing in Applied Probability
Volume23
Pagination369–397
Date Published13 August 2020
Abstract

The paper is devoted to studies of regularly and singularly perturbed Markov chains with damping component. In such models, a matrix of transition probabilities is regularised by adding a special damping matrix multiplied by a small damping (perturbation) parameter ε. We perform a detailed perturbation analysis for such Markov chains, particularly, give effective upper bounds for the rate of approximation for stationary distributions of unperturbed Markov chains by stationary distributions of perturbed Markov chains with regularised matrices of transition probabilities, asymptotic expansions for approximating stationary distributions with respect to damping parameter, explicit coupling type upper bounds for the rate of convergence in ergodic theorems for n-step transition probabilities, as well as ergodic theorems in triangular array mode.