/*! This file is auto-generated */ .wp-block-button__link{color:#fff;background-color:#32373c;border-radius:9999px;box-shadow:none;text-decoration:none;padding:calc(.667em + 2px) calc(1.333em + 2px);font-size:1.125em}.wp-block-file__button{background:#32373c;color:#fff;text-decoration:none} Q. 9.7 A transition probability matrix ... [FREE SOLUTION] | 91Ó°ÊÓ

91Ó°ÊÓ

A transition probability matrix is said to be doubly

stochastic if

∑i=0MPij=1

for all states j = 0, 1, ... , M. Show that such a Markov chain is ergodic, then

j = 1/(M + 1), j = 0, 1, ... , M.

Short Answer

Expert verified

It is proved that a Markov chain is ergodic, then πj=1M+1forj=0,1,...,M

Step by step solution

01

Given Information

We have given that the transition probability matrix is doubly stochastic if

∑i=0MPij=1

for all statesj=0,1,...,M.

02

Simplify

As the chain ergodic and the transition matrix is doubly stochastic, there exists a unique stationary distribution Ï€. Now, we just have to check that is that localid="1648139523807" Ï€i=1m+!solution of the system of the equation Ï€=Ï€±Êi.e., is it true

πj=∑ipijπjπj=∑ipijπj

but, we havelocalid="1648139404599" ∑ipij=1, which means

1M+1=1M+1.∑ipij=1M+1.1=1M+1

So, we have proved that the stationary distribution is localid="1651480780070" πj=1m+1.

Unlock Step-by-Step Solutions & Ace Your Exams!

  • Full Textbook Solutions

    Get detailed explanations and key concepts

  • Unlimited Al creation

    Al flashcards, explanations, exams and more...

  • Ads-free access

    To over 500 millions flashcards

  • Money-back guarantee

    We refund you if you fail your exam.

Over 30 million students worldwide already upgrade their learning with 91Ó°ÊÓ!

One App. One Place for Learning.

All the tools & learning materials you need for study success - in one app.

Get started for free

Most popular questions from this chapter

Events occur according to a Poisson process with rate λ = 3 per hour. (a) What is the probability that no events occur between times 8 and 10 in the morning? (b) What is the expected value of the number of events that occur between times 8 and 10 in the morning? (c) What is the expected time of occurrence of the fifth event after 2 P.M.?

Cars cross a certain point in the highway in accordance with a Poisson process with rate λ = 3 per minute. If Al runs blindly across the highway, what is the probability that he will be uninjured if the amount of time that it takes him to cross the road is s seconds? (Assume that if he is on the highway when a car passes by, then he will be injured.) Do this exercise for s = 2, 5, 10, 20.

Let X be a random variable that takes on 5 possible values with respective probabilities .35, .2, .2, .2, and .05. Also, let Y be a random variable that takes on 5 possible values with respective probabilities .05, .35, .1, .15, and .35. (a) Show that H(X) > H(Y). (b) Using the result of Problem 9.13, give an intuitive explanation for the preceding inequality.

Compute the limiting probabilities for the model of Problem 9.4.

In transmitting a bit from location A to location B, if we let X denote the value of the bit sent at location A and Y denote the value received at location B, then H(X) − HY(X) is called the rate of transmission of information from A to B. The maximal rate of transmission, as a function of P{X = 1} = 1 − P{X = 0}, is called the channel capacity. Show that for a binary symmetric channel with P{Y = 1|X = 1} = P{Y = 0|X = 0} = p, the channel capacity is attained by the rate of transmission of information when P{X = 1} = 1 2 and its value is 1 + p log p + (1 − p)log(1 − p).

See all solutions

Recommended explanations on Math Textbooks

View all explanations

What do you think about this solution?

We value your feedback to improve our textbook solutions.

Study anywhere. Anytime. Across all devices.