Chapter 2: Problem 9
Let $$ \mathbf{P}=\left\|\begin{array}{cc} 1-a & a \\ b & 1-b \end{array}\right\|, \quad 0
Short Answer
Step by step solution
Key Concepts
These are the key concepts you need to understand to accurately answer the question.
/*! This file is auto-generated */ .wp-block-button__link{color:#fff;background-color:#32373c;border-radius:9999px;box-shadow:none;text-decoration:none;padding:calc(.667em + 2px) calc(1.333em + 2px);font-size:1.125em}.wp-block-file__button{background:#32373c;color:#fff;text-decoration:none}
Learning Materials
Features
Discover
Chapter 2: Problem 9
Let $$ \mathbf{P}=\left\|\begin{array}{cc} 1-a & a \\ b & 1-b \end{array}\right\|, \quad 0
These are the key concepts you need to understand to accurately answer the question.
All the tools & learning materials you need for study success - in one app.
Get started for free
Let a Markov chain contain \(r\) states. Prove the following: (a) If a state \(k\) can be reached from \(j\), then it can be reached in \(r-1\) steps or less. (b) If \(j\) is a recurrent state, there exists \(\alpha(0<\alpha<1)\) such that for \(n>r\) the probability that first return to state \(j\) oeeurs after \(n\) transitions is \(\leq \alpha^{n}\).
(Continuation). Adding to the notation of Problem 15, let \(\tau\) be the first
time the partial sums \(S_{n}\) deviate \(y\) units from their maximum to date.
That is, let \(\tau=\min \left\\{n: Y_{n}=y\right\\}\). Show that
\(M_{t}=S_{n}+y\) has a geometrie distribution I'r \(\left\langle M_{\mathrm{t}}
\geq a\right\\}=\theta^{n}\) for \(a=0,1, \ldots\) and determine \(0 .\)
llint: \(M_{\mathrm{t}} \geq a\) if and only if \(\max _{0 \leq k \leq T(a)}
Y_{k}
Let \(n_{1}, n_{2}, \ldots, n_{2}\) be positive integers with greatest common
divisor \(d\). Show that there exists a positive integer \(M\) such that \(m \geq
M\) implies there exist nonnegative integers \(\left\\{c_{j}\right\\}_{j=1}^{k}\)
such that
$$
m d=\sum_{j=1}^{k} c_{j} n_{j}
$$
(This result is needed for Problem 4 below.)
Hint: Let \(A=\left\\{n \mid n=c_{1} n_{1}+\cdots+c_{k}
n_{k},\left\\{c_{i}\right\\}\right.\) nonnegative integers\\}
Let \(B=\left\\{\begin{array}{l}b_{1} n_{1}+\cdots+b_{j} n_{j} \mid n_{1},
n_{2}, \ldots, n_{j} \in A, \text { and } b_{1}, \ldots, b_{j} \\ \text { are
positive or negative integers }\end{array}\right\\}\)
Let \(d^{\prime}\) be the smallest positive integer in \(B\) and prove that
\(d^{\prime}\) is a common divisor of all integers in \(A\). Then show that \(d\) '
is the greatest common divisor of all integers in \(A\). Hence \(d^{\prime}=d\).
Rearrange the terms in the representation \(d=a_{1} n_{1}+\cdots+a_{l} n_{i}\)
so that the terms with positive coefficients are written first. Thus
\(d=N_{1}-N_{2}\) with \(N_{1} \in A\) and \(N_{2} \in A\). Let \(M\) be the positive
integer, \(M=N \frac{2}{2} / d\). Every integer \(m \geq M\) can be written as
\(m=M+k=N_{2}^{2} / d+k\), \((k=0,1,2, \ldots)\), and \(k=\delta N_{2} / d+b\) where
\(0 \leq b
Given a finite aperiodic irreducible Markov chain, prove that for some \(n\) all torms of \(P^{3}\) are positive.
Consider a sequence of Bernoulli trials \(X_{1}, X_{2}, X_{3}, \ldots\), where \(X_{n}=1\) or 0 . Assume $$ \operatorname{Pr}\left\\{X_{n}=1 \mid X_{1}, X_{2}, \ldots, X_{n-1}\right\\} \geq \alpha>0, \quad n=1,2, \ldots $$ Prove that (a) \(\operatorname{Pr}\left\\{X_{n}=1\right.\) for some \(\left.n\right\\}=1\), (b) \(\operatorname{Pr}\left\\{X_{n}=1\right.\) infinitely often \(\\}=1\).
What do you think about this solution?
We value your feedback to improve our textbook solutions.