Chapter 6: Problem 1
A Markov sequence is realizable if and only if its generating series is rational.
Short Answer
Step by step solution
Key Concepts
These are the key concepts you need to understand to accurately answer the question.
/*! This file is auto-generated */ .wp-block-button__link{color:#fff;background-color:#32373c;border-radius:9999px;box-shadow:none;text-decoration:none;padding:calc(.667em + 2px) calc(1.333em + 2px);font-size:1.125em}.wp-block-file__button{background:#32373c;color:#fff;text-decoration:none}
Learning Materials
Features
Discover
Chapter 6: Problem 1
A Markov sequence is realizable if and only if its generating series is rational.
These are the key concepts you need to understand to accurately answer the question.
All the tools & learning materials you need for study success - in one app.
Get started for free
Let \(\Lambda\) be any time-invariant complete behavior and let \(\sim\) be the following equivalence relation on \(\Omega\) : $$ \omega \sim \omega^{\prime} \Leftrightarrow \lambda(\omega \nu)=\lambda\left(\omega^{\prime} \nu\right) \quad \forall \nu $$ (to be more precise, one should write the translated version of \(\nu\) ). This is the Nerode equivalence relation. Prove that \(\lambda\) admits a finite- cardinality realization if and only if there are only finitely many equivalence classes under the Nerode relation. (Hint: It only takes a couple of lines, using previous results.)
There is a continuous-time version of the above result. Consider continuous- time polynomial systems $$ \dot{x}=f(x, u), \quad y=h(x) $$ where \(\mathcal{X}, \mathcal{U}, \mathcal{y}, h\) are as above and \(f\) is polynomial. We assume completeness. Show that, again, there exists then a finite set of controls \(\omega_{1}, \ldots, \omega_{k}\) such that, for any pair of states \(x\) and \(z\), these states are distinguishable if and only if one of the controls \(\omega_{i}\) distinguishes them. (Hint: Use analytic controls and argue in terms of the corresponding derivatives \(y(0), \dot{y}(0), \ldots\) that there must exist for each such control a polynomial \(\Delta_{\omega}\) so that \(x\) and \(z\) are indistinguishable by \(\omega\) if and only if \(\Delta_{\omega}(x, z)=0\). The Hilbert Basis Theorem is needed for that. Now apply the Basis Theorem again.)
When \(\mathbb{K}=\mathbb{R}\) or \(\mathbb{C}\), one may use complex variables techniques in order to study realizability. Take for simplicity the case \(m=p=1\) (otherwise one argues with each entry). If we can write \(W_{\mathcal{A}}(s)=P(s) / q(s)\) with \(\operatorname{deg} P<\) \(\operatorname{deg} q\), pick any positive real number \(\lambda\) that is greater than the magnitudes of all zeros of \(q\). Then, \(W_{\mathcal{A}}\) must be the Laurent expansion of the rational function \(P / q\) on the annulus \(|s|>\lambda\). (This can be proved as follows: The formal equality \(q W_{\mathcal{A}}=P\) implies that the Taylor series of \(P / q\) about \(s=\infty\) equals \(W_{\mathcal{A}}\), and the coefficients of this Taylor series are those of the Laurent series on \(|s|>\lambda\). Equivalently, one could substitute \(z:=1 / s\) and let $$ \widetilde{q}(z):=z^{d} q(1 / z), \widetilde{P}(z):=z^{d} P(1 / z), $$ with \(d:=\operatorname{deg} q(s)\); there results the equality \(\widetilde{q}(z) W(1 / z)=\widetilde{P}(z)\) of power series, with \(\widetilde{q}(0) \neq 0\), and this implies that \(W(1 / z)\) is the Taylor series of \(\widetilde{P} / \widetilde{q}\) about 0 . Observe that on any other annulus \(\lambda_{1}<|s|<\lambda_{2}\) where \(q\) has no roots the Laurent expansion will in general have terms in \(s^{k}\), with \(k>0\), and will therefore be different from \(W_{\mathcal{A} .)}\) Thus, if there is any function \(g\) which is analytic on \(|s|>\mu\) for some \(\mu\) and is so that \(W_{\mathcal{A}}\) is its Laurent expansion about \(s=\infty\), realizability of \(\mathcal{A}\) implies that \(g\) must be rational, since the Taylor expansion at infinity uniquely determines the function. Arguing in this manner it is easy to construct examples of nonrealizable Markov sequences. For instance, $$ \mathcal{A}=1, \frac{1}{2}, \frac{1}{3 !}, \frac{1}{4 !}, \ldots $$ is unrealizable, since \(\mathcal{W}_{\mathcal{A}}=e^{1 / s}-1\) on \(s \neq 0\). As another example, the sequence $$ \mathcal{A}=1, \frac{1}{2}, \frac{1}{3}, \frac{1}{4}, \ldots $$ cannot be realized because \(\mathcal{W}_{\mathcal{A}}=-\ln \left(1-s^{-1}\right)\) on \(|s|>1\).
Let \(\omega_{i}, i=1, \ldots, k\) be \(k\) different positive real numbers. Show that there is some continuous-time time-invariant linear system with outputs and no inputs \(\Sigma=(A, 0, C)\) such that: \- \(\Sigma\) is observable, and \- for each set of \(2 k\) real numbers \(a_{i}, \varphi_{i}, i=1, \ldots, k\), there is some initial state \(x\) so that $$ \lambda_{x}^{0, t}=\eta(t)=\sum_{i=1}^{k} a_{i} \sin \left(2 \pi \omega_{i} t+\varphi_{i}\right) $$ for all \(t \geq 0\). Conclude from the above discussion that, if $$ \frac{1}{\delta}>2 \max _{i=1, \ldots, m}\left|\omega_{i}\right| $$ then the complete function \(\eta(t)\) can be recovered from the values $$ \eta(0), \eta(\delta), \eta(2 \delta), \ldots $$ for every set of \(a_{i}\) 's and \(\varphi_{i}\) 's.
Calculate a canonical realization, and separately calculate the rank of the Hankel matrix, for each of these examples with \(m=p=1\) : 1\. The sequence of natural numbers \(1,2,3, \ldots\) 2\. The Fibonacci sequence \(0,1,1,2,3,5,8, \ldots\)
What do you think about this solution?
We value your feedback to improve our textbook solutions.