/*! This file is auto-generated */ .wp-block-button__link{color:#fff;background-color:#32373c;border-radius:9999px;box-shadow:none;text-decoration:none;padding:calc(.667em + 2px) calc(1.333em + 2px);font-size:1.125em}.wp-block-file__button{background:#32373c;color:#fff;text-decoration:none} Q3E Question:  Suppose that a rando... [FREE SOLUTION] | 91Ó°ÊÓ

91Ó°ÊÓ

Question: Suppose that a random variable X has the Poisson distribution with unknown mean \({\bf{\theta }}\) >0. Find the Fisher information \({\bf{I}}\left( {\bf{\theta }} \right)\) in X.

Short Answer

Expert verified

The Fisher Information is \(\frac{n}{\theta }\)

Step by step solution

01

Given information

It is given that X is a random variable that follows Poisson distribution with unknown parameter \(\theta \). Therefore \({X_1} \ldots {X_n}\) are iid \(Poisson\left( \theta \right)\) .

02

Define the pdf anStep 2: Define the pdf and find the expectation and varianced find the expectation and variance

\(f\left( {x{\rm{ }}|{\rm{ }}\theta } \right) = \frac{{{\theta ^x}{e^{ - \theta }}}}{{x!}},x = 0,1, \ldots \)

By the properties of a Poisson distribution

\(\begin{array}{l}E\left( X \right) = \theta \\Var\left( X \right) = \theta \end{array}\)

03

Define fisher information

Assume \(X \sim f\left( {x{\rm{ }}|{\rm{ }}\theta } \right)\) (pdf or pmf) with\(\theta \in \Theta \subset R\) .

Then fisher information is defined by

\(\begin{array}{c}{I_x}\left( \theta \right) = {E_\theta }\left[ {{{\left( {\frac{\partial }{{\partial \theta }}\log f\left( {X|\theta } \right)} \right)}^2}} \right]\\ = {E_\theta }\left( { - \frac{{{\partial ^2}}}{{\partial {\theta ^2}}}\log f\left( {X|\theta } \right)} \right)\end{array}\)

And

\({I_x}\left( \theta \right) = n{I_x}_{_1}\left( \theta \right)\)

04

Calculating fisher information for Poisson distribution

Let \(X = {X_1}\)

From the definition,

\(\begin{array}{c}{I_x}\left( \theta \right) = {E_\theta }\left( {{{\left( {\frac{\partial }{{\partial \theta }}\log f\left( {X|\theta } \right)} \right)}^2}} \right)\\ = {E_\theta }\left( {{{\left( {\frac{X}{\theta } - 1} \right)}^2}} \right)\\ = Va{r_\theta }\left( {\frac{X}{\theta }} \right)\,\,\,\left( {\,{\rm{Since}}\,\,{\rm{E}}\left( {\frac{{\rm{X}}}{{\rm{\theta }}}} \right){\rm{ = }}\frac{{{\rm{E}}\left( {\rm{X}} \right)}}{{\rm{\theta }}}{\rm{ = 1}}} \right)\end{array}\)

\(\begin{array}{c} = \frac{{Va{r_\theta }\left( X \right)}}{{{\theta ^2}}}\\ = \frac{\theta }{{{\theta ^2}}}\\ = \frac{1}{\theta }\end{array}\)

We know that

\(\begin{array}{c}{I_x}\left( \theta \right) = n{I_x}_{_1}\left( \theta \right)\\ = \frac{n}{\theta }\end{array}\)

Therefore, the Fisher Information is \(\frac{n}{\theta }\)

Unlock Step-by-Step Solutions & Ace Your Exams!

  • Full Textbook Solutions

    Get detailed explanations and key concepts

  • Unlimited Al creation

    Al flashcards, explanations, exams and more...

  • Ads-free access

    To over 500 millions flashcards

  • Money-back guarantee

    We refund you if you fail your exam.

Over 30 million students worldwide already upgrade their learning with 91Ó°ÊÓ!

One App. One Place for Learning.

All the tools & learning materials you need for study success - in one app.

Get started for free

Most popular questions from this chapter

Suppose that\({{\bf{X}}_{\bf{1}}},{\bf{ \ldots }},{{\bf{X}}_{\bf{n}}}\)form a random sample from the normal distribution with unknown meanμand known variance\({{\bf{\sigma }}^{\bf{2}}}\). Let\({\bf{\Phi }}\)stand for the c.d.f. of the standard normal distribution, and let\({{\bf{\Phi }}^{{\bf{ - 1}}}}\)be its inverse. Show that

the following interval is a coefficient\(\gamma \)confidence interval forμif\({{\bf{\bar X}}_{\bf{n}}}\)is the observed average of the data values:

\(\left( {{{{\bf{\bar X}}}_{\bf{n}}}{\bf{ - }}{{\bf{\Phi }}^{{\bf{ - 1}}}}\left( {\frac{{{\bf{1 + }}\gamma }}{{\bf{2}}}} \right)\frac{{\bf{\sigma }}}{{{{\bf{n}}^{\frac{{\bf{1}}}{{\bf{2}}}}}}}{\bf{,}}{{{\bf{\bar X}}}_{\bf{n}}}{\bf{ + }}{{\bf{\Phi }}^{{\bf{ - 1}}}}\left( {\frac{{{\bf{1 + }}\gamma }}{{\bf{2}}}} \right)\frac{{\bf{\sigma }}}{{{{\bf{n}}^{\frac{{\bf{1}}}{{\bf{2}}}}}}}} \right)\)

Suppose that a random variable X has the normal distribution with mean 0 and unknown variance σ2> 0. Find the Fisher information I(σ2) in X. Note that in this exercise, the variance σ2 is regarded as the parameter, whereas in Exercise 4, the standard deviation σ is regarded as the parameter.

Question:Suppose that a random variable X has a normal distribution for which the mean μ is unknown (−∞ <μ< ∞) and the variance σ2 is known. Let\({\bf{f}}\left( {{\bf{x}}\left| {\bf{\mu }} \right.} \right)\)denote the p.d.f. of X, and let\({\bf{f'}}\left( {{\bf{x}}\left| {\bf{\mu }} \right.} \right)\)and\({\bf{f''}}\left( {{\bf{x}}\left| {\bf{\mu }} \right.} \right)\)denote the first and second partial derivatives with respect to μ. Show that

\(\int_{{\bf{ - }}\infty }^\infty {{\bf{f'}}\left( {{\bf{x}}\left| {\bf{\mu }} \right.} \right)} {\bf{dx = 0}}\,\,{\bf{and}}\,\,\int_{{\bf{ - }}\infty }^\infty {{\bf{f''}}\left( {{\bf{x}}\left| {\bf{\mu }} \right.} \right)} {\bf{dx = 0}}{\bf{.}}\).

Consider the analysis performed in Example 8.6.2. This time, use the usual improper before computing the parameters' posterior distribution.

Consider the conditions of Exercise 10 again. Suppose also that it is found in a random sample of size n = 10 \(\overline {{{\bf{x}}_{\bf{n}}}} {\bf{ = 1}}\,\,{\bf{and}}\,\,{{\bf{s}}_{\bf{n}}}^{\bf{2}}{\bf{ = 8}}\) . Find the shortest possible interval so that the posterior probability \({\bf{\mu }}\) lies in the interval is 0.95.

See all solutions

Recommended explanations on Math Textbooks

View all explanations

What do you think about this solution?

We value your feedback to improve our textbook solutions.

Study anywhere. Anytime. Across all devices.