/*! This file is auto-generated */ .wp-block-button__link{color:#fff;background-color:#32373c;border-radius:9999px;box-shadow:none;text-decoration:none;padding:calc(.667em + 2px) calc(1.333em + 2px);font-size:1.125em}.wp-block-file__button{background:#32373c;color:#fff;text-decoration:none} Q. 9.15 A coin having probability p = 2 ... [FREE SOLUTION] | 91Ó°ÊÓ

91Ó°ÊÓ

A coin having probability p = 2 3 of coming up heads is flipped 6 times. Compute the entropy of the outcome of this experiment.

Short Answer

Expert verified

The entropy of the outcome of this experiment isHX=5.5098.

Step by step solution

01

Given Information

We have given the probability of the coinp=23.

02

Simplify

Considering random vector X=X1,…,X6where Xiare independent equally distributed variables with distribution which given as

Xi~Bern23

Calculating the entropy of X.

localid="1648135034976" HX=−∑x∈0,16pxlogpx

This sum contains 26summands. Then,

localid="1648135254966" ∑x∈0,16=pxlogpx=-60136log136=−6113523log13516=−66236log236

Hence,

HX=5.5098

Unlock Step-by-Step Solutions & Ace Your Exams!

  • Full Textbook Solutions

    Get detailed explanations and key concepts

  • Unlimited Al creation

    Al flashcards, explanations, exams and more...

  • Ads-free access

    To over 500 millions flashcards

  • Money-back guarantee

    We refund you if you fail your exam.

Over 30 million students worldwide already upgrade their learning with 91Ó°ÊÓ!

One App. One Place for Learning.

All the tools & learning materials you need for study success - in one app.

Get started for free

Most popular questions from this chapter

Consider Example 2a. If there is a 50–50 chance of rain today, compute the probability that it will rain 3 days from now if α = .7 and β = .3.

Suppose that in Problem 9.2, Al is agile enough to escape from a single car, but if he encounters two or more cars while attempting to cross the road, then he is injured. What is the probability that he will be unhurt if it takes him s seconds to cross? Do this exercise for s = 5, 10, 20, 30.

In transmitting a bit from location A to location B, if we let X denote the value of the bit sent at location A and Y denote the value received at location B, then H(X) − HY(X) is called the rate of transmission of information from A to B. The maximal rate of transmission, as a function of P{X = 1} = 1 − P{X = 0}, is called the channel capacity. Show that for a binary symmetric channel with P{Y = 1|X = 1} = P{Y = 0|X = 0} = p, the channel capacity is attained by the rate of transmission of information when P{X = 1} = 1 2 and its value is 1 + p log p + (1 − p)log(1 − p).

Suppose that whether it rains tomorrow depends on past weather conditions only through the past 2 days. Specifically, suppose that if it has rained yesterday and today, then it will rain tomorrow with probability .8; if it rained yesterday but not today, then it will rain tomorrow with probability .3; if it rained today but not yesterday, then it will rain tomorrow with probability .4; and if it has not rained either yesterday or today, then it will rain tomorrow with probability .2. What proportion of days does it rain?

A pair of fair dice is rolled. Let

X=1ifthesumofthediceis60otherwise

and let Y equal the value of the first die. Compute (a) H(Y), (b) HY(X), and (c) H(X, Y).

See all solutions

Recommended explanations on Math Textbooks

View all explanations

What do you think about this solution?

We value your feedback to improve our textbook solutions.

Study anywhere. Anytime. Across all devices.