91Ó°ÊÓ

Covariance is a statistical measure that describes how two random variables change together. If one variable tends to increase when the other increases, they have positive covariance. Conversely, if one decreases when the other increases, they exhibit negative covariance. Thus, covariance can be a measure of the strength of a linear relationship between two variables.

For random variables \(X\) and \(Y\), the covariance \(\sigma_{XY}\) is calculated using the formula:

• \(\sigma_{XY} = E[(X - \mu_X)(Y - \mu_Y)]\)

Here, \(\mu_X\) and \(\mu_Y\) represent the expected values or means of \(X\) and \(Y\) respectively.

When \(X\) and \(Y\) are independent, their covariance is zero. This follows from the fact that the measure of dependency between the two variables is nonexistent, as they do not affect each other's outcomes. Hence, there is no trend or direction of change that both variables follow together.

In probability theory, a probability density function (PDF) is a function that describes the likelihood of a continuous random variable to take on a particular value. It is a vital tool in evaluating probabilities for continuous random variables, and its integral over a range gives the probability that the variable falls within that range.

To understand this, consider a continuous random variable \(X\) with PDF \(f_X(x)\). Then the probability that \(X\) falls between two values \(a\) and \(b\) is:

• \( P(a \leq X \leq b) = \int_{a}^{b} f_X(x) \, dx \)

The function \(f_X(x)\) itself does not give probabilities directly, but rather densities. For two independent random variables \(X\) and \(Y\), their joint PDF is simply the product of their individual PDFs:

• \(f_{X,Y}(x,y) = f_X(x) \cdot f_Y(y)\)

This property forms an essential understanding that underpins the independence of \(X\) and \(Y\), in essence implying that knowing the value of \(X\) does not provide information about the value of \(Y\), and vice versa.

The expected value is a fundamental concept in probability, representing the average or mean value of a random variable based on its probability distribution. It essentially gives a long-term average if you were to repeat an experiment or observation infinite times.

For a continuous random variable \(X\) with probability density function \(f_X(x)\), the expected value \(E[X]\) is defined as:

• \( E[X] = \int_{-\infty}^{\infty} x \, f_X(x) \, dx \)

This formula means you multiply each possible value of the random variable by its probability density and sum across all possible values.

Understanding expected value is crucial, especially when examining independence and covariance. For example, if random variables \(X\) and \(Y\) are independent, the expected value of their product equals the product of their expected values:

• \(E[X \cdot Y] = E[X] \cdot E[Y]\)

This property is extensively used in proving that the covariance of two independent random variables is zero, emphasizing the non-existence of a linear relationship between them as they do not influence each other's expected outcomes.