91Ó°ÊÓ

In probability theory, random variables are essential for understanding various scenarios involving uncertainty. A random variable is essentially a variable whose possible values are numerical outcomes of a random phenomenon. They can take on different values according to the specific distribution they belong to.

• Discrete Random Variables: These are variables that have a countable number of distinct values. Typically, these arise from counting scenarios, like the roll of a die. The probability distribution of a discrete random variable is characterized by a probability mass function (PMF).
• Continuous Random Variables: These variables take on a continuous range of values, such as the height of a person. Their distribution is described by a probability density function (PDF).

Random variables are crucial because they allow us to model real-world phenomena and analyze outcomes using probability distributions. They help in calculating probabilities, expectations, and variances, which are used to make informed predictions and decisions.

The expected value is a fundamental concept in probability theory, often described as the 'mean' or 'average' of a random variable. It provides a measure of the central tendency of a random variable's distribution.

For a random variable, the expected value is calculated differently based on whether it is discrete or continuous:

• Discrete Random Variables: The expected value is the sum of the products of all possible values the variable can take and their respective probabilities. For a discrete random variable X with possible values x_i and probability P(x_i), its expected value is: \[ E(X) = \sum x_i P(x_i) \]
• Continuous Random Variables: The expected value is the integral of the product of the variable value and its probability density function (PDF) over the entire range of the variable. \[ E(X) = \int x f(x) dx \]

In the context of the original exercise, using the linearity of expectation, we calculated expected values for random variables combined in different ways, demonstrating how this property simplifies such calculations.

Variance is an important measure that quantifies the spread or dispersion of a set of values in a probability distribution. It tells us how much the values of a random variable differ from the expected value.

To determine variance:

• Formula for Discrete Variables: For a discrete random variable, the variance is the average of the squares of the differences between each possible value and the expected value, weighted by the probability of each value. \[ \text{Var}(X) = \sum (x_i - E(X))^2 P(x_i) \]
• Formula for Continuous Variables: For continuous random variables, it is the integral of the squared differences from the mean, multiplied by the PDF across the distribution. \[ \text{Var}(X) = \int (x - E(X))^2 f(x) dx \]

In step 3 of the original solution, the variance of the sum of independent random variables was calculated as the sum of their variances, which is a crucial property of variance useful in real-world applications.

The linearity of expectation is a powerful property in probability theory. It states that the expected value of a sum of random variables is equal to the sum of their expected values, regardless of whether the variables are dependent or independent.

This means that for any random variables X and Y:

• \[ E(X + Y) = E(X) + E(Y) \]
• For any constant "a": \[ E(aX) = a \, E(X) \]

This property significantly simplifies the calculation of expected values for sum and linear transformations of random variables, as seen in our exercise solution.

Because the linearity of expectation holds even when variables are correlated, it offers flexibility in theoretical and practical calculations. It is foundational for understanding concepts like the expected value of sums, which simplifies the analysis of complex random processes.