Independence; Discrete Random Variables

Definition

Independence of two events means that the occurrence of one event does not change the probability of the other event. For events $A$ and $B$, they are independent if:

$$P(A \cap B) = P(A)P(B)$$

For random variables, independence means that knowing the value of one random variable gives no information about the other. If $X$ and $Y$ are independent discrete random variables, then their joint probability satisfies:

$$P(X=x, Y=y) = P(X=x)\,P(Y=y)$$

A discrete random variable is a random variable that takes a finite or countably infinite set of distinct values, such as $0, 1, 2, 3, \dots$. Each possible value has an associated probability, and the total probability of all possible values is 1.

Main Content

1. Independence

Meaning and interpretation

Independence describes a situation where one event or variable does not influence another. In everyday terms, if the outcome of one experiment tells you nothing about the outcome of another, the two are independent. For example, tossing a fair coin and rolling a fair die are independent experiments because the result of the coin toss does not affect the die outcome.

Mathematical conditions and examples

For two events $A$ and $B$, independence is checked by verifying whether $P(A \cap B)=P(A)P(B)$.
Example: Let $A$ be the event “getting heads on a coin toss” and $B$ be the event “getting 4 on a die roll.” Then: $$P(A)=\frac12,\quad P(B)=\frac16,\quad P(A\cap B)=\frac{1}{12}$$ Since $$P(A)P(B)=\frac12 \cdot \frac16 = \frac{1}{12},$$ the events are independent.

A useful visual idea is:

  Coin toss result  ── no effect ──> Die roll result

This shows that the two outcomes do not influence each other.

2. Discrete Random Variables

Definition and nature of values

A discrete random variable assigns a numerical value to each outcome of a random experiment, but only specific separate values are possible. These values can be listed, even if the list is infinite. Common examples include the number of heads in three coin tosses, the number of defective items in a sample, or the number of students absent in a class.

Probability mass function (PMF)

The probabilities of a discrete random variable are described by its probability mass function: $$p(x)=P(X=x)$$ where $X$ is the discrete random variable. The PMF must satisfy:

• $p(x)\ge 0$ for every possible value $x$
• $\sum p(x)=1$

Example: If $X$ is the number of heads in one fair coin toss, then: $$P(X=0)=\frac12,\quad P(X=1)=\frac12$$ These probabilities sum to 1, so $X$ is a valid discrete random variable.

Another example is the number shown on a die: $$X \in \{1,2,3,4,5,6\},\quad P(X=x)=\frac16$$ for each value $x$.

3. Independence of Discrete Random Variables

Joint and marginal probabilities

If $X$ and $Y$ are discrete random variables, their behavior together is described by a joint probability distribution: $$P(X=x, Y=y)$$ They are independent if the joint probability equals the product of their individual probabilities for every possible pair $(x,y)$: $$P(X=x, Y=y)=P(X=x)P(Y=y)$$ This means the probability distribution of one variable does not depend on the other.

Practical example and table form

Suppose two fair coins are tossed. Let $X$ be the result of the first coin and $Y$ be the result of the second coin, where Heads = 1 and Tails = 0. Then each pair is equally likely:

Since: $$P(X=1)=\frac12,\quad P(Y=1)=\frac12,\quad P(X=1,Y=1)=\frac14$$ and $$\frac12 \cdot \frac12 = \frac14,$$ the variables are independent.

Important note: events and random variables must be distinguished carefully. Two events can be independent, and two discrete random variables can be independent, but one does not automatically guarantee the other unless properly defined.

Working / Process

1. Identify the random variable(s) and outcomes

First, determine what experiment is being studied and what numerical values the random variable can take. For discrete random variables, list all possible values clearly. For example, if $X$ is “number of defective bulbs in a sample of 3,” then possible values are $0,1,2,3$.

2. Find probabilities and test independence

Compute the probability of each event or each value of the random variables. To test independence, compare: $$P(A \cap B) \quad \text{with} \quad P(A)P(B)$$ for events, or $$P(X=x,Y=y) \quad \text{with} \quad P(X=x)P(Y=y)$$ for random variables. If they are equal for all relevant cases, the variables are independent.

3. Construct the distribution and interpret the result

Build the PMF or joint distribution table, verify that probabilities sum to 1, and interpret what the independence means in context. If independent, one variable does not help predict the other. If not independent, then the variables are linked, and knowledge of one changes the probabilities of the other.

Advantages / Applications

Simplifies probability calculations

Independence allows complex joint probabilities to be computed as products of simpler probabilities, making calculations much easier in multi-step experiments.

Used in real-world modeling

Discrete random variables are used in quality control, insurance, inventory management, computer science, and survey analysis. Independence is especially important when modeling repeated trials, such as repeated coin tosses, independent sensor readings, or separate production defects.

Foundation for advanced topics

These ideas are essential for expectation, variance, binomial and multinomial distributions, conditional probability, and statistical inference. Without understanding discrete random variables and independence, later topics become much harder to interpret correctly.

Summary

• Independence means one event or discrete random variable does not affect another.
• A discrete random variable takes countable values with assigned probabilities.
• Their joint probability equals the product of individual probabilities when independent.
• Important terms to remember: independence, discrete random variable, probability mass function, joint probability, marginal probability.