Conditional Probability

Definition

Conditional probability is the measure of the probability of an event occurring, given that another event has already occurred. It focuses on how the likelihood of an outcome changes when we have additional information or context about a specific condition.

Main Content

1. The Concept of Dependence

Events are considered dependent if the occurrence of one event changes the probability of the other.
If event A happens, and it restricts the possible outcomes for event B, we say B is conditional on A.

2. The Conditional Probability Formula

The probability of A given B is written as P(A|B).
Mathematically, it is defined as: P(A|B) = P(A ∩ B) / P(B), provided that P(B) > 0.
P(A ∩ B) represents the intersection, where both events happen simultaneously.

3. Visual Representation

Using a Venn diagram helps visualize the reduction of the "sample space" to only the portion covered by the condition.

       Sample Space (S)
    +-----------------------+
    |       ( A )    ( B )  |
    |      /     \  /     \ |
    |     |  A∩B   |       ||
    |      \     /  \     / |
    +-----------------------+

    If we know B has happened, we ignore 
    everything outside of B.

Working / Process

1. Identify the Sample Space and Events

Determine the total number of possible outcomes in the experiment.
Clearly define event A (the event you want to find) and event B (the condition already met).

2. Calculate the Intersection

Find the probability of both events happening together, denoted as P(A ∩ B).
In a deck of cards example, this would be picking a card that is both a "Heart" and a "Face card."

3. Divide by the Condition

Calculate the probability of the condition, P(B).
Divide the intersection result by P(B) to arrive at the final conditional probability.
Example: If P(A ∩ B) = 0.2 and P(B) = 0.5, then P(A|B) = 0.2 / 0.5 = 0.4.

Advantages / Applications

Used extensively in medical diagnosis to determine the probability of a disease given a positive test result.
Essential in machine learning algorithms, particularly in Naive Bayes classifiers for spam detection.
Applied in finance and risk management to predict market movements based on previous economic indicators.

Summary

Conditional probability is a fundamental statistical tool used to calculate the likelihood of an event based on prior knowledge or the occurrence of a related event. By narrowing the sample space to only the outcomes satisfying the given condition, researchers can make more accurate predictions in uncertain environments. Key terms to remember include intersection (P(A ∩ B)), dependent events, and the condition (P(B)).