Shannon’s Theorem for Channel Capacity
Definition
Shannon’s channel capacity theorem states that for a communication channel with bandwidth hertz and signal-to-noise ratio , the maximum achievable data rate without error can be expressed as:
where:
- = channel capacity in bits per second
- = bandwidth in hertz
- = average signal power
- = average noise power
This capacity represents the upper limit of error-free communication for a noisy channel. If the transmission rate is below this value, reliable communication is theoretically possible; if it is above this value, error-free communication becomes impossible regardless of the coding method used.
Main Content
1. Channel Capacity and Its Meaning
Channel capacity is the maximum rate of reliable information transfer
- through a channel. It is not the same as the actual transmission rate of a practical system, but rather the theoretical limit.
It depends on bandwidth and signal-to-noise ratio
- . A wider bandwidth or a higher SNR increases capacity, but only up to a certain limit.
A very important idea in Shannon’s theorem is that capacity is not determined by bandwidth alone or power alone, but by the combined effect of bandwidth and noise. For example:
- If bandwidth is very large but signal power is too weak, capacity may still be limited.
- If signal power is high but bandwidth is narrow, the data rate is also restricted.
Example:
Suppose a channel has:
- Hz
Then,
So the maximum reliable rate is 15 kbps.
2. Role of Noise and Signal-to-Noise Ratio
Noise is the unwanted random signal that disturbs the original message
- during transmission. It may come from thermal sources, atmospheric disturbances, interference, or electronic components.
The signal-to-noise ratio (SNR) measures the relative strength of the useful signal compared to noise
- . A larger SNR means the signal is clearer and more likely to be detected correctly.
In Shannon’s formula, the term shows how capacity changes with noise:
- When noise increases, decreases, so capacity decreases.
- When signal power increases, increases, so capacity increases.
This means that improving channel reliability is possible either by:
- Increasing signal power, or
- Reducing noise, or
- Using efficient coding techniques.
However, increasing power has practical limits due to energy constraints, interference, and hardware limitations. Therefore, modern systems often improve performance through better coding and modulation rather than power alone.
Example:
If a channel has:
- MHz
Then:
If the noise increases such that , then:
Thus, increasing noise reduces the maximum possible data rate.
3. Implications for Digital Communication Systems
Shannon’s theorem guides the design of practical communication systems
- by showing how close a system can operate to the theoretical maximum.
It explains the trade-off between bandwidth, power, and coding efficiency
- . Engineers must balance these factors to achieve the best performance.
A major outcome of this theorem is the concept of coding gain. Instead of only increasing transmit power, systems use:
- Error-correcting codes
- Advanced modulation techniques
- Channel equalization
- Spread spectrum methods
- Adaptive transmission
This theorem also shows why no communication system can exceed capacity with zero error. If a system tries to transmit above capacity, the receiver cannot distinguish symbols reliably because the noise causes too much uncertainty.
Practical interpretation:
- Below capacity → reliable communication is possible with suitable coding.
- At capacity → extremely difficult but theoretically achievable with very long and complex codes.
- Above capacity → reliable communication is impossible.
ASCII diagram for the relationship between rate and capacity:
Reliable Communication Region
^
| Not possible
|------------------------- Capacity ----------------------> Data rate
| Possible with coding
|
|____________________________________________________________
This diagram shows that the channel capacity acts like a boundary between feasible and infeasible communication rates.
Working / Process
1. Identify the channel parameters
- Determine the available bandwidth in hertz.
- Measure or estimate the signal power and noise power .
- Compute the SNR as .
2. Apply Shannon’s capacity formula
-
Use:
-
Calculate the maximum theoretical data rate in bits per second.
3. Compare actual transmission rate with capacity
- If actual rate , reliable communication can be achieved using proper coding.
- If actual rate , communication is at the theoretical limit.
- If actual rate , errors become unavoidable regardless of the coding scheme.
Example process:
Given:
- Hz
- mW
- mW
Then:
So the channel capacity is approximately 6.92 kbps.
Advantages / Applications
Provides the theoretical upper limit of data transmission
- , helping engineers know the maximum achievable performance of a channel.
Helps in designing efficient digital communication systems
- such as mobile networks, Wi-Fi, satellite links, fiber-optic communication, and broadcasting systems.
Supports the development of error-control coding and modulation techniques
- that approach capacity while maintaining low error rates.
Shannon’s theorem is widely used in:
- Cellular communication systems
- Wireless networking
- Satellite and deep-space communication
- Optical fiber communication
- Data compression and coding theory
It is also useful in comparing different communication channels. For example, a fiber-optic channel with high bandwidth and low noise has much larger capacity than a low-bandwidth, noisy radio channel.
Summary
- Shannon’s theorem gives the maximum possible rate of error-free communication over a noisy channel.
- Channel capacity depends on both bandwidth and signal-to-noise ratio.
- The theorem is the foundation for understanding limits and design goals in digital communication.