8.3 Choosing an efficient transmission system.
In many situations we are given a physical channel for information transmission (a set of wires and amplifiers, radio beams, or whatever) and have to decide how we can use it most efficiently. This means we have to assess how well various information transmission systems would make use of the available channel. To see how this is done we can compare transmitting information in two possible forms — as an analog voltage and a serial binary data stream — and decide which would make the best use of a given channel.
When doing this it should be remembered that there are a large variety of ways in which information can be represented. This comparison only tells us which out of the two we're considered is better. If we really did want to find the ‘best possible' we might have to compare quite a few other methods. For the sake of comparison we will assume that the signal power at our disposal is the same regardless of whether we choose a digital or an analog form for the signal. It should be noted, however, that this isn't always the case and that any variations in available signal power with signal form will naturally affect the relative merits of the choices.
Noise may be caused by various physical processes, some of which are under our control to some extent. Here, for simplicity, we will assume that the only significant noise in the channel is due to unavoidable thermal noise. Under these conditions the noise power will be
where T is the physical temperature of the system, and k is Boltzmann's Constant.
Thermal noise has a 'white' spectrum — i.e. the noise power spectral density is the same at all frequencies. Many of the other physical processes which generate noise also exhibit white spectra. As a consequence we can often describe the overall noise level of a real system in terms of a Noise Temperature, T, which is linked to the observed total noise by expression 8.14. The concept of a noise temperature is a convenient one and is used in many practical situations. Its important to remember, however, that a noisy system may have a noise temperature of, say, one million degrees Kelvin, yet have a physical temperature of no more than 20 °C! The noise temperature isn't the same thing as the ‘real' temperature. A very noisy amplifier doesn't have to glow in the dark or emit X-rays!
Most real signals begin in an analog form so we can start by considering an analog signal which we wish to transmit. The highest frequency component in this signal is at a frequency, W Hertz. The Sampling Theorem tells us that we would therefore have to take at least 2W samples per second to convert all the signal information into another form. If we choose to transmit the signal in analog form we can place a low-pass filter in front of the receiver which rejects any frequencies above W. This filter will not stop any of the wanted signal from being received, but rejects any noise power at frequencies above W. Under these conditions the effective channel bandwidth will be equal to W and the received noise power N will be equal to . Using Shannon's equation we can say that the effective capacity of this analog channel will be
In order to communicate the same information as a serial string of digital values we have to be able to transmit two samples of m bits each during the time required for one cycle at the frequency, W — i.e. we have to transmit 2mW bits per second. The frequencies present in a digitized version of a signal will depend upon the details of the pattern of ‘1’s & ‘0’s. The highest frequency will, however, be required when we alternate ‘1's & ‘0's. When this happens each pair of ‘1's & ‘0's will look like the high and low halves of a signal whose frequency is mW (not 2mW). Hence the digital signal will require a channel bandwidth of mW to carry information at the same rate as the analog version.
Various misconceptions have arisen around the question of the bandwidth required to send a serial digital signal. The most common of these amongst students (and a few of their teachers!) are:-
i) “Since you are sending 2mW bits per sample, the required digital bandwidth is 2mW.”
ii) “Since digital signals are like squarewaves, you have to provide enough bandwidth to keep the ‘square edges’ so you can tell they're square, not sinewaves.”
Neither of the above statements are true. The required signal bandwidth is determined by how quickly we have to be able to switch level from '1' to '0' and vice versa. The digital receiver doesn't have to see ‘square' signals, all it has to do is decide which of the two possible levels is being presented during the time allotted for any specific bit.
In order to allow all the digital signal into the receiver whilst rejecting ‘out of band' noise we must now employ a noise-rejecting filter in front of the receiver which only rejects frequencies above mW. The effective capacity of this digital channel will then be
This shows the capacity of the channel at our disposal if we can set the bandwidth to the value required to send the data in digital serial form. Note that this is not the actual rate at which we wish to send data! The digital data rate is
It will only be possible to transmit the data in digital form if we can satisfy two conditions:-
i) The channel must actually be able to transmit frequencies up to mW.
ii) The capacity of the channel must be greater or equal to I.
The digital form of signal will only communicate information at a higher rate than the analog form if
so there is no point in digitising the signal for transmission unless this inequality is true. The number of bits per sample, m, must therefore be such that
Otherwise the precision of the digital samples will be worse than the uncertainty introduced into an analog version of the signal by the channel noise. As a result, if the digital system is to be better than the analog one, the number of bits per sample must satisfy 8.19. (Note that this also means the initial signal has to have a S/N ratio good enough to make it worthwhile taking m bits per sample!)
Unfortunately, we can't just choose a value for m which is as large as we would always wish. This is because the data rate, I, cannot exceed the digital channel capacity, . From 8.16 & 8.17 this is equivalent to requiring that
We can therefore conclude that a digitized form of signal will convey more information than an analog form over the available channel if we can choose a value for m which simultaneously satisfies conditions 8.19 & 8.21, and the available channel can carry a bandwidth, mW. If we can't satisfy these requirements the digital signalling system will be poorer than the analog one.
8.4 Noise, Quantisation, & Dither.
An unavoidable feature of digital systems is that there must always be a finite number of bits per sample. This affects the way details of a signal will be transmitted.
Fig 8.1a represents a typical example of an input analog signal. In this case the signal waveform was obtained from the function — i.e. an exponentially decaying sinewave. Figure 8.1b shows the effect of converting this into a stream of 4-bit digital samples and communicating these samples to a receiver which restores the signal into an analog form. Clearly, 8.1a & 8.1b are not identical! The received signal (8.1b) has obviously been distorted during transmission and is no longer a precise representation of the input. This distortion arises because the communication system only has 2 = 16 available code symbols or levels to represent the variations of the input signal. The output of the system is said to be quantised. It can only produce one of the sixteen available possible levels at any instant. The difference between adjacent levels is called the Quantisation Interval. Any smooth changes in the input become converted into a ‘staircase’ output whose steps are one quantisation interval high.
This form of distortion is particularly awkward when we are interested in the small details of a signal. Consider, for example, the low-amplitude fluctuations of the ‘tail’ of the signal shown in fig 8.1a. These variations are totally absent from the received signal shown in 8.1b. This is because the digitising system uses the same symbol for all of the levels of this small tail. As a result we can expect that any details of the signal which involve level changes smaller than a quantisation interval may be entirely lost during transmission.
At first sight these quantisation effects seem unavoidable. We can reduce the severity of the quantisation distortion by increasing the number of bits per sample. In our 4-bit example the quantisation interval is 1/2 th of the total range (6·25%). If were to replace this with a Compact Disc standard system using 16-bit samples the quantisation interval would be reduced to 1/2th (0.0015%). This reduces the staircase effect, but doesn't banish it altogether. As a result, small signal details will, it seems, always be lost. Fortunately, there is a way of dealing with this problem. We can add some random noise to the signal before it is sampled. Noise which has been deliberately added in this way to a signal before sampling is called Dither.
Figure 8.1c shows the kind of received signal we will obtain if some noise is added to the initial signal before sampling. This noise has the effect of superimposing a random variation onto the staircase distortion. Figure 8.1d shows the effect of passing the output shown in 8.1c through a filter which smooths away the higher frequencies. This essentially produces a ‘moving average' of the received signal plus noise. This filtering action can be carried out by passing the output from the receiver's digital-to-analog convertor through a low-pass analog filter (e.g. a simple RC time constant). Alternatively, filtering can be carried out by performing some equivalent calculations upon the received digital values before reconversion into an analog output. This ‘numerical’ approach was adopted for the example shown in figure 8.1.
Comparing 8.1d with 8.1b we can see that the combination of input dithering and output filtering can remove the quantisation staircase. We may therefore concluded that Dithering provides a way to overcome this form of distortion. It can also (as shown) allow the system to communicate signal details such as the small ‘tail’ of the waveform which are smaller than the quantisation. In reality any input signal will already contain some random noise, however small. In principle therefore we don't need to add any extra noise if, instead, we can employ an analog-to-digital convertor (ADC) which produces enough bits per sample to ensure that the quantisation interval is less than the pre-existing noise level. All that matters is that the signal presented to the ADC varies randomly by an amount greater than the quantisation interval.
In principle, the amount of information communicated is not significantly altered by using dithering. However, the form of information loss changes from a ‘hard’ staircase distortion loss to a ‘gentle’ superimposed random noise which is often more acceptable. For example, in audio systems, where the human ear is less annoyed by random noise than periodic distortions. The ability of dithered systems to respond to tiny signals well below the quantisation level is also useful in many circumstances. Hence dither is widely used when signals are digitised.
From a practical point of view using random noise in this way is quite useful. Most of the time engineers and scientists want to reduce the noise level in order to make more accurate measurements. Noise is usually regarded as an enemy by information engineers. However when digitising analog signals we want a given amount of noise to avoid quantisation effects. The noise allows us to detect small signal details by averaging over a number of samples. Without the noise these details would be lost since small changes in the input signal level would leave the output unchanged.
In fact, the use of dither noise in this way is a special case of a more general rule. Consider as an example a situation where you are using a 3-digit Digital Volt Meter (DVM) to measure a d.c voltage. In the absence of any noise you get a steady reading, something like 1·29 Volts, say. No matter how long you stare at the DVM, the value remains the same. In this situation, if you want a more accurate measurement you may have to get a more expensive DVM which shows more digits! However, if there is a large enough amount of random noise superimposed on the d.c. you'll see the DVM reading vary from time to time. If you now regularly note the DVM reading you'll get some sequence like, 1·29, 1·28, 1·29, 1·27, 1·26, 1·29, etc... Having collected enough measurements you can now add up all the readings and take their average. This can provide a more accurate result than the steady 1·29 Volts you'd get from a steady level in the absence of any noise.
We'll be looking at the use of signal averaging in more detail in a later page. Here we need only note that, for averaging to work, we must have a random noise level fluctuation which is at least a little larger than the quantisation interval. In the case of the 3-digit DVM the quantisation level is the smallest voltage change which alters the reading — i.e. 0·01 Volts in this example. In the case of the 4-bit analog to digital/digital to analog system considered earlier it is of the total range. Although the details of the two examples differ, the basic usefulness of dither and averaging remains the same.
You should now know that an efficient (i.e. no redundancy or repetition) signal provides information because its form is unpredictable in advance. This means that its statistical properties are the same as random noise. You should also now know how to use Shannon's Equation to determine the information carrying capacity of a channel an decide whether a digital or analog system makes the best use of a given channel. You should now know how quantisation distortion arises. It should also be clear that a properly dithered digital information system can provide an output signal which looks just like an analog ‘signal plus noise’ output without any signs of quantisation.
Content and pages maintained by: Jim Lesurf (email@example.com)
using HTMLEdit and TechWriter on a RISCOS machine.
University of St. Andrews, St Andrews, Fife KY16 9SS, Scotland.