Maximum likelihood sequence estimation


Maximum likelihood sequence estimation is a mathematical algorithm to extract useful data out of a noisy data stream.

Theory

For an optimized detector for digital signals the priority is not to reconstruct the transmitter signal, but it should do a best estimation of the transmitted data with the least possible number of errors.
The receiver emulates the distorted channel. All possible transmitted data streams are fed into this distorted channel model. The receiver compares the time response with the actual received signal and determines the most likely signal.
In cases that are most computationally straightforward, root mean square deviation can be used as the decision criterion for the lowest error probability.

Background

Suppose that there is an underlying signal, of which an observed signal is available. The observed signal r is related to x via a transformation that may be nonlinear and may involve attenuation, and would usually involve the incorporation of random noise. The statistical parameters of this transformation are assumed known. The problem to be solved is to use the observations to create a good estimate of.
Maximum likelihood sequence estimation is formally the application of maximum likelihood to this problem. That is, the estimate of is defined to be sequence of values which maximize the functional
where p denotes the conditional joint probability density function of the observed series given that the underlying series has the values.
In contrast, the related method of maximum a posteriori estimation is formally the application of the maximum a posteriori estimation approach. This is more complex than maximum likelihood sequence estimation and requires a known distribution for the underlying signal. In this case the estimate of is defined to be sequence of values which maximize the functional
where p denotes the conditional joint probability density function of the underlying series given that the observed series has taken the values. Bayes' theorem implies that
In cases where the contribution of random noise is additive and has a multivariate normal distribution, the problem of maximum likelihood sequence estimation can be reduced to that of a least squares minimization.