In statistics, suppose that we have been given some data, and we are constructing a statistical model of that data. The relative likelihood compares the relative plausibilities of different candidate models or of different values of a parameter of a single model.
Relative likelihood of parameter values
Assume that we are given some data for which we have a statistical model with parameter. Suppose that the maximum likelihood estimate for is. Relative plausibilities of other values may be found by comparing the likelihoods of those other values with the likelihood of. The relative likelihood of is defined to be where denotes the likelihood function. Thus, the relative likelihood is the likelihood ratio with fixed denominator. The function is the relative likelihood function.
Likelihood region
A likelihood region is the set of all values of whose relative likelihood is greater than or equal to a given threshold. In terms of percentages, a % likelihood region for is defined to be. If is a single real parameter, a % likelihood region will usually comprise an interval of real values. If the region does comprise an interval, then it is called a likelihood interval. Likelihood intervals, and more generally likelihood regions, are used for interval estimation within likelihood-based statistics : They are similar to confidence intervals in frequentist statistics and credible intervals in Bayesian statistics. Likelihood intervals are interpreted directly in terms of relative likelihood, not in terms of coverage probability or posterior probability. Given a model, likelihood intervals can be compared to confidence intervals. If is a single real parameter, then under certain conditions, a 14.65% likelihood interval for will be the same as a 95% confidence interval. In a slightly different formulation suited to the use of log-likelihoods, the test statistic is twice the difference in log-likelihoods and the probability distribution of the test statistic is approximately a chi-squared distribution with degrees-of-freedom equal to the difference in df-s between the two models.
Relative likelihood of models
The definition of relative likelihood can be generalized to compare different statistical models. This generalization is based on AIC, or sometimes AICc. Suppose that for some given data we have two statistical models, and. Also suppose that. Then the relative likelihood of with respect to is defined as follows. To see that this is a generalization of the earlier definition, suppose that we have some model with a parameter. Then for any, set, and also set. The general definition now gives the same result as the earlier definition.
