Spearman–Brown prediction formula


The Spearman–Brown prediction formula, also known as the Spearman–Brown prophecy formula, is a formula relating psychometric reliability to test length and used by psychometricians to predict the reliability of a test after changing the test length. The method was published independently by Spearman and Brown.

Calculation

Predicted reliability,, is estimated as:
where n is the number of "tests" combined and is the reliability of the current "test". The formula predicts the reliability of a new test composed by replicating the current test n times. Thus n = 2 implies doubling the exam length by adding items with the same properties as those in the current exam. Values of n less than one may be used to predict the effect of shortening a test.

Forecasting test length

The formula can also be rearranged to predict the number of replications required to achieve a degree of reliability:

Split-half reliability

Until the developement of tau-equivalent reliability, split-half reliability using the Spearman-Brown formula was the only way to obtain inter-item reliability. After splitting the whole item into arbitrary halves, the correlation between the split-halves can be converted into reliability by applying the Spearman-Brown formula. That is,
,where is the Pearson correlation between the split-halves. Although the Spearman-Brown formula is rarely used as a split-half reliability coefficient after the development of tau-equivalent reliability, some scholars claim that this method is still useful. Eisinga, R.; Te Grotenhuis, M.; Pelzer, B.. "The reliability of a two-item scale: Pearson, Cronbach or Spearman-Brown?". International Journal of Public Health. 58 : 637-642. doi: 10.1007 / s00038-012-0416-3

Its relation to other split-half reliability coefficients

Split-half parallel reliability

Cho suggests using systematic nomenclature and formula expressions, criticizing that reliability coefficients have been represented in an disorganized and inconsistent manner with historically inaccurate and uninformative names. The assumption of the Spearman-Brown formula is that split-halves are parallel, which means that the variances of the split-halves are equal. The systematic name proposed for the Spearman-Brown formula is split-half parallel reliability. In addition, the following systematic formula has been proposed.

Split-half tau-equivalent reliability

Split-half tau-equivalent reliability is a reliability coefficient that can be used when the variances of split-halves are not equal. Flanagan-Rulon suggested the following formula expressions:
,
, and
.
Where,,, and is the variance of the first split-half, the second half, the sum of the two split-halves, and the difference of the two split-halves, respectively.
These formulas are all algebraically equivalent. The systematic formula is as follows.

Split-half congeneric reliability

Split-half parallel reliability and split-half tau-equivalent reliability have the assumption that split-halves have the same length. Split-half congeneric reliability mitigates this assumption. However, because there are more parameters that need to be estimated than the given pieces of information, another assumption is needed. Raju examined the split-half congeneric reliability coefficient when the relative length of each split-half was known. Angoff and Feldt published the split-half congeneric reliability assuming that the length of each split-half was proportional to the sum of the variances and covariances.

History

The name Spearman-Brown seems to imply a partnership, but the two authors were competitive. This formula originates from two papers published simultaneously by Brown and Spearman in the British Journal of Psychology. Charles Spearman had a hostile relationship with Karl Pearson who worked together in King's College London, and they exchanged papers that criticized and ridiculed each other. Cowles, M. Statistics in psychology: An historical perspective. New York: Psychology Press. William Brown received his Ph.D. under Pearson's guidance. An important part of Brown's doctoral dissertation was devoted to criticizing Spearman' work. Spearman appears first in this formula before Brown because he is a more prestigious scholar than Brown. Cho, E. & Chun, S.. Fixing a broken clock: A historical review of the originators reliability coefficients including Cronbach's alpha. Survey Research, 19, 23-54. For example, Spearman established the first theory of reliability and is called "the father of classical reliability theory." This is an example of Matthew Effect or Stigler's law of eponymy.
This formula should be referred to as the Brown-Spearman formula for the following reasons: Third, it is likely that Brown was written before Spearman. Brown is based on his doctoral dissertation, which was already available at the time of publication. Spearman criticized Brown, but Brown criticized only Spearman. Fourth, it is the APA style to list the authors in alphabetical order.

Use and related topics

This formula is commonly used by psychometricians to predict the
reliability of a test after changing the test length. This relationship is
particularly vital to the split-half and related methods of estimating
reliability.
The formula is also helpful in understanding the nonlinear relationship
between test reliability and test length. Test length must grow by increasingly larger values as the desired reliability approaches 1.0.
If the longer/shorter test is not parallel to the current test, then the prediction will not be strictly accurate. For example, if a highly reliable test was lengthened by adding many poor items then the achieved reliability will probably be much lower than that predicted by this formula.
For the reliability of a two-item test, the formula is more appropriate than Cronbach's alpha.
Item response theory item information provides a much more precise means of predicting changes in the quality of measurement by adding or removing individual items.

Citations