Discrimination testing


Discrimination testing is a technique employed in sensory analysis to determine whether there is a detectable difference among two or more products. The test uses a group of assessors with a degree of training appropriate to the complexity of the test to discriminate from one product to another through one of a variety of experimental designs. Though useful, these tests typically do not quantify or describe any differences, requiring a more specifically trained panel under different study design to describe differences and assess significance of the difference.

Statistical basis

The statistical principle behind any discrimination test should be to reject a null hypothesis that states there is no detectable difference between two products. If there is sufficient evidence to reject H0 in favour of the alternative hypothesis, HA:There is a detectable difference, then a difference can be recorded. However, failure to reject H0 should not be assumed to be sufficient evidence to accept it. H0 is formulated on the premise that all of the assessors guessed when they made their response. The statistical test chosen should give a probability value that the result was arrived at through pure guesswork. If this probability is sufficiently low then H0 can be rejected in favour of HA.
Tests used to decide whether or not to reject H0 include binomial, χ2, t-test etc.

Types of test

A number of tests can be classified as discrimination tests. If it's designed to detect a difference then it's a discrimination test. The type of test determines the number of samples presented to each member of the panel and also the question they are asked to respond to.
Schematically, these tests may be described as follows; A & B are used for knowns, X and Y are used for different unknowns, while means that the order of presentation is unknown:
;Paired comparison: XY or – two unknown samples, known to be different, test is which satisfies some criterion ; unlike the others this is not an equality test.
;Duo-trio: AXY – one known, two unknown, test is which unknown is the known
;Triangle: – three unknowns, test is which is odd one out.
;ABX: ABX – two knowns, one unknown, test is which of the knowns the unknown is.
;Duo-trio in constant reference mode: X – three unknowns, where it is stated that the first two are different, but which is which is not identified, test is which of the first two the third is.

Paired comparison

In this type of test the assessors are presented with two products and are asked to state which product fulfils a certain condition. This condition will usually be some attribute such as sweetness, sourness, intensity of flavour, etc. The probability for each assessor arriving at a correct response by guessing is

Advantages

Minimum number of samples required. Most straightforward approach when the question is 'Which sample is more ____?"

Disadvantages

Need to know in advance the attribute that is likely to change. Not statistically powerful with large panel sizes required to obtain sufficient confidence.

Duo-trio

The assessors are presented with three products, one of which is identified as the control. Of the other two, one is identical to the control, the other is the test product. The assessors are asked to state which product more closely resembles the control.
The probability for each assessor arriving at a correct response by guessing is

Advantages

Quick to set up and execute. No need to have prior knowledge of nature of difference.

Disadvantages

Not statistically powerful therefore relatively large panel sizes required to obtain sufficient confidence.

Triangle

The assessors are presented with three products, two of which are identical and the other one different. The assessors are asked to state which product they believe is the odd one out.
The probability for each assessor arriving at a correct response by guessing is

Advantages

Can be quick to execute and offers greater power than paired comparison or duo-trio.

Disadvantages

Error might occur:
There are many other errors which can occur but the above are the main possible errors. It is evident from the above information that randomisation, control and professional conduct of the experiment are essential for obtaining the most accurate results.
Important
Used to assist research and development in formulating and reformulating products. Using the triangle design to determine if a particular ingredient change, or a change in processing, creates a detectable difference in the final product. Triangle taste testing is also used in quality control to determine if a particular production run meets the quality-control standard.

ABX

The assessors are presented with three products, two of which are identified as reference A and alternative B, the third is unknown X, and identical to either A or B. The assessors are asked to state which of A and B the unknown is; the test may also be described as "matching-to-sample", or "duo-trio in balanced reference mode".
ABX testing is widely used in comparison of audio compression algorithms, but less used in food science.
ABX testing differs from the other listed tests in that subjects are given two known different samples, and thus are able to compare them with an eye towards differences – there is an "inspection phase". While this may be hypothesized to make discrimination easier, no advantage has been observed in discrimination performance in ABX testing compared with other testing methods.

Duo-trio in constant reference mode

Like triangle testing, but third is known to not be the odd one out. Intermediate between ABX, and triangle, where any of the three could be out.

Degree of difference (DoD)

Signal Detection Theory

Experimental design