Main effect


In the design of experiments and analysis of variance, a main effect is the effect of an independent variable on a dependent variable averaged across the levels of any other independent variables. The term is frequently used in the context of factorial designs and regression models to distinguish main effects from interaction effects.
Relative to a factorial design, under an analysis of variance, a main effect test will test the hypotheses expected such as H0, the null hypothesis. Running a hypothesis for a main effect will test whether there is evidence of an effect of different treatments. However a main effect test is nonspecific and will not allow for a localization of specific mean pairwise comparisons. A main effect test will merely look at whether overall there is something about a particular factor that is making a difference. In other words, it is a test examining differences amongst the levels of a single factor. Main effects are essentially the overall effect of a factor.

Definition

A factor averaged over all other levels of the effects of other factors is termed as main effect. The contrast of a factor between levels over all levels of other factors is the main effect. The difference between the marginal means of all the levels of a factor is the main effect of the response variable on that factor. Main effects are the primary independent variables or factors tested in the experiment. Main effect is the specific effect of a factor or independent variable regardless of other parameters in the experiment. In design of experiment, it is referred to as a factor but in regression analysis it is referred to as the independent variable.

Estimating Main Effects

In factorial designs, thus two levels each of factor A and B in a factorial design, the main effects of two factors say A and B be can be calculated. The main effect of A is given by
The main effect of B is given by
Where n is total number of replicates. The letter "a" represent the factor combination of level 1 of A and level 2 of B and "b" represents the factor combination of A level 2 of A and level 1 of B. "ab" is the represents both factors at level 1.

Hypothesis Testing for Two Way Factorial Design.

Consider a two-way factorial design in which factor A has 3 levels and factor B has 2 levels with only 1 replicate. There are 6 treatments with 5 degrees of freedom. in this example, we have two null hypotheses. The first for Factor A is: and the second for Factor B is:. The main effect for factor A can be computed with 2 degrees of freedom.This variation is summarized by the sum of squares denoted by the term SSA. Likewise the variation from factor B can be computed as SSB with 1 degree of freedom. The expected value for the mean of the responses in column i is while the expected value for the mean of the responses in row j is where i corresponds to the level of factor in factor A and j corresponds to the level of factor in factor B. and are main effects. SSA and SSB are main-effects sums of squares. The two remaining degrees of freedom can be used to describe the variation that comes from the interaction between the two factors and can be denoted as SSAB. A table can show the layout of this particular design with the main effects :

Example

Take a factorial design testing the taste ranking of fried chicken at two fast food restaurants. Let taste testers rank the chicken from 1 to 10, for factor X: "spiciness" and factor Y: "crispiness." Level X1 is for "not spicy" chicken and X2 is for "spicy" chicken. Level Y1 is for "not crispy" and level Y2 is for "crispy" chicken. Suppose that five people tasted all four kinds of chicken and gave a ranking of 1-10 for each. The hypotheses of interest would be: Factor X is: and for Factor Y is:. The table of hypothetical results is given here:
Factor CombinationIIIIIIIVVTotal
Not Spicy, Not Crispy 3261921
Not Spicy, Crispy 7242823
Spicy, Not Crispy 5561825
Spicy, Crispy 91086841

The "Main Effect" of X when we are at Y1 is given as:
where n is the number of replicates. Likewise, the "Main Effect" of X at Y2 is given as:
, upon which we can take the simple average of these two to determine the overall main effect of the Factor X, which results as the above
formula, written here as:
=
Likewise, for Y, the overall main effect will be:
=
For the Chicken tasting experiment, we would have the resulting main effects: