Personality test


A personality test is a method of assessing human personality constructs. Most personality assessment instruments are in fact introspective self-report questionnaire measures or reports from life records such as rating scales. Attempts to construct actual performance tests of personality have been very limited even though Raymond Cattell with his colleague Frank Warburton compiled a list of over 2000 separate objective tests that could be used in constructing objective personality tests. One exception however, was the Objective-Analytic Test Battery, a performance test designed to quantitatively measure 10 factor-analytically discerned personality trait dimensions. A major problem with both L-data and Q-data methods is that because of item transparency, rating scales and self-report questionnaires are highly susceptible to motivational and response distortion ranging all the way from lack of adequate self-insight to downright dissimulation depending on the reason/motivation for the assessment being undertaken.
The first personality assessment measures were developed in the 1920s and were intended to ease the process of personnel selection, particularly in the armed forces. Since these early efforts, a wide variety of personality scales and questionnaires have been developed, including the Minnesota Multiphasic Personality Inventory, the Sixteen Personality Factor Questionnaire, the Comrey Personality Scales, among many others. Although popular especially among personnel consultants, the Myers–Briggs Type Indicator has numerous psychometric deficiencies. More recently, a number of instruments based on the Five Factor Model of personality have been constructed such as the Revised NEO Personality Inventory. However, the Big Five and related Five Factor Model have been challenged for accounting for less than two-thirds of the known trait variance in the normal personality sphere alone.
Estimates of how much the personality assessment industry in the US is worth range anywhere from $2 and $4 billion a year. Personality assessment is used in wide a range of contexts, including individual and relationship counseling, clinical psychology, forensic psychology, school psychology, career counseling, employment testing, occupational health and safety and customer relationship management.

History

The origins of personality assessment date back to the 18th and 19th centuries, when personality was assessed through phrenology, the measurement of bumps on the human skull, and physiognomy, which assessed personality based on a person's outer appearances. Sir Francis Galton took another approach to assessing personality late in the 19th century. Based on the lexical hypothesis, Galton estimated the number of adjectives that described personality in the English dictionary Galton's list was eventually refined by Louis Leon Thurstone to 60 words that were commonly used for describing personality at the time. Through factor analyzing responses from 1300 participants, Thurstone was able to reduce this severely restricted pool of 60 adjectives into seven common factors. This procedure of factor analyzing common adjectives was later utilized by Raymond Cattell, who subsequently utilized a data set of over 4000 affect terms from the English dictionary that eventually resulted in construction of the Sixteen Personality Factor Questionnaire which also measured up to eight second-stratum personality factors. Of the many introspective self-report instruments constructed to measure the putative Big Five personality dimensions, perhaps the most popular has been the Revised NEO Personality Inventory However, the psychometric properties of the NEO-PI-R has been severely criticized.
Another early personality instrument was the Woodworth Personal Data Sheet, a self-report inventory developed for World War I and used for the psychiatric screening of new draftees.

Overview

There are many different types of personality assessment measures. The self-report inventory involves administration of many items requiring respondents to introspectively assess their own personality characteristics. This is highly subjective, and because of item transparency, such Q-data measures are highly susceptible to motivational and response distortion. Respondents are required to indicate their level of agreement with each item using a Likert scale or, more accurately, a Likert-type scale. An item on a personality questionnaire, for example, might ask respondents to rate the degree to which they agree with the statement "I talk to a lot of different people at parties" on a scale from 1 to 5.
Historically, the most widely used multidimensional personality instrument is the Minnesota Multiphasic Personality Inventory, a psychopathology instrument originally designed to assess archaic psychiatric nosology.
In addition to subjective/introspective self-report inventories, there are several other methods for assessing human personality, including observational measures, ratings of others, projective tests, and actual objective performance tests.

Topics

Norms

The meaning of personality test scores are difficult to interpret in a direct sense. For this reason substantial effort is made by producers of personality tests to produce norms to provide a comparative basis for interpreting a respondent's test scores. Common formats for these norms include percentile ranks, z scores, sten scores, and other forms of standardised scores.

Test development

A substantial amount of research and thinking has gone into the topic of personality test development. Development of personality tests tends to be an iterative process whereby a test is progressively refined. Test development can proceed on theoretical or statistical grounds. There are three commonly used general strategies: Inductive, Deductive, and Empirical. Scales created today will often incorporate elements of all three methods.
Deductive assessment construction begins by selecting a domain or construct to measure. The construct is thoroughly defined by experts and items are created which fully represent all the attributes of the construct definition. Test items are then selected or eliminated based upon which will result in the strongest internal validity for the scale. Measures created through deductive methodology are equally valid and take significantly less time to construct compared to inductive and empirical measures. The clearly defined and face valid questions that result from this process make them easy for the person taking the assessment to understand. Although subtle items can be created through the deductive process, these measure often are not as capable of detecting lying as other methods of personality assessment construction.
Inductive assessment construction begins with the creation of a multitude of diverse items. The items created for an inductive measure to not intended to represent any theory or construct in particular. Once the items have been created they are administered to a large group of participants. This allows researchers to analyze natural relationships among the questions and label components of the scale based upon how the questions group together. Several statistical techniques can be used to determine the constructs assessed by the measure. Exploratory Factor Analysis and Confirmatory Factor Analysis are two of the most common data reduction techniques that allow researchers to create scales from responses on the initial items.
The Five Factor Model of personality was developed using this method. Advanced statistical methods include the opportunity to discover previously unidentified or unexpected relationships between items or constructs. It also may allow for the development of subtle items that prevent test takers from knowing what is being measured and may represent the actual structure of a construct better than a pre-developed theory. Criticisms include a vulnerability to finding item relationships that do not apply to a broader population, difficulty identifying what may be measured in each component because of confusing item relationships, or constructs that were not fully addressed by the originally created questions.
Empirically derived personality assessments require statistical techniques. One of the central goals of empirical personality assessment is to create a test that validly discriminates between two distinct dimensions of personality. Empirical tests can take a great deal of time to construct. In order to ensure that the test is measuring what it is purported to measure, psychologists first collect data through self- or observer reports, ideally from a large number of participants.

Self- vs. observer-reports

A personality test can be administered directly to the person being evaluated or to an observer. In a self-report, the individual responds to personality items as they pertain to the person himself/herself. Self-reports are commonly used. In an observer-report, a person responds to the personality items as those items pertain to someone else. To produce the most accurate results, the observer needs to know the individual being evaluated. Combining the scores of a self-report and an observer report can reduce error, providing a more accurate depiction of the person being evaluated. Self- and observer-reports tend to yield similar results, supporting their validity.

Direct observation reports

Direct observation involves a second party directly observing and evaluating someone else. The second party observes how the target of the observation behaves in certain situations. The observations can take place in a natural or artificial setting. Direct observation can help identify job applicants who are likely to be successful or maternal attachment in young children. The object of the method is to directly observe genuine behaviors in the target. A limitation of direct observation is that the target persons may change their behavior because they know that they are being observed. A second limitation is that some behavioral traits are more difficult to observe than others. A third limitation is that direct observation is more expensive and time-consuming than a number of other methods.

Personality tests in the workplace

Personality tests can predict something about how a job applicant will act in some workplace situations. Conscientiousness is one of the big five personality traits. A person is high in conscientiousness will ordinarily be less likely to commit crimes against the employer. People who are higher in the agreeableness trait tend to be less likely to fight or argue with other employees. There is a chance that an applicant may fake responses to personality test items in order to make the applicant appear more attractive to the employing organization than the individual actually is.

Test evaluation

There are several criteria for evaluating a personality test. For a test to be successful, users need to be sure that test results are replicable and the test measures what its creators purport it to measure. Fundamentally, a personality test is expected to demonstrate reliability and validity. Reliability refers to the extent to which test scores, if a test were administered to a sample twice within a short period of time, would be similar in both administrations. Test validity refers to evidence that a test measures the construct that it is supposed to measure.

Analysis

A respondent's response is used to compute the analysis. Analysis of data is a long process. Two major theories are used here; Classical test theory - used for the observed score, and item response theory - "a family of models for persons' responses to items". The two theories focus upon different 'levels' of responses and researchers are implored to use both in order to fully appreciate their results.

Non-response

Firstly, item non-response needs to be addressed. Non-response can either be 'unit'- where a person gave no response for any of the n items, or 'item'- i.e., individual question. Unit non-response is generally dealt with exclusion. Item non-response should be handled by imputation- the method used can vary between test and questionnaire items. Literature about the most appropriate method to use and when can be found here....

Scoring

The conventional method of scoring items is to assign '0' for an incorrect answer '1' for a correct answer. When tests have more response options '0' when incorrect, '1' for being partly correct and '2' for being correct. Personality tests can also be scored using a dimensional or a typological approach. Dimensional approaches such as the Big 5 describe personality as a set of continuous dimensions on which individuals differ. From the item scores, an 'observed' score is computed. This is generally found by summing the un-weighted item scores.

Criticism and controversy

Personality versus social factors

In the 60s and 70s some psychologists dismissed the whole idea of personality, considering much behaviour to be context-specific. This idea was supported by the fact that personality often does not predict behaviour in specific contexts. However, more extensive research has shown that when behaviour is aggregated across contexts, that personality can be a modest to good predictor of behaviour. Almost all psychologists now acknowledge that both social and individual difference factors influence behaviour. The debate is currently more around the relative importance of each of these factors and how these factors interact.

Respondent faking

One problem with self-report measures of personality is that respondents are often able to distort their responses. Emotive tests in particular could in theory become prey to unreliable results due to people striving to pick the answer they feel the best fitting of an ideal character and therefore not their true response. This is particularly problematic in employment contexts and other contexts where important decisions are being made and there is an incentive to present oneself in a favourable manner.
Work in experimental settings has also shown that when student samples have been asked to deliberately fake on a personality test, they clearly demonstrated that they are capable of doing so.
Hogan, Barett and Hogan analyzed data of 5,266 applicants who did a personality test based on the big five. At the first application the applicants were rejected. After six months the applicants reapplied and completed the same personality test. The answers on the personality tests were compared and there was no significant difference between the answers.
So in practice, most people do not significantly distort. Nevertheless, a researcher has to be prepared for such possibilities. Also, sometimes participants think that tests results are more valid than they really are because they like the results that they get. People want to believe that the positive traits that the test results say they possess are in fact present in their personality. This leads to distorted results of people's sentiments on the validity of such tests.
Several strategies have been adopted for reducing respondent faking. One strategy involves providing a warning on the test that methods exist for detecting faking and that detection will result in negative consequences for the respondent. Forced choice item formats have been adopted which require respondents to choose between alternatives of equal social desirability. Social desirability and lie scales are often included which detect certain patterns of responses, although these are often confounded by true variability in social desirability.
More recently, Item Response Theory approaches have been adopted with some success in identifying item response profiles that flag fakers. Other researchers are looking at the timing of responses on electronically administered tests to assess faking. While people can fake in practice they seldom do so to any significant level. To successfully fake means knowing what the ideal answer would be. Even with something as simple as assertiveness people who are unassertive and try to appear assertive often endorse the wrong items. This is because unassertive people confuse assertion with aggression, anger, oppositional behavior, etc.

Psychological research

Research on the importance of personality and intelligence in education shows evidence that when others provide the personality rating, rather than providing a self-rating, the outcome is nearly four times more accurate for predicting grades.

Additional applications

A study by American Management Association reveals that 39 percent of companies surveyed use personality testing as part of their hiring process. However, ipsative personality tests are often misused in recruitment and selection, where they are mistakenly treated as if they were normative measures.
More people are using personality testing to evaluate their business partners, their dates and their spouses. Salespeople are using personality testing to better understand the needs of their customers and to gain a competitive edge in the closing of deals. College students have started to use personality testing to evaluate their roommates. Lawyers are beginning to use personality testing for criminal behavior analysis, litigation profiling, witness examination and jury selection.

Dangers

Personality tests have been around for a long time, but it wasn't until it became illegal for employers to use polygraphs that we began to see the widespread use of personality tests. The idea behind these personality tests is that employers can reduce their turnover rates and prevent economic losses in the form of people prone to thievery, drug abuse, emotional disorders or violence in the workplace.
Employers may also view personality tests as more accurate assessment of a candidate's behavioral characteristics versus an employment reference. But the problem with using personality tests as a hiring tool is the notion a person's job performance in one environment will carry over to another work environment. However, the reality is that one's environment plays a crucial role in determining job performance, and not all environments are created equally. One danger of using personality tests is the results may be skewed based on a person's mood so good candidates may potentially be screened out because of unfavorable responses that reflect that mood.
Another danger of personality tests is that they can create false-negative results especially in cases when stress on the applicant's part is involved. There is also the issue of privacy to be of concern forcing applicants to reveal private thoughts and feelings through his or her responses that seem to become a condition for employment. Another danger of personality tests is the illegal discrimination of certain groups under the guise of a personality test.

Examples

Different types of the Big Five personality traits: