Skip to main content
Intended for healthcare professionals
Restricted access
Review article
First published online December 14, 2010

Fact and Fiction in Cognitive Ability Testing for Admissions and Hiring Decisions

Abstract

Standardized measures of intelligence, ability, or achievement are all measures of acquired knowledge and skill and have consistent relationships with multiple facets of success in life, including academic and job performance. Five persistent beliefs about ability tests have developed, including: (a) that there is no relationship with important outcomes like creativity or leadership, (b) that there is predictive bias, (c) that there is a lack of predictive independence from socioeconomic status, (d) that there are thresholds beyond which scores cease to matter, and (e) that other characteristics, like personality, matter as well. We present the evidence and conclude that of these five beliefs, only the importance of personality is a fact; the other four are fiction.

Get full access to this article

View all access and purchase options for this article.

References

Atkinson R.C. (2005). College admissions and the SAT: A personal perspective. APS Observer, 18(5):15–22.
Barrick M.R., Mount M.K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1–26.
Berry C.M., Sackett P.R. (2009). Individual differences in course choice result in underestimation of the validity of college admissions systems. Psychological Science, 20, 822–830.
Campbell J.P., McCloy R.A., Oppler S.H., Sager C.E. (1993). A theory of performance. In Schmitt N., Borman W.C. (Eds.), Personnel Selection in Organizations (pp. 35–70). San Francisco: Jossey-Bass.
Colquitt J.A., LePine J.A., Noe R.A. (2000). Toward an integrative theory of training motivation: A meta-analytic path analysis of 20 years of research. Journal of Applied Psychology, 85, 678–707.
Connelly B.S., Ones D.S. (in press). An other perspective on personality: Meta-analytic integration of observers' accuracy and predictive validity. Psychological Bulletin.
Coward W.M., Sackett P.R. (1990). Linearity of ability-performance relationships: A reconfirmation. Journal of Applied Psychology, 75, 297–300.
Crede M., Kuncel N.R. (2007). Study habits, skills, and attitudes: The third pillar supporting collegiate academic performance. Perspectives on Psychological Science, 3, 425–453.
Cullen M.J., Hardison C.M., Sackett P.R. (2004). Using SAT-grade and ability-job performance relationships to test predictions derived from stereotype threat theory. Journal of Applied Psychology, 89, 220–230.
Deary I.J., Whalley L.J., Lemmon H., Crawford J.R., Starr J.M. (2000). The stability of individual differences in mental ability from childhood to old age: Follow-up of the 1932 Scottish Mental Survey. Intelligence, 28, 49–55.
Geiser S., Studley R. (2001). Supporting documents for “UC and the SAT: Predictive validity and differential impact of the SAT I and SAT II at the University of California.” Oakland, CA: University of California Office of the President, Division of Academic Affairs. Downloaded August 21, 2009, from http://www.ucop.edu/sas/research/researchandplanning/supporting.htm
Kuncel N.R., Hezlett S.A. (2007). Standardized tests predict graduate student’s success. Science, 315, 1080–1081.
Kuncel N.R., Hezlett S.A., Ones D.S. (2004). Academic performance, career potential, creativity, and job performance: Can one construct predict them all? Journal of Personality and Social Psychology, 86, 148–161.
Lubinski D. (2009). Exceptional cognitive ability: The phenotype. Behavioral Genetics, 39, 350–358.
Mael F.A. (1995). Staying afloat: Within-group swimming proficiency for Whites and Blacks. Journal of Applied Psychology, 80, 479–490.
McCloy R.A., Campbell J.P., Cudeck R. (1994). A confirmatory test of a model of performance determinants. Journal of Applied Psychology, 78, 493–505.
Ones D.S., Viswesvaran C., Dilchert S. (2005). Cognitive ability in personnel selection decisions. In Evers A., Anderson N., Voskuijl O. (Eds.), The Blackwell handbook of personnel selection. Oxford, UK: Blackwell Publishing.
Phillips M., Brooks-Gunn J., Duncan G.J., Kelbanov P., Crane J. (1998). Family background, parenting practices, and the Black-White test score gap. In Jencks C., Phillips M. (Eds.), The Black-White test score gap. Washington, DC: Brookings Institution Press.
Poropat A.E. (2009). A meta-analysis of the five-factor model of personality and academic performance. Psychological Bulletin, 135, 322–338.
Sackett P.R., Borneman M.J., Connelly B.S. (2008). High stakes testing in higher education and employment. American Psychologist, 63, 215–227.
Sackett P.R., Kuncel N.R., Arneson J., Cooper S.R., Waters S. (2009). Socio-economic status and the relationship between admissions tests and post-secondary academic performance. Psychological Bulletin, 135, 1–22.
Schmidt F.L., Hunter J.E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262–274.
Schmidt F.L., Hunter J.E., Outerbridge A.N. (1986). Impact of job experience and ability on job knowledge, work sample performance, and supervisory ratings of job performance. Journal of Applied Psychology, 71, 432–439.