Hostname: page-component-8678677fb7-ngjx9 Total loading time: 0 Render date: 2026-10-01T06:06:14.139Z Has data issue: false hasContentIssue false
  • English
  • Français

NIH Toolbox Cognition Battery (CB): Validation of Executive Function Measures in Adults

Published online by Cambridge University Press:  24 June 2014

Philip David Zelazo ,
Jacob E. Anderson ,
Jennifer Richler ,
Kathleen Wallner-Allen ,
Jennifer L. Beaumont ,
Kevin P. Conway ,
Richard Gershon  and
Sandra Weintraub
Philip David Zelazo*
Affiliation:
University of Minnesota, Minneapolis, Minnesota
Jacob E. Anderson
Affiliation:
University of Minnesota, Minneapolis, Minnesota
Jennifer Richler
Affiliation:
Indiana University, Bloomington, Indiana
Kathleen Wallner-Allen
Affiliation:
Westat, Inc., Rockville, Maryland
Jennifer L. Beaumont
Affiliation:
Northwestern University, Evanston, Illinois
Kevin P. Conway
Affiliation:
National Institutes of Health, Bethesda, Maryland
Richard Gershon
Affiliation:
Northwestern University, Evanston, Illinois
Sandra Weintraub
Affiliation:
Northwestern University, Evanston, Illinois
*
Correspondence and reprint requests to: Philip David Zelazo, Institute of Child Development, University of Minnesota, 51 East River Road, Minneapolis, MN 55455-0345. E-mail: zelazo@umn.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

This study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) executive function measures in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20–85 years), gender, education and ethnicity. The NIHTB-CB contains two computer-based instruments assessing executive function: the Dimensional Change Card Sort (a measure of cognitive flexibility) and a flanker task (a measure of inhibitory control and selective attention). Participants completed the NIHTB-CB, corresponding gold standard convergent and discriminant measures, and sociodemographic questionnaires. A subset of participants (N=89) was retested 7 to 21 days later. Results reveal excellent sensitivity to age-related changes during adulthood, excellent test–retest reliability, and adequate to good convergent and discriminant validity. The NIH Toolbox EF measures can be used effectively in epidemiologic and clinical studies. (JINS, 2014, 20, 1–10)

Keywords

Cognitive controlCognitive flexibilityInhibitory controlLifespan developmentStandardized testingValidation

Information

Type
Special Series
Information
Journal of the International Neuropsychological Society , Volume 20 , Issue 6 , July 2014 , pp. 620 - 629
Copyright
Copyright © The International Neuropsychological Society 2014 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Beck, D.M., Schaefer, C., Pang, K., & Carlson, S.M. (2011). Executive function in preschool children: Test-retest reliability. Journal of Cognition and Development, 12, 169–193.Google Scholar
Bialystok, E., & Craik, F.I.M. (2010). Structure and process in life-span cognitive development. In W.F. Overton (Ed.), Cognition, biology, and methods across the lifespan. Volume 1 of the Handbook of life-span development (pp. 195–225). Hoboken, NJ: Wiley.Google Scholar
Cepeda, N.J., Kramer, A.F., & Gonzalez de Sather, J.C.M. (2001). Changes in executive control across the life span: Examination of task-switching performance. Developmental Psychology, 37, 715–730.Google Scholar
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159.CrossRefGoogle ScholarPubMed
Coubard, O.A., Ferrufino, L., Boura, M., Gripon, A., Renaud, M., & Bherer, L. (2011). Attentional control in normal aging and Alzheimer’s disease. Neuropsychology, 25, 353–367.Google Scholar
Craik, F.I.M., & Byrd, M. (1982). Aging and cognitive deficits: The role of attentional resources. In F.I.M. Craik & S. Trehub (Eds.), Aging and cognitive processes (pp. 191–211). New York: Plenum Press.Google Scholar
Craik, F.I.M., & Salthouse, T.A. (Eds.) (2000). The handbook of aging and cognition (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Crone, E.A., Bunge, S.A., Van der Molen, M.W., & Ridderinkhof, K.R. (2006). Switching between tasks and responses: A developmental study. Developmental Science, 9, 278–287.Google Scholar
Davidson, M.C., Amso, D., Cruess-Anderson, L., & Diamond, A. (2006). Development of cognitive control and executive functions from 4-13 years: Evidence from manipulations of memory, inhibition and task switching. Neuropsychologia, 44, 2037–2078.Google Scholar
Delis, D.C., Kaplan, E., & Kramer, J.H. (2001). Delis-Kaplan executive function system. San Antonio, TX: Pearson (The Psychological Corporation).Google Scholar
Dempster, F.N. (1992). The rise and fall of the inhibitory mechanism: Toward a unified theory of cognitive development and aging. Developmental Review, 12, 45–75.Google Scholar
Diamond, A., & Kirkham, N. (2005). Not quite as grown-up as we like to think. Psychological Science, 16, 291–297.Google Scholar
Dick, A.S., Overton, W.F., & Kovacs, S.L. (2005). The development of symbolic coordination: Representation of imagined objects, executive function, and theory of mind. Journal of Cognition and Development, 6, 133–161.Google Scholar
Dunn, L.M., & Dunn, D.M. (2007). Peabody Picture Vocabulary Test, 4th edition. San Antonio, TX: Pearson.Google Scholar
Eriksen, B.A., & Eriksen, C.W. (1974). Effects of noise letters upon the identification of a target letter in a nonsearch task. Perception and Psychophysics, 16, 143–149.Google Scholar
Fan, J., McCandliss, B.D., Sommer, T., Raz, A., & Posner, M.I. (2002). Testing the efficiency and independence of attentional networks. Journal of Cognitive Neuroscience, 14, 340–347.Google Scholar
Frye, D., Zelazo, P.D., & Palfai, T. (1995). Theory of mind and rule-based reasoning. Cognitive Development, 10, 483–527.Google Scholar
Grant, D.A., & Berg, E.A. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type-card-sorting problem. Journal of Experimental Psychology, 38, 404–411.Google Scholar
Happaney, K., Zelazo, P.D., & Stuss, D.T. (2004). Development of orbitofrontal function: Current themes and future directions. Brain and Cognition, 55, 1–10.Google Scholar
Hasher, L., & Zacks, R.T. (1988). Working memory, comprehension, and aging: A review and new view. In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 22, pp. 193–225). New York: Academic Press.Google Scholar
Jacques, S., & Marcovitch, S. (2010). Development of executive function across the lifespan. In W.F. Overton (Ed.), Cognition, biology, and methods across the lifespan. Volume 1 of the Handbook of life-span development (pp. 431–466). Hoboken, NJ: Wiley.Google Scholar
Kirkham, N., Cruess, L.M., & Diamond, A. (2003). Helping children apply their knowledge to their behavior on a dimension-switching task. Developmental Science, 6, 449–467.Google Scholar
Kline, R.B. (2001). Brief cognitive assessment of children: Review of instruments and recommendations for best practice. In J.J.W. Andrews, D.H. Sakloske, & H.L. Janzem (Eds.), Handbook of psychoeducational assessment (pp. 103–132). San Diego, CA: Academic Press.Google Scholar
Marner, L., Nyengaard, J.R., Tang, Y., & Pakkenberg, B. (2003). Marked loss of myelinated nerve fibers in the human brain with age. Journal of Comparative Neurology, 462, 144–152.Google Scholar
Masten, A.S., Herbers, J.E., Desjardins, C.D., Cutuli, J.J., McCormick, C.M., Sapienze, J.K., … Zelazo, P.D. (2012). Executive function skills and school success in young children experiencing homelessness. Educational Researcher, 41, 375–384.CrossRefGoogle Scholar
Miller, E.K., & Cohen, J.D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167–202.CrossRefGoogle ScholarPubMed
Miyake, A., Friedman, N.P., Emerson, M.J., Witzki, A.H., Howerter, A., & Wager, T.D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41, 49–100.Google Scholar
Moffit, T.E., Arsenault, L., Belsky, D., Dickson, N., Hancox, R.J., Harrington, H., … Caspi, A. (2011). A gradient of childhood self-control predicts health, wealth, and public safety. Proceedings of the National Academy of Sciences of the United States of America, 108, 2693–2698.Google Scholar
Morton, J.B., Bosma, R., & Ansari, D. (2009). Age-related changes in brain activation associated with dimension shifts of attention: An fMRI study. Neuroimage, 46, 249–256.Google Scholar
Noble, K.G., Norman, M.F., & Farah, M.J. (2004). Neurocognitive correlates of socioeconomic status in kindergarten children. Developmental Science, 8(1), 74–87.Google Scholar
Olesen, P.J., Westerberg, H., & Klingberg, T. (2003). Increased prefrontal and parietal activity after training of working memory. Nature Neuroscience, 7, 75–79.Google Scholar
Raz, N. (2000). Aging of the brain and its impact on cognitive performance: Integration of structural and functional findings. In F.I.M. Craik & T.A. Salthouse (Eds.), The handbook of aging and cognition (2nd ed., pp 1–90). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Reimers, S., & Maylor, E.A. (2005). Task switching across the lifespan: Effects of age on general and specific switch costs. Developmental Psychology, 41, 661–671.Google Scholar
Rueda, M.R., Fan, J., McCandliss, B.D., Halparin, J.D., Gruber, D.B., Lercari, L.P., …Posner, M.I. (2004). Development of attentional networks in childhood. Neuropsychologia, 42, 1029–1040.Google Scholar
Salthouse, T.A. (1996). The processing-speed theory of adult age differences in cognition. Psychological Review, 103, 403–428.Google Scholar
Salthouse, T.A., & Davies, H.P. (2006). Organization of cognitive abilities and neuropsychological variables across the lifespan. Developmental Review, 26, 31–54.Google Scholar
Sowell, E.R., Peterson, B.S., Thompson, P.M., Welcome, S.E., Henkenius, A.L., & Toga, A.W. (2003). Mapping cortical change across the human life span. Nature Neuroscience, 6, 309–315.Google Scholar
Stroop, J.R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643–662.Google Scholar
Terry, R.D., De Teresa, R., & Hansen, L.A. (1987). Neocortical cell counts in normal adult aging. Annals of Neurology, 21, 530–539.Google Scholar
von Hippel, W. (2007). Aging, executive functioning, and social control. Current Directions in Psychological Science, 16, 240–244.Google Scholar
Weintraub, S., Dikmen, S.S., Heaton, R.K., Tulsky, D.S., Zelazo, P.D., Bauer, P.J., …Gershon, R.C. (2013). Cognition assessment using the NIH Toolbox. Neurology, 80(11 Suppl. 3), S54–S64. doi:10.1212/WNL.0b013e3182872dedGoogle Scholar
Zelazo, P.D. (2006). The Dimensional Change Card Sort: A method of assessing executive function in children. Nature Protocols, 1, 297–301.Google Scholar
Zelazo, P.D., Anderson, J.E., Richler, J., Wallner-Allen, K., Beaumont, J.L., & Weintraub, S. (2013). NIH Toolbox Cognitive Function Battery (CFB): Measuring executive function and attention. In P.D. Zelazo & P.J. Bauer (Eds.), National Institutes of Health Toolbox—Cognitive Function Battery (NIH Toolbox CFB): Validation for children between 3 and 15 years Monographs of the Society for Research in Child Development, 78(4), 16–33.Google Scholar
Zelazo, P.D., & Bauer, P.J. (Eds.) (2013). National Institutes of Health Toolbox—Cognitive Function Battery (NIH Toolbox CFB): Validation for children between 3 and 15 years. Monographs of the Society for Research in Child Development, 78(4).Google Scholar
Zelazo, P.D., Craik, F.I.M., & Booth, L. (2004). Executive function across the life span. Acta Psychologica, 115, 167–184.Google Scholar
Zelazo, P.D., & Lee, W.S.C. (2010). Brain development: An overview. In W. F. Overton (Ed.), Cognition, biology, and methods across the lifespan. Volume 1 of the handbook of life-span development (pp. 89–114). Hoboken, NJ: Wiley.Google Scholar
Zelazo, P.D., Müller, U., Frye, D., & Marcovitch, S. (2003). The development of executive function in early childhood. Monographs of the Society for Research in Child Development, 68(3).Google Scholar