Validity of Neuropsychological Testing in Young African Children Affected by HIV

Abstract

Introduction Western-constructed neuropsychological tests have been used in low- and middle-income countries to assess the impact of human immunodeficiency virus/acquired immunodeficiency syndrome (HIV/AIDS) and other chronic illnesses. We explore using such instruments cross-culturally in a sub-Saharan African setting.

Methods IMPAACT P1104S was a 2-year observational study performed at six clinical sites (South Africa—three sites, Malawi, Uganda, and Zimbabwe) to assess and compare neuropsychological outcomes in three cohorts of children between the ages of 5 and 11 years: HIV-infected (HIV), HIV-exposed but uninfected (HEU), and HIV unexposed and uninfected (HU). Descriptive statistics compared sociodemographic characteristics among children at sites. Instruments included the Kaufman Assessment Battery for Children, 2nd edition (KABC-II) cognitive ability, Test of Variables of Attention (TOVA) attention/impulsivity, Bruininks–Oseretsky Test of Motor Proficiency, 2nd edition (BOT-2) motor proficiency tests, and Behavior Rating Inventory for Executive Function (BRIEF) executive function problems. Test characteristics were assessed using intraclass and Spearman's nonparametric correlations, linear regression, and principal factor analyses.

Results Of the 611 participants, 50% were males and mean age ranged from 6.6 to 8 years. In Malawi, Uganda, and Zimbabwe, substantial proportions of families lived in rural settings in contrast to the South African sites. Intraclass correlation coefficients between weeks 0 and 48 were highest for the KABC scores, ranging between 0.42 and 0.71. Correlations among similar test domains were low to moderate but significant, with positive correlation between KABC sequential and TOVA scores and negative correlation between BRIEF and KABC scores. TOVA response time scores correlated negatively with the BOT-2 total points score. Strong and significant associations between individual measures of growth, disability, and development with all test scores were observed. Performance-based measures were markedly lower for HIV compared with HEU and HU participants, even after controlling for age, sex, and site. Factor analyses confirmed the underlying theoretical structure of the KABC scaled item scores.

Conclusion The KABC, TOVA, BRIEF, and BOT-2 were valid and reliable tools for assessing the neuropsychological impact of HIV in four sub-Saharan African countries.

Keywords

pediatric HIV - neuropsychological testing - validity - reliability - Africa

• References

• 1 Boivin MJ, Giordani B. Neuropsychological assessment of African children: evidence for a universal brain/behavior omnibus within a coconstructivist paradigm. Prog Brain Res 2009; 178: 113-135
• 2 Sternberg RJ. Culture and intelligence. Am Psychol 2004; 59 (05) 325-338
• 3 Giordani B, Boivin MJ, Opel B, Dia Nseyila DN, Lauer RE. Use of the K-ABC with children in Zaire, Africa: An evaluation of the sequential-simultaneous processing distinction within an intercultural context. Int J Disabil Dev Educ 1996; 43 (01) 5-24
• 4 Abubakar A, van de Vijver FJR. How to adapt tests for Sub-Saharan Africa. In: Abubakar A, van de Vijver FJR. , eds. Handbook of Applied Developmental Science in Sub-Saharan Africa. Springer; 2017: 197-212 . Available at: http://www.springer.com/978-1-4939-7326-2
• 5 Holding P, Anum A, van de Vijver FJR. , et al. Can we measure cognitive constructs consistently within and across cultures? Evidence from a test battery in Bangladesh, Ghana, and Tanzania. Appl Neuropsychol Child 2018; 7 (01) 1-13
• 6 Mitchell JM, Tomlinson M, Bland RM, Houle B, Stein A, Rochat TJ. Confirmatory factor analysis of the Kaufman assessment battery in a sample of primary school-aged children in rural South Africa. S Afr J Psychol 2017; 1-19 https://doi.org/10.1177/0081246317741822
• 7 Save-the-children. Cognition Workshop Report. Paper presented at: Cognition Workshop; July 23–24, 2013 ; Institute of Education, London; 2013
• 8 Bangirana P, John CC, Idro R. , et al. Socioeconomic predictors of cognition in Ugandan children: implications for community interventions. PLoS One 2009; 4 (11) e7898
• 9 Brahmbhatt H, Boivin M, Ssempijja V. , et al. Impact of HIV and antiretroviral therapy on neurocognitive outcomes among school-aged children. J Acquir Immune Defic Syndr 2017; 75 (01) 1-8
• 10 Ogunlade AO, Kruger HS, Jerling JC. , et al. Point-of-use micronutrient fortification: lessons learned in implementing a preschool-based pilot trial in South Africa. Int J Food Sci Nutr 2011; 62 (01) 1-16
• 11 Semrud-Clikeman M, Romero RA, Prado EL, Shapiro EG, Bangirana P, John CC. Selecting measures for the neurodevelopmental assessment of children in low- and middle-income countries. J Child Neuropsychol 2017; 7: 761-802
• 12 van Wyhe KS, van de Water T, Boivin MJ, Cotton MF, Thomas KG. Cross-cultural assessment of HIV-associated cognitive impairment using the Kaufman assessment battery for children: a systematic review. J Int AIDS Soc 2017; 20 (01) 21412
• 13 Bangirana P, Allebeck P, Boivin MJ. , et al. Cognition, behaviour and academic skills after cognitive rehabilitation in Ugandan children surviving severe malaria: a randomised trial. BMC Neurol 2011; 11: 96
• 14 Bangirana P, Sikorskii A, Giordani B, Nakasujja N, Boivin MJ. Validation of the CogState battery for rapid neurocognitive assessment in Ugandan school age children. Child Adolesc Psychiatry Ment Health 2015; 9: 38
• 15 Boivin MJ, Busman RA, Parikh SM. , et al. A pilot study of the neuropsychological benefits of computerized cognitive rehabilitation in Ugandan children with HIV. Neuropsychology 2010; 24 (05) 667-673
• 16 Familiar I, Ruisenor-Escudero H, Giordani B. , et al. Use of the behavior rating inventory of executive function and child behavior checklist in Ugandan children with HIV or a history of severe malaria. J Dev Behav Pediatr 2015; 36 (04) 277-284
• 17 Kaufman AS, Kaufman NL. Kaufman Assessment Battery for Children. 2nd ed. San Antonio, TX: Pearson Inc NCS Pearson; 2004
• 18 The T.O.V.A. (Version 6.X) (Computer Program) [computer program]. Los Alamitos, CA; 1993
• 19 Bruininks RH, Bruininks BD. BOT2: Bruininks-Oseretsky Test of Motor Proficiency. 2nd ed. Minneapolis, MN: Pearson Assessments; 2005
• 20 Gioia GA, Isquith PK, Guy SC, Kenworthy L. Behavior Rating Inventory of Executive Function® (BRIEF®). Lutz, FL: Psychological Assessment Resources (PAR); 2003
• 21 Boivin MJ, Giordani B. Neuropsychological assessment of African children: evidence for a universal basis to cognitive ability. In: Chiao JY. , ed. Cultural Neuroscience: Cultural Influences on Brain Function. Vol. 178. New York, NY: Elsevier Publications; 2009: 113-135
• 22 Boivin MJ, Giordani B. , eds. Neuropsychology of children in Africa: perspectives on risk and resilience. In: Fletcher-Janzen E. , ed. Specialty Topics in Pediatric Neuropsychology. Vol. 1. New York, NY: Springer; 2013
• 23 Boivin MJ, Barlow-Mosha L, Chernoff MC. , et al; IMPAACT P1104s Study Team. Neuropsychological performance in African children with HIV enrolled in a multisite antiretroviral clinical trial. AIDS 2018; 32 (02) 189-204
• 24 Barlow-Mosha L, Angelidou K, Lindsey J. , et al. Nevirapine- versus lopinavir/ritonavir-based antiretroviral therapy in HIV-infected infants and young children: long-term follow-up of the IMPAACT P1060 randomized trial. Clin Infect Dis 2016; 63 (08) 1113-1121
• 25 Bangirana P, Giordani B, John CC, Page C, Opoka RO, Boivin MJ. Immediate neuropsychological and behavioral benefits of computerized cognitive rehabilitation in Ugandan pediatric cerebral malaria survivors. J Dev Behav Pediatr 2009; 30 (04) 310-318
• 26 Bangirana P, , Seggane-Musisi, Allebeck P. , et al. A preliminary examination of the construct validity of the KABC-II in Ugandan children with a history of cerebral malaria. Afr Health Sci 2009; 9 (03) 186-192
• 27 Bergemann TL, Bangirana P, Boivin MJ, Connett JE, Giordani BJ, John CC. Statistical approaches to assess the effects of disease on neurocognitive function over time. J Biom Biostat 2012; S7 (016, Suppl 7): 1-8
• 28 Boivin MJ, Bangirana P, Byarugaba J. , et al. Cognitive impairment after cerebral malaria in children: a prospective study. Pediatrics 2007; 119 (02) e360-e366
• 29 John CC, Bangirana P, Byarugaba J. , et al. Cerebral malaria in children is associated with long-term cognitive impairment. Pediatrics 2008; 122 (01) e92-e99
• 30 Deitz JC, Kartin D, Kopp K. Review of the Bruininks-Oseretsky Test of Motor Proficiency, Second Edition (BOT-2). Phys Occup Ther Pediatr 2007; 27 (04) 87-102
• 31 Gioia GA, Isquith PK, Retzlaff PD, Espy KA. Confirmatory factor analysis of the Behavior Rating Inventory of Executive Function (BRIEF) in a clinical sample. Child Neuropsychol 2002; 8 (04) 249-257
• 32 UNICEF. Multiple Indicator Cluster Surveys; 2017 . Available at: http://mics.unicef.org/ . Accessed March 14, 2017
• 33 Bonett DG. Sample size requirements for estimating intraclass correlations with desired precision. Stat Med 2002; 21 (09) 1331-1335
• 34 Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986; 1 (8476): 307-310
• 35 Vaz S, Falkmer T, Passmore AE, Parsons R, Andreou P. The case for using the repeatability coefficient when calculating test-retest reliability. PLoS One 2013; 8 (09) e73990
• 36 Boivin MJ, Chounramany C, Giordani B, Xaisida S, Choulamountry L. Validating a cognitive ability testing protocol with Lao children for community development applications. Neuropsychology 1996; 10 (04) 588-599
• 37 Holding P, Boivin MJ. The assessment of neuropsychological outcomes in pediatric severe malaria. In: Boivin MJ, Giordani B. , eds. Neuropsychology of Children in Africa: Perspectives on Risk and Resilience. New York, NY: Springer Science + Business; 2013
• 38 Boivin M, Chernoff M, Laughton B. , et al. Neuropsychological outcomes in a two year African-based pediatric observational study. Paper presented at: Conference on Retroviruses and Opportunistic Infections (CROIs) 2017 February 13–16, 2017; Seattle, WA
• 39 Jansen P, Greenop K. Factor analyses of the Kaufman Assessment Battery for Children assessed longitudinally at 5 and 10 years. S Afr J Psychol 2008; 38 (02) 335-365