Normative scores for a brief neuropsychological battery for the detection of HIV-associated neurocognitive disorder (HAND) among South Africans
© Singh et al; licensee BioMed Central Ltd. 2010
Received: 19 August 2009
Accepted: 29 January 2010
Published: 29 January 2010
There is an urgent need to more accurately diagnose HIV-associated neurocognitive disorder (HAND) in Africa. Rapid screening tests for HIV-associated dementia are of limited utility due to variable sensitivity and specificity. The use of selected neuropsychological tests is more appropriate, but norms for HIV seronegative people are not readily available for sub-Saharan African populations. We sought to derive normative scores for two commonly used neuropsychological tests that generate four test scores -- namely the Trail-Making Test (Parts A and B) and the Digit Span Test [Forward (DSF) and Backward (DSB)]. To assess memory and recall, we used the memory item of the International HIV Dementia Scale (IHDS).
One hundred and ten HIV seronegative participants were assessed at McCord Hospital, Durban, South Africa between March 3rd and October 31st, 2008. We excluded people with major depressive disorder, substance use abuse and dependence and head injuries (with or without loss of consciousness). All the participants in this study were African and predominantly female with an average age of 28.5 years and 10 years of education. Age and gender influenced neuropsychological functioning, with older people performing worse. The effect of gender was not uniform across all the tests.
These two neuropsychological tests can be administered with the IHDS in busy antiretroviral clinics. Their performance can be measured against these norms to more accurately diagnose the spectrum and progression of HAND.
Infection of the central nervous system by the human immunodeficiency virus (HIV) is frequently associated with potentially debilitating forms of neurocognitive disorders. HIV-associated dementia (HAD) occurs in approximately 10-15% of all individuals with HIV/AIDS and is more common in late stages of infection. The less severe disorder (mild neurocognitive disorder (MND) and sub-clinical neurocognitive impairment more common, occurring in 30-60% of people infected with HIV depending on disease stage [2, 3]. Collectively, these disorders are referred to as HIV-associated neurocognitive disorders (HAND) .
While neuropsychological (NP) test batteries are regarded as the gold standard by which to diagnose HAND, particularly HAD [5–8], these are not always available or appropriate in busy clinical settings. It is important to detect HAD because of its severity despite a greater than 40% decline in the incidence of HAD [2, 9] since the widespread introduction of highly active anti-retroviral therapy (HAART). Without antiretroviral (ARV) therapy, death may ensue within 6 months . South Africa and other sub-Saharan countries follow the WHO guidelines for initiating ARVs in resource constrained settings. People with HAD are eligible to HAART, regardless of CD4 cell count. In addition to the importance of diagnosing HAD and initiating HAART on this context, there is growing evidence that MND and sub-clinical neurocognitive impairment should also be diagnosed and treated.
Many screening tests have been used to detect HAD, such as the HIV dementia scale (HDS) , the EXIT interview , mental alternation tests , the modified Memorial Sloan-Kettering scale , and the International HIV Dementia Scale . These tools may have limited clinical utility because they are insensitive to the milder end of the spectrum of HIV-associated neurocognitive impairment . Longer NP batteries require local normative data for comparison. Ultimately, a balance needs to be found between longer but less practical batteries, and shorter, but less sensitive ones.
The American Academy of Neurology research nomenclature and diagnostic process for HAND have recently been updated . This approach not only specifies the domains most affected by HIV, namely speed of processing information, memory, attention/concentration, learning, executive functioning, motor and psychomotor speed but also requires that specialised NP test batteries are employed. The administration of detailed batteries tends to be restricted to research settings, and requires trained neuropsychologists. In order to address the gap between longer NP batteries and the brief screening tools, selected NP tests, which represent the domains most affected by HIV infection, need to be identified for use in international settings. In addition, these tests need to be measured against normative data obtained from HIV seronegative people in the population in question. For example, there is some concern that "speed" in completing cognitive tests is not emphasized equally across regions of the world. If true, healthy controls outside of US and Europe would perform more poorly on tests of neurocognitive or motor speed when compared to normative data obtained in the US or Europe, where most neurocognitive tests have been developed .
Published norms for neurocognitive tests cannot be used in all populations. For example, a comparison of normative scores for the Trail Making Test from various countries and cultures showed that scores are not equivalent and can lead to serious diagnostic errors. Relevant to the current study, population normative scores are not widely available for Africans . Three quarters of all people living with AIDS live in sub-Saharan Africa . South Africa is the country with the highest number of HIV infections worldwide and is a region where HIV-1 clade C is predominant. While it has been proposed that clade C was less neurovirulent than other, better studied clades (like B), it has recently been suggested that neurocognitive impairment occurs at similar rates. There are no guidelines to assess HAND in Africa; yet, the importance is very high from both clinical and research perspectives as both rely on normative data to generate clinical classifications of impairment. The purpose of this study was to establish population normative scores for a select number of NP tests that can be used in South African antiretroviral clinics to assess the neurocognitive domains most commonly affected by HIV infection.
Sample and setting
This study was conducted at McCord Hospital, Durban, South Africa between March 3rd and October 31st, 2008. McCord Hospital has a voluntary counselling and testing clinic (VCT) for HIV and an ARV clinic. At the VCT clinic from January through December, 2008, a total of 1,052 patients received voluntary counselling and testing. HIV testing is free and confidential and is available to anyone requesting a test.
Participants were recruited from the VCT clinic. To limit selection bias, we recruited participants on different days and selected people from the list of all people registered for the day using a random numbers list. We excluded people who were: HIV seropositive, under 18 years of age, who reported a history of any substance abuse or dependence in the past three months (including alcohol), those who reported any past psychiatric history, or any history of conditions that would affect neurocognitive function e.g. past head injury (regardless of loss of consciousness), cerebrovascular accidents, or seizure disorders. Primary languages of the participants were either isi Zulu or English. After determining eligibility criteria, one hundred and ten consenting participants were assessed in a private room to minimize distractions from noise and other operational distractions in the VCT clinic. This study was reviewed and approved by the hospital's research and ethics committee prior to study initiation.
NP Test battery
We chose individual tests which were sensitive to domains affected by HIV infection, could be administered by non-psychologists without specialized equipment, and would require no longer than 20 minutes. Five tests were initially selected; each of the tests selected have been successfully administered before on HIV seropositive people but not in South Africa [5, 8, 18–20].
Attention and concentration was assessed using Digit Span Forward (DSF) and Digit Span Backwards (DSB). Digit span tests are frequently used because they are sensitive measures of both attention and working memory. Speed of information processing was assessed with the Trail Making Test Part A (TMT A), and Executive Function was assessed by Trail Making Test Part B (TMT B). The latter two tests also measure psychomotor functions. While the Grooved Pegboard Test (using the dominant and non-dominant hands) is regularly used to detect the motor abnormalities in HAND [5, 21], we did not include this measure because it requires equipment that is not readily available in primary care clinics. In addition, other NP tests that are significantly language-based were not included due to differences in culture. We assessed memory with the four item recall from the International HIV Dementia Scale . Together, this brief battery takes between 10-15 minutes to complete.
DS (a psychiatrist trained in the use of the NP tests) trained a psychologist to administer the NP tests according to standard guidelines. In the training, the test-retest reliability between DS and the psychologist was 0.89.
Results of linear multiple regression models that included age, sex and education categories in predicting NP test score outcomes.
(30-50 = 1)
(Male = 1)
(< = 10 years = 1)
Descriptive Statistics for Age, Educational Level, Gender, Memory Item Score, Digit Span Forward, Digit Span Backward, and the Trail Making Test Parts A and memory item
Age Group 18-29 (n = 68)
Minimum - Maximum
1 SD from mean
2 SD from
Age Group 30-50 (n = 42)
Diagnosis of HAD Versus Absence of HAD Based on Frascati Criteria
Absence of HAD (incorporating MND, ANI, and No NP Impairment)
Level of NP impairment
No to mild NP impairment
Moderate to severe NP impairment.
Level of Functional Status Impairment
No to mild impairment in everyday activities; may need help with complex tasks, able to perform basic Activities of daily living, walks without assistance.
Moderate to severe impairment in everyday activities ; needs help with many or most activities
Number SD below population norm on neuropsychological test
1-2: ANI and MND
0-1: No NP Impairment
Number of domains impaired
ANI and MND: ≥ 2 HAD: ≥ 2
No NP Impairment: 0-1
Absence of criteria for delirium or dementia.
Condition cannot be explained by another comorbid condition e.g. substance use, infections or neuropsychiatric disorder
There was no difference between the first and second SD of the number of items recalled for female participants; they recalled 3 items. Amongst the men, fewer items were recalled two SD from the mean. This lack of variability amongst the women will create a challenge in classifying women's performance. For example if a women scored 2 SD on one other test and recalled 3 items on the memory subtest, she can be classified as non-HAD or HAD depending if one reads 3 items in the 1 SD column or 2 SD column respectively.
This is the first study to recommend a brief battery of standardized NP tests and present locally relevant population norms to assess HAND in a country at the epicenter of the HIV pandemic. In particular, these tests represent a battery suitable for use by primary care physicians and allied health professionals without specialized NP training who work in busy clinical settings. Further, these NP tests assess the neurocognitive domains most frequently and earliest affected by HIV infection. Depending on the frequency and severity of abnormal NP test scores, it is possible to identify HAD in a clinical sample. The stratification of the data by age and gender allows for a more robust interpretation than the limited data published to date on other sub-Saharan African populations that provide only a summary mean and standard deviation.
Our findings are consistent with those of other researchers who have observed that age affects neurocognitive functioning among HIV infected persons especially on the TMT [16, 22]. Several studies have assessed the relationship between the TMT and sociodemographic variables such as educational level, gender, and age. Of all the sociodemographic variables we considered, age accounted for most of the variance in NP test performance . Unlike others we did not find a correlation of the TMT with educational level [24, 25]. We believe this may be because our sample size was too small to detect this correlation or that years of education did not accurately reflect educational differences.
The median years of education in our sample was low (10 years) compared to other samples that had medians of 12,6  and 16 years . Previously available normative data are mainly from Caucasian and well-educated samples [16, 21, 22, 24, 25]. Sub-Saharan African data are highly limited. Normative data for cognitive tests has recently become available for school children in Cameroon . Robertson et al  have provided means and standard deviations for DSF, DSB and the Color Trails Text in a Ugandan population. However, noting the confounding effect of age, educational level, and culture, the use of these summary means could lead to errors in HAND diagnosis in our population. For example, the norms on the Color Trails Test are not comparable to the time taken to complete the TMT.
Our findings support Fernandez and Marcopulos' conclusion that use of cross-cultural data for the TMT will lead to errors in classification . For example, according to the norms published by Tombach (on a Caucasian population) the average time for an 18-24 year old to complete the TMT A and B is 22.93 and 48.97 seconds, respectively . In our sample these same tests would require almost one and a half to twice that amount of time -- 38.92 and 70.96 seconds. The limited variability of the number of items recalled by women would limit the clinical utility of the memory subtest. For example, if a woman recalled three items it will be difficult to classify her performance because three items is the number of items on both the first and second standard deviation on this subtest (table 2). We would recommend investigators use other longer and more sensitive tests to assess verbal memory e.g., the California Verbal Learning Test II.
The strengths of this study are that we more completely present the descriptive statistical properties of NP test performance and the results of relevant stratification of data rather than the summary measures alone. These data can be used by other investigators in South Africa to standardize their own local NP test data. Given the well documented influence of age and educational level on neurocognitive performance [7, 24, 29], we adjusted for these co-factors. The 'normative' data thus obtained therefore may be controlled for variance according to the age and educational level of the cohort studied. Our sample was largely represented by young African females. This is the group is most frequently affected by HIV infection in sub-Saharan Africa, and, therefore, our data set serves as an appropriate reference. Our data meet many of the criteria set out by Mitrushina et al. in evaluating the norms for the TMT . As recommended, we provide a detailed description of the sample, with inclusion and exclusion criteria, gender distribution, and descriptive statistical properties of the NP data obtained .
There are several limitations of this study. The sample size is relatively small. True population norms typically require at least a thousand people; however, this level of sampling is very costly. It may require many years before such data become available. Others have presented similarly small sample size studies [16, 22, 30]. The findings may not be generalizable to the entire population; however, in the absence of NP data on South Africans, the high burden of HIV disease, and the urgent need for more refined methods to diagnose HAND, this study presents data that can be used immediately by primary care clinicians and allied health professionals caring for the HIV infected. Other sub-Saharan counties can also use these data, as they may well be more comparable than other data derived on HIV infected persons from predominantly well educated, high resource, Caucasian countries.
The assessment of neurocognitive status is recommended as standard evaluation for all HIV seropositive pesons. Notwithstanding the problems of current screening tests for HIV-associated dementia and the need for population norms using the new classification of HAND, this battery of NP tests does offer an alternative to other screening scales not standardized on this population and longer NP test batteries. The four NP tests we recommend to utilize (DSF, DSB, TMT A, TMT B) can be completed in 15 minutes, require minimal assessor training, and demand no specialized equipment. Primary care clinicians and allied health professionals caring for the HIV infected should be trained to use these NP tests and the available normative reference data. Data like those reported here, will assist HIV primary care providers to more reliably diagnose HAND, monitor its progression, and its response to therapy (such as CSF-penetrating ARV medications) without the need to rely upon CD4 cell count and plasma viral load to make this assessment.
Dinesh Singh was supported by Fogarty International Centre, NIH, grant 5-D43-TW00231.
- Sacktor N, Lyles RH, Skolasky R, Kleeberger C, Selnes OA, Miller EN, Becker JT, Cohen B, McArthur JC: HIV-associated neurologic disease incidence changes: Multicenter AIDS Cohort Study, 1990-1998. Neurology. 2001, 56 (2): 257-260.PubMedView ArticleGoogle Scholar
- Grant I: Neurocognitive disturbances in HIV 1. Int Rev Psychiatry. 2008, 20 (1): 33-47. 10.1080/09540260701877894.PubMedView ArticleGoogle Scholar
- Goodkin K: Psychiatric Aspects of HIV Spectrum Disease. Focus. 2009, 7 (3): 303-310.View ArticleGoogle Scholar
- Antinori A, Arendt G, Becker JT, Brew BJ, Byrd DA, Cherner M, Clifford DB, Cinque P, Epstein LG, Goodkin K: Updated research nosology for HIV-associated neurocognitive disorders. Neurology. 2007, 69 (18): 1789-1799. 10.1212/01.WNL.0000287431.88658.8b.PubMed CentralPubMedView ArticleGoogle Scholar
- Carey MB, Carey KB, Maistro SA, Gordon CM: Reducing HIV risk behaviour among adults receiving outpatient psychiatric treatment: Results from a randomized controlled trial. Journal of Consulting & Clinical Psychology. 2004, 72 (2): 252-268. 10.1037/0022-006X.72.2.252.View ArticleGoogle Scholar
- Power C, Selnes OA, Grim JA, McArthur JC: HIV Dementia Scale: a rapid screening test. J Acquir Immune Defic Syndr Hum Retrovirol. 1995, 8 (3): 273-278. 10.1097/00042560-199503010-00008.PubMedView ArticleGoogle Scholar
- Robertson KR, Nakasujja N, Wong M, Musisi S, Katabira E, Parsons TD, Ronald A, Sacktor N: Pattern of neuropsychological performance among HIV positive patients in Uganda. BMC Neurol. 2007, 7: 8-10.1186/1471-2377-7-8.PubMed CentralPubMedView ArticleGoogle Scholar
- Sacktor NC, Wong M, Nakasujja N, Skolasky RL, Selnes OA, Musisi S, Robertson K, McArthur JC, Ronald A, Katabira E: The International HIV Dementia Scale: a new rapid screening test for HIV dementia. AIDS. 2005, 19 (13): 1367-1374.PubMedGoogle Scholar
- Brodt HR, Kamps BS, Gute P, Knupp B, Staszewski S, Helm EB: Changing incidence of AIDS-defining illnesses in the era of antiretroviral combination therapy 1. AIDS. 1997, 11 (14): 1731-1738. 10.1097/00002030-199714000-00010.PubMedView ArticleGoogle Scholar
- McArthur JC, Hoover DR, Bacellar H, Miller EN, Cohen BA, Becker JT, Graham NM, McArthur JH, Selnes OA, Jacobson LP: Dementia in AIDS patients: incidence and risk factors. Multicenter AIDS Cohort Study. Neurology. 1993, 43 (11): 2245-2252.PubMedView ArticleGoogle Scholar
- Berghuis JP, Uldall KK, Lalonde B: Validity of two scales in identifying HIV-associated dementia. J Acquir Immune Defic Syndr. 1999, 21 (2): 134-140.PubMedGoogle Scholar
- Jones BN, Teng EL, Folstein MF, Harrison KS: A new bedside test of cognition for patients with HIV infection. Ann Intern Med. 1993, 119 (10): 1001-1004.PubMedView ArticleGoogle Scholar
- Marder K, Albert SM, McDermott MP, McArthur JC, Schifitto G, Selnes OA, Sacktor N, Stern Y, Palumbo D, Kieburtz K: Inter-rater reliability of a clinical staging of HIV-associated cognitive impairment. Neurology. 2003, 60 (9): 1467-1473.PubMedView ArticleGoogle Scholar
- Smith CA, van Gorp WG, Ryan ER, Ferrando SJ, Rabkin J: Screening subtle HIV-related cognitive dysfunction: the clinical utility of the HIV dementia scale. J Acquir Immune Defic Syndr. 2003, 33 (1): 116-118.PubMedView ArticleGoogle Scholar
- Woods Paul Steven, Moore David, Weber Erica, Grant I: Cognitive neuropsychology of HIV-associated neurocognitive disorders. Neuropsychol Rev. 2009, 19: 152-168. 10.1007/s11065-009-9102-5.PubMed CentralPubMedView ArticleGoogle Scholar
- Fernandez AL, Marcopulos BA: A comparison of normative data for the Trail Making Test from several countries: equivalence of norms and considerations for interpretation 1. Scand J Psychol. 2008, 49 (3): 239-246. 10.1111/j.1467-9450.2008.00637.x.PubMedView ArticleGoogle Scholar
- Unaids: 2008 report on the global AIDS epidemic: Executive summary. 2008, Geneva: World Health OrganizationGoogle Scholar
- Sacktor N, Nakasujja N, Robertson K, Clifford DB: HIV-associated cognitive impairment in sub-Saharan Africa--the potential effect of clade diversity. Nat Clin Pract Neurol. 2007, 3 (8): 436-443. 10.1038/ncpneuro0559.PubMedView ArticleGoogle Scholar
- Sacktor N, Nakasujja N, Skolasky R, Robertson K, Wong M, Musisi S, Ronald A, Katabira E: Antiretroviral therapy improves cognitive impairment in HIV+ individuals in sub-Saharan Africa. Neurology. 2006, 67 (2): 311-314. 10.1212/01.wnl.0000225183.74521.72.PubMedView ArticleGoogle Scholar
- Sacktor NC, Skolasky RL, Lyles RH, Esposito D, Selnes OA, McArthur JC: Improvement in HIV-associated motor slowing after antiretroviral therapy including protease inhibitors. J Neurovirol. 2000, 6 (1): 84-88. 10.3109/13550280009006385.PubMedView ArticleGoogle Scholar
- Butters N, Grant I, Haxby J, Judd LL, Martin A, McClelland J, Pequegnat W, Schacter D, Stover E: Assessment of AIDS-related cognitive changes: recommendations of the NIMH Workshop on Neuropsychological Assessment Approaches 1. J Clin Exp Neuropsychol. 1990, 12 (6): 963-978. 10.1080/01688639008401035.PubMedView ArticleGoogle Scholar
- Concha M, Seines OA, McArthur JC, Nance-Sproson T, Updike ML, Royal W, Solomon L, Vlahov D: Normative Data for a Brief Neuropsychologic Test Battery in a Cohort of Injecting Drug Users. Substance Use & Misuse. 1995, 30 (7): 823-841. 10.3109/10826089509067009.View ArticleGoogle Scholar
- Corrigan JD, Hinkeldey NS: Relationship between parts A and B of the Trail Making Test. Journal of Clinical Psychology. 1987, 402-409. 10.1002/1097-4679(198707)43:4<402::AID-JCLP2270430411>3.0.CO;2-E. 43
- Mitrushina MN, Boone KL, D'Elia L: Handbook of normative data for neuropsychological assessment. 1999, New York: Oxford University PressGoogle Scholar
- Tombaugh TN: Trail Making Test A and B: Normative data stratified by age and education. Archives of Clinical Neuropsychology. 2004, 19 (2): 203-214. 10.1016/S0887-6177(03)00039-8.PubMedView ArticleGoogle Scholar
- Lu L, Bigler ED: Normative data on trail making test for neurologically normal, Chinese-speaking adults. Applied Neuropsychology. 2002, 9 (4): 219-225. 10.1207/S15324826AN0904_4.PubMedView ArticleGoogle Scholar
- Ruffieux N, Njamnshi AK, Mayer E, Sztajzel R, Kengne A, Ngamaleu RN, Chanal J, Verdon V, Hauert CA: Neuropsychology in Cameroon: First Normative Data for Cognitive Tests Among School-Aged Children. Child Neuropsychology. 2009, 15: 1-19.View ArticleGoogle Scholar
- Robertson KR, Smurzynski M, Parsons TD, Wu K, Bosch RJ, Wu J, McArthur JC, Collier AC, Evans SR, Ellis RJ: The prevalence and incidence of neurocognitive impairment in the HAART era. AIDS. 2007, 21 (14): 1915-1921. 10.1097/QAD.0b013e32828e4e27.PubMedView ArticleGoogle Scholar
- Cullen B, O'Neill B, Evans JJ, Coen RF, Lawlor BA: A review of screening tests for cognitive impairment. Journal of Neurology, Neurosurgery, and Psychiatry. 2007, 78 (8): 790-799. 10.1136/jnnp.2006.095414.PubMed CentralPubMedView ArticleGoogle Scholar
- Becker JT, Lopez OL, Dew MA, Aizenstein HJ: Prevalence of cognitive disorders differs as a function of age in HIV virus infection. AIDS. 2004, 18 (Suppl 1): S11-S18.PubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.