Subscribe to RSS
DOI: 10.1590/0004-282X-ANP-2021-0099
Diagnostic accuracy of CompCog: reaction time as a screening measure for mild cognitive impairment
Acurácia diagnóstica do CompCog: tempo de reação como uma medida de rastreio para comprometimento cognitivo leveABSTRACT
Background Reaction time is affected under different neurological conditions but has not been much investigated considering all types of mild cognitive impairment (MCI). Objective This study investigated the diagnostic accuracy of CompCog, a computerized cognitive screening battery focusing on reaction time measurements. Methods A sample of 52 older adults underwent neuropsychological assessments, including CompCog, and medical appointments, to be classified as a control group or be diagnosed with MCI. The accuracy of CompCog for distinguishing between the two groups was calculated. Results The results from diagnostic accuracy analyses showed that the AUCs of ROC curves were as high as 0.915 (CI 0.837-0.993). The subtest with the highest sensitivity and specificity (choice reaction time subtest) had 91.7% sensitivity and 89.3% specificity. The logistic regression final model correctly classified 92.3% of individuals, with 92.9% specificity and 91.7% sensitivity, and included only four variables from different subtests. Conclusions In summary, the study showed that reaction time assessed through CompCog is a good screening measure to differentiate between normal aging and MCI. Reaction time measurements in milliseconds were more accurate than correct answers. This test can form part of routine clinical tests to achieve the objectives of screening for MCI, indicating further procedures for investigation and diagnosis and planning interventions.
RESUMO
Antecedentes O tempo de reação é afetado em diferentes condições neurológicas, mas não foi muito investigado considerando todos os tipos de comprometimento cognitivo leve (CCL). Objetivo Este estudo investigou a acurácia diagnóstica do CompCog, uma bateria computadorizada de rastreio cognitivo focada em medidas de tempo de reação. Métodos Uma amostra de 52 idosos passou por uma avaliação neuropsicológica, incluindo o CompCog, e uma consulta médica para serem classificados como grupo controle ou serem diagnósticos com CCL. A acurácia do teste para distinguir entre os dois grupos foi calculada. Resultados Os resultados das análises de acurácia diagnóstica mostraram AUC das curvas ROC tão altas quanto 0,915 (CI 0,837-0,993). O subteste com maior sensibilidade e especificidade - subteste de tempo de reação de escolha - apresentou sensibilidade de 91,7% e especificidade de 89,3%. O modelo final de regressão logística classificou corretamente 92,3% dos indivíduos, com especificidade de 92,9% e sensibilidade de 91,7%, e incluiu apenas 4 variáveis de diferentes subtestes. Conclusões Em resumo, o estudo mostrou que o tempo de reação avaliado pelo CompCog é uma boa medida de rastreio para diferenciar entre envelhecimento normal e CCL. Medidas de tempo de reação em milissegundos se mostraram melhores que o número de respostas corretas. O teste pode fazer parte de testes clínicos de rotina para atingir o objetivo de rastrear o CCL, indicar outros procedimentos para investigação e diagnóstico e planejar intervenções.
Palavras-chave:
Disfunção Cognitiva - Tempo de Reação - Diagnóstico - Demência - Envelhecimento CognitivoAuthors’ contributions:
LH, MM, HF: conceptualization; LH, MM, RS: data curation, investigation; LH, GB, HF: methodology; HF: validation and project administration; LH: formal analysis; LH, MM: writing-original draft; LH, GB, HF: writing-review & editing; HF: supervision.
Support
Larissa Hartle acknowledges funding from the Coordination for the Improvement of Higher Education Personnel (CAPES).
Publication History
Received: 18 March 2021
Accepted: 31 August 2021
Article published online:
06 February 2023
© 2022. Academia Brasileira de Neurologia. This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commecial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Thieme Revinter Publicações Ltda.
Rua do Matoso 170, Rio de Janeiro, RJ, CEP 20270-135, Brazil
-
References
- 1 Petersen RC, Stevens JC, Ganguli M, Tangalos EG, Cummings JL, DeKosky ST. Practice parameter: early detection of dementia: mild cognitive impairment (an evidence-based review). Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology 2001; 56 (09) 1133-1142 https://doi.org/10.1212/wnl.56.9.1133
- 2 Petersen RC, Doody R, Kurz A, Mohs RC, Morris JC, Rabins PV. et al. Current concepts in mild cognitive impairment. Arch Neurol 2001; 58 (12) 1985-1992 https://doi.org/10.1001/archneur.58.12.1985
- 3 Kasper S, Bancher C, Eckert A, Förstl H, Frölich L, Hort J. et al. Management of mild cognitive impairment (MCI): the need for national and international guidelines. World J Biol Psychiatry 2020; (08) 579-594 https://doi.org/10.1080/15622975.2019.1696473
- 4 Ritchie CW, Russ TC, Banerjee S, Barber B, Boaden A, Fox NC. et al. The Edinburgh Consensus: preparing for the advent of disease-modifying therapies for Alzheimer's disease. Alzheimers Res Ther 2017; 9 (01) 85 https://doi.org/10.1186/s13195-017-0312-4
- 5 Petersen RC. Mild cognitive impairment. Continuum (Minneap Minn) 2016; 22 (02) 404-418 https://doi.org/10.1212/CON.20210099202100990313
- 6 Breton A, Casey D, Arnaoutoglou NA. Cognitive tests for the detection of mild cognitive impairment (MCI), the prodromal stage of dementia: meta-analysis of diagnostic accuracy studies. Int J Geriatr Psychiatry 2019; 34 (02) 233-242 https://doi.org/10.1002/gps.5016
- 7 Tsoi KKF, Chan JYC, Hirai HW, Wong A, Mok VCT, Lam LCW. et al. Recall tests are effective to detect mild cognitive impairment: a systematic review and meta-analysis of 108 diagnostic studies. J Am Med Dir Assoc 2017; 18 (09) 807 https://doi.org/10.1016/j.jamda.2017.05.016
- 8 Giau VV, Bagyinszky E, An SSA. Potential fluid biomarkers for the diagnosis of mild cognitive impairment. Int J Mol Sci 2019; 20 (17) 4149 https://doi.org/10.3390/ijms20174149
- 9 Knopman DS, Petersen RC. Mild cognitive impairment and mild dementia: a clinical perspective. Mayo Clin Proc 2014; 89 (10) 1452-1459 https://doi.org/10.1016/j.mayocp.2014.06.019
- 10 Parra MA, Baez S, Allegri R, Nitrini R, Lopera F, Slachevsky A. et al. Dementia in Latin America: assessing the present and envisioning the future. Neurology 2018; 90 (05) 222-231 https://doi.org/10.1212/WNL.20210099202100994897
- 11 Oliveira MO, Brucki SMD. Computerized Neurocognitive Test (CNT) in mild cognitive impairment and Alzheimer’s disease. Dement Neuropsychol 2014; 8 (02) 112-116 https://doi.org/10.1590/S1980-57642014DN82000005
- 12 Razak MAA, Ahmad NA, Chan YY, Kasim NM, Yusof M, Ghani MKAA. et al. Validity of screening tools for dementia and mild cognitive impairment among the elderly in primary health care: a systematic review. Public Health 2019; 169: 84-92 https://doi.org/10.1016/j.puhe.2019.01.001
- 13 Salthouse TA. Aging and measures of processing speed. Biol Psychol 2000; 54 1-3 35-54 https://doi.org/10.1016/s0301-0511(00)00052-1
- 14 Booth T, Dykiert D, Corley J, Gow AJ, Morris Z, Maniega SM. et al. Reaction time variability and brain white matter integrity. Neuropsychology 2019; 33 (05) 642-657 https://doi.org/10.1037/neu0000483
- 15 Phillips M, Rogers P, Haworth J, Bayer A, Tales A. Intra-individual reaction time variability in mild cognitive impairment and Alzheimer's disease: gender, processing load and speed factors. PLoS One 2013; 8 (06) e65712 https://doi.org/10.1371/journal.pone.0065712
- 16 Hong Y, Alvarado RL, Jog A, Greve DN, Salat DH. Serial reaction time task performance in older adults with neuropsychologically defined mild cognitive impairment. J Alzheimers Dis 2020; 74 (02) 491-500 https://doi.org/10.3233/JAD-191323
- 17 Salthouse TA. The processing-speed theory of adult age differences in cognition. Psychol Rev 1996; 103 (03) 403-428 https://doi.org/10.1037/0033-295x.103.3.403
- 18 Martorelli M, Hartle L, Coutinho G, Mograbi DC, Chaves D, Silberman C. et al. Diagnostic accuracy of early cognitive indicators in mild cognitive impairment. Dement Neuropsychol 2020; 14 (04) 358-365 https://doi.org/10.1590/1980-57642020dn14-040005
- 19 Haworth J, Phillips M, Newson M, Rogers PJ, Torrens-Burton A, Tales A. Measuring information processing speed in mild cognitive impairment: clinical versus research dichotomy. J Alzheimers Dis 2016; 51 (01) 263-275 https://doi.org/10.3233/JAD-150791
- 20 Chen K-C, Weng C-Y, Hsiao S, Tsao W-L, Koo M. Cognitive decline and slower reaction time in elderly individuals with mild cognitive impairment. Psychogeriatrics 2017; 17 (06) 364-370 https://doi.org/10.1111/psyg.12247
- 21 Andriuta D, Diouf M, Roussel M, Godefroy O. Is reaction time slowing an early sign of Alzheimer’s disease? A meta-analysis. Dement Geriatr Cogn Disord 2019; 47 4-6 281-288 https://doi.org/10.1159/000500348
- 22 Bailon O, Roussel M, Boucart M, Krystkowiak P, Godefroy O. Psychomotor slowing in mild cognitive impairment, Alzheimer's disease and lewy body dementia: mechanisms and diagnostic value. Dement Geriatr Cogn Disord 2010; 29 (05) 388-396 https://doi.org/10.1159/000305095
- 23 Fernaeus S-E, Östberg P, Wahlund L-O. Late reaction times identify MCI. Scand J Psychol 2013; 54 (04) 283-285 https://doi.org/10.1111/sjop.12053
- 24 Okonkwo OC, Wadley VG, Griffith HR, Ball K, Marson DC. Cognitive correlates of financial abilities in mild cognitive impairment. J Am Geriatr Soc 2006; 54 (11) 1745-1750 https://doi.org/10.1111/j.1532-5415.2006.00916.x
- 25 Giovannetti T, Bettcher BM, Brennan L, Libon DJ, Kessler RK, Duey K. Coffee with jelly or unbuttered toast: commissions and omissions are dissociable aspects of everyday action impairment in Alzheimer's disease. Neuropsychology 2008; 22 (02) 235-245 https://doi.org/10.1037/0894-4105.22.2.235
- 26 Miller JB, Barr WB. The technology crisis in neuropsychology. Arch Clin Neuropsychol 2017; 32 (05) 541-554 https://doi.org/10.1093/arclin/acx050
- 27 Ferreira D, Correia R, Nieto A, Machado A, Molina Y, Barroso J. Cognitive decline before the age of 50 can be detected with sensitive cognitive measures. Psicothema 2015; 27 (03) 216-222 https://doi.org/10.7334/psicothema2014.192
- 28 Levinson D, Reeves D, Watson J, Harrison M. Automated neuropsychological assessment metrics (ANAM) measures of cognitive effects of Alzheimer's disease. Arch Clin Neuropsychol 2005; 20 (03) 403-408 https://doi.org/10.1016/j.acn.2004.09.001
- 29 Charchat H, Nitrini R, Caramelli P, Sameshima K. Investigação de marcadores clínicos dos estágios iniciais da doença de Alzheimer com testes neuropsicológicos computadorizados. Psicol Reflex Crit 2001; 14 (02) 305-316 https://doi.org/10.1590/S0102-79722001000200006
- 30 Fichman HC, Nitrini R, Caramelli P, Sameshima K. A new Brief computerized cognitive screening battery (CompCogs) for early diagnosis of Alzheimer's disease. Dement Neuropsychol 2008; 2 (01) 13-19 https://doi.org/10.1590/S1980-57642009DN20100004
- 31 Araujo VC, Lima CMB, Barbosa ENB, Furtado FP, Charchat-Fichman H. Impact of age and schooling on performance on the Brief Cognitive Screening Battery: a study of elderly residents in the City of Rio de Janeiro, Brazil. Psychol Neurosci 2018; 11 (03) 317-328 https://doi.org/10.1037/pne0000118
- 32 Brucki SMD, Nitrin R, Caramelli P, Bertolucci PHF, Okamoto IH. Sugestões para o uso do mini-exame do estado mental no Brasil. Arq Neuropsiquiatr 2003; 61(3B) 777-781 https://doi.org/10.1590/s0004-282x2003000500014
- 33 Nitrini R, Lefèvre BH, Mathias SC, Caramelli P, Carrilho PE, Sauaia N. et al. Testes neuropsicológicos de aplicação simples para o diagnóstico de demência. Arq Neuropsiquiatr 1994; 52 (04) 457-465 https://doi.org/10.1590/s0004-282x1994000400001
- 34 Veras C, Hartle L, Araújo VC, Charchat-Fichaman H. Estudo normativo da Escala de Depressão Geriátrica em amostra de idosos do Rio de Janeiro. Rev Neuropsicol Latinoam 2020; 12 (03) 41-50 https://doi.org/10.5579/rnl.2016.0561
- 35 Sanchez MAS, Correa PCR, Lourenço RA. Cross-cultural adaptation of the "Functional Activities Questionnaire - FAQ" for use in Brazil. Dement Neuropsychol 2011; 5 (04) 322-327 https://doi.org/10.1590/S1980-57642011DN05040010
- 36 Santos RL, Virtuoso Júnior JS. Confiabilidade da versão brasileira da escala de atividades instrumentais da vida diária. Rev Bras Promoç Saúde 2012; 21 (04) 290-296 https://doi.org/10.5020/575
- 37 Naidel E, Faria CDA, Veiga H, Alves D, Lima DA, Novaes R. et al. Perfis neuropsicológicos do Comprometimento Cognitivo Leve no envelhecimento (CCL). Rev Neuropsicol Latinoam 2015; 7: 15-23 https://doi.org/10.5579/rnl.2015.0257
- 38 Stroop JR. Studies of interference in serial verbal reactions. J Exp Psychol 1935; 18 (06) 643-662 https://doi.org/10.1037/h0054651
- 39 Hartle L, Mendes-Santos L, Barbosa E, Balboni G, Charchat-Fichman H. Evidence of validity of a novel version of the computerized cognitive screening battery CompCog. Dement Neuropsychol 2021; 15 (04) 485-496 https://doi.org/10.1590/1980-57642021dn15-040010
- 40 Monsch AU, Bondi MW, Butters N, Paulsen JS, Salmon DP, Brugger P. et al. A comparison of category and letter fluency in Alzheimer's disease and Huntington's disease. Neuropsychology 1994; 8 (01) 25-30 https://doi.org/10.1037/0894-4105.8.1.25
- 41 Joubert S, Gardy L, Didic M, Rouleau I, Barbeau EJ. A meta-analysis of semantic memory in mild cognitive impairment. Neuropsychol Rev 2021; 31 (02) 221-232 https://doi.org/10.1007/s11065-020-09453-5
- 42 Kit KA, Mateer CA, Tuokko HA, Spencer-Rodgers J. Influence of negative stereotypes and beliefs on neuropsychological test performance in a traumatic brain injury population. J Int Neuropsychol Soc 2014; 20 (02) 157-167 https://doi.org/10.1017/S1355617713001264
- 43 Brailean A, Steptoe A, Batty GD, Zaninotto P, Llewellyn DJ. Are subjective memory complaints indicative of objective cognitive decline or depressive symptoms? Findings from the english longitudinal study of ageing. J Psychiatr Res 2019; 110: 143-151 https://doi.org/10.1016/j.jpsychires.2018.12.005
- 44 Mitchell AJ, Beaumont H, Ferguson D, Yadegarfar M, Stubbs B. Risk of dementia and mild cognitive impairment in older people with subjective memory complaints: meta-analysis. Acta Psychiatr Scand 2014; 130 (06) 439-451 https://doi.org/10.1111/acps.12336
- 45 Jorm AF, Butterworth P, Anstey KJ, Christensen H, Easteal S, Maller J. et al. Memory complaints in a community sample aged 60-64 years: associations with cognitive functioning, psychiatric symptoms, medical conditions, APOE genotype, hippocampus and amygdala volumes, and white-matter hyperintensities. Psychol Med 2004; 34 (08) 1495-1506 https://doi.org/10.1017/s0033291704003162
- 46 Park J-H, Jung M, Kim J, Park HY, Kim J-R, Park J-H. Validity of a novel computerized screening test system for mild cognitive impairment. Int Psychogeriatr 2018; 30 (10) 1455-1463 https://doi.org/10.1017/S1041610218000923
- 47 Memória CM, Yassuda MS, Nakano EY, Forlenza OV. Contributions of the Computer-Administered Neuropsychological Screen for Mild Cognitive Impairment (CANS-MCI) for the diagnosis of MCI in Brazil. Int Psychogeriatr 2014; 26 (09) 1483-1491 https://doi.org/10.1017/S1041610214000726
- 48 Tornatore JB, Hill E, Laboff JA, McGann ME. Self-administered screening for mild cognitive impairment: initial validation of a computerized test battery. J Neuropsychiatry Clin Neurosci 2005; 17 (01) 98-105 https://doi.org/10.1176/jnp.17.1.98
- 49 Gorus E, De Raedt R, Lambert M, Lemper J-C, Mets T. Reaction times and performance variability in normal aging, mild cognitive impairment, and Alzheimer's disease. J Geriatr Psychiatry Neurol 2008; 21 (03) 204-218 https://doi.org/10.1177/0891988708320973
- 50 de Jager CA, Schrijnemaekers A-CMC, Honey TEM, Budge MM. Detection of MCI in the clinic: evaluation of the sensitivity and specificity of a computerised test battery, the Hopkins Verbal Learning Test and the MMSE. Age Ageing 2009; 38 (04) 455-460 https://doi.org/10.1093/ageing/afp068
- 51 Anstey KJ, Mack HA, Christensen H, Li S-C, Reglade-Meslin C, Maller J. et al. Corpus callosum size, reaction time speed and variability in mild cognitive disorders and in a normative sample. Neuropsychologia 2007; 45 (08) 1911-1920 https://doi.org/10.1016/j.neuropsychologia.2006.11.020
- 52 Park J-H, Park J-H. Development of computerized screening test items for mild cognitive impairment. Ther Sci Rehabil 2018; 7 (04) 31-41 https://doi.org/10.22683/tsnr.2018.7.4.031
- 53 Schweiger A, Doniger GM, Dwolatzky T, Jaffe D, Simon ES. Reliability of a novel computerized neuropsychological battery for mild cognitive impairment. Neuropsychilogica 2003; 1: 407-413
- 54 Hartle L, Charchat-Fichman H. Mild cognitive impairment history and current procedures in low- and middle-income countries: a brief review. Dement Neuropsychol 2021; 15 (02) 155-163 https://doi.org/10.1590/1980-57642021dn15-020001