Sensitivity, specificity and cut-off point of the Montreal Cognitive Assessment (MoCA) in Patients with mild-Traumatic Brain Injury (mTBI)

Document Type : Original Article

Authors

1 Department of Psychology, Faculty of Literature and Humanities, University of Guilan, Rasht, Iran

2 Guilan Road Trauma Research Center, Department of Neurosurgery, School of Medicine, Guilan University of Medical Sciences, Rasht, Iran

Abstract

Background: Although patients with mild traumatic brain injury (mTBI) rarely exhibit an identifiable lesion on neuroimaging, they frequently experience neurocognitive problems.
Objectives: The present study aimed to determine the cut-off point, sensitivity, and specificity of the Montreal Cognitive Assessment (MoCA) test in mTBI patients.
Methods: In this cross-sectional-analytical study, the case group included 79 patients with mTBI were enrolled in the trauma, neurosurgery, and ICU ward of PourSina hospital (northern Iran), and there were 79 healthy individuals in the control group. Both groups were participating in this study were cognitively evaluated by the MoCA and MMSE test. Moreover, as retesting reliability and determining the concurrent and convergent validity of the MoCA, and Pearson correlation coefficient between two groups, MMSE test was performed on 20 mTBI patients with an average time interval of 3 days. The independent t-test, Cronbach’s alpha and discriminant analysis used for determining the distribution, internal consistency reliability and sensitivity, specificity, and diagnostic value of the MoCA test between groups respectively.
Results: The results showed a cut-off point of 26/27 as the probable point of cognitive impairment in mTBI. Also, in order to identify cognitive impairment in mTBI patients, this test reported sensitivity of 0.62 and   specificity of 0.81 with Youden's index of 0.43.
Conclusion: In screening for possible mild cognitive impairment in mTBI patients, the MoCA is relatively useful and should not be used only as a substitute for a complete neuropsychological assessment with diagnostic purposes.

Keywords

References

  1. Erlanger DM, Kutner KC, Barth JT, Barnes R. Forum neuropsychology of sports-related head injury: Dementia pugilistica to post concussion syndrome. Clin Neuropsychol. 1999;13(2).‏ doi:10.1076/clin.13.2.193.1963 PMid:10949160
  2. Panwar N, Purohit D, Deo Sinha V, Joshi M. Evaluation of extent and pattern of neurocognitive functions in mild and moderate traumatic brain injury patients by using Montreal Cognitive Assessment (MoCA) score as a screening tool: An observational study from India. Asian J Psychiatr 2019;41:60-5. doi:10.1016/j.ajp.2018.08.007 PMid:30396805
  3. Rostami S, Heidarzadeh F, Ashourzadeh Fallah S, Rahimi S, Mehrizi M, Sadeghi F, et al. Diagnostic salivary biomarkers in traumatic brain injury: narrative review. Novel Clin Med 2022; 1(2): 59-69. doi: 10.22034/ncm.2022.327121.1009
  4. Lannsjö M, Backheden M, Johansson U, Af Geijerstam JL, Borg J. Does head CT scan pathology predict outcome after mild traumatic brain injury? Eur J Neurol. 2013;20(1):124-9. doi:10.1111/j.1468-1331.2012.03813.x PMid:22812542
  5. Puig J, Ellis MJ, Kornelsen J, Figley TD, Figley CR, Daunis-I-Estadella P, et al. Magnetic resonance imaging biomarkers of brain connectivity in predicting outcome after mild traumatic brain injury: A systematic review. J Neurotrauma. 2020;37(16):1761-76. doi:10.1089/neu.2019.6623 PMid:32228145
  6. Stenberg J, Håberg AK, Follestad T, Olsen A, Iverson GL, Terry DP, et al. Cognitive reserve moderates cognitive outcome after mild traumatic brain injury. Arch Phys Med Rehabil. 2020; 101 (1):72-80. doi:10.1016/j.apmr.2019.08.477 PMid:31562876
  7. Bai L, Bai G, Wang S, Yang X, Gan S, Jia X, et al. Strategic white matter injury associated with long-term information processing speed deficits in mild traumatic brain injury. Hum Brain Mapp. 2020;41(15):4431-41. doi:10.1002/hbm.25135 PMid:32657510 PMCid:PMC7502829
  8. Mullally WJ. Concussion. Am J Med. 2017;130(8):885-92. doi:10.1016/j.amjmed.2017.04.016 PMid:28502817
  9. Thomas RE, Alves J, Vaska Mlis MM, Magalhaes R. Therapy and rehabilitation of mild brain injury/concussion: Systematic review. Restor Neurol Neurosci. 2017;35(6) doi:10.3233/RNN-170761 PMid:29172011
  10. Ismail Z, Rajji TK, Shulman KI. Brief cognitive screening instruments: an update. Int J Geriatr Psychiatry. 2010;25(2):111-20. doi:10.1002/gps.2306 PMid:19582756
  11. Rosca EC, Simu M. Montreal cognitive assessment for evaluating cognitive impairment in Huntington's disease: a systematic review. CNS Spectr 2022;27(1):27-45. doi:10.1017/S1092852920001868 PMid:33023702
  12. Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189-98. doi:10.1016/0022-3956(75)90026-6 PMid:1202204
  13. Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment: Moca: A brief screening tool for MCI. J Am Geriatr Soc. 2005; 53 (4):695-9. doi:10.1111/j.1532-5415.2005.53221.x PMid:15817019
  14. Murri MB, Folesani F, Costa S, Biancosino B, Colla C, Zerbinati L, et al. Screening for cognitive impairment in non-affective psychoses: A comparison between the SCIP and the MoCA. Schizophrenia Res. 2020;218 doi:10.1016/j.schres.2020.01.005 PMid:31948897
  15. Julayanont P, Nasreddine ZS. Montreal cognitive assessment (MoCA): Concept and clinical review. In: Cognitive Screening Instruments. Cham: Springer International Publishing; 2017. p. 139-95. doi:10.1007/978-3-319-44775-9_7
  16. Patnode CD, Perdue LA, Rossom RC, Rushkin MC, Redmond N, Thomas RG, et al. Screening for cognitive impairment in older adults: Updated evidence report and systematic review for the US Preventive Services Task Force: Updated evidence report and systematic review for the US preventive services task force. JAMA. 2020;323(8):764-85. doi:10.1001/jama.2019.22258PMid:32096857
  17. Rambe AS, Fitri FI. Correlation between the Montreal Cognitive Assessment-Indonesian Version (Moca-INA) and the Mini-Mental State Examination (MMSE) in elderly. Open Access Maced J Med Sci . 2017;5(7):915-9. doi:10.3889/oamjms.2017.202
    PMid:29362618 PMCid:PMC5771294
  18. Coen RF, Robertson DA, Kenny RA, King-Kallimanis BL. Strengths and limitations of the MoCA for assessing cognitive functioning: Findings from a large representative sample of Irish older adults. J Geriatr Psychiatry Neurol 2016;29(1):18-24. doi:10.1177/0891988715598236 PMid:26251108
  19. Zhuang L, Yang Y, Gao J. Cognitive assessment tools for mild cognitive impairment screening. J Neurol . 2021;268(5):1615-22. doi:10.1007/s00415-019-09506-7 PMid:31414193
  20. Bruijnen CJWH, Jansen M, Dijkstra BAG, Walvoort SJW, Lugtmeijer S, Markus W, et al. The Montreal Cognitive Assessment (MoCA) as a cognitive screen in addiction health care: A validation study for clinical practice. J Subst Use. 2019;24(1):47-54. doi:10.1080/14659891.2018.1497102
  21. Carson N, Leach L, Murphy KJ. A re‐examination of Montreal Cognitive Assessment (MoCA) cutoff scores: Re-examination of MoCA cutoff scores. Int J Geriatr Psychiatry . 2018;33(2):379-88. doi:10.1002/gps.4756 PMid:28731508
  22. Masika GM, Yu DSF, Li PWC. Accuracy of the Montreal Cognitive Assessment in detecting mild cognitive impairment and dementia in the rural African population. Arch Clin Neuropsychol 2021;36(3):371-80. doi:10.1093/arclin/acz086 PMid:31942599
  23. Rosca EC, Cornea A, Simu M. Montreal Cognitive Assessment for evaluating the cognitive impairment in patients with schizophrenia: A systematic review. Gen Hosp Psychiatry. 2020; 65:64-73. doi:10.1016/j.genhosppsych.2020.05.011 PMid:32502879
  24. Tolle K, Montgomery V, Gradwohl B, Spencer R, Stelmokas J. The Montreal Cognitive Assessment in veteran postacute care: Implications of cut scores. Cogn Behav Neurol. 2020;33(2):129-36. doi:10.1097/WNN.0000000000000233 PMid:32496298
  25. Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007;39(2):175-91. doi:10.3758/BF03193146 PMid:17695343
  26. Folstein MF, Folstein SE, Mchugh PR. Mini-mental state": a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189-98. doi:10.1016/0022-3956(75)90026-6 PMid:1202204
  27. Weeks DL, Ambrose SB, Tindall AG. The utility of the Modified Mini-Mental State Examination in inpatient rehabilitation for traumatic brain injury: preliminary findings. Brain Inj 2020; 34 (7):881-8. doi:10.1080/02699052.2020.1761564 PMid:32396468
  28. Seyedian M., Falah Mahtab, Nourouzian Maryam, Nejat Saharnaz, Delavar A., Ghasemzadeh H.A. Validity of the Farsi version of mini-mental state examination. J Med Council Iran. 2008;25(4):408-414.
  29. Bello-Lepe S, Alonso-Sánchez MF, Ortega A, Gaete M, Veliz M, Lira J, et al. Montreal Cognitive Assessment as screening measure for mild and major neurocognitive disorder in a Chilean population. Dement Geriatr Cogn Dis Extra. 2020;10(3):105-14. doi:10.1159/000506280 PMid:33250917 PMCid:PMC7670370
  30. Dautzenberg G, Lijmer J, Beekman A. Diagnostic accuracy of the Montreal Cognitive Assessment (MoCA) for cognitive screening in old age psychiatry: Determining cutoff scores in clinical practice. Avoiding spectrum bias caused by healthy controls. Int J Geriatr Psychiatry 2020;35(3):261-9. doi:10.1002/gps.5227 PMid:31650623 PMCid:PMC7028034
  31. Zaidi KB, Rich JB, Sunderland KM, Binns MA, Truong L, McLaughlin PM, et al. Methods for improving screening for vascular cognitive impairment using the Montreal Cognitive Assessment. Can J Neurol Sci. 2020;47(6):756-63. doi:10.1017/cjn.2020.121 PMid:32522309
  32. Wong GKC, Ngai K, Lam SW, Wong A, Mok V, Poon WS. Validity of the Montreal Cognitive Assessment for traumatic brain injury patients with intracranial haemorrhage. Brain Inj. 2013; 27 (4):394-8. doi:10.3109/02699052.2012.750746 PMid:23473067
  33. Perkins N. The Youden index and the corresponding optimal cut-point corrected for measurement error. Epidemiology. 2004;15 (4): S153. doi:10.1097/00001648-200407000-00400
  34. Habibpour Gatabi K, Safari Shali R. Comprehensive guide to the use of SPSS in survey research (quantitative data analysis). Tehran: Louyeh; 2009. https://opac.nlai.ir/opac-prod/search/briefListSearch.do?command=FULL_VIEW&id=9058769&pageStatus=1&sortKeyValue1=sortkey_title&sortKeyValue2=sortkey_author
  35. Mckee AC, Daneshvar DH. The neuropathology of traumatic brain injury. Handb Clin Neurol 2015;127:45-66. doi:10.1016/B978-0-444-52892-6.00004-0 PMid:25702209 PMCid:PMC4694720
  36. Kumar S, Jawahar A, Shah P, Kumar M. Montreal Cognitive Assessment, a screening tool for Mild Traumatic Brain Injury. 2015
  37. Veeramuthu V, Narayanan V, Kuo TL, Delano-Wood L, Chinna K, Bondi MW, et al. Diffusion tensor imaging parameters in mild traumatic brain injury and its correlation with early neuropsychological impairment: A longitudinal study. J Neurotrauma 2015;32(19):1497-509. doi:10.1089/neu.2014.3750 PMid:25952562 PMCid:PMC4589266
  38. Frenette LC, Tinawi S, Correa JA, Alturki AY, LeBlanc J, Feyz M, et al. Early detection of cognitive impairments with the Montreal Cognitive Assessment in patients with uncomplicated and complicated mild traumatic brain injury. Brain Inj. 2019;33 (2):189-97. doi:10.1080/02699052.2018.1542506 PMid:30388898
  39. Vissoci JRN, de Oliveira LP, Gafaar T, Haglund MM, Mvungi M, Mmbaga BT, et al. Cross-cultural adaptation and psychometric properties of the MMSE and MoCA questionnaires in Tanzanian Swahili for a traumatic brain injury population. BMC Neurol 2019; 19 (1):57. doi:10.1186/s12883-019-1283-9 PMid:30961532 PMCid:PMC6454609
  40. ertolucci PH, Brucki SM, Campacci SR, Juliano Y. O Mini-Exame do Estado Mental em uma população geral. Impacto da escolaridade. Arquivos Neuropsiquiatria; 1994. doi:10.1590/S0004-282X1994000100001 PMid:8002795
  41. Ng A, Chew I, Narasimhalu K, Kandiah N. Effectiveness of Montreal Cognitive Assessment for the diagnosis of mild cognitive impairment and mild Alzheimer's disease in Singapore. Singapore Med J. 2013;54(11):616-9. doi:10.11622/smedj.2013220
  42. Cheng Y, Zhang Y, Zhang Y, Wu YH, Zhang S. Reliability and validity of the Rowland Universal Dementia Assessment Scale for patients with traumatic brain injury. Appl Neuropsychol Adult 2022;29(5):1160-6. doi:10.1080/23279095.2020.1856850 PMid:33321049  
  43. Gagnon C, Saillant K, Olmand M, Gayda M, Nigam A, Bouabdallaoui N, et al. Performances on the Montreal Cognitive Assessment along the cardiovascular disease continuum. Arch Clin Neuropsychol 2022; 37(1):117-24. doi:10.1093/arclin/acab029 PMid:33960374 PMCid:PMC8763113
  44. Zhang S, Wu YH, Zhang Y, Zhang Y, Cheng Y. Preliminary study of the validity and reliability of the Chinese version of the Saint Louis University Mental Status Examination (SLUMS) in detecting cognitive impairment in patients with traumatic brain injury. Appl Neuropsychol Adult 2021;28(6):633-40 doi:10.1080/23279095.2019.1680986 PMid:31646902
  45. Siqueira GSA, Hagemann P de MS, Coelho D de S, Santos FHD, Bertolucci PHF. Can MoCA and MMSE be interchangeable cognitive screening tools? A systematic review. Gerontologist . 2019;59(6):e743-63. doi:10.1093/geront/gny126 PMid:30517634
  46. Kopecek M, Stepankova H, Lukavsky J, Ripova D, Nikolai T, Bezdicek O. Montreal cognitive assessment (MoCA): Normative data for old and very old Czech adults. Appl Neuropsychol Adult 2017;24(1):23-9. doi:10.1080/23279095.2015.1065261 PMid:27144665 
  47. Mishra K, Purohit D, Sharma S. Montreal cognitive assessment score: A screening tool for cognitive function in traumatic brain injury (TBI) population. J Neurol Neuromed. 2020;5(3):35-9 doi:10.29245/2572.942X/2020/3.1238
  48. Zhuang L, Yang Y, Gao J. Cognitive assessment tools for mild cognitive impairment screening. J Neurol. 2021;268(5):1615-22. doi:10.1007/s00415-019-09506-7 PMid:31414193
  49. Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: Clinical characterization and outcome. Arch Neurol. 1999;56(3):303. doi:10.1001/archneur.56.3.303 PMid:10190820 
Archives of Trauma Research
Volume 12, Issue 3
November 2023
Pages 159-168

Files

History

  • Receive Date: 19 June 2023
  • Revise Date: 27 September 2023
  • Accept Date: 28 October 2023

Share

How to cite

Statistics