Augmented Reality for Cognitive Screening in Neurodegenerative Diseases: A Ten-Year Systematic Review

Luiz Gustavo Guilherme do Nascimento; Walter Franklin Marques Correia; Fabio Campos; Marnix S. van Gisbergen; Marina de Lima Neves Barros; Anthony Lins; João Marcelo X. N. Teixeira

doi:10.5753/jbcs.2025.5761

Authors

Luiz Gustavo Guilherme do Nascimento UFPE https://orcid.org/0009-0009-2226-4393
Walter Franklin Marques Correia UFPE https://orcid.org/0000-0002-6491-9783
Fabio Campos UFPE https://orcid.org/0000-0002-7882-876X
Marnix S. van Gisbergen BUas - Breda University of applied Sciences https://orcid.org/0000-0002-7907-7312
Marina de Lima Neves Barros Universidade Católica de Pernambuco https://orcid.org/0000-0002-3544-0538
Anthony Lins Universidade Católica de Pernambuco https://orcid.org/0000-0002-7153-841X
João Marcelo X. N. Teixeira EACH-USP / UFPE https://orcid.org/0000-0001-7180-512X

DOI:

https://doi.org/10.5753/jbcs.2025.5761

Keywords:

Design, Augmented Reality, Neurodegenerative diseases, Cognitive Test

Abstract

Augmented Reality (AR) is increasingly explored as a low-burden alternative to pencil-and-paper cognitive tests for dementia and Parkinson’s Disease. Our objective with this review is to synthesize ten years (2014-2024) of empirical evidence on AR-based cognitive screening, estimate pooled diagnostic accuracy, and distil user experience (UX) guidelines for people with neurodegenerative disorders. We searched Scopus with the string “augmented reality” AND cognitive AND (dementia OR Parkinson), screened 399 records, and retained 38 primary studies. Two reviewers independently extracted sample, task, hardware, and accuracy metrics. Optical see-through AR improved test sensitivity over matched non-immersive tests, while projection-based AR offered the largest UX gains. Hardware cost and eye-tracker drift were the main precision bottlenecks. AR can raise both diagnostic sen sitivity and patient engagement, but only four studies used clinical-stage participants. Future work should couple low-cost hand-held AR with cloud inference to widen accessibility.

Downloads

Download data is not yet available.

References

Ahn, D., Chung, H., Lee, H.-W., Kang, K., Ko, P.-W., Kim, N. S., and Park, T. (2017). Smart gait-aid glasses for parkinson's disease patients. IEEE Transactions on Biomedical Engineering, 64(10):2394-2402. DOI: 10.1109/tbme.2017.2655344.

Andrade Ferreira, L. D., Cavaco, S., and Bermúdez i Badia, S. (2018). Feasibility study of an augmented reality system for people with dementia. DOI: 10.2312/egve.20181326.

Aruanno, B. and Garzotto, F. (2019). Memholo: mixed reality experiences for subjects with alzheimer's disease. Multimedia Tools and Applications, 78:13517-13537. DOI: 10.1007/s11042-018-7089-8.

Baugher, B., Kaya, R., Sonneborn, C., Baker, K. B., Fernandez, H. H., Szewczyk, N., Alberts, J. L., and Liao, J. (2025). Effects of augmented reality cueing strategies on freezing of gait: The eliminate fog trial. Clinical Parkinsonism & Related Disorders, 12:100332. DOI: 10.1016/j.prdoa.2025.100332.

Boletsis, C. and McCallum, S. (2017). The smartkuber case study: lessons learned from the development of an augmented reality serious game for cognitive screening. In Augmented Reality, Virtual Reality, and Computer Graphics: 4th International Conference, AVR 2017, Ugento, Italy, June 12-15, 2017, Proceedings, Part I 4, pages 457-472. Springer. DOI: 10.1007/978-3-319-60922-5_36.

Cerrato, A. and Ponticorvo, M. (2017). Enhancing neuropsychological testing with gamification and tangible interfaces: the baking tray task. In Biomedical Applications Based on Natural and Artificial Computing: International Work-Conference on the Interplay Between Natural and Artificial Computation, IWINAC 2017, Corunna, Spain, June 19-23, 2017, Proceedings, Part II, pages 147-156. Springer. DOI: 10.1007/978-3-319-59773-7_16.

Chaldogeridis, A., Tsiatsos, T., Gialaouzidis, M., and Tsolaki, M. (2014). Comparing data from a computer based intervention program for patients with alzheimer's disease. In Virtual, Augmented and Mixed Reality. Applications of Virtual and Augmented Reality: 6th International Conference, VAMR 2014, Held as Part of HCI International 2014, Heraklion, Crete, Greece, June 22-27, 2014, Proceedings, Part II 6, pages 258-266. Springer. DOI: 10.1007/978-3-319-07464-1_24.

Christova, M., Strohmaier, R., Fuchs-Neuhold, B., Guggenberger, B., Loder-Fink, B., Draxler, T., Palli, C., Simi, H., Schadenbauer, S., Nischelwitzer, A., et al. (2022). Mixed reality prototype of multimodal screening for early detection of cognitive impairments in older adults: Protocol development and usability study. JMIR Research Protocols, 11(10):e39513. DOI: 10.2196/39513.

Cidota, M., Lukosch, S., and Bank, P. J. (2015). Augmented reality for motion analysis of patients with upper extremity motor dysfunction. In 2015 3rd IEEE VR International Workshop on Virtual and Augmented Assistive Technology (VAAT), pages 1-4. IEEE. DOI: 10.1109/vaat.2015.7155401.

Desai, S., Fels, D., and Astell, A. (2020). Designing for experiences in blended reality environments for people with dementia. In International Conference on Human-Computer Interaction, pages 495-509. Springer. DOI: 10.1007/978-3-030-60149-2_38.

Ejaz, A., Ali, S. A., Ejaz, M. Y., and Siddiqui, F. A. (2019). Graphic user interface design principles for designing augmented reality applications. International Journal of Advanced Computer Science and Applications (IJACSA), 10(2):209-216. DOI: 10.14569/ijacsa.2019.0100228.

Fasilis, T., Patrikelis, P., Siatouni, A., Alexoudi, A., Veretzioti, A., Zachou, L., and Gatzonis, S. S. (2018). A pilot study and brief overview of rehabilitation via virtual environment in patients suffering from dementia. Psychiatrike= Psychiatriki, 29(1):42-51. DOI: 10.22365/jpsych.2018.291.42.

Gacem, M. A., Alghlayini, S., Shehieb, W., Saeed, M., Ghazal, A., and Mir, M. (2019). Smart assistive glasses for alzheimer's patients. In 2019 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), pages 1-5. IEEE. DOI: 10.1109/isspit47144.2019.9001827.

Goderie, J., Alashrafov, R., Jockin, P., Liu, L., Liu, X., Cidota, M. A., and Lukosch, S. G. (2017). [poster] chirochroma: An augmented reality game for the assessment of hand motor functionality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), pages 115-120. IEEE. DOI: 10.1109/ismar-adjunct.2017.44.

Hamilton, M. A., Beug, A. P., Hamilton, H. J., and Norton, W. J. (2021). Augmented reality technology for people living with dementia and their care partners. In Proceedings of the 2021 5th International Conference on Virtual and Augmented Reality Simulations, pages 21-30. DOI: 10.1145/3463914.3463918.

Jin, R., Pilozzi, A., and Huang, X. (2020). Current cognition tests, potential virtual reality applications, and serious games in cognitive assessment and non-pharmacological therapy for neurocognitive disorders. Journal of Clinical Medicine, 9(10):3287. DOI: 10.3390/jcm9103287.

Kakoutopoulos, K., Drakakis, E., Papadopoulou, A., and Goumopoulos, C. (2025). Feasibility of augmented reality-based cognitive training for older adults: The marketmind ar approach. Sensors, 25(7):2081. DOI: 10.3390/s25072081.

Kanno, K. M., Lamounier, E. A., Cardoso, A., Lopes, E. J., and de Lima, G. F. M. (2018). Augmented reality system for aiding mild alzheimer patients and caregivers. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 593-594. IEEE. DOI: 10.1109/vr.2018.8446143.

Karimah, H., Suryani, M., and Hidayat, A. (2022). Implementation of design thinking in part 30 of the qur'an augmented reality based learning application to improve user experience and cognitive ability. In AIP Conference Proceedings, volume 2433. AIP Publishing. DOI: 10.1063/5.0100383.

Kirner, C. and Tori, R. (2006). Fundamentos de realidade aumentada. Fundamentos e tecnologia de realidade virtual e aumentada, 1:22-38. Available at:[link].

Lee, I.-J., Chen, C.-H., and Chang, K.-P. (2016). Augmented reality technology combined with three-dimensional holography to train the mental rotation ability of older adults. Computers in Human Behavior, 65:488-500. DOI: 10.1016/j.chb.2016.09.014.

Lin, C.-H., Chan, S.-B., Lai, Y.-C., Liang, W.-L., Huang, M.-S., and Chen, Y.-Y. (2021). Ai in ehealth: Diagnosis of parkinson's disease with augmented reality. In 2021 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW), pages 1-2. IEEE. DOI: 10.1109/icce-tw52618.2021.9603258.

Liu, C.-L. and Chang, S.-R. (2021). A pilot tool of the virtual scenario initial dementia cognitive screening (vsidcs) with a cultural exhibition for improving the standard traditional test. In Healthcare, volume 9, page 1160. MDPI. DOI: 10.3390/healthcare9091160.

Loreiro, l. (2009). DoenÃ§as neurodegenerativas. Available at:[link]. Accessed on April 15, 2024.

Maharjan, B., Albabawat, A. A., Salah, R. M., AlSallami, N., Altaf, S., and Al-Jerew, O. (2023). Augmented reality for cognitive impairment and dementia. In International Conference on Advances in Computing Research, pages 257-269. Springer. DOI: 10.1007/978-3-031-33743-7_22.

Muurling, M., de Boer, C., Vairavan, S., Harms, R. L., Chadha, A. S., Tarnanas, I., Luis, E. V., Religa, D., Gjestsen, M. T., Galluzzi, S., et al. (2023). Augmented reality versus standard tests to assess cognition and function in early alzheimer's disease. NPJ digital medicine, 6(1):234. DOI: 10.1038/s41746-023-00978-6.

Okahashi, S., Sawada, S., and Kinoshita, A. (2020). Tablet-based comprehensive cognitive rehabilitation in daily life using virtual and augmented reality technology. In Human Aspects of IT for the Aged Population. Healthy and Active Aging: 6th International Conference, ITAP 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19-24, 2020, Proceedings, Part II 22, pages 167-176. Springer. DOI: 10.1007/978-3-030-50249-2_13.

Onorati, T., Díaz, P., Montero, Á., and Aedo, I. (2023). Designing ar applications for people living with dementia. In IFIP Conference on Human-Computer Interaction, pages 449-453. Springer. DOI: 10.1007/978-3-031-42293-5_52.

Park, E., Yun, B.-J., Min, Y.-S., Lee, Y.-S., Moon, S.-J., Huh, J.-W., Cha, H., Chang, Y., and Jung, T.-D. (2019). Effects of a mixed reality-based cognitive training system compared to a conventional computer-assisted cognitive training system on mild cognitive impairment: a pilot study. Cognitive and Behavioral Neurology, 32(3):172-178. DOI: 10.1097/wnn.0000000000000197.

Parums, D. V. (2021). Review articles, systematic reviews, meta-analysis, and the updated preferred reporting items for systematic reviews and meta-analyses (prisma) 2020 guidelines. Medical science monitor: international medical journal of experimental and clinical research, 27:e934475-1. DOI: 10.12659/msm.934475.

Pushpakumar, R., Sanjaya, K., Rathika, S., Alawadi, A. H., Makhzuna, K., Venkatesh, S., and Rajalakshmi, B. (2023). Human-computer interaction: Enhancing user experience in interactive systems. In E3S Web of Conferences, volume 399, page 04037. EDP Sciences. DOI: 10.1051/e3sconf/202339904037.

Ramos, M., Merino, E. A. D., Merino, G. S. A. D., and Ferreira, M. G. G. (2016). Design de serviços e experiência do usuário (ux): uma análise do relacionamento das áreas. DAPesquisa, 11(16):105-123. DOI: 10.5965/1808312911162016105.

Taghavi, M. F., Ghorbani, F., and Delrobaei, M. (2023). Development of an augmented reality-based serious game: A cognitive assessment study. IEEE Transactions on Cognitive and Developmental Systems. DOI: 10.1109/TCDS.2023.3329807.

van der Meulen, E., Cidota, M. A., Lukosch, S. G., Bank, P. J., van der Helm, A. J., and Visch, V. T. (2016). A haptic serious augmented reality game for motor assessment of parkinson's disease patients. In 2016 IEEE international symposium on mixed and augmented reality (ISMAR-Adjunct), pages 102-104. IEEE. DOI: 10.1109/ismar-adjunct.2016.0050.

Vovk, A., Patel, A., and Chan, D. (2019). Augmented reality for early alzheimer's disease diagnosis. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, pages 1-6. DOI: 10.1145/3290607.3313007.

Wang, Y.-W., Chen, C.-H., and Lin, Y.-C. (2020). Balance rehabilitation system for parkinson's disease patients based on augmented reality. In 2020 IEEE Eurasia Conference on IOT, Communication and Engineering (ECICE), pages 191-194. IEEE. DOI: 10.1109/ecice50847.2020.9302018.

WenKai, H., Kuwahara, N., and Siriaraya, P. (2023). Development of a game system to provide enjoyable playful experiences to people in all stages of dementia. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pages 239-242. IEEE. DOI: 10.1109/vrw58643.2023.00059.

Wolf, D., Besserer, D., Sejunaite, K., Riepe, M., and Rukzio, E. (2018). care: An augmented reality support system for dementia patients. In Adjunct Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, pages 42-44. DOI: 10.1145/3266037.3266095.