Effects of task difficulty and musical training in Virtual Reality: Observations of cognitive load and task accuracy in a VR rhythm exergame

Kyla Ellahiyoun; Emma Jane Pretty; Renan Guarese; Marcel Takac; Haytham Fayek; Fabio Zambetta

doi:10.5753/jbcs.2026.8215

Authors

Kyla Ellahiyoun RMIT University https://orcid.org/0009-0001-4050-6837
Emma Jane Pretty Tampere University https://orcid.org/0000-0002-5108-5740
Renan Guarese Maynooth University https://orcid.org/0000-0003-1206-5701
Marcel Takac RMIT University https://orcid.org/0000-0002-5761-1828
Haytham Fayek RMIT University https://orcid.org/0000-0002-1840-7605
Fabio Zambetta RMIT University https://orcid.org/0000-0003-4133-7913

DOI:

https://doi.org/10.5753/jbcs.2026.8215

Keywords:

Virtual Reality, Exergames, Biofeedback, Physiological Sensors, Cognitive Load, Human-Computer Interaction

Abstract

This study explores the relationship between musical training, cognitive load (CL), and task accuracy within the virtual reality (VR) rhythm exergame Beat Saber across increasing task difficulty levels. Participants (N = 32) had their physiological metric data measured while playing the VR rhythm exergame under three task difficulty levels, completing a series of questionnaires after each task. Using regression analyses, we found that task difficulty and gaming experience significantly predicted perceived mental demand, whereas musical training did not. Musical training, along with lower perceived mental demand, increased gaming experience, and greater physiological arousal, significantly predicted higher task accuracy. These results suggest that musical training enhances task-specific performance but does not directly reduce perceived mental demand. Future research should consider alternative methods of grouping musical training and the additional predictability of flow and self-efficacy.

Downloads

Download data is not yet available.

References

Anglin, J., Sugiyama, T., and Liew, S. (2017). Visuomotor adaptation in head-mounted virtual reality versus conventional training. Scientific reports, 7(1):45469. DOI: 10.1038/srep45469.

Arndt, S., Perkis, A., and Voigt-Antons, J.-N. (2018). Using virtual reality and head-mounted displays to increase performance in rowing workouts. In Proceedings of the 1st International Workshop on Multimedia Content Analysis in Sports, MMSports'18, page 45–50, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3265845.3265848.

Atkinson, R. and Shiffrin, R. (1968). Human memory: A proposed system and its control processes. volume 2 of Psychology of Learning and Motivation, pages 89-195. Academic Press. DOI: 10.1016/S0079-7421(08)60422-3.

Baddeley, A. D. and Hitch, G. (1974). Working memory. 8:47-89. DOI: 10.1016/S0079-7421(08)60452-1.

Baker, D. J., Ventura, J., Calamia, M., Shanahan, D., and Elliott, E. M. (2020). Examining musical sophistication: A replication and theoretical commentary on the Goldsmiths Musical Sophistication Index. Musicae Scientiae, 24(4):411-429. DOI: 10.1177/1029864918811879.

Benz, S., Sellaro, R., Hommel, B., and Colzato, L. S. (2016). Music makes the world go round: The impact of musical training on non-musical cognitive functions—A Review. Frontiers in Psychology, 6:2023-2023. DOI: 10.3389/FPSYG.2015.02023.

Berends, I. E. and van Lieshout, E. C. (2009). The effect of illustrations in arithmetic problem-solving: Effects of increased cognitive load. Learning and Instruction, 19(4):345-353. DOI: 10.1016/j.learninstruc.2008.06.012.

Bowman, N. D., Wasserman, J., and Banks, J. (2018). Development of the video game demand scale. In Video Games: A Medium That Demands Our Attention, pages 208-233. Routledge. DOI: 10.4324/9781351235266-13.

Bowmer, A., Mason, K., Knight, J., and Welch, G. (2018). Investigating the impact of a musical intervention on preschool children’s executive function. Frontiers in Psychology, Volume 9 - 2018. DOI: 10.3389/fpsyg.2018.02389.

Campo-Prieto, P., Cancela, J. M., and Rodríguez-Fuentes, G. (2021). Immersive virtual reality as physical therapy in older adults: present or future (systematic review). Virtual Reality, 25(3):801-817. DOI: 10.1007/s10055-020-00495-x.

Chaddock-Heyman, L., Loui, P., Weng, T. B., Weisshappel, R., McAuley, E., and Kramer, A. F. (2021). Musical Training and Brain Volume in Older Adults. Brain Sciences, 11(1):50. Number: 1 Publisher: Multidisciplinary Digital Publishing Institute. DOI: 10.3390/brainsci11010050.

Chee, Z. J., Leung, Y., and de Vries, M. (2022). Musical sophistication and its relationship with executive functions, autistic traits, and quality of life. Psychomusicology: Music, Mind and Brain, 32(3-4):87-97. Num Pages: 87-97 Publisher: Educational Publishing Foundation (US). DOI: 10.1037/pmu0000294.

Chen, F., Zhou, J., Wang, Y., Yu, K., Arshad, S. Z., Khawaji, A., and Conway, D. (2016). Robust Multimodal Cognitive Load Measurement. Springer Publishing Company, Incorporated, 1st edition. DOI: 10.5555/2978285.

Chi, M. T. H., Glaser, R., and Rees, E. (1982). Expertise in problem solving. In Sternberg, R. J., editor, Advances in the psychology of human intelligence, pages 7-75. Lawrence Erlbaum Associates, Inc., Hillsdale, NJ. Book.

Csikszentmihalyi, M. (1975). Beyond boredom and anxiety: the experience of play in work and games. Jossey-Bass Inc. Publishers. Book.

Cutting, J., Deterding, S., Demediuk, S., and Sephton, N. (2023). Difficulty-skill balance does not affect engagement and enjoyment: a pre-registered study using artificial intelligence-controlled difficulty. Royal Society Open Science, 10(2):220274. DOI: 10.1098/rsos.220274.

Dahary, H., Palma Fernandes, T., and Quintin, E.-M. (2020). The relationship between musical training and musical empathizing and systemizing traits. Musicae Scientiae, 24(1):113-129. DOI: 10.1177/1029864918779636.

Elvitigala, D. S., Karahanouglu, A., Matviienko, A., Turmo Vidal, L., Postma, D., Jones, M. D., Montoya, M. F., Harrison, D., Elbaek, L., Daiber, F., Burr, L. A., Patibanda, R., Buono, P., H"am"al"ainen, P., Van Delden, R., Bernhaupt, R., Ren, X., Van Rheden, V., Zambetta, F., Van Den Hoven, E., Lallemand, C., Reidsma, D., and Mueller, F. F. (2024). Grand challenges in sportshci. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, CHI '24, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3613904.3642050.

Frederiksen, J. G., Sorensen, S. M. D., Konge, L., Svendsen, M. B. S., Nobel-Jorgensen, M., Bjerrum, F., and Andersen, S. A. W. (2020). Cognitive load and performance in immersive virtual reality versus conventional virtual reality simulation training of laparoscopic surgery: a randomized trial. Surgical endoscopy, 34:1244-1252. DOI: 10.1007/s00464-019-06887-8.

Gradl, S., Eskofier, B. M., Eskofier, D., Mutschler, C., and Otto, S. (2016). Virtual and augmented reality in sports: an overview and acceptance study. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, UbiComp '16, page 885–888, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2968219.2968572.

Greenfield, P. M., Brannon, C., and Lohr, D. (1994). Two-dimensional representation of movement through three- dimensional space: The role of video game expertise. Journal of Applied Developmental Psychology, 15(1):87-103. DOI: 10.1016/0193-3973(94)90007-8.

Guarese, R., Pretty, E., Renata, A., Polson, D., and Zambetta, F. (2024). Exploring audio interfaces for vertical guidance in augmented reality via hand-based feedback. IEEE Transactions on Visualization and Computer Graphics, 30(5):2818-2828. DOI: 10.1109/TVCG.2024.3372040.

Guarese, R., van Schyndel, R., and Zambetta, F. (2022). Evaluating micro-guidance sonification methods in manual tasks for blind and visually impaired people. In OzCHI '22: Proceedings of the 34th Australian Conference on Human-Computer Interaction. DOI: 10.1145/3572921.3572929.

Haith, A. M. and Krakauer, J. W. (2018). The multiple effects of practice: skill, habit and reduced cognitive load. Current Opinion in Behavioral Sciences, 20:196-201. DOI: 10.1016/j.cobeha.2018.01.015.

Hart, S. G. and Staveland, L. E. (1988). Development of nasa-tlx (task load index): Results of empirical and theoretical research. In Hancock, P. A. and Meshkati, N., editors, Human Mental Workload, volume 52 of Advances in Psychology, pages 139-183. North-Holland. DOI: 10.1016/S0166-4115(08)62386-9.

Hedlund, M., Jonsson, A., Bogdan, C., Meixner, G., Ekblom Bak, E., and Matviienko, A. (2023a). BlocklyVR: exploring block-based programming in virtual reality. In Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia, MUM '23, page 257–269, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3626705.3627779.

Hedlund, M., Lundstr"om, A., Bogdan, C., and Matviienko, A. (2023b). Jogging-in-place: Exploring body-steering methods for jogging in virtual environments. In Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia, MUM '23, page 377–385, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3626705.3627778.

Huang, K.-T. (2020). Exergaming Executive Functions: An Immersive Virtual Reality-Based Cognitive Training for Adults Aged 50 and Older. Cyberpsychology, Behavior, and Social Networking, 23(3):143-149. DOI: 10.1089/cyber.2019.0269.

Huang, W., Roscoe, R. D., Johnson-Glenberg, M. C., and Craig, S. D. (2021). Motivation, engagement, and performance across multiple virtual reality sessions and levels of immersion. Journal of Computer Assisted Learning, 37(3):745-758. DOI: 10.1111/jcal.12520.

Kajastila, R., Holsti, L., and H"am"al"ainen, P. (2016). The augmented climbing wall: High-exertion proximity interaction on a wall-sized interactive surface. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16, page 758–769, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2858036.2858450.

Kalyuga, S. and Singh, A.-M. (2016). Rethinking the boundaries of cognitive load theory in complex learning. Educational Psychology Review, 28(4):831-852. DOI: 10.1007/s10648-015-9352-0.

Kennedy, R. S., Lane, N. E., Berbaum, K. S., and Lilienthal, M. G. (1993). Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. The International Journal of Aviation Psychology, 3(3):203-220. DOI: 10.1207/s15327108ijap0303_3.

Kirschner, D. and Williams, J. P. (2013). Experts and Novices or Expertise? Positioning Players through Gameplay Reviews. In DiGRA Conference, pages 1-18. DOI: 10.26503/dl.v2013i1.660.

LaViola, J. J. (2000). A discussion of cybersickness in virtual environments. SIGCHI Bull., 32(1):47–56. DOI: 10.1145/333329.333344.

Lemmens, J. S. and von Münchhausen, C. F. (2023). Let the beat flow: How game difficulty in virtual reality affects flow. Acta Psychologica, 232:103812. DOI: 10.1016/j.actpsy.2022.103812.

Levitin, D. (2012). What does it mean to be musical? Neuron, 73(4):633-637. DOI: 10.1016/j.neuron.2012.01.017.

Mandryk, R. L., Inkpen, K. M., and Calvert, T. W. (2006). Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour & Information Technology, 25(2):141-158. DOI: 10.1080/01449290500331156.

Matziorinis, A. M., Gaser, C., and Koelsch, S. (2023). Is musical engagement enough to keep the brain young? Brain Structure and Function, 228(2):577-588. DOI: 10.1007/s00429-022-02602-x.

Miura, Y., Wu, E., Kuribayashi, M., Koike, H., and Morishima, S. (2023). Exploration of sonification feedback for people with visual impairment to use ski simulator. In Proceedings of the Augmented Humans International Conference 2023, AHs '23, page 147–158, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3582700.3582702.

Moreno, R. and Mayer, R. (2007). Interactive Multimodal Learning Environments. Educational Psychology Review, 19(3):309-326. DOI: 10.1007/s10648-007-9047-2.

Mueller, F. and Isbister, K. (2014). Movement-based game guidelines. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '14, page 2191–2200, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2556288.2557163.

Müllensiefen, D., Gingras, B., Musil, J., and Stewart, L. (2014). The Musicality of Non-Musicians: An Index for Assessing Musical Sophistication in the General Population. PLOS ONE, 9(2):e89642. DOI: 10.1371/journal.pone.0089642.

Nacke, L. E., Kalyn, M., Lough, C., and Mandryk, R. L. (2011). Biofeedback game design: using direct and indirect physiological control to enhance game interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '11, page 103–112, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/1978942.1978958.

Paas, F. G. and Van Merri"enboer, J. J. (1994). Instructional control of cognitive load in the training of complex cognitive tasks. Educational psychology review, 6(4):351-371. DOI: 10.1007/BF02213420.

Pretty, E. J., Fayek, H. M., and Zambetta, F. (2023a). A Case for Personalized Non-Player Character Companion Design. International Journal of Human–Computer Interaction, 0(0):1-20. DOI: 10.1080/10447318.2023.2181125.

Pretty, E. J., Guarese, R., Dziego, C. A., Fayek, H. M., and Zambetta, F. (2024a). Multimodal measurement of cognitive load in a video game context: A comparative study between subjective and objective metrics. IEEE Transactions on Games, 16(4):854-867. DOI: 10.1109/TG.2024.3406723.

Pretty, E. J., Guarese, R., Fayek, H. M., and Zambetta, F. (2023b). Replicability and transparency for the creation of public human user video game datasets. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pages 74-81. DOI: 10.1109/VRW58643.2023.00021.

Pretty, E. J., Guarese, R., Fayek, H. M., and Zambetta, F. (2024b). Comparing subjective measures of workload in video game play: Evaluating the test-retest reliability of the vgds and nasa-tlx. In Companion Proceedings of the 26th International Conference on Multimodal Interaction, ICMI '24 Companion, page 56–60, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3686215.3690151.

Renata, A., Guarese, R., Takac, M., and Zambetta, F. (2024). Assessment of embodied visuospatial perspective taking in augmented reality: insights from a reaction time task. Frontiers in Virtual Reality, Volume 5 - 2024. DOI: 10.3389/frvir.2024.1422467.

Robinson, R., Wiley, K., Rezaeivahdati, A., Klarkowski, M., and Mandryk, R. L. (2020). ``let's get physiological, physiological!": A systematic review of affective gaming. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play, CHI PLAY '20, page 132–147, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3410404.3414227.

Rutkowski, S., Adamczyk, M., Pastula, A., Gos, E., Luque-Moreno, C., and Rutkowska, A. (2021). Training using a commercial immersive virtual reality system on hand-eye coordination and reaction time in young musicians: A pilot study. International journal of environmental research and public health, 18(3):1297. DOI: 10.3390/ijerph18031297.

Sawan, N., Eltweri, A., De Lucia, C., Pio Leonardo Cavaliere, L., Faccia, A., and Roxana Mocsteanu, N. (2021). Mixed and augmented reality applications in the sport industry. In Proceedings of the 2020 2nd International Conference on E-Business and E-Commerce Engineering, EBEE '20, page 55–59, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3446922.3446932.

Schmidt, S., Ehrenbrink, P., Weiss, B., Voigt-Antons, J.-N., Kojic, T., Johnston, A., and Möller, S. (2018). Impact of virtual environments on motivation and engagement during exergames. In 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX), pages 1-6. DOI: 10.1109/QoMEX.2018.8463389.

Schnotz, W. and Kürschner, C. (2007). A Reconsideration of Cognitive Load Theory. Educational Psychology Review, 19(4):469-508. DOI: 10.1007/s10648-007-9053-4.

Setz, C., Arnrich, B., Schumm, J., La Marca, R., Tröster, G., and Ehlert, U. (2010). Discriminating Stress From Cognitive Load Using a Wearable EDA Device. IEEE Transactions on Information Technology in Biomedicine, 14(2):410-417. DOI: 10.1109/TITB.2009.2036164.

Slater, M. and Sanchez-Vives, M. V. (2016). Enhancing Our Lives with Immersive Virtual Reality. Frontiers in Robotics and AI, 3. DOI: 10.3389/frobt.2016.00074.

Steuer, J. (1992). Defining virtual reality: Dimensions determining telepresence. Journal of Communication, 42(4):73-93. DOI: 10.1111/j.1460-2466.1992.tb00812.x.

Strong, J. V. and Mast, B. T. (2019). The cognitive functioning of older adult instrumental musicians and non-musicians. Aging, Neuropsychology, and Cognition, 26(3):367-386. DOI: 10.1080/13825585.2018.1448356.

Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4(4):295-312. DOI: 10.1016/0959-4752(94)90003-5.

Sweller, J. (2010). Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load. Educational Psychology Review, 22(2):123-138. DOI: 10.1007/s10648-010-9128-5.

Sweller, J. (2011). CHAPTER TWO - Cognitive Load Theory. In Mestre, J. P. and Ross, B. H., editors, Psychology of Learning and Motivation, volume 55, pages 37-76. Academic Press. DOI: 10.1016/B978-0-12-387691-1.00002-8.

Sweller, J., Ayres, P., and Kalyuga, S. (2011). Cognitive Load Theory. Springer New York, New York, NY. DOI: 10.1007/978-1-4419-8126-4.

Sweller, J., van Merrienboer, J. J. G., and Paas, F. G. W. C. (1998). Cognitive Architecture and Instructional Design. Educational Psychology Review, 10(3):251-296. DOI: 10.1023/A:1022193728205.

Takac, M., Collett, J., Conduit, R., and De Foe, A. (2023). A cognitive model for emotional regulation in virtual reality exposure. Virtual Reality, 27(1):159-172. DOI: 10.1007/s10055-021-00531-4.

Talamini, F., Altoè, G., Carretti, B., and Grassi, M. (2017). Musicians have better memory than nonmusicians: A meta-analysis. PLOS ONE, 12(10):e0186773. DOI: 10.1371/journal.pone.0186773.

Tammy Lin, J.-H., Wu, D.-Y., and Bowman, N. (2023). Beat Saber as Virtual Reality Exercising in 360 Degrees: A Moderated Mediation Model of VR Playable Angles on Physiological and Psychological Outcomes. Media Psychology, 26(4):414-435. DOI: 10.1080/15213269.2022.2154806.

Tian, M., Cai, Y., and Zhang, J. (2023). The Impact of Virtual Reality-Based Products on Mild Cognitive Impairment Senior Subjects: An Experimental Study Using Multiple Sources of Data. Applied Sciences, 13(4):2372. Number: 4 Publisher: Multidisciplinary Digital Publishing Institute. DOI: 10.3390/app13042372.

Toft-Nielsen, C. (2016). Gaming Expertise: Doing Gender and Maintaining Social Relationships in the Context of Gamers’ Daily Lives. Nordicom Review, 37(s1):71-83. DOI: 10.1515/nor-2016-0024.

van Delden, R., Bergsma, S., Vogel, K., Postma, D., Klaassen, R., and Reidsma, D. (2020). VR4VRT: Virtual reality for virtual rowing training. In Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play, CHI PLAY '20, page 388–392, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3383668.3419865.

Vanneste, P., Raes, A., Morton, J., Bombeke, K., Van Acker, B. B., Larmuseau, C., Depaepe, F., and Van den Noortgate, W. (2021). Towards measuring cognitive load through multimodal physiological data. Cognition, Technology & Work, 23:567-585. DOI: 10.1007/s10111-020-00641-0.

Wintersberger, P., Matviienko, A., Schweidler, A., and Michahelles, F. (2022). Development and evaluation of a motion-based VR bicycle simulator. Proc. ACM Hum.-Comput. Interact., 6(MHCI). DOI: 10.1145/3546745.

Xu, W., Liang, H.-N., Zhang, Z., and Baghaei, N. (2020). Studying the Effect of Display Type and Viewing Perspective on User Experience in Virtual Reality Exergames. Games for Health Journal, 9(6):405-414. DOI: 10.1089/g4h.2019.0102.

Yannakakis, G. N., Martinez, H. P., and Garbarino, M. (2016). Psychophysiology in games. In Karpouzis, K. and Yannakakis, G. N., editors, Emotion in Games: Theory and Praxis, Socio-Affective Computing, pages 119-137. Springer International Publishing. DOI: 10.1007/978-3-319-41316-7_7.

Yerkes, R. M. and Dodson, J. D. (1908). The relation of strength of stimulus to rapidity of habit-formation. Journal of Comparative Neurology and Psychology, 18(5):459-482. DOI: 10.1002/cne.920180503.

Yeung, A. S., Jin, P., and Sweller, J. (1998). Cognitive load and learner expertise: Split-attention and redundancy effects in reading with explanatory notes. Contemporary Educational Psychology, 23(1):1-21. DOI: 10.1006/ceps.1997.0951.

Yoo, S., Gough, P., and Kay, J. (2020). Embedding a VR game studio in a sedentary workplace: Use, experience and exercise benefits. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, CHI '20, page 1–14, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3313831.3376371.