Accessible Harmony: Enhancing Music Education for Deaf Children with Artificial Intelligence
DOI:
https://doi.org/10.5753/rbie.2025.5944Keywords:
Deaf music education, Assistive technology, Artificial intelligence in music, Social inclusionAbstract
This study explores the use of artificial intelligence to promote digital inclusion in the musical education of deaf children. We developed an innovative system that integrates tactile and visual feedback, along with interactions with educational robots, creating an inclusive learning environment. Artificial intelligence monitors children's performance and emotional responses in real time, dynamically adjusting activity difficulty to personalize the learning experience. We applied an experimental methodology with seven deaf children, comparing the system’s impact with traditional teaching methods. Quantitative and qualitative methods were used to assess gesture accuracy, engagement levels, and emotional and social effects. The results indicated that the AI-based system improved gesture accuracy by 30% and increased engagement and motivation by 40% compared to conventional methods. Longitudinal analyses demonstrated that multisensory learning enhances musical knowledge retention even after long intervals, reinforcing the system’s effectiveness. These findings highlight the transformative potential of artificial intelligence in inclusive musical education, expanding learning opportunities for deaf children. The project suggests promising directions for future research and innovations in assistive technology, contributing to a more equitable and accessible educational environment.
Downloads
References
Abadi, M., and et al. (2016). TensorFlow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI), p. 265–283. Disponível em: [link] [GS Search]
Baker, R. S., and Inventado, P. S. (2014). Educational data mining and learning analytics. In Learning Analytics. Springer, p. 61–75. Disponível em: [link] [GS Search]
Braun, V., and Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), p. 77–101. Disponível em: [link] [GS Search]
Cook, A. M., and Polgar, J. M. (2015). Assistive Technologies: Principles and Practice. 4. ed. St. Louis: Elsevier. Disponível em: [link] [GS Search]
Costa, M. S., and Oliveira, J. V. (2020). Tecnologias assistivas na educação inclusiva: um olhar pedagógico. Revista Educação Especial, 33(65), p. 145–160. Disponível em: [link] [GS Search]
Darrow, A. A., and Heller, G. N. 1985). Music and the hearing impaired: A review of literature and recommendations for music educators. Update: Applications of Research in Music Education, 4(2), p. 6–10. Disponível em: [link] [GS Search]
Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, v. 1, p. 4171–4186. Association for Computational Linguistics. https://doi.org/10.48550/arXiv.1810.04805 [GS Search]
Eguchi, A. (2014). Robotics as a learning tool for educational transformation. In Proceedings of the 4th International Workshop Teaching Robotics, Teaching with Robotics. Disponível em: [link] [GS Search]
Goldstein, E. B. (2010). Sensação e Percepção. 8. ed. São Paulo: Cengage Learning. Disponível em: [link] [GS Search]
Gonzalez, A., Morales, A., and Rivera, J. (2017). VibroFeel: a tactile music perception system for deaf and hard-of-hearing users. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. Disponível em: [link] [GS Search]
Kay, J.; Reimann, P., Diebold, E., and Kummerfeld, B. (2017). MOOCs: So many learners, so much potential... IEEE Intelligent Systems, 32(1), p. 70–77. https://doi.org/10.1109/MIS.2017.23 [GS Search]
Lee, J. Y., and Chen, C. (2013). Music Touch: Enhancing musical experience for hearing-impaired people through vibration. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. Disponível em: [link] [GS Search]
Mahler, A. R. (2016). Deaf musicians and musical experience. In: LEONARD, J.; NEUMEYER, M. (orgs.). The Oxford Handbook of Music and Disability Studies. Oxford University Press, p. 340–355. Disponível em: [link] [GS Search]
Makeblock. (2018). mBot Educational Robot Kit User Manual. Shenzhen: Makeblock Co. Disponível em: [link] [GS Search]
Mendes, L. F., and Souza, M. R. (2019). Tecnologia assistiva no ensino de artes: possibilidades e desafios. Revista Brasileira de Educação Especial, 25(3), p. 435–452. Disponível em: [link] [GS Search]
Muska, J. A. (2014). Mapeamento das respostas neurocognitivas à música em pessoas com deficiência auditiva. Journal of Music Therapy, 51(2), p. 121–136. Disponível em: [link] [GS Search]
Nielsen, J. (1993). Usability Engineering. Boston: Morgan Kaufmann. Disponível em: [link] [GS Search]
Pan, S. J., and Yang, Q. (2010). A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering, 22(10), p. 1345–1359. Disponível em: [link] [GS Search]
Papert, S. (1980). Mindstorms: Children, Computers, and Powerful Ideas. New York: Basic Books. Disponível em: [link] [GS Search]
Poria, S., Cambria, E., and Gelbukh, A. (2017). Aspect extraction for opinion mining with a deep convolutional neural network. Knowledge-Based Systems, 108, p. 42–49. Disponível em: [link] [GS Search]
Shibata, D. K. (2001). Functional MRI study of auditory cortex activation by vibrotactile stimuli in deaf subjects. NeuroReport, 12(7), p. 121–127. Disponível em: [link] [GS Search]
Swanwick, K. (1999). Teaching Music Musically. London: Routledge. Disponível em: [link] [GS Search]
Woolf, B. P. et al. (2013). AI grand challenges for education. AI Magazine, 34(4), p. 66–84. Disponível em: [link] [GS Search]
Zhou, Q., Song, Y., and Shu, K. (2020). TeachAI: An AI-based personalized learning system. In IEEE International Conference on Artificial Intelligence in Education (AIEd). Disponível em: [link] [GS Search]
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Cristiano da Silva Benites; Ismar Frango Silveira
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
