Development and Accessibility Automatic Assessment of ADA Blocks: A Virtual Assistant that Supports the Choice of Block Programming Tools

Authors

DOI:

https://doi.org/10.5753/rbie.2025.4630

Keywords:

ADA Blocks, Virtual Assistant, Accessibility, Automatic Evaluators, Block Programming

Abstract

Currently, personalized learning is sought to encourage 21st Century skills and competencies in students, such as logical reasoning and computational thinking. Block programming can support this process. However, it was noticed that teachers, such as those in high school, have difficulties in choosing programming tools depending on their context of use. Therefore, the ADA Blocks virtual assistant was developed to assist teachers in choosing block programming tools. The ADA Blocks development methodology includes systematic mapping study, preliminary and feasibility studies, and accessibility automatic evaluation. As a result of the feasibility study, the usefulness, ease of use, and limitations of ADA Blocks were identified.
The automated accessibility assessment, performed with tools such as AccessMonitor and ASES, identified technical and content issues. Based on these findings, the assistant was improved, with adjustments such as hierarchical text organization and the insertion of textual references in images for assistive technologies ('alt' attribute). After the improvements, a new automatic evaluation showed a significant increase in accessibility scores, rising from 61.57% to 88.41% on ASES and from 5.2 to 6.9 on AccessMonitor. Finally, ADA Blocks demonstrated positive accessibility results in its new version.
This work fills a gap in the literature, being the first to evaluate the accessibility of virtual assistants for recommending block programming tools. Future prospects include evaluation with users with disabilities and experts, eventually identifying usability issues and refining the assistant based on user feedback.

Descargas

Los datos de descargas todavía no están disponibles.

Citas

Albert, B., & Tullis, T. (2022). Measuring the user experience: Collecting, analyzing, and presenting UX metrics. Interactive Technologies. https://doi.org/10.1016/C2018-0-00693-3 [GS Search].

ASES. (2018). Avaliador e simulador de acessibilidade em sítios - ASES. Disponível em: [Link]. Acesso em: 13 jun. 2024.

Basili, V. R., & Rombach, H. D. (1988). Towards a comprehensive framework for reuse: A reuse-enabling software evolution environment (tech. rep.). University of Maryland. College Park, MD, USA. [GS Search].

BNCC. (2018). Base nacional comum curricular. Disponível em: [Link]. Acesso em: 13 jun. 2024.

Brasil. (2004). Decreto n° 5.296 de 02 de dezembro de 2004. [Link]. Acesso em: 13 jun. 2024.

Burnett, M. M., & McIntyre, D. W. (1995). Visual programming. Computer-Los Alamitos-, 28, 14-14. Disponível em: [Link]. Acesso em: 13 jun. 2024. [GS Search].

Cabral, A. L. T., Lima, N. V., & Albert, S. (2019). TDIC na educação básica: Perspectivas e desafios para as práticas de ensino da escrita. Trabalhos em Linguística Aplicada, 58(3), 1134-1163. https://doi.org/10.1590/01031813554251420190620 [GS Search].

Cárdenas-Cobo, J., Vidal-Silva, C., Arévalo, L., & Torres, M. (2024). Applying recommendation system for developing programming competencies in children from a non-WEIRD context. Education and Information Technologies, 29(8), 9355-9386. https://doi.org/10.1007/s10639-023-12156-y [GS Search].

Corbin, J., & Strauss, A. (2014). Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage Publications. [GS Search].

eMAG. (2014). Modelo de acessibilidade em governo eletrônico. Disponível em: [Link]. Acesso em: 13 jun. 2024.

Ferreira, R. W. C., & Sant'Ana, C. C. (2025). Jogos de matemática no Scratch: Relato de um minicurso promovido com vistas a contribuir com a formação docente. Educação Matemática em Revista, 30(86), 1-17. https://doi.org/10.37001/emr.v30i86.4227 [GS Search].

Führ, R. C., & Haubenthal, W. R. (2019). Educação 4.0 e seus impactos no século XXI. Educação no Século XXI - Volume 36 Tecnologia, 61-78. [GS Search].

Guggemos, J., Seufert, S., & Román-González, M. (2019). Measuring computational thinking-adapting a performance test and a self-assessment instrument for German-speaking countries. Proceedings of the 16th International Conference Cognition and Exploratory Learning in the Digital Age, 183-191. https://doi.org/10.33965/celda2019_201911L023 [GS Search].

Haduong, P., & Brennan, K. (2019). Helping K-12 teachers get unstuck with Scratch: The design of an online professional learning experience. Proceedings of the 50th ACM Technical Symposium on Computer Science Education, 1095-1101. https://doi.org/10.1145/3287324.3287479 [GS Search].

Himmetoğlu, B., Ayduğ, D., & Bayrak, C. (2020). Education 4.0: Defining the teacher, the student, and the school manager aspects of the revolution. Turkish Online Journal of Distance Education, 21(Special Issue), 1-20. https://doi.org/10.17718/tojde.770896 [GS Search].

Hudin, S. S., & Adii, A. (2024). Programming challenges experience by primary school students: A systematic literature review. International Journal of Academic Research in Progressive Education and Development, 13(4), 489-502. [Link]

Hyury, A., & Jailton, J. (2025). Formação docente e pensamento computacional: Desafios na utilização do Scratch no ensino médio técnico. Anais do XXXIII Workshop sobre Educação em Computação, 746-757. https://doi.org/10.5753/wei.2025.8526 [GS Search].

IBGE. (2010). Pessoas com deficiência no Brasil em 2010. Disponível em: [Link]. Acesso em: 13 jun. 2024.

IBGE. (2022). Pessoas com deficiência no Brasil em 2022. Disponível em: [Link]. Acesso em: 13 jun. 2024.

ISO. (2003). ISO/TS 16071: Ergonomics of human-system interaction - guidance on accessibility for human-computer interfaces. Disponível em: [Link]. Acesso em: 13 jun. 2024.

Jocius, R., Joshi, D., Dong, Y., Robinson, R., Cateté, V., Barnes, T., Albert, J., Andrews, A., & Lytle, N. (2020). Code, connect, create: The 3C professional development model to support computational thinking infusion. Proceedings of the 51st ACM Technical Symposium on Computer Science Education, 971-977. https://doi.org/10.1145/3328778.3366797 [GS Search].

Kitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering (tech. rep.) (Disponível em: [Link]. Acesso em: 13 jun. 2024). Keele University and University of Durham. Keele, UK. [GS Search].

Lee, I., & Malyn-Smith, J. (2020). Computational thinking integration patterns along the framework defining computational thinking from a disciplinary perspective. Journal of Science Education and Technology, 29(1), 9-18. https://doi.org/10.1007/s10956-019-09802-x [GS Search].

Lemos, S. K. S., Teixeira, L. N. B., & Kafure, I. (2019). Acessível para quem? uma análise da acessibilidade em sítios institucionais. Brazilian Journal of Development, 5(6), 4976-4989. https://doi.org/10.34117/bjdtv5n6-0052 [GS Search].

Medeiros, R. P., Ramalho, G. L., & Falcão, T. P. (2019). A systematic literature review on teaching and learning introductory programming in higher education. IEEE Transactions on Education, 62(2), 77-90. https://doi.org/10.1109/TE.2018.2864133 [GS Search].

Nielsen, J. (2007). Usabilidade na web. Elsevier Brasil. [GS Search].

Papadakis, S., & Orfanakis, V. (2018). Comparing novice programing environments for use in secondary education: App Inventor for Android vs. Alice. International Journal of Technology Enhanced Learning, 10(1-2), 44-72. https://doi.org/10.1504/IJTEL.2018.088333 [GS Search].

Penn State University. (2023). Language tags in HTML: Declaring page language. Disponível em: [Link]. Acesso em: 13 jun. 2024.

Perin, A., Silva, D., & Valentim, N. (2023). ADA blocks: Assistente virtual para apoiar professores na escolha de ferramentas de programação em blocos. Anais Estendidos do XII Congresso Brasileiro de Informática na Educação, 137-140. https://doi.org/10.5753/cbie_estendido.2023.233147 [GS Search].

Perin, A., Silva, D. E., & Valentim, N. (2021). Um benchmark de ferramentas de programação em blocos que podem ser utilizadas nas salas de aula do ensino médio. Anais do XXXII Simpósio Brasileiro de Informática na Educação, 1162-1173. https://doi.org/10.5753/sbie.2021.217765 [GS Search].

Perin, A., Silva, D. E., & Valentim, N. (2022). Um estudo de viabilidade sobre a assistente virtual ADA blocks com professores do ensino médio. Anais do XXXIII Simpósio Brasileiro de Informática na Educação, 1243-1254. https://doi.org/10.5753/sbie.2022.224682 [GS Search].

Perin, A., Silva, D. E., & Valentim, N. M. C. (2023). Investigating block programming tools in high school to support education 4.0: A systematic mapping study. Informatics in Education, 22(3), 463-498. https://doi.org/10.15388/infedu.2023.21 [GS Search].

Perin, A., Silva, D. E., & Valentim, N. M. (2021). Experiência de docentes do ensino médio em conduzir atividades remotas durante o distanciamento social: Uma análise baseada no contexto da educação 4.0. Anais do Computer on the Beach, 12, 141-148. https://doi.org/10.14210/cotb.v12.p141-148 [GS Search].

Perin, A., Silva, D. E., & Valentim, N. M. C. (2022). Investigating the teaching of block programming in high school. XVIII Brazilian Symposium on Information Systems. https://doi.org/10.1145/3535511.3535543 [GS Search].

Pivetta, E. M., Saito, D. S., & Ulbricht, V. R. (2014). Surdos e acessibilidade: Análise de um ambiente virtual de ensino e aprendizagem. Revista Brasileira de Educação Especial, 20(1), 147-162. https://doi.org/10.1590/S1413-65382014000100011 [GS Search].

Rios, L. K. S., Junior, A. O. C., Lima, J. P. F., Guedes, E. B., & Silva, C. A. (2019). Uma análise comparativa entre ambientes de programação em blocos para a interação com o Arduino. Anais do Simpósio Ibero-Americano de Tecnologias Educacionais, 345-356. [GS Search].

SBC. (2018). Diretrizes para o ensino de computação na educação básica [Disponível em: [Link]. Acesso em: 13 jun. 2024]. [GS Search].

Silva, D. E., Lopes, T., Corrêa Sobrinho, M., & Valentim, N. M. C. (2020). Educação 4.0: Um estudo de caso com atividades de computação desplugada na amazônia brasileira. Anais do Computer on the Beach, 11, 141-147. https://doi.org/10.14210/cotb.v11n1.p141-147 [GS Search].

Silva, E. H. (2021). Análise de acessibilidade dos ambientes virtuais de aprendizagem (AVAs) do IFPE de acordo com as aplicações e padrões web, voltado para pessoas com deficiência visual[Bachelor's Thesis]. Instituto Federal de Ciência e Tecnologia de Pernambuco - IFPE Campus Jaboatão dos Guararapes. [GS Search].

Souza, E. R., & Mont'Alvão, C. (2012). Web accessibility: Evaluation of a website with different semi-automatic evaluation tools. Work, 41(1), 1567-1571. https://doi.org/10.3233/WOR-2012-0354-1567 [GS Search].

Souza, M. V. R., & França, A. C. C. (2013). Um estudo sobre as dificuldades no processo de aprendizagem de programação no curso de Análise e Desenvolvimento de Sistemas na FAFICA - Faculdade de Filosofia, Ciências e Letras de Caruaru-PE. Revista da Escola Regional de Informática, 2(2), 19-27. [GS Search].

Viana, W., Araújo, M., Façanha, A., Pequeno, H., Fontenele, T., & Matos, B. (2017). Análise de acessibilidade no ambiente virtual de aprendizagem solar - um estudo de caso para usuários com deficiência visual. Nuevas Ideas en Informática Educativa, 281-289. [GS Search].

Vigo, M., & Brajnik, G. (2011). Automatic web accessibility metrics: Where we are and where we can go. Interact. Comput., 23(2), 137-155. https://doi.org/10.1016/j.intcom.2011.01.001 [GS Search].

Vinayakumar, R., Soman, K. P., & Menon, P. (2018). Fractal geometry: Enhancing computational thinking with MIT Scratch. 2018 9th International Conference on Computing, Communication and Networking Technologies (ICCCNT), 1-6. https://doi.org/10.1109/ICCCNT.2018.8494096 [GS Search].

W3C. (2008). Web Content Accessibility Guidelines (WCAG) 2.0. Disponível em: [Link]. Acesso em: 13 jun. 2024.

W3C. (2023). Declaring language in HTML. Disponível em: [Link]. Acesso em: 13 jun. 2024.

W3C. (2024). Scripts: The NOSCRIPT element. Disponível em: [Link]. Acesso em: 13 jun. 2024.

Wing, J. M. (2006). Computational thinking. Communications of the ACM, 49(3), 33-35. https://doi.org/10.1145/1118178.1118215 [GS Search].

Yett, B., Hutchins, N., Stein, G., Zare, H., Snyder, C., Biswas, G., Metelko, M., & Ledeczi, A. (2020). A hands-on cybersecurity curriculum using a robotics platform. Proceedings of the 51st ACM Technical Symposium on Computer Science Education, 1040-1046. https://doi.org/10.1145/3328778.3366878 [GS Search].

Yu, Q., Yu, K., & Li, B. (2025). Effects of block-based visual programming on K-12 students' learning outcomes. Journal of Educational Computing Research, 63(1), 64-98. https://doi.org/10.1177/07356331241293163 [GS Search].

Zaffalon, F., Prisco, A., Souza, R., Teixeira, D., Paes, W., Evald, P., Tonin, N., Devincenzi, S., & Botelho, S. (2022). A recommender system of computer programming exercises based on student's multiple abilities and skills model. 2022 IEEE Frontiers in Education Conference (FIE), 1-8. https://doi.org/10.1109/FIE56618.2022.9962646 [GS Search].

Archivos adicionales

Published

2025-10-15

Cómo citar

PERIN, A. P. J.; SILVA, D. E. S.; VALENTIM, N. M. C. Development and Accessibility Automatic Assessment of ADA Blocks: A Virtual Assistant that Supports the Choice of Block Programming Tools. Revista Brasileña de Informática en la Educación, [S. l.], v. 33, p. 1448–1483, 2025. DOI: 10.5753/rbie.2025.4630. Disponível em: https://journals-sol.sbc.org.br/index.php/rbie/article/view/4630. Acesso em: 5 dic. 2025.

Issue

Section

Artículos Premiados :: CBIE