A Conceptual Framework for the Design and Evaluation of Learner Experience Across the Learning Lifecycle
DOI:
https://doi.org/10.5753/rbie.2026.7845Keywords:
Learner eXperience, LX design, LX evaluationAbstract
Learner Experience (LX) aims to make learning more meaningful by accounting for motivational, social, and contextual factors. To support professors in the systematic design and evaluation of LX, we propose the Learner Experience Design and Evaluation Framework (LEDEF), a conceptual framework that integrates LEDG design guidelines and the LEEM evaluation model, focusing on the entire learning experience lifecycle. This paper presents a process for creating LEDEF oriented by Design Science Research (DSR), including a case study that investigates the applicability of LEDEF in an undergraduate course on Algorithms and Programming Techniques at a Brazilian university, involving one professor and a class of learners. The professor was responsible for designing and redesigning the learning activity using LEDEF and for assessing the LX throughout the process. Data were collected using checklists applied at different stages of the LX lifecycle and a semi-structured interview with the professor. The findings indicate that interactions mediated by computational resources positively influenced the learning experience, particularly in terms of efficiency and learner satisfaction. However, social interactions emerged as a critical challenge. Even in a context where learners were comfortable with technology, difficulties in communication and interpersonal skills adversely affected the LX. The main results include the development of three technologies to support educators, designers, and researchers. Overall, LEDEF enabled the professor to identify these issues and implement small, iterative interventions during the course, supporting continuous improvement of the learning experience.
Downloads
Referências
Arachchi, T. K., Sitbon, L., & Zhang, J. (2017). Enhancing access to eLearning for people with intellectual disability: Integrating usability with learning. Human-Computer Interaction-INTERACT 2017: 16th IFIP TC 13 International Conference, Mumbai, India, September 25-29, 2017, Proceedings, Part II 16, 13–32. DOI: https://doi.org/10.1007/978-3-319-67684-5. [GS Search]
Bevan, N., Carter, J., Earthy, J., Geis, T., & Harker, S. (2016). New iso standards for usability, usability reports and usability measures. Human-Computer Interaction. Theory, Design, Development and Practice: 18th International Conference, HCI International 2016, Toronto, ON, Canada, July 17-22, 2016. Proceedings, Part I 18, 268–278. DOI: https://doi.org/10.1007/978-3-319-39510-4_25 . [GS Search]
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative research in psychology, 3(2), 77–101. DOI: https://doi.org/10.1191/1478088706qp063oa. [GS Search]
Bulcão, J. d. S. B., Madeira, C. A. G., Guimarães, C. A. S., & de Sousa, C. A. (2021). Capacitando professores no programa norte-rio-grandense de pensamento computacional. Revista Brasileira de Informática na Educação, 29, 1178–1201. DOI: https://doi.org/10.5753/rbie.2021.2120. [GS Search]
Caldiera, V. R. B. G., & Rombach, H. D. (1994). The goal question metric approach. Encyclopedia of software engineering, 528–532. [GS Search]
Campos, T. P. D., Damasceno, E. F., & Valentim, N. M. C. (2022). Porifera: A collaborative tool to support systematic literature review and systematic mapping study. Proceedings of the XXXVI Brazilian Symposium on Software Engineering, 452–457. DOI: https://doi.org/10.1145/3555228.355527. [GS Search]
Capuano, N., Pierri, A., Colace, F., Gaeta, M., & Mangione, G. R. (2009). A mash-up authoring tool for e-learning based on pedagogical templates. Proceedings of the first ACM international workshop on Multimedia technologies for distance learning, 87–94. DOI: https://doi.org/10.1145/1631111.1631126. [GS Search]
Dewey, J. (1986). Experience and education. The educational forum, 50(3), 241–252. DOI: https://doi.org/10.1080/00131728609335764. [GS Search]
dos Santos, G., Silva, D., Peres, L. M., & Valentim, N. M. C. (2024). Case study of a model that evaluates the learner experience with dicts. Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, 1–9. DOI: https://doi.org/10.1145/3613905.363713. [GS Search]
dos Santos, G., Silva, D., & Valentim, N. (2025). Learner experience evaluation: A feasibility study and a benchmark. Journal of the Brazilian Computer Society, 31(1), 132–153. DOI: https://doi.org/10.5753/jbcs.2025.4306. [GS Search]
dos Santos, G., Silva, D. E., & Valentim, N. M. (2023a). Feasibility study of a model that evaluates the learner experience: A quantitative and qualitative analysis. XXII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais, 1–11. DOI: https://doi.org/10.1145/3638067.36381. [GS Search]
dos Santos, G., Silva, D. E., & Valentim, N. M. (2023b). Proposal and preliminary evaluation of a learner experience evaluation model in information systems. Proceedings of the XIX Brazilian Symposium on Information Systems, 308–316. DOI: https://doi.org/10.1145/3592813.3592919. [GS Search]
dos Santos, G., Silva, D. E. d. S., Peres, L. M., & Valentim, N. M. (2024). Acceptance analysis of a learner experience evaluation model. Simpósio Brasileiro de Informática na Educação (SBIE), 1057–1070. DOI: https://doi.org/10.5753/sbie.2024.241385. [GS Search]
dos Santos, G., Silva, D. E. d. S., & Valentim, N. M. (2022). Um mapeamento sistemático da literatura sobre iniciativas que avaliam a experiência do aprendiz. Anais do XXXIII Simpósio Brasileiro de Informática na Educação, 621–633. DOI: https://doi.org/10.5753/sbie.2022.224673. [GS Search]
El Mawas, N., Tal, I., Moldovan, A.-N., Bogusevschi, D., Andrews, J., Muntean, G.-M., & Muntean, C. H. (2020). Investigating the impact of an adventure-based 3d solar system game on primary school learning process. Knowledge Management & E-Learning: An International Journal, 12(2), 165–190. DOI: https://doi.org/10.34105/j.kmel.2020.12.009. [GS Search]
Georgiou, Y., & Ioannou, A. (2021). Developing, enacting and evaluating a learning experience design for technology-enhanced embodied learning in math classrooms. TechTrends, 65(1), 38–50. DOI: https://doi.org/10.1007/s11528-020-00543-y. [GS Search]
Granić, A., & Čukušić, M. (2007). Universal design within the context of e-learning. Universal Access in Human-Computer Interaction. Applications and Services: 4th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2007 Held as Part of HCI International 2007 Beijing, China, July 22-27, 2007 Proceedings, Part III 4, 617–626. DOI: https://doi.org/10.1007/978-3-540-73283-9_68. [GS Search]
Huang, R., Hu, Y., & Yang, J. (2015). Improving learner experience in the technology-rich classrooms. Ubiquitous learning environments and technologies, 243–258. DOI: https://doi.org/10.1007/978-3-662-44659-1_13. [GS Search]
Huang, R., Spector, J. M., & Yang, J. (2019). Educational technology a primer for the 21st century. Springer. DOI: https://doi.org/10.1007/978-981-13-6643-7. [GS Search]
Kitchenham, B. A., Budgen, D., & Brereton, P. (2016). Evidence-based software engineering and systematic reviews. [GS Search]
Magyar, N., & Haley, S. R. (2020). Balancing learner experience and user experience in a peer feedback web application for MOOCs. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 1–8. DOI: https://doi.org/10.1145/3334480.337523. [GS Search]
Martin, C., Hughes, J., & Richards, J. (2017). Learning dimensions: Lessons from field studies. Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education, 299–304. DOI: https://doi.org/10.1145/3059009.305904. [GS Search]
Melo, A. A. S., & Oliveira Junior, R. (2025). Base Nacional Comum Curricular de Computação (BNCC Computação) na Conferência Nacional de Educação (conae 2024). Revista Brasileira de Informática na Educação, 33, 672–691. https://doi.org/10.5753/rbie.2025.4642 [GS Search]
Miller, B. (2014). Six dimensions of learner experience design. Retrieved March, 18, 2026. [GS Search]
Monib, W. K., Qazi, A., & Mahmud, M. M. (2024). Exploring learners’ experiences and perceptions of chatgpt as a learning tool in higher education. Education and Information Technologies, 30(1), 917–939. DOI: https://doi.org/10.1007/s10639-024-13065-4 . [GS Search]
Ortiz, J., Junior, D. S., Oliveira, C. M., & Pereira, R. (2019). Pensamento computacional e cultura digital: Discussões sobre uma prática para o letramento digital. Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação - SBIE), 30(1), 1241. DOI: https://doi.org/10.5753/cbie.sbie.2019.1241. [GS Search]
Papavlasopoulou, S., Giannakos, M. N., & Jaccheri, L. (2019). Exploring children’s learning experience in constructionism-based coding activities through design-based research. Computers in Human Behavior, 99, 415–427. DOI: https://doi.org/10.1016/j.chb.2019.01.008. [GS Search]
Pawson, R., & Tilley, N. (2001). Realistic evaluation bloodlines. American Journal of Evaluation, 22(3), 317–324. DOI: https://doi.org/10.1177/109821400102200305. [GS Search]
Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015). Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology, 64, 1–18. [GS Search]
Pimentel, M., Filippo, D., & Santoro, F. M. (2019). Design science research: Fazendo pesquisas científicas rigorosas atreladas ao desenvolvimento de artefatos computacionais projetados para a educação. Metodologia de Pesquisa em Informática na Educação: Concepção da Pesquisa. Porto Alegre: SBC. [GS Search]
Recke, M. P., Perna, S., & Pereira, T. G. (2021). Designing narratively driven learning activities for blended learning experiences. 2021 9th International Conference on Information and Education Technology (ICIET), 171–177. DOI: https://doi.org/10.1109/ICIET51873.2021.9419659. [GS Search]
Santos, G., & Valentim, N. (2025). Percepções e experiências sobre o ensino e aprendizado de uma disciplina de ihc com foco em práticas colaborativas. Anais do Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (IHC), 173–195. DOI: https://doi.org/10.5753/ihc.2025.10847. [GS Search]
Schmidt, M., & Huang, R. (2022). Defining learning experience design: Voices from the field of learning design & technology. TechTrends, 66(2), 141–158. DOI: https://doi.org/10.1007/s11528-021-00656-y. [GS Search]
Shi, L. (2014). Defining and evaluating learner experience for social adaptive e-learning. Imperial College Computing Student Workshop. DOI: https://doi.org/10.4230/OASIcs.ICCSW.2014.74. [GS Search]
Silva, D., Conte, T., & Valentim, N. (2024). A systematic mapping study about learner experience design in computational systems. Informatics in Education, 23(2), 439–478. DOI: https://doi.org/10.15388/infedu.2024.12. [GS Search]
Silva, D., Conte, T. U., Guerino, G. C., & Valentim, N. M. C. (2025). From design to evaluation: A case study on learner experience. 20th IFIP TC13 International Conference on Human-Computer Interaction (Interact) - accepted for publication. DOI: https://doi.org/10.1007/978-3-032-05002-1_22. [GS Search]
Silva, D., Conte, T. U., & Valentim, N. M. C. (2024). Learner experience design guidelines: Proposal and a preliminary evaluation with experts. Simpósio Brasileiro de Informática na Educação (SBIE), 2922–2930. DOI: https://doi.org/10.5753/sbie.2024.244888. [GS Search]
Silva, D., Guerino, G., & Valentim, N. (2022). Ensino remoto emergencial da disciplina ihc experimental: Uma análise baseada na experiência do aprendiz. Anais do XXX Workshop sobre Educação em Computação, 215–226. DOI: https://doi.org/10.5753/wei.2022.222577. [GS Search]
Silva, D., Guerino, G. C., & Valentim, N. M. (2023). Analyzing the learners’ experience of an experimental hci course in a remote context. Journal on Interactive Systems, 14(1), 341–353. DOI: https://doi.org/10.5753/jis.2023.3243. [GS Search]
Silva, D. E., Sobrinho, M. C., & Valentim, N. M. (2020). Educação 4.0: Um estudo de caso com atividades de computação desplugada na Amazônia brasileira. Anais do Computer on the Beach, 11, 141–147. DOI: https://doi.org/10.14210/cotb.v11n1.p141-147. [GS Search]
Silva, D. E., & Valentim, N. M. C. (2023). Projeto e avaliação da experiência do aprendiz em sistemas computacionais. Simpósio Brasileiro de Educação em Computação (EDUCOMP), 36–37. https://doi.org/10.5753/educomp_estendido.2023.229055 [GS Search]
Soares, L. E., Clementino Júnior, J. M., Brito, L. A. V., Gonzaga, R. G., Antico, H. A., Azevedo, R. J. d., & Macedo, A. A. (2023). Usabilidade dos ambientes virtuais de aprendizagem canvas e blackboard: Caso de estudo em uma universidade brasileira. Revista Brasileira de Informática na Educação, 31, 149–173. DOI: https://doi.org/10.5753/rbie.2023.2921. [GS Search]
Venkatesh, V., & Bala, H. (2008). Technology acceptance model 3 and a research agenda on interventions. Decision sciences, 39(2), 273–315. DOI: https://doi.org/10.1111/j.1540-5915.2008.00192.x. [GS Search]
Yates, J., Davidson, C. A., Orchard, T., Burke, S. M., & Mantler, T. (2026). “i watched my child become half of the person they were”: Emergency remote learning experiences among primary caregivers of elementary school children during the covid-19 pandemic. Journal of Education, 206(1), 60–71. DOI: https://doi.org/10.1177/00220574251349795. [GS Search]
Zhang, D., Yang, Y., Ji, T., Xie, H., & He, Y. (2018). Designing craft learning experience for rural children: A case study on huayao cross-stitch in southwest china. Cross-Cultural Design. Applications in Cultural Heritage, Creativity and Social Development: 10th International Conference, CCD 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA, July 15-20, 2018, Proceedings, Part II 10, 117–132. DOI: https://doi.org/10.1007/978-3-319-92252-2_9. [GS Search]
Arquivos adicionais
Published
Como Citar
Issue
Section
Licença
Copyright (c) 2026 Deivid Eive Silva, Tayana Conte, Natasha Valentim

Este trabalho está licenciado sob uma licença Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

