Do They Understand What We Want? A Study on the Perception of Students in a Gamified Educational System
DOI:
https://doi.org/10.5753/rbie.2023.3118Keywords:
Gamification, Implemented gamification, Perceived gamification, Gamified educational systems, Quantitative studyAbstract
Recent studies point to gamification as a resource capable of increasing student motivation and engagement in educational environments. However, an important current challenge is to understand how the implemented gamification is perceived by end users. To face this challenge, in this research, we conducted an observational study (cross-sectional, descriptive, and temporally prospective) analyzing the perception of 61 post-graduate students regarding the gamification implemented in a gamified educational system (used for 23 months) as well as, the psychological and behavioral effects of gamification on students. The main results indicate that i) students had different perceptions of the gamification elements implemented in the system and ii) they present different positive psychological and behavioral effects resulting from gamification. The study results especially contribute to the areas of educational technologies and gamification in education, providing insights related to the design of gamified education systems.
Downloads
References
Alabbasi, D. (2017). Exploring graduate students’ perspectives towards using gamification techniques in online learning. Turkish Online Journal of Distance Education, 18(3), 180-196. doi: 10.17718/tojde.328951. [GS Search]
Alabbasi, D. (2018). Exploring Teachers' Perspectives towards Using Gamification Techniques in Online Learning. Turkish Online Journal of Educational Technology-TOJET, 17(2), 34-45. [GS Search]
Andrade, F. R., Mizoguchi, R., & Isotani, S. (2016, June). The bright and dark sides of gamification. In International conference on intelligent tutoring systems (pp. 176-186). Springer, Cham. doi: 10.1007/978-3-319-39583-8_17. [GS Search]
Antonaci, A., Klemke, R., & Specht, M. (2019, August). The effects of gamification in online learning environments: A systematic literature review. In Informatics (Vol. 6, No. 3, p. 32). MDPI. doi: 10.3390/informatics6030032. [GS Search]
Bai, S., Hew, K. F., & Huang, B. (2020). Does gamification improve student learning outcome? Evidence from a meta-analysis and synthesis of qualitative data in educational contexts. Educational Research Review, 30, 100322. doi: 10.1016/j.edurev.2020.100322. [GS Search]
Cheong, C., Filippou, J., & Cheong, F. (2013). Understanding student perceptions of game elements to develop gamified systems for learning. [GS Search]
Cheong, C., Filippou, J., & Cheong, F. (2014). Towards the gamification of learning: Investigating student perceptions of game elements. Journal of Information Systems Education, 25(3), 233. [GS Search]
Costa, A. C. S., & Marchiori, P. Z. (2015). Gamificação, elementos de jogos e estratégia: uma matriz de referência. InCID: Revista de Ciência da Informação e Documentação, 6(2), 44-65. doi: 10.11606/issn.2178-2075.v6i2p44-65. [GS Search]
De-Marcos, L., Domínguez, A., Saenz-de-Navarrete, J., & Pagés, C. (2014). An empirical study comparing gamification and social networking on e-learning. Computers & education, 75, 82-91. doi: 10.1016/j.compedu.2014.01.012. [GS Search]
Denden, M., Tlili, A., Essalmi, F., & Jemni, M. (2017, December). An investigation of the factors affecting the perception of gamification and game elements. In 2017 6th international conference on Information and Communication Technology and Accessibility (ICTA) (pp. 1-6). IEEE. doi: 10.1109/ICTA.2017.8336019 . [GS Search]
Denden, M., Tlili, A., Essalmi, F., & Jemni, M. (2018, July). Does personality affect students' perceived preferences for game elements in gamified learning environments?. In 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT) (pp. 111-115). IEEE. doi: 10.1109/ICALT.2018.00033 . [GS Search]
Denny, P. (2013, April). The effect of virtual achievements on student engagement. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 763-772). doi: 10.1145/2470654.2470763 . [GS Search]
Favero, R. V. M., & Franco, S. R. K. (2006). Um estudo sobre a permanência e a evasão na Educação a Distância. Renote, 4(2). [GS Search]
Ferreira, M., Costa, M. R. M., & Mill, D. (2021). Reflexões necessárias e urgentes acerca da gestão da EAD no Brasil. Plurais Revista Multidisciplinar, 6(3). doi: 10.29378/plurais.2447-9373.2021.v6.n3.13242. [GS Search]
Fonsêca, C. G. R., Fonsêca, A. G. R., & de Brito, A. H. (2021). O desafio de se manter motivado a estudar em meio à pandemia: percepção de alunos piauiense de universidade pública na modalidade EAD. Brazilian Journal of Development, 7(12), 116698-116714. doi: 10.34117/bjdv7n12-431. [GS Search]
Galasso, B. (2014). A gestão em EAD e seus múltiplos aspectos: os desafios na implementação de um curso online. In XI Congresso Brasileiro de Ensino Superior a Distância–ESUD. [GS Search]
Haaranen, L., Ihantola, P., Hakulinen, L., & Korhonen, A. (2014, March). How (not) to introduce badges to online exercises. In Proceedings of the 45th ACM technical symposium on Computer science education (pp. 33-38). doi: 10.1145/2538862.2538921. [GS Search]
Hallifax, S., Serna, A., Marty, J. C., & Lavoué, É. (2019, September). Adaptive gamification in education: A literature review of current trends and developments. In European conference on technology enhanced learning (pp. 294-307). Springer, Cham. doi: 10.1007/978-3-030-29736-7_22 . [GS Search]
Hamari, J., & Koivisto, J. (2013). Social motivations to use gamification: an empirical study of gamifying exercise. [GS Search]
Hamari, J. G., Ritzer, G., & Rojek, C. (2019). The Blackwell Encyclopedia of Sociology. [GS Search]
Hanus, M. D., & Fox, J. (2015). Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & education, 80, 152-161. doi: 10.1016/j.compedu.2014.08.019 . [GS Search]
Heilbrunn, B., Herzig, P., & Schill, A. (2017). Gamification analytics—methods and tools for monitoring and adapting gamification designs. In Gamification (pp. 31-47). Springer, Cham. doi: 10.1007/978-3-319-45557-0_3. [GS Search]
Högberg, J., Hamari, J., & Wästlund, E. (2019). Gameful Experience Questionnaire (GAMEFULQUEST): an instrument for measuring the perceived gamefulness of system use. User Modeling and User-Adapted Interaction, 29(3), 619-660. [GS Search]
Huotari, K., & Hamari, J. (2012, October). Defining gamification: a service marketing perspective. In Proceeding of the 16th international academic MindTrek conference (pp. 17-22). doi: 10.1145/2393132.2393137. [GS Search]
Isler, G. L., & Machado, A. A. (2013). Motivação discente em cursos na modalidade de educação à distância (EaD): fatores que influenciam. Revista Nupem, 5(9), 67-84. [GS Search]
Khaled, R. (2011, May). Itʼs not just whether you win or lose: Thoughts on gamification and culture. In Proceedings of the 2011 annual conference on Human factors in computing systems. Association for Computing Machinery. [GS Search]
Koivisto, J., & Hamari, J. (2019). The rise of motivational information systems: A review of gamification research. International Journal of Information Management, 45, 191-210. doi: 10.1016/j.ijinfomgt.2018.10.013. [GS Search]
Kung, F. Y., Kwok, N., & Brown, D. J. (2018). Are attention check questions a threat to scale validity?. Applied Psychology, 67(2), 264-283. [GS Search]
Li, W., Grossman, T., & Fitzmaurice, G. (2012, October). GamiCAD: a gamified tutorial system for first time autocad users. In Proceedings of the 25th annual ACM symposium on User interface software and technology (pp. 103-112). doi: 10.1145/2380116.2380131 . [GS Search]
Likert, R. (1932). A technique for the measurement of attitudes. Archives of psychology. [GS Search]
Martins, C., & Giraffa, L. M. M. (2018). Possibilidades de ressignificações nas práticas pedagógicas emergentes da gamificação. ETD-Educação Temática Digital, 20(1), 5-26. doi: 10.20396/etd.v20i1.8645976. [GS Search]
Meder, M., Plumbaum, T., & Hopfgartner, F. (2013, December). Perceived and actual role of gamification principles. In 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing (pp. 488-493). IEEE [GS Search]
Mello, E. D. F. F., & Teixeira, A. C. (2011, November). A interação social descrita por Vigotski e a sua possível ligação com a aprendizagem colaborativa através das tecnologias em rede. In Anais do Workshop de Informática na Escola (Vol. 1, No. 1, pp. 1362-1365). [GS Search]
Nascimento, I. M., do Amaral Neto, J. R., da Silva Junior, L. O., de Lima Costa, T. K., & Oliveira, W. (2021). Os efeitos da gamificação social no desempenho dos estudantes durante a quarentena da Covid-19. In Anais do XXXII Simpósio Brasileiro de Informática na Educação (pp. 338-349). SBC. doi: 10.5753/sbie.2021.218186. [GS Search]
Nascimento, I. M., do Amaral Neto, J. R., da Silva Junior, L. O., de Lima Costa, T. K., & Oliveira, W. (2021). Tentando Recuperar a Interação Social Perdida Durante a Pandemia da Covid-19 por meio da Gamificação. In Anais do XXVII Workshop de Informática na Escola (pp. 212-223). SBC. doi: 10.5753/wie.2021.217367 . [GS Search]
Nascimento, I. M., do Amaral Neto, J. R., da Silva Junior, L. O., de Lima Costa, T. K., & Oliveira, W. (2022). Os Efeitos da Gamificação Personalizada na Experiência de Ensino e Aprendizagem Durante o Ensino Remoto Emergencial. Revista Brasileira de Informática na Educação, 30, 210-236. doi: 10.5753/rbie.2022.2650. [GS Search]
Neto, C., Barreto, L. S. M., & Afeche, S. C. (1998). A formação social da mente Vygotski, LS 153.65-V631 Psicologia e Pedagogia O desenvolvimento dos processos psicológicos superiores. Psicologia, 153, V631. [GS Search]
Oliveira, Wilk; Bittencourt, Ig Ibert; Dermeval, Diego; Isotani, Seiji. Gamificação e Informática na Educação. In: Sampaio, Fábio F.; Pimentel, Mariano; Santos, Edméa O. (Org.). Informática na Educação: games, inteligência artificial, realidade virtual/aumentada e computação ubíqua. Porto Alegre: Sociedade Brasileira de Computação, 2021. (Série Informática na Educação, v.7) [Link] [GS Search]
Oliveira, F. A., & Santos, A. M. S. (2020). Construção do Conhecimento na Modalidade de Educação a Distância: Descortinando as Potencialidades da EaD no Brasil. EaD em Foco, 10(1). doi: 10.18264/eadf.v10i1.799. [GS Search]
Oliveira, W. D., & Bittencourt, W. J. M. (2020). A evasão na EaD: uma análise sobre os dados e relatórios, ano base 2017, apresentados pelo Inep, UAB e Abed. Educação Pública, 20(3). [GS Search]
Oliveira, W., Hamari, J., Shi, L., Toda, A. M., Rodrigues, L., Palomino, P. T., & Isotani, S. (2022). Tailored gamification in education: A literature review and future agenda. Education and Information Technologies, 1-34. doi: 10.1007/s10639-022-11122-4. [GS Search]
Orji, R., Tondello, G. F., & Nacke, L. E. (2018, April). Personalizing persuasive strategies in gameful systems to gamification user types. In Proceedings of the 2018 CHI conference on human factors in computing systems (pp. 1-14). doi: 10.1145/3173574.3174009 . [GS Search]
Pedro, L. Z., Lopes, A. M., Prates, B. G., Vassileva, J., & Isotani, S. (2015, April). Does gamification work for boys and girls? An exploratory study with a virtual learning environment. In Proceedings of the 30th annual ACM symposium on applied computing (pp. 214-219). doi: 10.1145/2695664.2695752. [GS Search]
Penteado, R. Z., & Costa, B. C. G. D. (2021). Trabalho docente com videoaulas em EAD: dificuldades de professores e desafios para a formação e a profissão docente. Educação em Revista, 37. doi: 10.1590/0102-4698236284. [GS Search]
Rajšp, A., Beranič, T., Heričko, M., & Horng-Jyh, P. W. (2017). Students' Perception of Gamification in Higher Education Courses. In Central European Conference on Information and Intelligent Systems (pp. 69-75). Faculty of Organization and Informatics Varazdin. [GS Search]
Rodrigues, L., Toda, A. M., Oliveira, W., Palomino, P. T., Vassileva, J., & Isotani, S. (2022). Automating gamification personalization to the user and beyond. IEEE Transactions on Learning Technologies, 15(2), 199-212. doi: 10.1109/TLT.2022.3162409. [GS Search]
Sailer, M., & Homner, L. (2020). The gamification of learning: A meta-analysis. Educational Psychology Review, 32(1), 77-112. doi: https://psycnet.apa.org/doi/10.1007/s10648-019-09498-w. [GS Search]
Santos, A. C. G., Oliveira, W., Altmeyer, M., Hamari, J., & Isotani, S. (2022). Psychometric investigation of the gamification Hexad user types scale in Brazilian Portuguese. Scientific Reports, 12(1), 1-12. doi: 10.1038/s41598-022-08820-x. [GS Search]
Silva, R. S. (2015). Ambientes virtuais e multiplataformas online na EAD: didática e design tecnológico de cursos digitais. Novatec Editora. [GS Search]
Schneider, N. R. (2021). Construção do conhecimento em EaD: desafios e possibilidades para o professor/tutor. Práxis Plural, 20030. [GS Search]
Sousa Borges, S., Durelli, V. H., Reis, H. M., & Isotani, S. (2014, March). A systematic mapping on gamification applied to education. In Proceedings of the 29th annual ACM symposium on applied computing (pp. 216-222). doi: 10.1145/2554850.2554956 . [GS Search]
Stieglitz, S. (2017). Enterprise Gamification–Vorgehen und Anwendung. In Gamification und Serious Games (pp. 3-13). Springer Vieweg, Wiesbaden. doi: 10.1007/978-3-658-16742-4_1. [GS Search]
Toda, A. M., Klock, A. C., Oliveira, W., Palomino, P. T., Rodrigues, L., Shi, L., ... & Cristea, A. I. (2019). Analysing gamification elements in educational environments using an existing Gamification taxonomy. Smart Learning Environments, 6(1), 1-14. doi: 10.1186/s40561-019-0106-1. [GS Search]
Toda, A. M., Valle, P. H., & Isotani, S. (2017, March). The dark side of gamification: An overview of negative effects of gamification in education. In Researcher links workshop: higher education for all (pp. 143-156). Springer, Cham. doi: 10.1007/978-3-319-97934-2_9. [GS Search]
Tondello, G. F., Wehbe, R. R., Diamond, L., Busch, M., Marczewski, A., & Nacke, L. E. (2016, October). The gamification user types hexad scale. In Proceedings of the 2016 annual symposium on computer-human interaction in play (pp. 229-243). doi: 10.1145/2967934.2968082. [GS Search]
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Marcelo Camargo de Juli, Wilk Oliveira, Isabelle Melo do Nascimento, Seiji Isotani
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
