Self-concepts applied as a strategy to measure the level of acceptance of a Serious Game

Anthony Lins; Walter Franklin Marques Correia; Fábio Ferreira da Costa Campos; Marnix van Gisbergen; João Marcelo Xavier Natário Teixeira

doi:10.5753/jis.2025.4785

Authors

Anthony Lins Universidade Católica de Pernambuco https://orcid.org/0000-0002-7153-841X
Walter Franklin Marques Correia Universidade Federal de Pernambuco https://orcid.org/0000-0002-6491-9783
Fábio Ferreira da Costa Campos Breda University of Applied Sciences https://orcid.org/0000-0002-7882-876X
Marnix van Gisbergen Breda University of Applied Sciences https://orcid.org/0000-0002-7907-7312
João Marcelo Xavier Natário Teixeira Universidade Federal de Pernambuco https://orcid.org/0000-0001-7180-512X

DOI:

https://doi.org/10.5753/jis.2025.4785

Keywords:

Self-concepts, Serious games, User acceptance

Abstract

This paper explores the application of Self-Concepts, a Semantic-Differential Scale-based methodology, to evaluate a Serious Game designed for cognitive impairment assessment using the MoCA test and augmented reality (AR) for mobility analysis. A case study involved seven elderly participants. Despite some challenges in navigating the AR environment and cognitive tests, self-concept evaluations consistently demonstrated high user expectations and positive experiences with the digital artifact. This study validates the process and highlights the potential of Self-Concepts in assessing product acceptance within user groups.

Downloads

References

Aguiar, B., Correia, W., and Campos, F. (2011). Uso da escala Likert na análise de jogos. Salvador: SBC-Proceedings of SBGames Anais, 7(2).

Aini, N. and Ferdinand, A. (2021). Self-congruence theory: Factors affecting brand loyalty in fast-moving consumer goods industry. Jurnal Inovasi Ekonomi, 7:1–12. DOI: https://doi.org/10.22219/jiko.v7i01.18111.

Amaral, L. A. d., Fortes, R. P. d. M., Chagas, M. H. N., Castro, P. C., Bittar, T. J., and Lobato, L. L. (2019). Towards adopting serious games for cognitive tests with Brazilian older people. Journal on Interactive Systems, 10(1). DOI: https://doi.org/10.5753/jis.2019.715.

Anolli, L., Mantovani, F., Confalonieri, L., Ascolese, A., and Peveri, L. (2010). Emotions in serious games: From experience to assessment. International Journal of Emerging Technologies in Learning (iJET), 5:3–11.

Bernhaupt, R., Ijsselsteijn, W., Mueller, F., Tscheligi, M., and Wixon, D. (2008). Evaluating user experiences in games. In CHI’08 Extended Abstracts on Human Factors in Computing Systems, pages 3905–3908.

Borges, B., Sidarta, I., de Souza, A., Coelho, B., and Darin, T. (2019). Experiência do usuário em jogos digitais: Uma catalogação de instrumentos de avaliação. In Anais do I Workshop sobre Interação e Pesquisa de Usuários no Desenvolvimento de Jogos, pages 69–78, Porto Alegre, RS, Brasil. SBC. DOI: https://doi.org/10.5753/wiplay.2019.7841.

Carvalho, A. P. d., Braz, C. S., and Prates, R. O. (2024). An analysis of the evaluation methods being applied to serious games for autistic children. Journal on Interactive Systems, 15(1):55–78. DOI: https://doi.org/10.5753/jis.2024.3288.

Dutra, T., Tondorf, D., Zils, T., Ferreira, A., Gasparini, I., Hounsell, M., and Maschio, E. (2021). Métodos de avaliação de IHC no contexto de jogos sérios educacionais: Um mapeamento sistemático. In Anais do XXXII Simpósio Brasileiro de Informática na Educação, pages 564–575, Porto Alegre, RS, Brasil. SBC. DOI: https://doi.org/10.5753/sbie.2021.217450.

Fellows, R., Braga, J., and Dotta, S. (2022). Revisão sistemática de literatura sobre métodos, técnicas e critérios de avaliação de aprendizagem em jogos sérios sociointeracionistas. In Anais do XXXIII Simpósio Brasileiro de Informática na Educação, pages 528–539, Porto Alegre, RS, Brasil. SBC. DOI: https://doi.org/10.5753/sbie.2022.225236.

Fokides, E., Atsikpasi, P., Kaimara, P., and Deliyannis, I. (2019). Let players evaluate serious games: Design and validation of the serious games evaluation scale. ICGA Journal, 41(3):116–137. DOI: https://doi.org/10.3233/ICG190111.

Friborg, O., Martinussen, M., and Rosenvinge, J. H. (2006). Likert-based vs. semantic differential-based scorings of positive psychological constructs: A psychometric comparison of two versions of a scale measuring resilience. Personality and Individual Differences, 40(5):873–884. DOI: https://doi.org/10.1016/j.paid.2005.08.015.

Funabashi, A. M. M., Aranha, R. V., Silva, T. D., Monteiro, C., Silva, W. S., and Nunes, F. (2018). A serious game for virtual rehabilitation: Evaluation with patients and physiotherapists. Journal on Interactive Systems, 9(2). DOI: https://doi.org/10.5753/jis.2018.698.

Garcia, M. (2023). A systematic review of serious games for health education: Technology acceptance and design considerations. Publication Platform. DOI: https://doi.org/10.4018/979-8-3693-3661-8.ch002.

García-Martínez, I., Augusto-Landa, J. M., Quijano-López, R., and León, S. P. (2022). Self-concept as a mediator of the relation between university students’ resilience and academic achievement. Frontiers in Psychology, 12. DOI: https://doi.org/10.3389/fpsyg.2021.747168.

Gazis, A., and Katsiri, E. (2023). Serious games in digital gaming: A comprehensive review of applications, game engines and advancements. WSEAS Transactions on Computer Research, 11:10–22. DOI: https://doi.org/10.37394/232018.2023.11.2.

Hosany, S., and Martin, D. (2012). Self-image congruence in consumer behavior. Journal of Business Research, 65(5):685–691. DOI: https://doi.org/10.1016/j.jbusres.2011.03.015.

Kim, S., and Jung, Y. (2023a). Development of semantic differential scales for artificial intelligence agents. International Journal of Social Robotics, 15(5):1155–1167.

Kim, S., and Jung, Y. (2023b). Development of semantic differential scales for artificial intelligence agents. International Journal of Social Robotics, 15(5):1155–1167. DOI: https://doi.org/10.1007/s12369-023-01010-3.

Lin, C., Ren, Y., and Lu, A. (2023). The effectiveness of virtual reality games in improving cognition, mobility, and emotion in elderly post-stroke patients: A systematic review and meta-analysis. Neurosurgical Review, 46:167. DOI: https://doi.org/10.1007/s10143-023-02061-w.

McMullen, T. (2020). Self-Concept. In Springer International Publishing, Cham, pages 1978–1979. DOI: https://doi.org/10.1007/978-3-030-39903-0_1497.

Michailidis, L., Balaguer-Ballester, E., and He, X. (2018). Flow and immersion in video games: The aftermath of a conceptual challenge. Frontiers in Psychology, 9:1682. DOI: https://doi.org/10.3389/fpsyg.2018.01682.

Nacke, L. E. (2015). Games user research and physiological game evaluation. In Game User Experience Evaluation, pages 63–86. Springer.

Nakamura, T., Miyata, K., Yamamoto, H., and Sato, H. (2021). A study on scale construction of adjective pairs for evaluating audiovisual effects in video games. In Design, User Experience, and Usability: UX Research and Design, pages 278–291. Springer.

Neves, C. E. (2021). Self-concept as an artifact evaluation method: Generating evidence of the use of self-concept as an artifact evaluation method through the application in feature films. Master’s thesis, Universidade Federal de Pernambuco.

Osgood, C. E. (1952). The nature and measurement of meaning. Psychological Bulletin, 49(3):197. DOI: https://doi.org/10.1037/h0055737.

Ploder, A., and Eder, A. (2015). Semantic differential. In International Encyclopedia of the Social Behavioral Sciences (Second Edition), pages 563–571. Elsevier, Oxford. DOI: https://doi.org/10.1016/B978-0-08-097086-8.03231-1.

Statista (2023). Video games - worldwide. Last accessed: 2024-12-23. Available at: [link].

Stoklasa, J., Zvarikova, K., and Poliak, M. (2019). Semantic differential for the twenty-first century: Scale relevance and methodological improvements. Quality & Quantity, 53(1):435–448.

Suryapranata, L. K. P., Soewito, B., Kusuma, G. P., Gaol, F. L., and Warnars, H. L. H. S. (2017). Quality measurement for serious games. In 2017 International Conference on Applied Computer and Communication Technologies (ComCom), pages 1–4. IEEE. DOI: https://doi.org/10.1109/COMCOM.2017.8167098.

Trautwein, U., and Möller, J. (2016). Self-Concept: Determinants and Consequences of Academic Self-Concept in School Contexts. In Springer, pages 187–214. DOI: https://doi.org/10.1007/978-3-319-28606-8_8.

Van Harreveld, F., Nohlen, H. U., and Schneider, I. K. (2015). The ABC of ambivalence: Affective, behavioral, and cognitive consequences of attitudinal conflict. In Advances in Experimental Social Psychology, volume 52, pages 285–324. Elsevier. DOI: https://doi.org/10.1016/bs.aesp.2015.01.002.