An Experimental Methodological Approach to Relate Emotions and Learning Using Facial Expressions Recognition

Authors

  • Carla Marina Paxiuba Programa de Computação Universidade Federal do Oeste do Pará https://orcid.org/0000-0002-9062-6079
  • Celson Pantoja Lima Programa de Computação Universidade Federal do Oeste do Pará

DOI:

https://doi.org/10.5753/rbie.2020.28.0.92

Keywords:

Emotion Recognition, Learning Model, Body Signals

Abstract

Nowadays is widely accepted that emotions significantly influence the learning process. But how to recognize the student's emotions and how to relate the various types of emotions to learning remains an open question. This article presents a teaching model that uses the student's emotions to support the teaching and learning process. Students' emotions are obtained automatically through a software tool for facial expressions recognition. The data generated by the tool serve as a basis for establishing individual and collective correlations between the students' emotions and their performance in the evaluations.

Downloads

Download data is not yet available.

References

Atkinson, R. L., Atkinson, R. C., Smith, E. E., Bem, D. J., & Nolen-Hoeksema, S. (2002). Introdução à psicologia de Hilgard. Porto Alegre: Artmed.

Bercht, M., & Viccari, R. (2000). Pedagogical Agents With Affective And Cognitive Dimensions. In: Congreso Iberoamericnao De Informatica Educativa, Vina Del Mar.Santiago: Universidad De Chile. [GS Search]

Conati, C., & Zhou, X. (2002). Modelling Students’ Emotions from Cognitive Appraisal in Educational Games. In: International Conference on Intelligent Tutoring Systems. Berlin: Springer-Verlag. [DOI: 10.1007/3-540-47987-2_94].[GS Search]

D. McDuff, R. El Kaliouby, T. Senechal, M. Amr, J. F. Cohn, R. Picard.(2013). Affectiva-mit facial expression dataset (am-fed): Naturalistic and spontaneous facial expressions collected in-the-wild, Computer Vision and Pattern Recognition Workshops (CVPRW) 2013 IEEE Conference on, 881-888. [DOI: 10.1007/3-540-47987-2_94].[GS Search]

Damasio, A. (1996). O Erro de Descartes: emoção, razão e o cérebro humano. São Paulo: Companhia das Letras. [GS Search]

Darwin C. (1872). The expression of the emotions in man and animals. London: John Murray. [GS Search]

Davis, M., & Lang, P. J. (2003). Emotion. In M. Gallagher & R. J. Nelson (Eds.), Handbook of psychology– volume 3: Biological psychology. New Jersey: John Wiley& Sons. [GS Search]

Dolog, P., & Schaefer, M. (2005). A Framework for browsing manipulating and maintaining interoperable learner profiles. Proceedings of UML2005 - 10 International Conference on User Modeling, Springer Verlag, United Kingdom, 2005. [DOI: 10.1007/11527886_52].[GS Search]

D’Mello, S. et al. (2010). A time for emoting: When affect-sensitivity is and isn’t effective at promoting deep learning. BT - 10th International Conference on Intelligent Tutoring Systems. [DOI: 10.1007/978-3-642-13388-6_29].[GS Search]

De Vicente, A., & Pain, H. (2002). Informing The Detection Of The Students' Motivational State: An Empirical Study. In: International Conference On Intelligent Tutoring Systems, 6., 2002, Biarritz, France. Proceedings... Berlin: Springer-Verlag, 2002. (pp. 933- 943). [DOI: 10.1007/3-540-47987-2_93].[GS Search]

Ekman, P. (2003). Emotions revealed. New York: Times Book.

Elliott, C. (1997). Affective Reasoner Personality Models For Automated Tutoring Systems. In: Workshop On Pedagogical Agents, 1. Kobe. Papers..Kobe: [S. N.]. (pp. 33-39). [GS Search]

Elliott, C., & Brzezinski, J. (1998). Autonomous Agents As Synthetic Characters. Ai Magazine, [S. L.], 19, 13-30, Summer. [DOI: 10.1609/aimag.v19i2.1366].[GS Search]

Felder, R. M, & Silverman, L. K. (1988). Learning and Teaching Styles in Engineering Education. Engineering Education, 78, 674-681. [GS Search]

Gazzaniga, M. S., & Heatherton, T. F. (2005). Personalidade. In Ciência psicológica: mente, cérebro e comportamento (pp. 470-496). Porto Alegre: Artmed

Georgeff, M. et al. (1998). The Belief-Desire-Intention Model of Agency. In: Müller J.P., Rao A.S., Singh M.P. (eds) Intelligent Agents V: Agents Theories, Architectures, and Languages. ATAL 1998. Lecture Notes in Computer Science, 1555. Springer, Berlin, Heidelberg. [DOI: 10.1007/3-540-49057-4_1].[GS Search]

Goleman, D. (1995). Inteligência Emocional. Rio de Janeiro: Objetiva. [GS Search]

Goodwin, C. J. (2005). História da psicologia moderna. São Paulo: Cultrix. [GS Search]

Izard, C. E. (1984). Emotion–cognition relationships and human development. Emotions, Cognition, and Behavior, 17-37. [GS Search]

James, W. (1890). The principles of psychology. New York: Holt. [GS Search]

Ledoux, J. (1996). The emotional brain: The mysterious underpinnings of emotional life. New York: Simon & Schuster. [GS Search]

Levenson, R. W. (1999). The intrapersonal functions of emotion. Cognition and Emotion, 13, 481-504. [DOI: 10.1080/026999399379159].[GS Search]

Liu, Y., & Ginther, D. (1999). Cognitive Styles and Distance Education. Online Journal of Distance Learning Administration. State University of West Georgia, Distance Education, Fall. [GS Search]

Lundqvist, D., & Öhman, A. (2005). Caught by the evil eye. In L. F. Barrett, P. M. Niedenthal, & P. Winkielman (Eds.), Emotion and consciousness (pp. 97-122). New York: Guilford. [GS Search]

Mandler, G. (2003). Emotion. In D. K. Freedheim & I. B. Weiner (Eds.), Handbook of psychology – volume 1: History of psychology (pp. 157–175). New Jersey: John Wiley & Sons. [GS Search]

Markham, R., & Wang, L. (1996). Recognition of emotion by Chinese and Australian children. Journal of Cross-Cultural Psychology, 27, 616-643. [DOI: 10.1177/0022022196275008].[GS Search]

Mora, F. (2013). NeuroEducación, solo se puede aprender aquello que se ama. Madri, 2013. (pp 65-72). [GS Search]

Niedenthal, P. M., Krauth-Gruber, S., & Ric, F. (2006). Psychology of emotion: Interpersonal, experiential, and cognitive approaches. New York: Psychology Press. [GS Search]

Picard, R. (1997). Affective Computing. Cambridge: MIT Press. [GS Search]

Piaget, J. (1989). A psicologia da criança. 17ed. Rio de Janeiro: Bertrand Brasil. [GS Search]

Plutchik, R. (2002). Emotions and life: Perspectives from psychology, biology and evolution. Washington, DC: American Psychological Association.[GS Search]

Schultz, D. P., & Schultz, S. E. (2009). História da psicologia moderna. São Paulo: Cengage Learning. [GS Search]

Vygotsky, L. (1994). The problem of the environment. Em: R. Van der Veer & J. Valsiner (Orgs.), The Vygotsky reader (pp. 338-354). Oxford, UK: Basil Blackwell Ltd.[GS Search]

Vygotsky, L. (1962). Thought and Language. Cambridge, MA: MIT Press.[GS Search]

Strongman, K. T. (2003). The Psychology of Emotion: From Everyday Life to Theory, West Sussex: Wiley and Sons.[GS Search]

Triantafillou, E., Pomportsis, A., & Demetriadis, S. (2003). The Design and the formative evaluation of an adaptive educational system based on cognitive styles. Computers & Education. 41, 87-103.[DOI: 10.1016/S0360-1315(03)00031-9].[GS Search]

Wehrle T., & Kaiser S. (2000). Emotion and Facial Expression. In: Paiva A. (eds) Affective Interactions. IWAI 1999. Lecture Notes in Computer Science, Springer, Berlin, Heidelberg. [DOI: 10.1007/10720296_5].[GS Search]

Published

2020-02-16

How to Cite

PAXIUBA, C. M.; LIMA, C. P. An Experimental Methodological Approach to Relate Emotions and Learning Using Facial Expressions Recognition. Brazilian Journal of Computers in Education, [S. l.], v. 28, p. 92–114, 2020. DOI: 10.5753/rbie.2020.28.0.92. Disponível em: https://journals-sol.sbc.org.br/index.php/rbie/article/view/3735. Acesso em: 7 jul. 2024.

Issue

Section

Awarded Papers