Research Identification and Analysis of Clustering Algorithms for the Discovery of Engagement Profiles

Authors

DOI:

https://doi.org/10.5753/rbie.2022.2508

Keywords:

Engagement, Distance Education, Interaction, Performance, Educational Data Mining

Abstract

The adoption of Distance Education (EAD) is a trend that has been gaining ground in the educational field. The number of people who choose this type of education has been growing. Advantages such as flexible hours, diversity of geographic access and the use of technologies as a means of access provide an increase in adherence. Despite these benefits that are offered through the E-learning modality (Electronic Learning) and study tools such as LMS (Learning Management System), institutions still face high dropout rates and a low number of graduates. Research shows a strong link between student engagement and academic performance, which requires education managers and researchers to pay more attention to the factors that influence student engagement levels throughout the course, rather than just considering the completion rate. In this sense, this work aimed to understand the relationship between levels of engagement with academic performance. The research was divided into two phases, in the first one it sought to present a systematic review to find studies that address the phenomenon of engagement and its consequences. In the second phase, it applied educational data mining (EDM) techniques to extract and analyze behavioral data from six thousand five hundred and twenty seven students throughout an undergraduate course. As a result of the systematic review, it was possible to obtain the answers to the five research questions in the twenty-six articles returned in the IEEExplore, Science Direct and Springer search repositories. In addition, the results of the application of the EDM technique made it possible to identify three different engagement profiles, which can contribute to pedagogical decision-making, as well as the development of methodological designs that reduce dropout levels in a course.

Downloads

Download data is not yet available.

References

Abu-dawood, S. (2016). The Cognitive And Social Motivational Affordances Of Gamification In E-learning Environment. 2016 Ieee 16th International Conference On Advanced Learning Technologies (icalt). doi: 10.1109/ICALT.2016.126. [GS Search]

Akbar, H. A., Purwarianti, A., & Zubir, H. Y. (2013). Development of e-learning with social network. 2013. Joint International Conference on Rural Information & Communication Technology and Electric-Vehicle Technology (RICT & ICeV-T). doi: 10.1109/rict-icevt.2013.6741558. [GS Search]

Alkabbany, I., Ali, A., Farag, A., Bennett, I., Ghanoum, M., & Farag, A. (2019). Measuring student engagement level using facial information. 2019 IEEE International Conference on Image Processing (ICIP). doi: 10.1109/icip.2019.8803590. [GS Search]

Altuwairqi, K., Jarraya, S. K., Allinjawi, A., & Hammami, M. (2018). A new emotion–based affective model to detect student’s engagement. Journal of King Saud University - Computer and Information Sciences. doi: 10.1016/j.jksuci.2018.12.008. [GS Search]

Banegas, D. L., & Busleimán, G. I. M. (2014). Motivating factors in online language teacher education in southern Argentina. Computers & Education, 76, 131-142. doi: 10.1016/j.compedu.2014.03.014 . [GS Search]

Barua, P. D., Zhou, X., Gururajan, R., & Chan, K. C. (2018). Determination of Factors Influencing Student Engagement Using a Learning Management System in a Tertiary Setting. 2018 IEEE/WIC/ACM International Conference on Web Intelligence (WI). doi: 10.1109/wi.2018.00-30. [GS Search]

Bergdahl, N., Nouri, J., & Fors, U. (2019). Disengagement, engagement and digital skills in technology-enhanced learning. Education and Information Technologies, 25(2), 957–983. doi: 10.1007/s10639-019-09998-w. [GS Search]

Blanchette, J. (2012). Participant interaction in asynchronous learning environments: evaluating interaction analysis methods. Linguistics and Education, 23(1), 77–87. doi: 10.1016/j.linged.2011.02.007. [GS Search]

Capuano, N., Mangione, G. R., Pierri, A., & Lin, E. (2013). Engaging e-learning for Risk Management: the ALICE Experience in Italian Schools. 2013 Seventh International Conference on Complex, Intelligent, and Software Intensive Systems. doi: 10.1109/cisis.2013.67. [GS Search]

Chuang, H., Wang, C., Chen, G., Liu, C., Liu, B. (2010). Design And Evaluation Of An Affective Interface Of The E-learning Systems. 2010 10th Ieee International Conference On Advanced Learning Technologies. doi: 10.1109 / ICALT.2010.62. [GS Search]

Ding, L., Kim, C., & Orey, M. (2017). Studies of student engagement in gamified online discussions. Computers & Education, 115, 126–142. doi: 10.1016/j.compedu.2017.06.016 . [GS Search]

Doumanis, I., Economou, D., Sim, G. R., & Porter, S. (2019). The impact of multimodal collaborative virtual environments on learning: A gamified online debate. Computers & Education, 130, 121–138. doi: 10.1016/j.compedu.2018.09.017. [GS Search]

Feidakis, M., Daradoumis, T., Caballe, S., & Conesa, J. (2013). Measuring the Impact of Emotion Awareness on e-learning Situations. 2013 Seventh International Conference on Complex, Intelligent, and Software Intensive Systems. doi: 10.1109/cisis.2013.71. [GS Search]

Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School Engagement: Potential of the Concept, State of the Evidence. Review of Educational Research, 74(1), 59-109. doi: 10.3102/00346543074001059. [GS Search]

Goh, W., Ayub, E., Wong, S. Y., & Lim, C. L. (2017). The importance of teacher's presence and engagement in MOOC learning environment: A case study. 2017 IEEE Conference on e-Learning, e-Management and e-Services (IC3e). doi: 10.1109/ic3e.2017.8409250. [GS Search]

Halawa, M. S, Shehab, M. E, & Hamed, E. M. R. (2015) Predicting student personality based on a data-driven model from student behavior on LMS and social networks. 2015 Fifth International Conference on Digital Information Processing and Communications (ICDIPC). doi: 10.1109/ICDIPC.2015.7323044. [GS Search]

Haron, H., Aziz, N. H. N., & Harun, A. (2017). A Conceptual Model Participatory Engagement Within E-learning Community. Procedia Computer Science, 116, 242–250. doi: 10.1016/j.procs.2017.10.046. [GS Search]

Heo, H.; Lim, K. Y.; Kim, Y. (2010). Exploratory study on the patterns of online interaction and knowledge co-construction in project-based learning. Computers & Education, 55(3), 1383–1392. doi: 10.1016 / j.compedu.2010.06.012. [GS Search]

Kassambara, A. (2017). Practical Guide To Principal Component Methods in R. STHDA. [GS Search]

Krouska, A., Troussas, C., & Virvou, M. (2017). Social networks as a learning environment: Developed applications and comparative analysis. 2017 8th International Conference on Information, Intelligence, Systems & Applications (IISA). doi: 10.1109/iisa.2017.8316430. [GS Search]

Lazareva, A. (2015). Promoting collaborative interactions in a learning management system. 2015 International Conference on Interactive Collaborative Learning (ICL). doi: 10.1109/icl.2015.7318066. [GS Search]

Malczewska-webb, B., Vallero, A., King, C. P., & Simon, H. (2016). Breaking Down The Barriers Of Online Teaching: Training Tesol Teachers In A Virtual Environment. Second Language Learning And Teaching Researching Second Language Learning And Teaching From A Psycholinguistic Perspective, 237–258. doi: 10.1007/978-3-319-31954-4_16. [GS Search]

Messias, I., Morgado, L., & Barbas, M. (2015). Students' engagement in Distance Learning: creating a scenario with LMS and social network aggregation. 2015 International Symposium on Computers in Education (SIIE). doi: 10.1109/siie.2015.7451646. [GS Search]

Moubayed, A., Injadat, M., Shami, A., & Lutfiyya, H. (2018). Relationship between student engagement and performance in e-learning environment using association rules. 2018 IEEE World Engineering Education Conference (EDUNINE). doi: 10.1109/edunine.2018.8451005. [GS Search]

Oliveira, P. L. S. D., Souza, A. J. D., & Rodrigues, R. (2019). Identificação de pesquisas referentes ao engajamento de alunos em plataformas de LMS e suas relações com o desempenho acadêmico. Anais do XXX Simpósio Brasileiro de Informática na Educação (SBIE 2019). doi: 10.5753/cbie.sbie.2019.1631. [GS Search]

Oyelere, S. S., & Suhonen, J. (2016). Design and Implementation of Mobile Edu M-learning Application for Computing Education in Nigeria: a Design Research Approach. 2016 International Conference on Learning and Teaching in Computing and Engineering (LaTICE). doi: 10.1109/latice.2016.3. [GS Search]

Pellas, N. (2014). Bolstering the Quality and Integrity of Online Collaborative University- Level Courses via an Open Sim Standalone Server in Conjunction with Sloodle. Education and Information Technologies, 21(5), 1007–1032. doi: 10.1007/s10639-014-9365-1. [GS Search]

Ramirez-Arellano, A. (2019). Students Learning Pathways in Higher Blended Education: An Analysis of Complex Networks Perspective. Computers & Education, 141, 103634. doi: 10.1016/j.compedu.2019.103634. [GS Search]

Ramos, J. L. C., Silva, R. E. D. E., Silva, J. C. S., Rodrigues, R. L., & Gomes, A. S. (2016). A Comparative Study between Clustering Methods in Educational Data Mining. IEEE Latin America Transactions, 14(8), 3755-3761. doi: 10.1109/tla.2016.7786360. [GS Search]

Refat, N., Rahman, M. A., Asyhari, A. T., Kurniawan, I. F., Bhuiyan, M. Z. A., & Kassim, H. (2019). Interactive Learning Experience-Driven Smart Communications Networks for Cognitive Load Management in Grammar Learning Context. IEEE Access, 7, 64545–64557. doi: 10.1109/access.2019.2915174. [GS Search]

Rodrigues, R., Ramos, J., Silva, J., & Gomes, A. (2016). Discovery engagement patterns MOOCs through cluster analysis. IEEE Latin America Transactions, 14(9), 4129–4135. doi: 10.1109/tla.2016.7785943. [GS Search]

Scannavino, K. R. F., Nakagawa, E. Y., Fabbri, S. C. P. F., & Ferrari, F. C. (2017). Revisão Sistemática da Literatura em Engenharia de Software: teoria e prática. Rio de Janeiro: Elsevier [GS Search]

Sedraz, J. C. S. S., Souza, F. da F. de, Ramos, J. L. C., Rodrigues, R. L., Zambom, E. de G., & Cavalcanti, A. (2018). Avaliação da usabilidade de um recurso de Learning Analíticas dedicado à promoção da Autorregulação da Aprendizagem em Flipped Classroom. Revista Latinoamericana de Tecnología Educativa - RELATEC. doi: 10.17398/1695-288X.17.2.9. [GS Search]

Shraim, K. (2013). Facilitating the Implementation of the Constructivist Approach through the Social Space of Facebook. 2013 Fourth International Conference on e-Learning "Best Practices in Management, Design and Development of e-Courses: Standards of Excellence and Creativity". doi: 10.1109/ECONF.2013.12. [GS Search]

Sobaih, Abu Elnasr E. et al. (2016). “To Use or Not to Use? Social Media in Higher Education in Developing Countries.” Computers in Human Behavior, 58, 296–305. doi: 10.1016/j.chb.2016.01.002. [GS Search]

Souza-Concilio, I. D. A., & Pacheco, B. D. A. (2013). How to make Learning Management Systems more exciting and entertaining: Games, interaction and experience design. 2013 IEEE Conference on e-Learning, e-Management and e-Services. doi: 10.1109/ic3e.2013.6735959. [GS Search]

Sypsas, A, Toki, E., & Pange, J. (2015). Supporting Undergraduate Students via Webinars. 2015 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL), 2015. doi: 10.1109/imctl.2015.7359592. [GS Search]

Vigentini, L., Mirriahi, N., & Kligyte G. (2016). From Reflective Practitioner to Active Researcher: Towards a Role for Learning Analytics in Higher Education Scholarship. Learning, Design, and Technology, 2016, 1–29. doi: 10.1007/978-3-319-17727-4_6-1 . [GS Search]

Whitty, C., & Anane, R. (2014). Social Network Enhancement for Non-formal Learning. 2014 47th Hawaii International Conference on System Sciences. doi: 10.1109/hicss.2014.210 . [GS Search]

Williams, K. M., Stafford, R. E., Corliss, S. B., & Reilly, E. D. (2018). Examining student characteristics, goals, and engagement in Massive Open Online Courses. Computers & Education, 126, 433-442. doi: doi:10.1016/j.compedu.2018.08.014. [GS Search]

Zainuddin, Z. (2018). Students' learning performance and perceived motivation in gamified flipped-class instruction. Computers & Education, 126, 75-88. doi: doi:10.1016/j.compedu.2018.07.003. [GS Search]

Published

2022-02-13

How to Cite

OLIVEIRA, P. L. S. de; RODRIGUES, R. L.; RAMOS, J. L. C.; SILVA, J. C. S. Research Identification and Analysis of Clustering Algorithms for the Discovery of Engagement Profiles. Brazilian Journal of Computers in Education, [S. l.], v. 30, p. 01–19, 2022. DOI: 10.5753/rbie.2022.2508. Disponível em: https://journals-sol.sbc.org.br/index.php/rbie/article/view/2508. Acesso em: 4 jul. 2024.

Issue

Section

Articles