Accuracy of Student Self-assessment in Higher Education: A Systematic Mapping of the Literature

Authors

DOI:

https://doi.org/10.5753/rbie.2022.2304

Keywords:

student self-assessment, coefficient of accuracy, higher education, systematic mapping of the literature

Abstract

Student self-assessment is an assessment strategy that provides educational benefits to students, such as the ability to evaluate their own work and self-regulate their learning. The purpose of this research is to present how student self-assessment has been applied in higher education through a Systematic Mapping of the Literature (SML) on the topic. The forty-six relevant papers showed that self-assessment is usually applied along with other strategies such as peer and teacher assessment. Educational gains such as improved academic performance, self-criticism, reflection, and accountability were observed by practicing self-assessment. Furthermore, of the 53% of the studies that mentioned the use of computer tools in the use of self-assessment, it was observed that two tools were necessary, one for the application of self-assessment and the other for data analysis. In relation to accuracy, no consensus was found among the authors, with 26% mentioning the use of Pearson's correlation coefficient, which does not meet all possible scenarios when comparing strategies such as self-assessment and teacher evaluation. A coefficient that allows measuring the accuracy of student self-assessment is suggested in this research, since the difficulty in measuring accuracy was a gap observed.

Downloads

Download data is not yet available.

Author Biographies

Indianara Amâncio, Universidade do Estado de Santa Catarina

Possui técnico em Informática pela Sociedade Educacional de Santa Catarina (2008). Graduação em Sistema de Informação pela Sociedade Educacional de Santa Catarina (2013). Pós graduação na área de docência para o ensino superior pela IBF (2016). Mestre em Computação Aplicada (2022) na instituição de ensino Udesc tendo como linha de pesquisa a Informática na Educação. Tem experiência na área de computação, gerência de TI e docência. Atualmente, é professora do Serviço Nacional de Aprendizagem Industrial (SENAI) do curso técnico em Desenvolvimento de Sistemas e graduação em Análise e Desenvolvimento de Sistemas.

Avanilde Kemczinski, Universidade do Estado de Santa Catarina

Avanilde Kemczinski é Professora Associada do Departamento de Ciência da Computação da Universidade do Estado de Santa Catarina - UDESC. Possui doutorado (2005) e mestrado (2000) em Engenharia de Produção e Sistemas pela Universidade Federal de Santa Catarina (UFSC), graduação em Terapia Ocupacional pela Associação Catarinense de Ensino - Faculdade de Ciências da Saúde de Joinville (1992) e pós-doutorado (2016) em Educação pela Universidade de Málaga/Espanha. Coordena o Programa de Pós-graduação em Ensino de Ciências, Matemática e Tecnologia (PPGECMT) e atua no Programa de Pós-graduação em Computação Aplicada (PPGCA) e nos cursos de graduação Bacharelado em Ciência da Computação (BCC) e Tecnologia em Análise e Desenvolvimento de Sistemas (TADS). É líder do Grupo de Pesquisa em Informática na Educação - GPIE pelo CNPQ/UDESC. Tem interesse nas áreas correlatas à Informática na Educação, notadamente tecnologia educacional,
objetos de aprendizagem, sistema/aprendizagem colaborativa (CSCL), interface humano-computador, qualidade no processo e no produto de software educacional, jogos educacionais e metodologias e/ou modelos de ensino-aprendizagem.
CV oficial completo no CNPq - Curriculum Lattes http://lattes.cnpq.br/0048790978449306
email de contato avanilde.kemczinski@udesc.br

Marlow R. B. Dickel, Universidade do Estado de Santa Catarina

Possui graduação em Tecnologia em Redes Industriais (SENAI Joinville - 2008), especialização Lato Sensu em Redes de Computadores (ESAB - 2014) e MBI em Educação para o Profissional do Futuro (SENAI Florianópolis - 2018). Trabalha desde 2008 como docente do SENAI em Joinville -SC, nos níveis técnico e superior. Professor certificado Google for Education - Trainer: Level 1 e Level 2. Cursa mestrado em Computação Aplicada na Universidade do Estado de Santa Catarina.

References

Abolfazli, Z. & Sadeghi, K. (2012).The Effect of Assessment Type (Self vs. Peer vs. Teacher) on Iranian University EFL Students’ Course Achievement. Language Testing in Asia, 2, 47–74. doi: 10.1186/2229-0443-2-4-47. [GS Search]

Alishah, A. & Dolmaci, M. (2013). The Interface Between Self-Efficacy Concerning the Self Assessment on Students Studying English as a Foreign Language. Procedia - social and behavioral sciences, 70, 873-881. doi:10.1016/j.sbspro.2013.01.133. [GS Search]

Aryadoust, V. (2015). Self- and Peer Assessments of Oral Presentations by First-Year University Students. Educational Assessment, 20, 199-225. doi: 10.1080/10627197.2015.1061989. [GS Search]

Bacich, L. & Moran, J. (2018). Metodologias Ativas para uma Educação Inovadora. Porto Alegre: Penso.

Boud, D. (1995). Enhancing Learning Through Self-Assessment. London: Routledge.

Boud, D. & Falchikov, N. (2005). Redesigning Assessment for Learning Beyond Higher Education. Higher Education in a Changing World. Research and Development in Higher Education, 28, 34-41. [GS Search]

Brew, A. & Boud, D. (1995). Teaching and Research: Establishing the Vital Link With Learning. Higher Education, 29, 261-273. doi: 10.1007/BF01384493. [GS Search]

Brown, G., Andrade, H. & Chen, F. (2015). Accuracy in Student Self-Assessment: Directions and Cautions for Research. Assessment in Education Principles Policy and Practice, 22, 444-457. doi: 10.1080/0969594X.2014.996523. [GS Search]

Buchinger, D., Cavalcanti, G. & Hounsell, M. (2014). Mecanismos de Busca Acadêmica: uma Análise Quantitativa. Revista Brasileira de Computação Aplicada, 6, 108-120. doi: 10.5335/rbca.2014.3452. [GS Search]

Dermeval, D., Coelho, J. A. P. de M. & Bittencourt, I. I. (2019). Mapeamento sistemático e revisão sistemática da literatura em informática na educação (pp. 5-6). Porto Alegre: Sociedade Brasileira de Computação. [GS Search]

Desrochers, M., Zhang, J., Caron, S. & Steinmiller, J. (2019). An Experimental Comparison of the Effect of Teacher versus Self-Evaluation/Self-Reflection Feedback on College Students’ Behavioral Observation Skills. Journal of Behavioral Education, 28, 258-274. doi: 10.1007/s10864-018-09313-6. [GS Search]

Dlab, H. M., Katic, M. A., & Candrlic, S. (2015). Ensuring Formative Assessment in Course with Online Tests. 10th International Conference on Computer Science & Education (ICCSE), 10, 322–327. doi: 10.1109/ICCSE.2015.7250264. [GS Search]

Dochy, F., Segers, M. & Sluijsmans, D. (1999). The use of self-, Peer and Co-Assessment in Higher Education: A Review. Studies in Higher Education, 24, 331-350. doi: 10.1080/03075079912331379935. [GS Search]

Echeazarra, L., Perera, J., Sanz-santamaría, S. & Gutiérrez, J. (2014). Student-Generated Online Videos to Develop Cross-Curricular and Curricular Competencies in Nursing Studies. Computers in Human Behavior, 31, 580-590. doi: 10.1016/j.chb.2013.06.011. [GS Search]

El Maaddawy, T. (2017). Enhancing Learning of Engineering Students Through Self-Assessment. IEEE Global Engineering Education Conference (EDUCON), 86-91. doi: 10.1109/EDUCON.2017.7942828. [GS Search]

Ezzahra, K., Islam, O., & Radid, M. (2015). Self-assessment of the Progress of Thesis for the PHD Students in the Moroccan University. Procedia - Social and Behavioral Sciences, 197, 1789-1795. doi: 10.1016/j.sbspro.2015.07.237. [GS Search]

França, R. & Tedesco, P. (2015). Caracterizando a Pesquisa Sobre Autoavaliação na Aprendizagem de Programação para Iniciantes. Simpósio Brasileiro de Informática na Educação, 549-558. doi: 10.5753/cbie.sbie.2015.549.

Ganajová, M., Sotáková, I., Jurková, V., Brestenska, B., Szarka, K. & Kozurkova, M. (2020). Investigating Students' Self-Assessment of Conceptual Understanding Using Self Assessment Cards in Chemistry. ICMET '20: Proceedings of the 2020 2nd International Conference on Modern Educational Technology, 20, 30-33. doi: 10.1145/3401861.3401864. [GS Search]

Garson, G. D. (2009). Statnotes: Topics in Multivariate Analysis. Recuperado de: [Link] Acesso em: fevereiro de 2022.

González-Betancor, S. M., Bolívar-Cruz, A. & Verano-Tacoronte, D. (2017). Self-assessment Accuracy in Higher Education: The Influence of Gender and Performance of University Students. Active Learning in Higher Education, 20, 101-114. doi: 10.1177/1469787417735604. [GS Search]

Guest, J. & Riegler, R. (2016). Learning by Doing: Do Economics Students Self-Evaluation Skills Improve? International Review of Economics Education, 24, 50-64. doi: 10.1016/j.iree.2016.10.002. [GS Search]

Hale C. (2015). Self-Assessment as Academic Community Building: a Study from a Japanese Liberal Arts University. Language Testing in Asia, 5, 1-12. doi: 10.1186/s40468-014-0010-0. [GS Search]

Han, C. (2018). A Longitudinal Quantitative Investigation Into the Concurrent Validity of Self and Peer Assessment Applied to English-Chinese Bi-Directional Interpretation in an Undergraduate Interpreting Course. Studies in Educational Evaluation, 58, 187-196. doi: 10.1016/j.stueduc.2018.01.001. [GS Search]

Heukelman, D. (2017). Measuring E-Readiness: A Case Study: Self-Assessment vs Performance Testing. 1st International Conference on Next Generation Computing Applications (NextComp), 215–219. doi: 10.1109/NEXTCOMP.2017.8016201. [GS Search]

Hosein, A. & Harle, J. (2018). The Relationship Between Students’ Prior Mathematical Attainment, Knowledge and Confidence on Their Self-Assessment Accuracy. Studies in Educational Evaluation, 56, 32–41. doi: 10.1016/j.stueduc.2017.10.008. [GS Search]

Hulsman, R. & Vloodt, J. (2014). Self-Evaluation and Peer-Feedback of Medical Students’ Communication Skills Using a Web-Based Video Annotation System. Exploring Content and Specificity. Patient Education and Counseling, 98. doi: 10.1016/j.pec.2014.11.007. [GS Search]

Hwang, W., Hsu, J., Shadiev, R., Chang, C. & Huang, Y. M. (2015). Employing Self-Assessment, Journaling, and Peer Sharing to Enhance Learning From an Online Course. . Journal of Computing in Higher education, 27, 114-133. doi: 10.1007/s12528-015-9096-3. [GS Search]

Ibabe, I. & Jauregizar, J. (2010). Online Self-Assessment With Feedback and Metacognitive Knowledge. Higher Education, 59, 243–258. doi: 10.1007/s10734-009-9245-6. [GS Search]

Kitchenham, B. & Charters S. (2007). Guidelines for performing systematic literature reviews in software engineering. Keele: Software Engineering Group - School of Computer Science and Mathematics. [GS Search]

Lanthony, A., Azzouzi, E., Francois, A. & Peyret, N. (2018). Self-Assessment In PBL: A Tool to Develop Self-Confidence and Autonomy of Students: The Example of Self-Assessment Experiment At Ismep-Supmeca In France. 2018 IEEE Global Engineering Education Conference (EDUCON), 263-267. doi: 10.1109/Educon.2018.8363238. [GS Search]

Larson, R. & Farber, B. (2015). Estatística aplicada. São Paulo: Pearson Education do Brasil.

Lewis, M., Titterton, N. & Clancy, M. (2011). Developing Students' Self-Assessment Skills Using Lab-Centric Instruction. Journal Of Computing Sciences In Colleges, 26, 173-180. doi: 10.5555/1953573.1953602. [GS Search]

Liang, Y., Wang, Q.,Lu, Y., Qian, R. & Yin, Y. (2011). Using a Web-Based System to Explore Peer, Self, and Tutor Assessment in Problem-Based Learning Tutorials. ITME 2011 - Proceedings: 2011 IEEE International Symposium On It In Medicine And Education, 1, 253-256. doi: 10.1109/ITiME.2011.6130827. [GS Search]

Mahlberg, J. (2015). Formative Self-Assessment College Classes Improves Self-Regulation And Retention In First/Second Year Community College Students. Community College Journal of Research and Practice, 39, 772-783. doi: 10.1080/10668926.2014.922134. [GS Search]

Matsuno, S. (2009). Self, Peer-, and Teacher-Assessments in Japanese University EFL Writing Classrooms. Language Testing - Lang Test, 26, 75-100. doi: 10.1177/0265532208097337.[GS Search]

Mbonigaba, J. & Oumar, S. (2015). Exploring the Reliability of Self-Assessment and Peer Assessment in Oral Presentations in Economics: A Sample of Postgraduate Students at a South African University. International Journal of Educational Sciences, 9, 81-92. doi: 10.1080/09751122.2015.11890297. [GS Search]

Mendoza, B., Reyes-Alamo, J., Wu, Huixin, Carranza, A. & Zavala, L. (2016). iPractice: A Self-Assessment Tool for Students Learning Computer Programming in an Urban Campus. Journal of Computing Sciences in Colleges, 31, 93-100. doi: 10.5555/2835377.2835392. [GS Search]

Meng, C., Cui, G. & Wang, S. (2015). The Effects of Self-Evaluation Traits on Efl Students' Learning Satisfaction. 2015 International Conference of Educational Innovation Through Technology (EITT), 184-189. doi: 10.1109/Eitt.2015.46. [GS Search]

Montalvo, T. & Torres, M. C. (2004). El Aprendizaje Autoregulado: Presente y Future de la Investigación. Electronic Journal Of Research In Educational Psychology, 2, 1-33. doi: 10.25115/ejrep.3.120. [GS Search]

Monteiro, E. J. L. B., Leitão, G. de S. & Barreto, R. da S. (2021). Um Método Baseado na Teoria da Resposta ao Item para Avaliação e Feedback Automático no Contexto de Educação Digital. Revista Brasileira de Informática na Educação, 29, 746-774. doi: 10.5753/rbie.2021.29.0.746. [GS Search]

Oliveira, K. L. & Santos, A. (2005). Avaliação de Aprendizagem na Universidade. Psicologia Escolar e Educacional, 9, 37-46. doi: 10.1590/S1413-85572005000100004. [GS Search]

Othman, W. & Abdullah, A. (2018). Assessing Self-Efficacy and College Readiness Level Among New Undergraduate Students in Computer Science Using Metacognitive Awareness Inventory (MAI). IOP Conference Series: Materials Science And Engineering. doi: 10.1088/1757-899x/342/1/012067. [GS Search]

Panadero, E., Brown, G. & Strijbos, J. (2016). The Future of Student Self-Assessment: A Review of Known Unknowns and Potential Directions. Educational Psychology Review, 28, 803-830. doi: 10.1007/s10648-015-9350-2. [GS Search]

Perera, J., Mohamadou, G. & Kaur, S. (2009). The Use of Objective Structured Self-Assessment and Peer-Feedback (OSSP) For Learning Communication Skills: Evaluation Using a Controlled Trial. Advances in Health Sciences Education: Theory and Practice, 15, 185–193. doi: 10.1007/S10459-009-9191-1. [GS Search]

Petersen, K., Vakkalanka, S. & Kuzniarz, L. (2015). Guidelines for Conducting Systematic Mapping Studies in Software Engineering: An Update. Information and Software Technology, 64, 1-18. doi: 10.1016/j.infsof.2015.03.007. [GS Search]

Pop, C. & Khampirat, B. (2019). Self-Assessment Instrument to Measure the Competencies of Namibian Graduates: Testing of Validity and Reliability. Studies in Educational Evaluation, 60, 130-139. doi: 10.1016/J.Stueduc.2018.12.004. [GS Search]

Potter, L. E. (2020). Preparing for Projects: IT Student Self-Evaluation of Technical and Professional Skills. Proceedings of the 2020 on Computers and People Research Conference, 63-69. doi: 10.1145/3378539.3393868. [GS Search]

Ro, H. K., Lattuca, L. & Alcott, B. (2017). Who Goes to Graduate School? Engineers’ Math Proficiency, College Experience, and Self-Assessment of Skills: Choice of Engineering Graduate School. Journal of Engineering Education, 106, 98-122. doi: 10.1002/Jee.20154. [GS Search]

Sánchez, V. G., Soldado, R. M. & López, M. C. P. (2014). Self-assessment via a blended-Learning Strategy to Improve Performance in an Accounting Subject. International Journal of Educational Technology in Higher Education, 11, 43-54. doi: 10.7238/rusc.v11i2.2055. [GS Search]

Sande, J. C. & Murthy, A. (2014). Including Peer and Self-Assessment in a Continuous Assessment Scheme in Electrical and Electronics Engineering Courses. Proceedings - Frontiers in Education Conference, 1-5. doi: 10.1109/FIE.2014.7044284. [GS Search]

Serra-Toro, C., Traver, V. & Amengual, J. (2015). Promoting Student Commitment and Responsibility Through Self- And Peer-Assessment. Proceedings - Frontiers In Education Conference, 1-4. doi: 10.1109/FIE.2014.7044285. [GS Search]

Seufert, S., Guggemos, J. & Sonderegger, S. (2019). Learning Analytics in Higher Education using Peer-feedback and Self-assessment: Use Case of an Academic Writing Course. Proceedings of the 11th International Conference on Computer Supported Education, 2, 315-322. doi: 10.5220/0007714603150322. [GS Search]

Silva Junior, S. D. & Costa, F. J. (2014). Mensuração e Escalas de Verificação uma Análise Comparativa das Escalas Likert e Phase Completion. XVII SEMEAD Seminários em Administração (pp. 4-5). [GS Search]

Spencer, L., Marschark, M., Machmer, E., Durkin, A., Borgna, G. & Convertino, C. (2018). Communication Skills of Deaf And Hard-Of-Hearing College Students: Objective Measures and Self-Assessment. Journal of Communication Disorders, 75, 13-24. doi: 10.1016/J.Jcomdis.2018.06.002. [GS Search]

Ssegawa, J. K. & Kasule, D. (2017). A Self-Assessment of the Propensity to Obtain Future Employment: A Case of Final-Year Engineering Students at The University of Botswana. European Journal of Engineering Education, 42, 513-532. doi: 10.1080/03043797.2016.1193124. [GS Search]

Stan, C. & Manea, A. (2015). The Divergent Relationship Between Assessment and SelfAssessment in Higher Education. Experimental Results. Procedia - Social and Behavioral Sciences, 209, 497-502. doi: 10.1016/j.sbspro.2015.11.278. [GS Search]

Tan, K. H. K. (2008). Qualitatively Different Ways of Experiencing Student Self-Assessment. Higher Education Research & Development, 27, 15-29. doi: 10.1080/07294360701658708. [GS Search]

Torres-Guijarro, S. & Bengoechea, M. (2016). Gender Differential in Self-Assessment: A Fact Neglected in Higher Education Peer and Self-Assessment Techniques. Higher Education Research and Development, 36, 1072-1084. doi: 10.1080/07294360.2016.1264372. [GS Search]

Vieira, F. & Moreira, M. A. (2003). Para além dos testes: A avaliação processual na aula de Inglês. Braga: Universidade Do Minho.

Vieira, I. M. A. (2013). A autoavaliação como instrumento de regulação da aprendizagem (pp. 28). Lisboa: Universidade Aberta. Departamento de Educação e Ensino a Distância. [GS Search]

Walser, T. (2009). An Action Research Study of Student Self-Assessment in Higher Education. Innovative Higher Education, 34, 299-306. doi: 10.1007/S10755-009-9116-1. [GS Search]

Wegner, S. & Beumann, S. (2017). An Outlook on Self-Assessment of Homework Assignments in Higher Mathematics Education. International Journal of Stem Education, 5, 55-62. doi: 10.1186/S40594-018-0146-Z. [GS Search]

Weisi, H. & Karimi, M. (2013). The Effect of Self-Assessment Among Iranian EFL Learners. Procedia - Social and Behavioral Sciences, 70, 731-737. doi: 10.1016/J.Sbspro.2013.01.117. [GS Search]

Published

2022-05-20

How to Cite

AMÂNCIO, I.; KEMCZINSKI, A.; DICKEL, M. R. B. Accuracy of Student Self-assessment in Higher Education: A Systematic Mapping of the Literature. Brazilian Journal of Computers in Education, [S. l.], v. 30, p. 182–209, 2022. DOI: 10.5753/rbie.2022.2304. Disponível em: https://journals-sol.sbc.org.br/index.php/rbie/article/view/2304. Acesso em: 25 nov. 2024.

Issue

Section

Articles