Accuracy of Student Self-assessment in Higher Education: A Systematic Mapping of the Literature
DOI:
https://doi.org/10.5753/rbie.2022.2304Keywords:
student self-assessment, coefficient of accuracy, higher education, systematic mapping of the literatureAbstract
Student self-assessment is an assessment strategy that provides educational benefits to students, such as the ability to evaluate their own work and self-regulate their learning. The purpose of this research is to present how student self-assessment has been applied in higher education through a Systematic Mapping of the Literature (SML) on the topic. The forty-six relevant papers showed that self-assessment is usually applied along with other strategies such as peer and teacher assessment. Educational gains such as improved academic performance, self-criticism, reflection, and accountability were observed by practicing self-assessment. Furthermore, of the 53% of the studies that mentioned the use of computer tools in the use of self-assessment, it was observed that two tools were necessary, one for the application of self-assessment and the other for data analysis. In relation to accuracy, no consensus was found among the authors, with 26% mentioning the use of Pearson's correlation coefficient, which does not meet all possible scenarios when comparing strategies such as self-assessment and teacher evaluation. A coefficient that allows measuring the accuracy of student self-assessment is suggested in this research, since the difficulty in measuring accuracy was a gap observed.
Downloads
References
Abolfazli, Z. & Sadeghi, K. (2012).The Effect of Assessment Type (Self vs. Peer vs. Teacher) on Iranian University EFL Students’ Course Achievement. Language Testing in Asia, 2, 47–74. doi: 10.1186/2229-0443-2-4-47. [GS Search]
Alishah, A. & Dolmaci, M. (2013). The Interface Between Self-Efficacy Concerning the Self Assessment on Students Studying English as a Foreign Language. Procedia - social and behavioral sciences, 70, 873-881. doi:10.1016/j.sbspro.2013.01.133. [GS Search]
Aryadoust, V. (2015). Self- and Peer Assessments of Oral Presentations by First-Year University Students. Educational Assessment, 20, 199-225. doi: 10.1080/10627197.2015.1061989. [GS Search]
Bacich, L. & Moran, J. (2018). Metodologias Ativas para uma Educação Inovadora. Porto Alegre: Penso.
Boud, D. (1995). Enhancing Learning Through Self-Assessment. London: Routledge.
Boud, D. & Falchikov, N. (2005). Redesigning Assessment for Learning Beyond Higher Education. Higher Education in a Changing World. Research and Development in Higher Education, 28, 34-41. [GS Search]
Brew, A. & Boud, D. (1995). Teaching and Research: Establishing the Vital Link With Learning. Higher Education, 29, 261-273. doi: 10.1007/BF01384493. [GS Search]
Brown, G., Andrade, H. & Chen, F. (2015). Accuracy in Student Self-Assessment: Directions and Cautions for Research. Assessment in Education Principles Policy and Practice, 22, 444-457. doi: 10.1080/0969594X.2014.996523. [GS Search]
Buchinger, D., Cavalcanti, G. & Hounsell, M. (2014). Mecanismos de Busca Acadêmica: uma Análise Quantitativa. Revista Brasileira de Computação Aplicada, 6, 108-120. doi: 10.5335/rbca.2014.3452. [GS Search]
Dermeval, D., Coelho, J. A. P. de M. & Bittencourt, I. I. (2019). Mapeamento sistemático e revisão sistemática da literatura em informática na educação (pp. 5-6). Porto Alegre: Sociedade Brasileira de Computação. [GS Search]
Desrochers, M., Zhang, J., Caron, S. & Steinmiller, J. (2019). An Experimental Comparison of the Effect of Teacher versus Self-Evaluation/Self-Reflection Feedback on College Students’ Behavioral Observation Skills. Journal of Behavioral Education, 28, 258-274. doi: 10.1007/s10864-018-09313-6. [GS Search]
Dlab, H. M., Katic, M. A., & Candrlic, S. (2015). Ensuring Formative Assessment in Course with Online Tests. 10th International Conference on Computer Science & Education (ICCSE), 10, 322–327. doi: 10.1109/ICCSE.2015.7250264. [GS Search]
Dochy, F., Segers, M. & Sluijsmans, D. (1999). The use of self-, Peer and Co-Assessment in Higher Education: A Review. Studies in Higher Education, 24, 331-350. doi: 10.1080/03075079912331379935. [GS Search]
Echeazarra, L., Perera, J., Sanz-santamaría, S. & Gutiérrez, J. (2014). Student-Generated Online Videos to Develop Cross-Curricular and Curricular Competencies in Nursing Studies. Computers in Human Behavior, 31, 580-590. doi: 10.1016/j.chb.2013.06.011. [GS Search]
El Maaddawy, T. (2017). Enhancing Learning of Engineering Students Through Self-Assessment. IEEE Global Engineering Education Conference (EDUCON), 86-91. doi: 10.1109/EDUCON.2017.7942828. [GS Search]
Ezzahra, K., Islam, O., & Radid, M. (2015). Self-assessment of the Progress of Thesis for the PHD Students in the Moroccan University. Procedia - Social and Behavioral Sciences, 197, 1789-1795. doi: 10.1016/j.sbspro.2015.07.237. [GS Search]
França, R. & Tedesco, P. (2015). Caracterizando a Pesquisa Sobre Autoavaliação na Aprendizagem de Programação para Iniciantes. Simpósio Brasileiro de Informática na Educação, 549-558. doi: 10.5753/cbie.sbie.2015.549.
Ganajová, M., Sotáková, I., Jurková, V., Brestenska, B., Szarka, K. & Kozurkova, M. (2020). Investigating Students' Self-Assessment of Conceptual Understanding Using Self Assessment Cards in Chemistry. ICMET '20: Proceedings of the 2020 2nd International Conference on Modern Educational Technology, 20, 30-33. doi: 10.1145/3401861.3401864. [GS Search]
Garson, G. D. (2009). Statnotes: Topics in Multivariate Analysis. Recuperado de: [Link] Acesso em: fevereiro de 2022.
González-Betancor, S. M., Bolívar-Cruz, A. & Verano-Tacoronte, D. (2017). Self-assessment Accuracy in Higher Education: The Influence of Gender and Performance of University Students. Active Learning in Higher Education, 20, 101-114. doi: 10.1177/1469787417735604. [GS Search]
Guest, J. & Riegler, R. (2016). Learning by Doing: Do Economics Students Self-Evaluation Skills Improve? International Review of Economics Education, 24, 50-64. doi: 10.1016/j.iree.2016.10.002. [GS Search]
Hale C. (2015). Self-Assessment as Academic Community Building: a Study from a Japanese Liberal Arts University. Language Testing in Asia, 5, 1-12. doi: 10.1186/s40468-014-0010-0. [GS Search]
Han, C. (2018). A Longitudinal Quantitative Investigation Into the Concurrent Validity of Self and Peer Assessment Applied to English-Chinese Bi-Directional Interpretation in an Undergraduate Interpreting Course. Studies in Educational Evaluation, 58, 187-196. doi: 10.1016/j.stueduc.2018.01.001. [GS Search]
Heukelman, D. (2017). Measuring E-Readiness: A Case Study: Self-Assessment vs Performance Testing. 1st International Conference on Next Generation Computing Applications (NextComp), 215–219. doi: 10.1109/NEXTCOMP.2017.8016201. [GS Search]
Hosein, A. & Harle, J. (2018). The Relationship Between Students’ Prior Mathematical Attainment, Knowledge and Confidence on Their Self-Assessment Accuracy. Studies in Educational Evaluation, 56, 32–41. doi: 10.1016/j.stueduc.2017.10.008. [GS Search]
Hulsman, R. & Vloodt, J. (2014). Self-Evaluation and Peer-Feedback of Medical Students’ Communication Skills Using a Web-Based Video Annotation System. Exploring Content and Specificity. Patient Education and Counseling, 98. doi: 10.1016/j.pec.2014.11.007. [GS Search]
Hwang, W., Hsu, J., Shadiev, R., Chang, C. & Huang, Y. M. (2015). Employing Self-Assessment, Journaling, and Peer Sharing to Enhance Learning From an Online Course. . Journal of Computing in Higher education, 27, 114-133. doi: 10.1007/s12528-015-9096-3. [GS Search]
Ibabe, I. & Jauregizar, J. (2010). Online Self-Assessment With Feedback and Metacognitive Knowledge. Higher Education, 59, 243–258. doi: 10.1007/s10734-009-9245-6. [GS Search]
Kitchenham, B. & Charters S. (2007). Guidelines for performing systematic literature reviews in software engineering. Keele: Software Engineering Group - School of Computer Science and Mathematics. [GS Search]
Lanthony, A., Azzouzi, E., Francois, A. & Peyret, N. (2018). Self-Assessment In PBL: A Tool to Develop Self-Confidence and Autonomy of Students: The Example of Self-Assessment Experiment At Ismep-Supmeca In France. 2018 IEEE Global Engineering Education Conference (EDUCON), 263-267. doi: 10.1109/Educon.2018.8363238. [GS Search]
Larson, R. & Farber, B. (2015). Estatística aplicada. São Paulo: Pearson Education do Brasil.
Lewis, M., Titterton, N. & Clancy, M. (2011). Developing Students' Self-Assessment Skills Using Lab-Centric Instruction. Journal Of Computing Sciences In Colleges, 26, 173-180. doi: 10.5555/1953573.1953602. [GS Search]
Liang, Y., Wang, Q.,Lu, Y., Qian, R. & Yin, Y. (2011). Using a Web-Based System to Explore Peer, Self, and Tutor Assessment in Problem-Based Learning Tutorials. ITME 2011 - Proceedings: 2011 IEEE International Symposium On It In Medicine And Education, 1, 253-256. doi: 10.1109/ITiME.2011.6130827. [GS Search]
Mahlberg, J. (2015). Formative Self-Assessment College Classes Improves Self-Regulation And Retention In First/Second Year Community College Students. Community College Journal of Research and Practice, 39, 772-783. doi: 10.1080/10668926.2014.922134. [GS Search]
Matsuno, S. (2009). Self, Peer-, and Teacher-Assessments in Japanese University EFL Writing Classrooms. Language Testing - Lang Test, 26, 75-100. doi: 10.1177/0265532208097337.[GS Search]
Mbonigaba, J. & Oumar, S. (2015). Exploring the Reliability of Self-Assessment and Peer Assessment in Oral Presentations in Economics: A Sample of Postgraduate Students at a South African University. International Journal of Educational Sciences, 9, 81-92. doi: 10.1080/09751122.2015.11890297. [GS Search]
Mendoza, B., Reyes-Alamo, J., Wu, Huixin, Carranza, A. & Zavala, L. (2016). iPractice: A Self-Assessment Tool for Students Learning Computer Programming in an Urban Campus. Journal of Computing Sciences in Colleges, 31, 93-100. doi: 10.5555/2835377.2835392. [GS Search]
Meng, C., Cui, G. & Wang, S. (2015). The Effects of Self-Evaluation Traits on Efl Students' Learning Satisfaction. 2015 International Conference of Educational Innovation Through Technology (EITT), 184-189. doi: 10.1109/Eitt.2015.46. [GS Search]
Montalvo, T. & Torres, M. C. (2004). El Aprendizaje Autoregulado: Presente y Future de la Investigación. Electronic Journal Of Research In Educational Psychology, 2, 1-33. doi: 10.25115/ejrep.3.120. [GS Search]
Monteiro, E. J. L. B., Leitão, G. de S. & Barreto, R. da S. (2021). Um Método Baseado na Teoria da Resposta ao Item para Avaliação e Feedback Automático no Contexto de Educação Digital. Revista Brasileira de Informática na Educação, 29, 746-774. doi: 10.5753/rbie.2021.29.0.746. [GS Search]
Oliveira, K. L. & Santos, A. (2005). Avaliação de Aprendizagem na Universidade. Psicologia Escolar e Educacional, 9, 37-46. doi: 10.1590/S1413-85572005000100004. [GS Search]
Othman, W. & Abdullah, A. (2018). Assessing Self-Efficacy and College Readiness Level Among New Undergraduate Students in Computer Science Using Metacognitive Awareness Inventory (MAI). IOP Conference Series: Materials Science And Engineering. doi: 10.1088/1757-899x/342/1/012067. [GS Search]
Panadero, E., Brown, G. & Strijbos, J. (2016). The Future of Student Self-Assessment: A Review of Known Unknowns and Potential Directions. Educational Psychology Review, 28, 803-830. doi: 10.1007/s10648-015-9350-2. [GS Search]
Perera, J., Mohamadou, G. & Kaur, S. (2009). The Use of Objective Structured Self-Assessment and Peer-Feedback (OSSP) For Learning Communication Skills: Evaluation Using a Controlled Trial. Advances in Health Sciences Education: Theory and Practice, 15, 185–193. doi: 10.1007/S10459-009-9191-1. [GS Search]
Petersen, K., Vakkalanka, S. & Kuzniarz, L. (2015). Guidelines for Conducting Systematic Mapping Studies in Software Engineering: An Update. Information and Software Technology, 64, 1-18. doi: 10.1016/j.infsof.2015.03.007. [GS Search]
Pop, C. & Khampirat, B. (2019). Self-Assessment Instrument to Measure the Competencies of Namibian Graduates: Testing of Validity and Reliability. Studies in Educational Evaluation, 60, 130-139. doi: 10.1016/J.Stueduc.2018.12.004. [GS Search]
Potter, L. E. (2020). Preparing for Projects: IT Student Self-Evaluation of Technical and Professional Skills. Proceedings of the 2020 on Computers and People Research Conference, 63-69. doi: 10.1145/3378539.3393868. [GS Search]
Ro, H. K., Lattuca, L. & Alcott, B. (2017). Who Goes to Graduate School? Engineers’ Math Proficiency, College Experience, and Self-Assessment of Skills: Choice of Engineering Graduate School. Journal of Engineering Education, 106, 98-122. doi: 10.1002/Jee.20154. [GS Search]
Sánchez, V. G., Soldado, R. M. & López, M. C. P. (2014). Self-assessment via a blended-Learning Strategy to Improve Performance in an Accounting Subject. International Journal of Educational Technology in Higher Education, 11, 43-54. doi: 10.7238/rusc.v11i2.2055. [GS Search]
Sande, J. C. & Murthy, A. (2014). Including Peer and Self-Assessment in a Continuous Assessment Scheme in Electrical and Electronics Engineering Courses. Proceedings - Frontiers in Education Conference, 1-5. doi: 10.1109/FIE.2014.7044284. [GS Search]
Serra-Toro, C., Traver, V. & Amengual, J. (2015). Promoting Student Commitment and Responsibility Through Self- And Peer-Assessment. Proceedings - Frontiers In Education Conference, 1-4. doi: 10.1109/FIE.2014.7044285. [GS Search]
Seufert, S., Guggemos, J. & Sonderegger, S. (2019). Learning Analytics in Higher Education using Peer-feedback and Self-assessment: Use Case of an Academic Writing Course. Proceedings of the 11th International Conference on Computer Supported Education, 2, 315-322. doi: 10.5220/0007714603150322. [GS Search]
Silva Junior, S. D. & Costa, F. J. (2014). Mensuração e Escalas de Verificação uma Análise Comparativa das Escalas Likert e Phase Completion. XVII SEMEAD Seminários em Administração (pp. 4-5). [GS Search]
Spencer, L., Marschark, M., Machmer, E., Durkin, A., Borgna, G. & Convertino, C. (2018). Communication Skills of Deaf And Hard-Of-Hearing College Students: Objective Measures and Self-Assessment. Journal of Communication Disorders, 75, 13-24. doi: 10.1016/J.Jcomdis.2018.06.002. [GS Search]
Ssegawa, J. K. & Kasule, D. (2017). A Self-Assessment of the Propensity to Obtain Future Employment: A Case of Final-Year Engineering Students at The University of Botswana. European Journal of Engineering Education, 42, 513-532. doi: 10.1080/03043797.2016.1193124. [GS Search]
Stan, C. & Manea, A. (2015). The Divergent Relationship Between Assessment and SelfAssessment in Higher Education. Experimental Results. Procedia - Social and Behavioral Sciences, 209, 497-502. doi: 10.1016/j.sbspro.2015.11.278. [GS Search]
Tan, K. H. K. (2008). Qualitatively Different Ways of Experiencing Student Self-Assessment. Higher Education Research & Development, 27, 15-29. doi: 10.1080/07294360701658708. [GS Search]
Torres-Guijarro, S. & Bengoechea, M. (2016). Gender Differential in Self-Assessment: A Fact Neglected in Higher Education Peer and Self-Assessment Techniques. Higher Education Research and Development, 36, 1072-1084. doi: 10.1080/07294360.2016.1264372. [GS Search]
Vieira, F. & Moreira, M. A. (2003). Para além dos testes: A avaliação processual na aula de Inglês. Braga: Universidade Do Minho.
Vieira, I. M. A. (2013). A autoavaliação como instrumento de regulação da aprendizagem (pp. 28). Lisboa: Universidade Aberta. Departamento de Educação e Ensino a Distância. [GS Search]
Walser, T. (2009). An Action Research Study of Student Self-Assessment in Higher Education. Innovative Higher Education, 34, 299-306. doi: 10.1007/S10755-009-9116-1. [GS Search]
Wegner, S. & Beumann, S. (2017). An Outlook on Self-Assessment of Homework Assignments in Higher Mathematics Education. International Journal of Stem Education, 5, 55-62. doi: 10.1186/S40594-018-0146-Z. [GS Search]
Weisi, H. & Karimi, M. (2013). The Effect of Self-Assessment Among Iranian EFL Learners. Procedia - Social and Behavioral Sciences, 70, 731-737. doi: 10.1016/J.Sbspro.2013.01.117. [GS Search]
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Indianara Amâncio, Avanilde Kemczinski, Marlow R. B. Dickel
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.