A process model to looking for signs of learning using concept maps: a case study

Authors

DOI:

https://doi.org/10.5753/rbie.2024.3575

Keywords:

Concept maps, Meaningful learning, Map evaluation, Process of maps construction

Abstract

Concept maps are pedagogical tools widely used to facilitate the teaching and learning process. They are an important instrument for learning assessment including aspects of Ausubel's theory that defines the principles of meaningful learning. Assessment of learning through concept maps are proposed in several works in the literature considering structural and semantic analysis. However, certain learner's cognitive aspects are only observed during the construction of concept maps. Therefore, analyse the maps construction process is essential to improve learning assessment through concept maps. One of the contributions of this paper is to present an evaluation process model which considers a set of efective criteria defined from maps individual propositions, aiming to point out signs of learning, classified as non-learning, rote learning and meaningful learning signs, through a detailed analysis of both maps and maps construction process. The evaluation process can be automated in order to give support for education. We evaluated our process model using a case study that, besides identifying signs from structural and semantics analysis, explore new learning signs from maps construction process. This paper mainly concentrates in the case study exposition and for that it uses a systematic presentation of the map evaluation process model. As the best as we know, our proposal differs from the works in the literature mainly due to the analysis of maps construction process combined with syntatic and semantics analysis of maps to identify signs of learning.

Downloads

Download data is not yet available.

References

Anohina, A., Graudina, V., & Grundspenkis, J. (2006). Intelligent system for learners’ knowledge self-assessment and process oriented knowledge control based on concept maps and ontologies. Annual Proceedings of Vidzeme University Colleg, 1–8. [GS Search]

Anohina, A., & Grundspenkis, J. (2007). A concept map based intelligent system for adaptive knowledge assessment. Conference on Databases and Information Systems, 263–276.[GS Search]

Anohina, A., Pozdnakovs, D., & Grundspenkis, J. (2007). Changing the degree of task difficulty in concept map based assessment system. International Conference e-Learning, 6(8), 443–450. [GS Search]

Araujo, A. M. T., de Menezes, C. S., & Cury, D. (2003). Apoio automatizado à avaliação da aprendizagem utilizando mapas conceituais. XIV Simpósio Brasileiro de Informática na Educação, 287–296. [GS Search]

Ausubel, D. P. (1962). A subsumption theory of meaningful verbal learning and retention. The Journal of General Psychology, 66(2), 213–224. [GS Search]

Ausubel, D. P. (1968). Educational psychology: A cognitive view. Holt, Rinehart; Winston. [GS Search]

Ausubel, D. P. (2000). The acquisition and retention of knowledge: A cognitive view. Kluwer Academic Publishers.[GS Search]

Ausubel, D. P., Robbins, L. C., & Jr., E. B. (1957). Retroactive inhibition and facilitation in the learning of school materials. Journal of Educational Psychology, 48(6), 334–343. [GS Search]

Azeredo, R. A., Aguiar, C. Z., Perin, W. A., Cury, D., & Lovati, M. P. D. (2017). Detecting synonyms in concept map as support for learning assessment. Latin American Conference on Learning Technologies, 1–4. https://doi.org/10.1109/LACLO.2017.8120902.[GS Search]

Basili, V., Caldiera, G., & Rombach, D. (1994). Goal question metric paradigm. Encyclopedia of Software Engineering, 1, 528–532. [GS Search]

Bleckmann, T., & Friege, G. (2023). Concept maps for formative assessment: Creation and implementation of an automatic and intelligent evaluation method. Knowledge Management & E-Learning, 15(3), 433–447. https://doi.org/https://doi.org/10.34105/j.kmel.2023.15.025. [GS Search]

Boss, S. L. B., de Souza Matos, E., & Andrade, A. M. S. (2019). Soluções computacionais para avaliação da aprendizagem por mapas conceituais: Um mapeamento sistemático. Simpósio Brasileiro de Informática na Educação, 399–408. [GS Search]

Canas, A. J., Carvalho, M., & Arguedas, M. (2004). Mining the web to suggest concepts during concept map construction. International Conference on Concept Mapping. [GS Search]

Chang, K.-E., Sung, Y.-T., Chang, R.-B., & Lin, S.-C. (2005). A new assessment for computer-based concept mapping. Educational Technology & Society, 8, 138–148. [GS Search]

Chen, S. W., Lin, S. C., & Chang, K. E. (2001). Attributed concept maps: Fuzzy integration and fuzzy matching. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 31(5), 842–852. https://doi.org/10.1109/3477.956047. [GS Search]

da Rocha, F. E. L., da Costa Junior, J. V., & Favero, E. L. (2008). An approach to computer-aided learning assessment. International Conference on Concept Mapping, 170–177. [GS Search]

da Rocha, F. E. L., da Costa Junior, J. V., & Favero, E. L. (2005). Como usar ontologias na avaliação da aprendizagem significativa mediada por mapas conceituais. Revista Brasileira de Informática na Educação, 13(2), 53–64. [GS Search]

da Rocha, F. E. L., & Favero, E. L. (2004). Cmtool: A supporting tool for conceptual map analysis. World Congress on Engineering and Technology Education, 14–17. [GS Search]

da Rocha, F. E. L., Vieira, R. V., da Costa Jr, J. V., & Favero, E. L. (2004). Especificação de um algoritmo genético para auxiliar na avaliação da aprendizagem significativa com mapas conceituais. XV Simpósio Brasileiro de Informática na Educação, 139–148. [GS Search]

da Silva, V., & Omar, N. (2017). Model of measurement of meaningful learning in distance learning environments. Iberian Conference on Information Systems and Technologies, 1–6. https://doi.org/10.23919/CISTI.2017.7975696. [GS Search]

Gouli, E., Gogoulou, A., Papanikolaou, K., & Grigoriadou, M. (2004). Compass: An adaptive web-based concept map assessment tool. International Conference on Concept Mapping, 1, 295–302. [GS Search]

Grundspenkis, J., & Strautmane, M. (2018). Usage of graph patterns for knowledge assessment based on concept maps. Scientific Journal of Riga Technical University. Computer Sciences, 38, 60–71. [GS Search]

Grundspenkis, J. (2008a). Knowledge creation supported by intelligent knowledge assessment system. 12th world multi-conference on systemics, cybernetics and informatics, 7(2), 135–140. [GS Search]

Grundspenkis, J. (2008b). Development of concept map based adaptive knowledge assessment system. Proceedings of the International Conference e-Learning, 1, 395–402. [GS Search]

Grundspenkis, J. (2009). Concept maps as knowledge assessment tool: Results of practical use of intellligent knowledge assessment system. International Conference Cognition and Exploratory Learning in Digital Age, 258–266. [GS Search]

Grundspenkis, J., & Anohina, A. (2009). Evolution of the concept map based adaptive knowledge assessment system: Implementation and evaluation results. Journal Riga Technical University, 38, 13–24. [GS Search]

H. Acton, W., J. Johnson, P., & E. Goldsmith, T. (1994). Structural knowledge assessment: Comparison of referent structures. Journal of Educational Psychology, 86, 303–311. https ://doi.org/https://doi.org/10.1037/0022-0663.86.2.303. [GS Search]

Hay, D., & Kinchin, I. (2008). Using concept mapping to measure learning quality. Education + Training, 50(2), 167–182. https://doi.org/10.1108/00400910810862146. [GS Search]

Hay, D., Kinchin, I., & Lygo-Baker, S. (2008). Making learning visible: The role of concept mapping in higher education. Studies in Higher Education, 33(3), 295–311. https://doi.org/10.1080/03075070802049251. [GS Search]

Hay, D. B. (2007). Using concept maps to measure deep, surface and non-learning outcomes. Studies in Higher Education, 32(1), 39–57. https://doi.org/10.1080/03075070601099432. [GS Search]

Hay, D. B., Kehoe, C., Miquel, M. E., Hatzipanagos, S., Kinchin, I. M., Keevil, S. F., & Lygo-Baker, S. (2008). Measuring the quality of e-learning. British Journal of Educational Technology, 39(6), 1037–1056. https://doi.org/10.1111/j.1467-8535.2007.00777.x. [GS Search]

Ian M. Kinchin, D. B. H., & Adams, A. (2010). How a qualitative approach to concept map analysis can be used to aid learning by illustrating patterns of conceptual developmen. Educational Research, 42(1), 43–57. https://doi.org/10.1080/001318800363908. [GS Search]

Iqbal, R., Murad, M. A. A., Sliman, L., & da Silva, C. P. (2018). A mathematical evaluation for measuring correctness of domain ontologies using concept maps. Measurement, 118, 73–82. https://doi.org/10.1016/j.measurement.2018.01.009. [GS Search]

Jarvis, P. (1992). Paradoxes of learning: On becoming an individual in society. Jossey-Bass. [GS Search]

Jonassen, D. H., Carr, C., & Yueh, H.-P. (1998). Computers as mindtools for engaging learners in critical thinking. TechTrends: Linking Research and Practice to Improve Learning, 43(2), 24–32. https://doi.org/https://doi.org/10.1007/BF02818172. [GS Search]

Kinchin, I. M. (2000). The active use of concept mapping to promote meaningful learning in biological science [Doctoral dissertation, School of Educational Studies]. [GS Search]

Moreira, M. A. (2010). Mapas conceituais e a aprendizagem significativa. Centauro. [GS Search]

Novak, J., & Canas, A. (2006). The theory underlying concept maps and how to construct them (tech. rep.). Institute for Human and Machine Cognition. Pensacola, Florida. [GS Search]

Novak, J. D. (1998). Learning, creating, and using knowledge: Concept maps as facilitative tools in schools and corporations. Lawrence Erlbaum Associates. [GS Search]

Novak, J. D. (2002). Meaningful learning: The essential factor for conceptual change in limited or inappropriate propositional hierarchies leading to empowerment of learners. Science Education, 86(4), 548–571. https://doi.org/10.1002/sce.10032. [GS Search]

Novak, J. D., & Gowin, D. B. (1984). Learning how to learn. Cambridge University Press. [GS Search]

Ruiz-Primo, M. A. (2004). Examining concept maps as assessment tool. International Conference on Concept Mapping, 1, 555–562. [GS Search]

Ruiz-Primo, M. A., Schultz, S. E., Li, M., & Shavelson, R. J. (2001). Comparison of the reliability and validity of scores from two concept-mapping techniques. Journal of Research in Science Teaching, 38(2), 260–278. https://doi.org/10.1002/1098-2736(200102)38:2%3C260::AID-TEA1005%3E3.0.CO;2-F. [GS Search]

Santos, P. S., de Menezes, C. S., Cury, D., & de Nevado, R. A. (2005). Um ambiente para acompanhamento da aprendizagem baseado em mapas conceituais. XVI Simpósio brasileiro de informática na educação, 455–465. [GS Search]

Additional Files

Published

2024-12-03

How to Cite

BOSS, S. L. B.; ANDRADE, A. M. S.; MATOS, E. de S. A process model to looking for signs of learning using concept maps: a case study. Brazilian Journal of Computers in Education, [S. l.], v. 32, p. 913–943, 2024. DOI: 10.5753/rbie.2024.3575. Disponível em: https://journals-sol.sbc.org.br/index.php/rbie/article/view/3575. Acesso em: 21 dec. 2024.

Issue

Section

Articles

Most read articles by the same author(s)