Usability of Canvas and Blackboard Learning Management Systems: A case study at a Brazilian University
DOI:
https://doi.org/10.5753/rbie.2023.2921Keywords:
Human Computer-Interface, Usability, Interaction, Inspection, Learning Management System, EaD, Canvas, BlackboardAbstract
Educational institutions should carefully evaluate the usability of their Learning Management Systems (LMS) before delivering them to teachers and students. This paper presents the process and the results of the usability evaluations in the teaching-learning activities supported by the Canvas and the Blackboard LMS at a Brazilian University. The methodology considered tests with users to evaluate five usability features in the Canvas and Blackboard systems. In addition, usability experts performed usability inspections to analyze problems and possible solutions. The results indicated that both platforms have severe usability issues. In terms of the comparisons between the two LMS systems, the results did not show a significant disparity in usability between them. As a result, we also pointed out the main problems and solutions of the LMS.
Downloads
References
Ahmad, F., Beyene, W., & Giannoumis, G. A. (2018). Comparative Evaluation of Accessibility and Learnability of Learning Management Systems: Case of Fronter and Canvas. In C. Stephanidis (Ed.), Hci international 2018 – posters’ extended abstracts (pp. 3–9). Cham: Springer International Publishing. doi:10.1007/978-3-319-92279-9_1. [GS Search]
Alhadreti, O. (2020). A comparative usability study of blackboard and desire2learn: Students’ perspective. In P. Zaphiris & A. Ioannou (Eds.), Learning and collaboration technologies. designing, developing and deploying learning experiences (pp. 3–19). Cham: Springer International Publishing. doi:10.1007/978-3-030-50513-4_1. [GS Search]
Alturki, U., Aldraiweesh, A., & Kinshuk. (2016). Evaluating the usability and accessibility of lms “blackboard” at king saud university. Contemporary Issues in Education Research (CIER), 9(1), 33-44. doi:10.19030/cier.v9i1.9548. [GS Search]
Andrews-Todd, J., Bond, G., Speller, L., Stevenson, R., & Tillman, B. (2013). Usability of the blackboard course management system: Student and instructor dynamics in a dynamic system. Cognitive Technology Journal, 18(2), 18-32. [GS Search]
Associação Brasileira de Normas Técnicas (2002). NBR 9241-11. Requisitos ergonômicos para trabalho de escritório com computadores: parte 11 - orientação sobre usabilidade. Rio de Janeiro: ABNT.
Brasil (2022). ReUni Digital. Panorama da EaD no Brasil (Vol. 2). Disponível em [Link].
Brooke, J. (1996). Sus: A ‘quick and dirty’ usability scale. In P. W. Jordan, B. Thomas, I. L. Mc-Clelland, & B. Weerdmeester (Eds.), Usability evaluation in industry (1st ed., pp. 1–6). Boca Raton, FL: CRC Press. doi:10.1201/9781498710411-35. [GS Search]
Chen, W., Sanderson, N. C., Nichshyk, A., Bong, W. K., & Kessel, S. (2021). Usability of learning management systems for instructors – the case of canvas. In P. Zaphiris & A. Ioannou (Eds.), Learning and collaboration technologies: New challenges and learning experiences (Vol. 12784, pp. 210–223). Cham: Springer International Publishing. doi:10.1007/978-3-030-77889-7_14. [GS Search]
Faulkner, L. (2003). Beyond the five-user assumption: Benefits of increased sample sizes in usability testing. Behavior Research Methods, Instruments and Computers, 35(3), 379-383. doi:10.3758/bf03195514. [GS Search]
Grossi, M. G. R., de Souza Elias, M. C. A., Chamon, C. M., & Leal, D. C. C. C. (2018). The educational potentialities of the virtual learning environments moodle and canvas: A comparative study. International Journal of Information and Education Technology, 8(7), 514-519. doi:10.18178/ijiet.2018.8.7.1091. [GS Search]
Gumasing, M. J. J., Vasquez, A. B., Doctora, A. L. S., & Perez, W. D. D. (2022). Usability evaluation of online learning management system: Comparison between blackboard and canvas. In 2022 the 9th international conference on industrial engineering and applications (europe) (p. 25–31). New York, NY, USA: Association for Computing Machinery. doi:10.1145/3523132.3523137. [GS Search]
Gunesekera, A. I., Bao, Y., & Kibelloh, M. (2019). The role of usability on e-learning user interactions and satisfaction: a literature review. Journal of Systems and Information Technology, 21(3), 368-394. doi:10.1108/JSIT-02-2019-0024. [GS Search]
Heimerl, F., Lohmann, S., Lange, S., & Ertl, T. (2014). Word cloud explorer: Text analytics based on word clouds. In 2014 47th hawaii international conference on system sciences (p. 1833-1842). Waikoloa, HI, USA: IEEE. doi:10.1109/HICSS.2014.231. [GS Search]
Lewis, J. R. (1995). Ibm computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human–Computer Interaction, 7(1), 57-78. doi:10.1080/10447319509526110. [GS Search]
Nielsen, J. (1994). Heuristic evaluation. In J. Nielsen & R. L. Mack (Eds.), Usability inspection methods (1st ed., p. 25–62). New York, NY, USA: John Wiley & Sons, Inc.
Nielsen, J. (2012, jun). How many test users in a usability study? Disponível em [Link].
Nielsen, J., & Loranger, H. (2006). Prioritizing web usability. Thousand Oaks, CA, USA: New Riders Publishing.
Oliveira, N. J. S., Procaci, T. B., & Siqueira, S. W. M. (2020). Captura da Aceitação do Blackboard e do Tipo de Motivação de Alunos de Cursos Presenciais de Ciências Exatas em uma Universidade Privada. Revista Brasileira de Informática na Educação, 28, 229-259. doi:10.5753/RBIE.2020.28.0.229. [GS Search]
Phongphaew, N., & Jiamsanguanwong, A. (2018). Usability evaluation on learning management system. In T. Ahram & C. Falcão (Eds.), Advances in usability and user experience (pp. 39–48). Cham: Springer International Publishing. doi:10.1007/978-3-319-60492-3_4. [GS Search]
Rocha, H. V., & Baranauskas, M. C. (2003). Avaliação de interfaces. In Design e avaliação de interfaces humano-computador (p. 200-208). Campinas: UNICAMP.
Sauro, J. (2011). A practical guide to the system usability scale: Background, benchmarks & best practices.
Sobaih, A. E. E., Hasanein, A. M., & Abu Elnasr, A. E. (2020). Responses to covid-19 in higher education: Social media usage for sustaining formal academic communication in developing countries. Sustainability, 12(16), 6520. doi:10.3390/su12166520. [GS Search]
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Lucas Exposto Soares, José Maria Clementino Júnior, Lucas Augusto Vieira Brito, Rogério Gil Gonzaga, Humberto Antonio Antico, Rodolfo Jardim de Azevedo, Alessandra Alaniz Macedo
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
