End-to-end automated student attendance recording system using surveillance camera
DOI:
https://doi.org/10.5753/rbie.2025.5125Keywords:
Technological infrastructure and connectivity, Visual Analysis, Computer Vision, Face Recognition, Face Detection, Deep Neural Networks, Automated Systems, Video Surveillance, Real-time SystemsAbstract
The practice of recording and monitoring student attendance is a fundamental action in various contexts, especially in the school environment. However, due to its manual process, it often consumes a significant part of class time. This paper presents an end-to-end automated student attendance recording system utilizing classroom surveillance cameras. The system used advanced technologies such as computer vision, face recognition, and Convolutional Neural Network (CNN) techniques to streamline the attendance process and enhance the time distribution in the classroom. The study evaluates the performance of five class sessions from a public dataset and three class sessions collected by us at the school studied in this paper through different scenarios with varying image quality and student positioning. Our results highlight the superiority of ResNet29 in detecting and recognizing students, especially in lower-resolution images. Compared to Facenet512, Facenet, and ArcFace models, in terms of final frequency marking accuracy, the model showed superior metric results by having an increase of 50% of accuracy compared to the others, reaching 80% accuracy, as well as demonstrating being superior in precision, recall, F1-score, and AUC-ROC metrics. The system's deployment in a school setting has shown promising results, prompting plans for expansion to additional classrooms. The lightweight and non-intrusive nature of the system aligns with the concept of Next-Generation Smart Classrooms, emphasizing its potential to revolutionize attendance management in educational institutions.
Downloads
Referências
Adelman, C. (2006, February). The toolbox revisited: Paths to degree completion from high school through college (tech. rep.). U.S. Department of Education. [link]. [GS Search].
Ashfaq, M., Amaan, M., Aalam, M., Ullah, M. A., Raghav, D., & Goel, A. (2023). Computer vision based attendance management system for students. International Journal for Research in Applied Science and Engineering Technology. https://doi.org/10.22214/ijraset.2023.48767. [GS Search].
Costa, J., & Guedes, L. (2022). Proposta de integração curricular com internet das coisas na educação profissional técnica de nível médio. Anais do XXXIII Simpósio Brasileiro de Informática na Educação, 244–254. https://doi.org/10.5753/sbie.2022.225171. [GS Search].
Decoito, I., & Richardson, T. (2018). Teachers and technology: Present practice and future directions. Contemporary Issues in Technology and Teacher Education, 18(2), 362–378. [link]. [GS Search].
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019). ArcFace: Additive angular margin loss for deep face recognition. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 4685–4694. https://doi.org/10.1109/CVPR.2019.00482. [GS Search].
Firmansyah, A., Kusumasari, T. F., & Alam, E. N. (2023). Comparison of Face Recognition Accuracy of ArcFace, Facenet and Facenet512 Models on Deepface Framework. 2023 International Conference on Computer Science, Information Technology and Engineering (ICCoSITE), 535–539. https://doi.org/10.1109/ICCoSITE57641.2023.10127799. [GS Search].
Fix, E., & Hodges, J. L. (1989). Discriminatory analysis. nonparametric discrimination: Consistency properties. International Statistical Review / Revue Internationale de Statistique, 57(3), 238–247. [link]. [GS Search].
Geitgey, A. (2017). Face_recognition. [link].
Ghimire, S. N., & and, K. R. (2023). CCTV in schools: An examination of perceived value of surveillance. Journal of Education for Students Placed at Risk (JESPAR), 28(4), 351–379. https://doi.org/10.1080/10824669.2022.2092110. [GS Search].
Gupta, S., T. S., A., & Reddy Guddeti, R. M. (2018). CVUCAMS: Computer vision based unobtrusive classroom attendance management system. IEEE 18th International Conference on Advanced Learning Technologies (ICALT), 101–102. https://doi.org/10.1109/ICALT.2018.00131. [GS Search].
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770–778. https://doi.org/10.1109/CVPR.2016.90. [GS Search].
Huang, G. B., Mattar, M., Berg, T., & Learned-Miller, E. (2008). Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments. Workshop on Faces in ‘Real-Life’ Images: Detection, Alignment, and Recognition. [link]. [GS Search].
Kaliappan, J., Shreyansh, J., P, S. S., & Singamsetti, M. S. (2019). Surveillance camera using face recognition for automatic attendance feeder and energy conservation in classroom. 2019 International Conference on Vision Towards Emerging Trends in Communication and Networking (ViTECoN), 1–5. https://doi.org/10.1109/ViTECoN.2019.8899369. [GS Search].
Kar, N., Deb Barma, D. M., Saha, A., & Pal, D. (2012). Study of implementing automated attendance system using face recognition technique. International Journal of Computer and Communication Engineering, 100–103. https://doi.org/10.7763/IJCCE.2012.V1.28. [GS Search].
King, D. E. (2009). Dlib-ml: A machine learning toolkit. The Journal of Machine Learning Research, 10, 1755–1758. [link]. [GS Search].
King, D. E. (2015). Max-margin object detection. CoRR, abs/1502.00046. [link]. [GS Search].
Kurunthachalam, A., Sangeetha, S., Periyakaruppan, K., Keerthana, K., SanjayGiridhar, V., & Shamaladevi, V. (2021). Design of attendance monitoring system using RFID. 7th International Conference on Advanced Computing and Communication Systems (ICACCS), 1, 1628–1631. https://doi.org/10.1109/ICACCS51430.2021.9441704. [GS Search].
Lavareda Filho, R., Colonna, J., Oliveira, D., Monteiro, E., & Gonçalves, P. (2022). Autenticação de alunos utilizando dinâmica de digitação e redes neurais profundas em sistemas juiz on-line. Anais do XXXIII Simpósio Brasileiro de Informática na Educação, 1222–1232. https://doi.org/10.5753/sbie.2022.225779. [GS Search].
Mery, D., Mackenney, I., & Villalobos, E. (2019). Student attendance system in crowded classrooms using a smartphone camera. 2019 IEEEWinter Conference on Applications of Computer Vision (WACV), 857–866. https://doi.org/10.1109/WACV.2019.00096. [GS Search].
Norton, V., Honda, F., Pessoa, M., & Pires, F. (2024). CodeX: Ambiente virtual de aprendizagem em programação, integrado à LLM, para auxiliar estudantes com TEA. Anais do XXXV Simpósio Brasileiro de Informática na Educação, 1770–1783. https://doi.org/10.5753/sbie.2024.242533. [GS Search].
Rashmi, Brindha, S., Srinithin, & Gnanasudharsan. (2022). Smart Attendance System Using RFID and Face ID. 2022 International Conference on Communication, Computing and Internet of Things (IC3IoT), 1–5. https://doi.org/10.1109/IC3IOT53935.2022.9768003. [GS Search].
Sawall, E., Honnef, A., Mohamed, M., Alqahtani, A., & Alshayeb, T. (2021). Covid-19 zerointeraction school attendance system. 2021 IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS), 1–4. https://doi.org/10.1109/IEMTRONICS52119.2021.9422614. [GS Search].
Schroff, F., Kalenichenko, D., & Philbin, J. (2015). Facenet: A unified embedding for face recognition and clustering. CoRR, abs/1503.03832. [link]. [GS Search].
Serengil, S. I., & Ozpinar, A. (2020). Lightface: A hybrid deep face recognition framework. 2020 Innovations in Intelligent Systems and Applications Conference (ASYU), 1–5. https://doi.org/10.1109/ASYU50717.2020.9259802. [GS Search].
Sreedevi & Ram, R. (2019). Smart attendance registration for future classrooms. Proceedings of the International Conference on Systems, Energy & Environment (ICSEE). https://doi.org/10.2139/ssrn.3444043. [GS Search].
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015). Going deeper with convolutions. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1–9. https://doi.org/10.1109/CVPR.2015.7298594. [GS Search].
Uskov, V. L., Bakken, J. P., & Pandey, A. (2015). The ontology of next generation smart classrooms. In V. L. Uskov, R. J. Howlett, & L. C. Jain (Eds.), Smart education and smart e-learning (pp. 3–14, Vol. 41). Springer International Publishing. https://doi.org/10.1007/978-3-319-19875-0_1. [GS Search].
Wati, V., Kusrini, K., Fatta, H. A., & Kapoor, N. (2021). Security of facial biometric authentication for attendance system. Multimedia Tools and Applications, 80, 23625–23646. https://doi.org/10.1007/s11042-020-10246-4. [GS Search].
Zhou, L., & Jiang, X. (2019). Face recognition based on weighted fusion of face similarity features. 3rd International Conference on Electronic Information Technology and Computer Engineering (EITCE), 1691–1694. https://doi.org/10.1109/eitce47263.2019.9094888. [GS Search].
Arquivos adicionais
Published
Como Citar
Issue
Section
Licença
Copyright (c) 2025 John Davi Dutra Canuto Pires, Marcelo Costa Oliveira, Baldoino Fonseca dos Santos Neto, Márcio de Medeiros Ribeiro, Rafael Sampaio de Melo
Este trabalho está licenciado sob uma licença Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
