Pattern Recognition: A Comparison Between Support Vector Machines and Relevance Vector Machines

Authors

DOI:

https://doi.org/10.5753/reic.2026.6697

Keywords:

SVM, RVM, Pattern Recognition

Abstract

This work deals with the comparison between support vector machines (SVM) and relevance vector machines (RVM) classifiers. Two data sets were generated from the numpy library, one predefined and the other randomly generated. The classifiers are trained using the datasets, with SVM using support vector classification (SVC) and RVM using expectation-maximization relevance vector classifier (EMRVC), both tested with the following kernels: RBF, polynomial, sigmoid, and linear. The main contribution of this work lies in observing the advantages and disadvantages of using each classifier. Given that the RVM model is Bayesian, it can provide a posteriori properties, but each classifier has its specific use.

Downloads

Download data is not yet available.

References

Cervantes, J., Garcia-Lamont, F., Rodríguez-Mazahua, L., and Lopez, A. (2020). A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing, 408:189–215. DOI: 10.1016/j.neucom.2019.10.118.

Cortes, C. and Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3):273–297. DOI: 10.1007/BF00994018.

Dostál, Z. (2025). Support vector machines. In Optimal Quadratic Programming and QCQP Algorithms with Applications, pages 339–347. Springer. DOI: 10.1007/978-3-031-95167-1_16.

Koruk, K. (2021). Relevance vector machines: An introduction. Geomet Queens University.

Murel, J. and Kavlakoglu, E. (2025). O que são modelos de classificação? Online; Acesso em 2025-06-20.

Rafi, M. and Shaikh, M. S. (2013). A comparison of svm and rvm for document classification. DOI: 10.48550/arXiv.1301.2785.

sickit learn. Emrvc - documentação scikit-learn. [link]. Online; Acesso em 2025-6-19.

sickit learn. Rvm - documentação scikit-learn. [link]. Online; Acesso em 2025-6-19.

sickit learn. Rvm for classification - documentação scikit-learn. [link]. Online; Acesso em 2025-6-19.

sickit learn. Svc - documentação scikit-learn. [link]. Online; Acesso em 2025-6-20.

Tipping, M. E. (2001). Sparse bayesian learning and the relevance vector machine. J. Mach. Learn. Res., 1:211–244.

Tzikas, D., Wei, L., Likas, A., and Yang, Y. (2006). A tutorial on relevance vector machines for regression and classification with applications. Eurosip, 17.

Published

2026-03-13

How to Cite

Fernandes, J., Adegas, L., Dias, G., & Santos dos Anjos, J. C. (2026). Pattern Recognition: A Comparison Between Support Vector Machines and Relevance Vector Machines. Electronic Journal of Undergraduate Research on Computing, 24(1), 138–145. https://doi.org/10.5753/reic.2026.6697

Issue

Section

Full Papers