An Evaluation of Software Testing Techniques and Criteria for the Python Programming Language

Authors

  • Renata O. Brito Universidade de São Paulo (USP)
  • Stevão A. Andrade Universidade de São Paulo (USP)
  • Márcio E. Delamaro Universidade de São Paulo (USP)

DOI:

https://doi.org/10.5753/reic.2022.1804

Keywords:

Software testing, Python

Abstract

The Python programming language has gained ground in the software industry and has become one of the most popular programming languages, mostly due to its simplicity and flexibility, which facilitates learning, in addition to popularizing the use of new computing technologies, such as machine learning. Considering this scenario, this work explores this problem by categorizing and evaluating software testing techniques and criteria applied to the Python programming language. Among the activities developed, it is worth highlighting an assessment regarding the ability to apply the testing techniques context of Python, categorization of tools and technologies that support the application of such approaches, as well as the development of a practical study to measure the feasibility of applying them in the context of open-source projects.

Downloads

Download data is not yet available.

References

Abingham, A. and Smallshire, R. (2021). Cosmic Ray - mutation testing for Python. [link].

Barbosa, E. F., Chaim, M. L., Vincenzi, A. M. R., Delamaro, M. E., Jino, M., and Maldonado, J. C. (2016). Introdução ao Teste de Software – Capı́tulo 4 - Teste Estrutural. Campus, Rio de Janeiro, 1 edition.

Delamaro, M. E., Andrade, S. A., de Souza, S. R. S., and de Souza, P. S. L. (2021). Parallel execution of programs as a support for mutation testing: A replication study. International Journal of Software Engineering and Knowledge Engineering, 31(03):337–380.

Delamaro, M. E., Maldonado, J. C., and Jino, M. (2016a). Introdução ao Teste de Software – Capı́tulo 1 – Conceitos Básicos. Campus, Rio de Janeiro, 2 edition.

Delamaro, M. E., Oliveira, R. A. P., Barbosa, E. F., and Maldonado, J. C. (2016b). Introdução ao Teste de Software – Capı́tulo 5 – Teste de Mutação. Campus, Rio de Janeiro, 2 edition.

Gilsing, V., Bekkers, R., Freitas, I. M. B., and Van der Steen, M. (2011). Differences in technology transfer between science-based and development-based industries: Transfer mechanisms and barriers. Technovation, 31(12):638–647.

Hałas, K. (2014). MutPy - A Mutation Testing Tool for Python 3.x. [link].

Holger Krekel (2020). pytest documentation release 5.4. Available from: [link].

Hovmöller, A. (2021). mutmut - python mutation tester. [link].

Hynninen, T., Kasurinen, J., Knutas, A., and Taipale, O. (2018). Software testing: Survey of the industry practices. In 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pages 1449–1454. IEEE.

Konrad Halas. Operators mutpy. Available from: [link], year=2019.

Krekel, H. (2021). pytest - helps you write better programs. [link].

Lin, D., Koppel, J., Chen, A., and Solar-Lezama, A. (2017). Quixbugs: A multi-lingual program repair benchmark set based on the quixey challenge. In Proceedings Companion of the 2017 ACM SIGPLAN International Conference on Systems, Programming, Languages, and Applications: Software for Humanity, pages 55–56.

Millman, K. J. and Aivazis, M. (2011). Python for scientists and engineers. Computing in Science & Engineering, 13(2):9–12.

Offutt, A. J. (1992). Investigations of the software testing coupling effect. ACM Transactions on Software Engineering and Methodology (TOSEM), 1(1):5–20.

Pressman, R. (2010). Software engineering: a practitioner’s approach. McGraw-Hill higher education. McGraw-Hill Higher Education.

Sandler, C., Myers, G., and Badgett, T. (2012). The Art of Software Testing. John Wiley & Sons.

Sixty North AS. Operators cosmic ray. Available from: [link], year=2019.

Snyk (2021). pytest popularity on Snyk. [link].

Srinath, K. (2017). Python–the fastest growing programming language. International Research Journal of Engineering and Technology, 4(12):354–357.

The economist (2018). Python is becoming the worlds most popular coding language. Available from: [link].

Tiobe the software quality company (2021). Tiobe index for january 2021. Available from: [link].

Van Rossum, G. et al. (2007). Python programming language. In USENIX annual technical conference, volume 41, page 36.

Published

2022-06-14

How to Cite

Brito, R. O., Andrade, S. A., & Delamaro, M. E. (2022). An Evaluation of Software Testing Techniques and Criteria for the Python Programming Language. Electronic Journal of Undergraduate Research on Computing, 20(1), 1–16. https://doi.org/10.5753/reic.2022.1804

Issue

Section

Full Papers