A survey on the practices of software testing: a look into Brazilian companies
DOI:
https://doi.org/10.5753/jserd.2022.786Keywords:
Survey, Software testing practices, Software quality assurance, BrazilAbstract
[Context:] Software testing is essential for all software development, and techniques and criteria have been proposed to ensure its quality in different application domains. [Objective:] This survey aims at the identification of software testing practices in Brazilian industries, towards an overview of the latest testing techniques, selection processes, challenges faced, tools and metrics used by testers. [Methodology:] Survey questions were carefully designed for providing relevant information to both industry and academy and evaluated by testers for improving the quality of the survey. [Results and Conclusions:] Our study provides insights into the current software testing practices in Brazilian software companies. The results show testers select a testing technique according to the project scope under development; however, most companies have shown a lack of importance and priority regarding to the testing activity. Some challenges raised will foster new research topics, outlined by the needs faced by testers in practice.
Downloads
References
Abran, A., Moore, J. W., Bourque, P., Dupuis, R., and Tripp, L. L. (2004). Guide to the software engineering body of knowledge: 2004 version SWEBOK. IEEE Computer Society.
Anand, S., Burke, E. K., Chen, T. Y., Clark, J., Cohen, M. B., Grieskamp, W., Harman, M., Harrold, M. J., Mcminn, P., Bertolino, A., et al. (2013). An orchestrated survey of methodologies for automated software test case generation. Journal of Systems and Software, 86(8):1978–2001.
Bertolino, A. (2007). Software testing research: Achievements, challenges, dreams. In 2007 Future of Software Engineering, pages 85–103. IEEE Computer Society.
Bourque, P., Fairley, R. E., et al. (2014). Guide to the software engineering body of knowledge (SWEBOK (R)): Version 3.0. IEEE Computer Society Press.
Briand, L. C., Differding, C. M., and Rombach, H. D. (1996). Practical guidelines for measurement-based process improvement. Software Process: Improvement and Practice, 2(4):253–280.
Caldiera, G., Basili, V. R., and Rombach, H. D. (1994). Goal question metric paradigm. Encyclopedia of software engineering, 1:528–532.
Copeland, L. (2004). A practitioner’s guide to software test design. Artech House.
Delamaro, M., Jino, M., and Maldonado, J. (2017). Introdução ao teste de software. Elsevier Brasil.
Dias-Neto, A. C., Matalonga, S., Solari, M., Robiolo, G., and Travassos, G. H. (2017). Toward the characterization of software testing practices in south america: looking at brazil and uruguay. Software Quality Journal, 25(4):1145–1183.
Dustin, E., Rashka, J., and Paul, J. (1999). Automated Software Testing: Introduction, Management, and Performance. Addison-Wesley Longman Publishing Co., Inc., USA.
Engström, E. and Runeson, P. (2010). A qualitative survey of regression testing practices. In International Conference on Product Focused Software Process Improvement, pages 3–16. Springer.
Fink, A. (2003). The survey handbook, volume 1. Sage.
Garousi, V. and Varma, T. (2010). A replicated survey of software testing practices in the canadian province of alberta: What has changed from 2004 to 2009? Journal of Systems and Software, 83(11):2251–2262.
Garousi, V. and Zhi, J. (2013). A survey of software testing practices in canada. Journal of Systems and Software, 86(5):1354–1376.
Geras, A. M., Smith, M., and Miller, J. (2004). A survey of software testing practices in alberta. Canadian Journal of Electrical and Computer Engineering, 29(3):183–191.
Groves, L., Nickson, R., Reeve, G., Reeves, S., and Utting, M. (2000). A survey of software development practices in the new zealand software industry. In Software Engineering Conference, 2000. Proceedings. 2000 Australian, pages 189–201. IEEE.
Kassab, M., DeFranco, J., and Laplante, P. (2016). Software testing practices in industry: The state of the practice. IEEE Software.
Kasunic, M. (2005). Designing an effective survey. Technical report, Carnegie-Mellon Univ Pittsburgh PA Software Engineering Inst.
Kitchenham, B. A. and Pfleeger, S. L. (2008). Personal opinion surveys. In Guide to advanced empirical software engineering, pages 63–92. Springer.
Lee, J., Kang, S., and Lee, D. (2012). Survey on software testing practices. IET software, 6(3):275–282.
Molléri, J. S., Petersen, K., and Mendes, E. (2016). Survey guidelines in software engineering: An annotated review. In Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, page 58. ACM.
Myers, G. J., Sandler, C., and Badgett, T. (2011). The art of software testing. John Wiley & Sons.
Ng, S., Murnane, T., Reed, K., Grant, D., and Chen, T. (2004). A preliminary survey on software testing practices in australia. In Software Engineering Conference, 2004. Proceedings. 2004 Australian, pages 116–125. IEEE.
Saglietti, F., Oster, N., and Pinte, F. (2008). White and grey-box verification and validation approaches for safety-and security-critical software systems. Information security technical report, 13(1):10–16.
Santos, I., C Filho, J. C., and Souza, S. R. (2020a). A survey on the practices of mobile application testing. In 2020 XLVI Latin American Computing Conference (CLEI), pages 232–241. IEEE.
Santos, I., Coutinho, E. F., and Souza, S. R. (2020b). Software testing ecosystems insights and research opportunities. In Proceedings of the 34th Brazilian Symposium on Software Engineering, pages 421–426.
Santos, I., Furlanetti, A. B., Melo, S. M., de Souza, P. S. L., Delamaro, M. E., and Souza, S. R. (2020c). Contributions to improve the combined selection of concurrent software testing techniques. In Proceedings of the 5th Brazilian Symposium on Systematic and Automated Software Testing, pages 69–78.
Santos, I., Melo, S. M., de Souza, P. S. L., and Souza, S. R. (2019). Testing techniques selection: A systematic mapping study. In Proceedings of the XXXIII Brazilian Symposium on Software Engineering, pages 347–356.
Santos, I., Melo, S. M., de Souza, P. S. L., and Souza, S. R. (2020d). Towards a unified catalog of attributes to guide industry in software testing technique selection. In 2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pages 398–407. IEEE.
Torchiano, M., Fernández, D. M., Travassos, G. H., and de Mello, R. M. (2017). Lessons learnt in conducting survey research. In 2017 IEEE/ACM 5th International Workshop on Conducting Empirical Studies in Industry (CESI), pages 33–39. IEEE.
Torkar, R. and Mankefors, S. (2003). A survey on testing and reuse. In Software: Science, Technology and Engineering, 2003. SwSTE’03. Proceedings. IEEE International Conference on, pages 164–173. IEEE.
Vegas, S. and Basili, V. (2005). A characterisation schema for software testing techniques. Empirical Software Engineering, 10(4):437–466.
Victor, M. and Upadhyay, N. (2011). Selection of software testing technique: A multi criteria decision making approach. In International Conference on Computational Science, Engineering and Information Technology, pages 453–462. Springer.
Wohlin, C., Aurum, A., Angelis, L., Phillips, L., Dittrich, Y., Gorschek, T., Grahn, H., Henningsson, K., Kagstrom, S., Low, G., et al. (2011). The success factors powering industry-academia collaboration. IEEE software, 29(2):67–73.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Italo Santos, Silvana M. Melo, Paulo S. L. Souza, Simone R. S. Souza
This work is licensed under a Creative Commons Attribution 4.0 International License.
