Assessing the awareness support in collaborative software development tools
DOI:
https://doi.org/10.5753/jbcs.2026.6287Keywords:
Awareness, Collaboration, Assessment, Software developmentAbstract
Agile methodologies and the growing geographic distribution of teams have driven significant transformations in the software development environment in recent decades. Collaborative tools have emerged as essential solutions for optimizing processes, enhancing communication, and coordinating efforts among team members. Therefore, implementing effective collaborative systems becomes crucial to guarantee project productivity, quality, and success. This study aims to evaluate the support provided by tools used in software development environments, with a particular focus on users' perspectives. We assessed some collaborative environments adopted by development teams, analyzing support for contextual collaboration and shared workspace aspects. We have noticed that an individual's ability to recognize and utilize awareness mechanisms depends on their skills and familiarity with the environment. As a contribution, this study provides a solid foundation for improving collaborative tools by highlighting strengths and weaknesses from the users’ perspective. The data obtained can guide developers in implementing features that provide greater support for awareness, thereby facilitating informed decision-making and effective coordination among team members.
Downloads
References
Baker, F. B. and Kim, S.-H. (2017). The basics of item response theory using R. Springer, Madision, WI, USA. DOI: 10.1007/978-3-319-54205-8.
Barbosa, S. and Silva, B. (2010). Interação humano-computador. Elsevier Brasil, Rio de Janeiro, RJ. Available at: [link].
BASILI, V. (1992). Software modeling and measurement: The goal/question/metric paradigm. Technical Report. Available at: [link].
Cai, L. (2010). Metropolis-hastings robbins-monro algorithm for confirmatory item factor analysis. Journal of Educational and Behavioral Statistics, 35(3):307–335. DOI: 10.3102/1076998609353115.
Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for therenvironment. Journal of Statistical Software, 48(6). DOI: 10.18637/jss.v048.i06.
Collazos, C. A., Gutierrez, F. L., Gallardo, J., Ortega, M., Fardoun, H. M., and Molina, A. I. (2019). Descriptive theory of awareness for groupware development. Journal of Ambient Intelligence and Humanized Computing, 10(12):4789-4818. DOI: 10.1007/s12652-018-1165-9.
Concentius, S. and Mantau, M. J. (2025). Avaliação do suporte à percepção em ferramentas colaborativas de apoio ao desenvolvimento de software: Repositório de artefatos. In Zenodo Repository. Zenodo. DOI: 10.5281/zenodo.15285691.
da Silva Estácio, B. J. and Prikladnicki, R. (2015). Distributed pair programming: A systematic literature review. Information and Software Technology, 63:1-10. DOI: https://doi.org/10.1016/j.infsof.2015.02.011.
de Andrade, D. F., Tavares, H. R., and Valle, R. d. C. (2000). Teoria da resposta ao item: conceitos e aplicações. ABE, Sao Paulo. Available at: [link].
DeVellis, R. F. (2016). Scale development: Theory and applications, volume 26 of Applied Social Research Methods 26. Sage Publications, Inc, London, UK, 4th edition. Available at: [link].
Dorans, N. J., Moses, T. P., and Eignor, D. R. (2010). Principles and practices of test score equating. ETS Research Report Series, 2010(2):1-41. DOI: 10.1002/j.2333-8504.2010.tb02236.x.
Dourish, P. and Bellotti, V. (1992). Awareness and coordination in shared workspaces. In Proceedings of the 1992 ACM Conference on Computer-Supported Cooperative Work, CSCW '92, pages 107-114, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/143457.143468.
Ellis, C., Gibbs, S., and Rein, G. (1991). Groupware some issues and experiences. Communications of the ACM, 34(1):38-58. DOI: 10.1145/99977.99987.
Fuks, H., Raposo, A., Gerosa, M., Pimental, M., and Lucena, C. (2008). The 3c collaboration model. In Encyclopedia of E-collaboration, Pennsylvania, USA. IGI Global. DOI: 10.4018/978-1-59904-000-4.ch097.
George, J. F. (2003). Groupware. In Bidgoli, H., editor, Encyclopedia of Information Systems, pages 509-518. Elsevier, New York, NY, USA. DOI: 10.1016/B0-12-227240-4/00084-8.
Gross, T. (2013). Supporting effortless coordination: 25 years of awareness research. Computer Supported Cooperative Work, 22(4-6):425-474. DOI: 10.1007/s10606-013-9190-x.
Gutwin, C., Barjawi, M., and Pinelle, D. (2016). The emergence of high-speed interaction and coordination in a (formerly) turn-based groupware game. In Proceedings of the 19th International Conference on Supporting Group Work, GROUP '16, pages 277-286, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2957276.2957315.
Gutwin, C. and Greenberg, S. (2002). A descriptive framework of workspace awareness for real-time groupware. Computer Supported Cooperative Work, 11(3-4):411-446. DOI: 10.1023/a:1021271517844.
Holland, P. W., Dorans, N. J., and Petersen, N. S. (2006). 6 equating test scores. In Rao, C. and Sinharay, S., editors, Psychometrics, volume 26 of Handbook of Statistics, pages 169-203. Elsevier, Princeton, NJ, USA. DOI: 10.1016/S0169-7161(06)26006-1.
ISO/IEC 25.040 (2011). Systems and software engineering - systems and software quality requirements and evaluation (square) - evaluation process. Standard, International Organization for Standardization, Geneva, CH. Available at: [link].
Lopez, G. and Guerrero, L. A. (2017). Awareness supporting technologies used in collaborative systems: A systematic literature review. In Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing, CSCW '17, pages 808-820, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2998181.2998281.
Mantau, M. J. and Benitti, F. B. V. (2022a). Awareness support in collaborative system: Reviewing last 10 years of cscw research. In 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD), pages 564-569, Hangzhou, China. IEEE. DOI: 10.1109/cscwd54268.2022.9776091.
Mantau, M. J. and Benitti, F. B. V. (2022b). Towards an awareness taxonomy. In 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD), pages 495-500, Hangzhou, China. IEEE. DOI: 10.1109/cscwd54268.2022.9776129.
Mantau, M. J. and Benitti, F. B. V. (2023a). The awareness assessment model: measuring the awareness and collaboration support over the participant’s perspective. In Anais do XVIII Simpósio Brasileiro de Sistemas Colaborativos, pages 30-43. SBC. DOI: 10.5753/sbsc.2023.229064.
Mantau, M. J. and Benitti, F. B. V. (2023b). The awareness assessment model repository. Data repository/Internal Documentation. Zenodo. DOI: 10.5281/zenodo.8298950.
Mantau, M. J. and Benitti, F. B. V. (2024). The awareness assessment model: measuring awareness and collaboration support over participant’s perspective. Universal Access in the Information Society. DOI: 10.1007/s10209-024-01110-5.
Molina, A. I., Bravo, C., Gallardo, J., Lacave, C., and Redondo, M. A. (2025). Awareness support in collaborative programming tools: An evaluation based on programmer's perception and eye tracking. Journal of Systems and Software, 220:112276. DOI: https://doi.org/10.1016/j.jss.2024.112276.
Molina, A. I., Gallardo, J., Redondo, M. A., and Bravo, C. (2015). Assessing the awareness mechanisms of a collaborative programming support system. Dyna, 82(193):212-222. DOI: 10.15446/dyna.v82n193.53497.
Pasquali, L. (2020). TRI-Teoria de resposta ao item: Teoria, procedimentos e aplicacoes. Editora Appris, Curitiba, PR, BR. Available at: [link].
Rogers, Y., Sharp, H., and Preece, J. (2013). Design de interação. Bookman Editora, Porto Alegre, RS, BR. Available at: [link].
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement. DOI: 10.1007/bf03372160.
Sansivieri, V., Wiberg, M., and Matteucci, M. (2017). A review of test equating methods with a special focus on irt-based approaches. Statistica, 77(4):329-352. DOI: 10.6092/issn.1973-2201/7066.
Schmidt, K. (2002). The problem with `awareness': Introductory remarks on `awareness in cscw'. Computer Supported Cooperative Work (CSCW), 11(3):285-298. DOI: 10.1023/A:1021272909573.
Silva, L., Mendes, A. J., and Gomes, A. (2020). Computer-supported collaborative learning in programming education: A systematic literature review. In 2020 IEEE Global Engineering Education Conference (EDUCON), pages 1086-1095. DOI: 10.1109/EDUCON45650.2020.9125237.
Tenenberg, J., Roth, W.-M., and Socha, D. (2016). From i-awareness to we-awareness in cscw. Computer Supported Cooperative Work (CSCW), 25(4):235-278. DOI: 10.1007/s10606-014-9215-0.
Thissen, D. and Wainer, H. (2001). Test Scoring. Routledge, New York, NY, USA. DOI: 10.4324/9781410604729.
Wohlin, C. (2014). Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, EASE '14, pages 1-10, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2601248.2601268.
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., and Wesslén, A. (2012). Experimentation in software engineering: an introduction. Springer Science & Business Media, New York, NY, USA. DOI: 10.1007/978-3-642-29044-2.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Márcio J. Mantau, Suelyn Concentius
This work is licensed under a Creative Commons Attribution 4.0 International License.
