Using an Instrument to Assess Trust, Knowledge, Learning, and Motivation of Agile Teams
DOI:
https://doi.org/10.5753/isys.2023.3005Keywords:
Organizational climate, Agile software development, Human factorsAbstract
Background: Trust, Knowledge, Learning, and Motivation influence the organizational environment of agile teams. Organizational climate surveys can provide concrete evidence of how the process, project activities, people, and culture work in practice. Using assessment climate instruments that do not consider agile values, principles, practices, and roles in a proper context may create difficulties in analyzing possible causes of problems and the execution of corrective actions within organizational climate management. Objective: We present a preliminary evaluation of TACT, which is an instrument to assess the organizational climate of agile teams, comprising four dimensions, Trust, Knowledge, Learning, and Motivation. Method: We planned and executed a case study considering eight development teams from three organizations. We evaluated TACT using open-ended questions, quantitative methods, and TAM dimensions of Intention to Use, Perceived Usefulness, and Output Quality. Results: TACT captured that the product owner's lack of knowledge and experience probably influenced the adverse climate in team trust and that unrealistic deadlines may have generated a lack of team motivation due to an absence of autonomy to plan the iteration. The team leaders reported intention of future use. Contributions and Impact in the IS area: TACT was grounded in scientific literature and industry observations. TACT items regarding Trust, Knowledge, Learning, and Motivation are grounded in the "agile philosophy'' and consider the most common agile practices. At the same time, it allows reflections on the behaviors of the prominent involved roles in agile projects. Based on the evidence gathered, we inferred that TACT captured the organizational climate of the teams correctly and can be used to identify issues better and improve actions aligned with the agile values, principles, and practices while developing Information Systems.
Downloads
References
Acunã, S. T., Gómez, M., and Juristo, N. (2008). Towards understanding the relationship between team climate and software quality - a quasi-experimental study. Empirical Software Engineering, 13(4):401-434.
Acikgöz, A. and Gunsel, Ayse, C. K. (2015). Climate and Product Quality in Software Development Teams: Assessing the Mediating Role of Problem Solving and Learning. Journal of Administrative Sciences, 13(16):7-40.
Ahmed, S., Ahmed, S., Ali, M., Naseem, A., Razzaq, A., and Ahmed, N. (2018). A Systematic Literature Review of Success Factors and Barriers of Agile Software Development. International Journal of Advanced Computer Science and Applications, 9(3):1-14.
Ahmed, S., Ahmed, S., Naseem, A., and Razzaq, A. (2017). Motivators and Demotivators of Agile Software Development: Elicitation and Analysis. International Journal of Advanced Computer Science and Applications, 8(12):1-11.
Akgun, A. E., Lynn, G. S., and Reilly, R. (2002). Multi-dimensionality of learning in new product development teams. European Journal of Innovation Management, 5(2):57- 72.
Alasad, H. (2020). The Impact of Agile Processes on Organisational Behaviour Within Current Banking Practice. Master degree, Auckland University of Technology.
Almanasreh, E., Moles, R., and Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2):214-221.
Anderson, N. R. and West, M. A. (1998). Measuring climate for work group innovation: development and validation of the team climate inventory. Journal of Organizational Behavior, 19(3):235-258.
Antino, M., Gil-Rodriguez, F., Martí, M., Barrasa, A., and Borzillo, S. (2014). Development and validation of the Spanish version of the Team Climate Inventory: a measurement invariance test. Anales de Psicología, 30(2).
Beck, K., Beedle, M., Bennekum, A. V., Cockburn, A., Cunningham, W., Fowler, M., Grenning, J., Highsmith, J., Hunt, A., Jeffries, R., Kern, J., Marick, B., Martin, R. C., Mellor, S., Schwaber, K., Sutherland, J., and Thomas, D. (2001). Manifesto for Agile Software Development.
Bhatt, P., Shroff, G., Anantaram, C., and Misra, A. K. (2006). An influence model for factors in outsourced software maintenance. Journal of Software Maintenance and Evolution: Research and Practice, 18(6):385-423.
Boehm, B. and Turner, R. (2003). Balancing Agility and Discipline: A Guide for the Perplexed. Pearson Education, Boston (USA), 1st edition.
Chagas, A. (2015). (In Portuguese) O impacto dos fatores humanos nos métodos ágeis. Masters dissertation, Universidade Federal de Pernanbuco, Pernanbuco.
Chagas, A., Santos, M., Santana, C., and Vasconcelos, A. (2015). The Impact of Human Factors on Agile Projects. In 2015 Agile Conference, pages 87-91, National Harbor, MD, USA. IEEE.
Cruzes, D. S. and Dyba, T. (2011). Recommended Steps for Thematic Synthesis in Software Engineering. In 2011 International Symposium on Empirical Software Engineer- ing and Measurement, pages 275-284, Banff, AB, Canada. IEEE.
Curtis, B., Hefley, W. E., and Miller, S. A. (2009). People Capability Maturity Model (P-CMM) Version 2.0, Second Edition. Technical report, Carnegie Mellon University.
de O. Melo, C., Santana, C., and Kon, F. (2012). Developers Motivation in Agile Teams. In 2012 38th Euromicro Conference on Software Engineering and Advanced Applications, pages 376-383, Cesme, Turkey. IEEE.
Delgado-Rico, E., Carretero-Dios, H., and Ruch, W. (2012). Content validity evidences in test development: An applied perspective. International Journal of Clinical and Health Psychology, 12(3):449-460.
Digital.ai, T. (2020). 14th Annual State of Agile Report. Technical report, Digital.ai.
Dima, A. L. (2018). Scale validation in applied health research: tutorial for a 6-step R-based psychometrics protocol. Health Psychology and Behavioral Medicine, 6(1):136- 161.
Dutra, E., Cerdeiral, C., Lima, P., Diirr, B., and Santos, G. (2022a). Organizational Climate Assessment of Trust, Knowledge, Learning, and Motivation of Agile Teams - A Case Study. In XVIII Brazilian Symposium on Information Systems, pages 1-8, Curitiba, Brazil. Association for Computing Machinery.
Dutra, E., Diirr, B., and Santos, G. (2021). Human factors and their influence on software development teams - a tertiary study. In Brazilian Symposium on Software Engineering, SBES '21, page 442-451, New York, NY, USA. Association for Computing Machinery.
Dutra, E., Lima, P., Cerdeiral, C., Diirr, B., and Santos, G. (2022b). Tact: An instrument to assess the organizational climate of agile teams - a preliminary study. Journal of Software Engineering Research and Development, 10:1:1 - 1:21.
Dutra, E., Lima, P., and Santos, G. (2020). An Instrument to Assess the Organizational Climate of Agile Teams - A Preliminary Study. In 19th Brazilian Symposium on Software Quality, pages 1-10, São Luis, Brazil. Association for Computing Machinery.
Dutra, E. and Santos, G. (2020). Organisational climate assessments of Agile teams - a qualitative multiple case study. IET Software, 14(7):861-870.
Dutra, J. S., Fischer, A. L., Nakata, L. E., Pereira, J. C. R., and Veloso, E. F. R. (2012). The use categories as indicator of organizational climate in Brazilian companies. Revista de Carreiras e Pessoas, 2:145-176.
Dybå, T. and Dingsøyr, T. (2008). Empirical studies of agile software development: A systematic review. Information and Software Technology, 50(9-10):833-859.
Field, A., Miles, J., and Field, Z. (2012). Discovering Statistics Using R. SAGE Publications, London, 1 st edition.
Gonçalves, E. (2022). An Instrument to Assess the Organizational Climate of Agile Software Development Teams. PhD thesis, UNIRIO.
Graziotin, D., Lenberg, P., Feldt, R., and Wagner, S. (2020). Psychometrics in Behavioral Software Engineering: A Methodological Introduction with Guidelines. ACM Trans. Softw. Eng. Methodol., I(1):Article 111 - 49 pages.
Grobelna, K. and Stefan, T. (2019). The Impact of Organizational Climate on the Regularity of Work Speed of Agile Software Development Teams. Entrepreneurhip and Management, 12(1):229-241.
Hinkle, D., Wiersma, W., and Jurs, S. (2003). Applied Statistics for the Behavioural Sciences. Houghton Mifflin, Boston, 5th edition.
Hohl, P., Klünder, J., van Bennekum, A., Lockard, R., Gifford, J., Münch, J., Stupperich, M., and Schneider, K. (2018). Back to the future: origins and directions of the "Agile Manifesto" - views of the originators. Journal of Software Engineering Research and Development, 6(1):15.
Hsiung, K. S., Colditz, J. B., McGuier, E. A., Switzer, G. E., VonVille, H. M., Folb, B. L., and Kolko, D. J. (2021). Measures of Organizational Culture and Climate in Primary Care: a Systematic Review. Journal of General Internal Medicine, 36(2):487-499.
ISO/IEC/IEEE (2018). ISO/IEC/IEEE 26515: 2018. Systems and software engineering - Developing information for users in an agile environment. International Standards Organization., Switzerland.
Kakar, A. K. (2020). A Theory of Agile Software Development. In Southern Association for Information Systems (SAIS 2020) Proceedings, page 8, Virtually. AISeL.
McFillen, J. M., O'Neil, D. A., Balzer, W. K., and Varney, G. H. (2013). Organizational Diagnosis: An Evidence-based Approach. Journal of Change Management, 13(2):223-246.
Oliveira, R. and França, C. (2019). Agile Practices and Motivation. In Proceedings of the Evaluation and Assessment on Software Engineering, pages 365-368, New York, NY, USA. Association for Computing Machinery.
Patterson, M. G., West, M. A., Shackleton, V. J., Dawson, J. F., Lawthom, R., Maitlis, S., Robinson, D. L., and Wallace, A. M. (2005). Validating the organizational climate measure: links to managerial practices, productivity and innovation. Journal of Organizational Behavior, 26(4):379-408.
PMI, P. M. I. and Agile Alliance, A. A. (2017). Agile Practice Guide. PMI, Pennsylvania, 1st edition.
Raza, M. M., Minhas, N. M., Khan, H. U., and Asghar, I. (2015). Impact of Stress on Software Engineers Knowledge Sharing and Creativity [A Pakistani Perspective]. International Journal of Business Intelligents, 004(002):69-73.
Recker, J. (2013). Scientific Research in Information Systems. Springer Berlin Heidelberg, Berlin, Heidelberg.
Reginaldo, F. and Santos, G. (2020). Challenges in Agile Transformation Journey. In Proceedings of the 34th Brazilian Symposium on Software Engineering, pages 11-20, New York, NY, USA. Association for Computing Machinery.
Revelle, W. (2018). How to: Use the psych package for factor analysis and data reduction. Technical report, Northwestern University.
Saldanã, J. (2013). The Coding Manual for Qualitative Researchers (2nd Ed.). SAGE Publications Ltd.
Schneider, B., Barbera, K. M., Schneider, B., and Barbera, K. M. (2014). Summary and Conclusion. In Barbera, B. S. and M., K., editors, The Oxford Handbook of Organizational Climate and Culture, chapter Summary an, pages 1-14. Oxford University Press, New York, NY, USA.
Senapathi, M. and Srinivasan, A. (2013). Sustained agile usage. In Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering - EASE '13, page 119, New York, New York, USA. Association for Computing Machinery.
Serrador, P., Gemino, A., and Horner, B. (2018). Creating a climate for project success. Journal of Modern Project Management, May/August:38-47.
Shahzad, F., Xiu, G., and Shahbaz, M. (2017). Organizational culture and innovation performance in Pakistan's software industry. Technology in Society, 51:66-73.
Sharma, A. and Gupta, A. (2012). Impact of organisational climate and demographics on project specific risks in context to Indian software industry. International Journal of Project Management, 30(2):176-187.
Sherman, S., Hadar, I., and Luria, G. (2018). Leveraging organizational climate theory for understanding industry-academia collaboration. Information and Software Technology, 98:148-160.
Soomro, A. B., Salleh, N., Mendes, E., Grundy, J., Burch, G., and Nordin, A. (2016). The effect of software engineers' personality traits on team climate and performance: A Systematic Literature Review. Information and Software Technology, 73(May 2016):52-65.
Spector, P. (1992). Summated Rating Scale Construction: An Introduction. Sage Publi- cations, Inc, California.
Tsai, M.-T. and Cheng, N.-C. (2010). Programmer perceptions of knowledge-sharing behavior under social cognitive theory. Expert Systems with Applications, 37(12):8479- 8485.
VandenBos, G. R. E. (2017). APA Dictionary of Psychology.
Venkatesh, V. and Bala, H. (2008). Technology Acceptance Model 3 and a Research Agenda on Interventions. Decision Sciences, 39(2):273-315.
Venkatesh, V. and Davis, F. D. (2000). A Theoretical Extension of the Technology Accep- tance Model: Four Longitudinal Field Studies. Management Science, 46(2):186-204.
Vishnubhotla, S. D., Mendes, E., and Lundberg, L. (2018). An Insight into the Capabilities of Professionals and Teams in Agile Software Development. In Proceedings of the 2018 7th International Conference on Software and Computer Applications - ICSCA 2018, pages 10-19, New York, New York, USA. Association for Computing Machinery.
Vishnubhotla, S. D., Mendes, E., and Lundberg, L. (2020). Investigating the relationship between personalities and agile team climate of software professionals in a telecom company. Information and Software Technology, 126:106335.
Wagner, S., Mendez, D., Felderer, M., Graziotin, D., and Kalinowski, M. (2020). Contemporary Empirical Methods in Software Engineering. Springer International Publishing, Cham.
Yin, R. K. (2013). Case Study Research: Design and Methods. Sage Publications, Los Angeles, 5th edition.
Zhang, H., Luo, X. R., Liao, Q., and Peng, L. (2015). Does IT team climate matter? An empirical study of the impact of co-workers and the Confucian work ethic on deviance behavior. Information and Management Management, 52(6):658-667.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 iSys - Brazilian Journal of Information Systems
This work is licensed under a Creative Commons Attribution 4.0 International License.
