The Development and Validation of a Questionnaire to Assess Agility in Software Engineering (QASE)
DOI:
https://doi.org/10.5753/jserd.2026.6280Keywords:
Agile, Agile Measurement Scale, Assessment of Agility, Agile Questionnaire, Measurement of Agility, PsychometricAbstract
The concept of agility is increasingly becoming the focus of empirical research. However, what agility is and how it can best be conceptualized and measured remain controversial, even among researchers. This lack of consensus is reflected in the literature in the divergent approaches used to operationalize the concept in research, which limits the comparability of empirical results and impedes the development of a cohesive body of knowledge in the field. Against this background, the present article addresses the development of a valid questionnaire to assess agility in software engineering (QASE) that can be consistently used across various contexts. For this purpose, the commonalities among pioneer agile methods were examined by analyzing their underlying techniques, resulting in a second-order measurement model comprising 30 factors and 90 items. The QASE was evaluated using confirmatory factor analysis in a first study (N = 418), then refined and re-evaluated in a second study (N = 152), thereby demonstrating its factor structure, validity, and reliability. With the QASE, we provide the research community with a theoretically sound and empirically valid measurement instrument that facilitates hypothesis testing, supports theory development, and enables more reliable conclusions about the mechanisms underlying the positive outcomes associated with agility, thereby contributing to a more coherent and cumulative body of knowledge in Agile Software Development.
Downloads
References
Abrahamsson, P., Conboy, K., & Wang, X. (2009). "Lots done, more to do": The current state of agile systems development research. European Journal of Information Systems, 18(4), 281–284. https://doi.org/10.1057/ejis.2009.27.
Abrahamsson, P., Salo, O., Ronkainen, J., & Warsta, J. (2002). Agile software development methods: Review and analysis (VTT Publications No. 478). VTT Technical Research Centre of Finland. [link].
Abrahamsson, P., Warsta, J., Siponen, M. T., & Ronkainen, J. (2003). New directions on agile methods: A comparative analysis. In Proceedings of the 25th International Conference on Software Engineering, pages 244–254. https://doi.org/10.1109/ICSE.2003.1201204.
Acuña, S. T., Lopez, M., Juristo, N., & Moreno, A. (1999). A process model applicable to software engineering and knowledge engineering. International Journal of Software Engineering and Knowledge Engineering, 9(5), 663–687. https://doi.org/10.1142/S0218194099000358.
Ågerfalk, P. J., Fitzgerald, B., & Slaughter, S. A. (2009). Introduction to the special issue—Flexible and distributed information systems development: State of the art and research challenges. Information Systems Research, 20(3), 317–328. https://doi.org/10.1287/isre.1090.0244.
Agile Alliance. (2015, June 29). Agile essentials: Agile101 – What is Agile? [link].
Akkaya, B., Panait, M., Apostu, S. A., & Kaya, Y. (2022). Agile leadership and perceived career success: The mediating role of job embeddedness. International Journal of Environmental Research and Public Health, 19(8), 4834. https://doi.org/10.3390/ijerph19084834.
Ambler, S. (2002). Agile Modeling: Effective Practices for Extreme Programming and the Unified Process (1st ed.). Wiley.
Amrit, C., & Meijberg, Y. (2018). Effectiveness of test-driven development and continuous integration: A case study. IT Professional, 20(1), 27–35. https://doi.org/10.1109/MITP.2018.014121554.
Ariza, H. M., Silva, L. F. W., & Contreras, L. A. L. (2020). Descriptive analysis of the agile methodology extreme programming (XP) for its implementation in software development. International Journal of Engineering Research and Technology, 14(10), 999–1004.
Atanassova, I., Bednar, P., Khan, H., & Khan, Z. (2025). Managing the VUCA environment: The dynamic role of organizational learning and strategic agility in B2B versus B2C firms. Industrial Marketing Management, 125, 12–28. https://doi.org/10.1016/j.indmarman.2024.12.008.
Atzberger, A., Wallisch, A., Nicklas, S., & Paetzold, K. (2020). Antagonizing ambiguity – Towards a taxonomy for agile development. Procedia CIRP, 91, 464–471. https://doi.org/10.1016/j.procir.2020.02.200.
Azad, N., & Hyrynsalmi, S. (2023). DevOps critical success factors—A systematic literature review. Information and Software Technology, 157, 107150. https://doi.org/10.1016/j.infsof.2023.107150.
Baham, C., & Hirschheim, R. (2021). Issues, challenges, and a proposed theoretical core of agile software development research. Information Systems Journal, 32(4), 103–129. https://doi.org/10.1111/isj.12336.
Barber, M. (2020, May 14). An updated Agile Manifesto. Medium. [link].
Beck, K. (1999). Extreme Programming Explained: Embrace Change (1st ed.). Addison-Wesley Longman.
Beck, K. (2003). Test-Driven Development: By Example. Addison-Wesley Professional.
Beck, K., Beedle, M., van Bennekum, A., Cockburn, A., Cunningham, W., Fowler, M., Grenning, J., Highsmith, J., Hunt, A., Jeffries, R., Kern, J., Marick, B., Martin, R., Mellor, S., Schwaber, K., Sutherland, J., & Thomas, D. (2001a). History: The Agile Manifesto. [link].
Beck, K., Beedle, M., van Bennekum, A., Cockburn, A., Cunningham, W., Fowler, M., Grenning, J., Highsmith, J., Hunt, A., Jeffries, R., Kern, J., Marick, B., Martin, R., Mellor, S., Schwaber, K., Sutherland, J., & Thomas, D. (2001b). Manifesto for Agile Software Development. [link].
Beck, K., Beedle, M., van Bennekum, A., Cockburn, A., Cunningham, W., Fowler, M., Grenning, J., Highsmith, J., Hunt, A., Jeffries, R., Kern, J., Marick, B., Martin, R., Mellor, S., Schwaber, K., Sutherland, J., & Thomas, D. (2001c). Principles behind the Agile Manifesto. [link].
Bennett, N., & Lemoine, G. J. (2014). What a difference a word makes: Understanding threats to performance in a VUCA world. Business Horizons, 57(3), 311–317. https://doi.org/10.1016/j.bushor.2014.01.001.
Bergmann, T. (2018). The relationship between agile project management and project success outcomes (Doctoral dissertation, University of Central Florida). [link].
Bono, C., Ried, L. D., Kimberlin, C., & Vogel, B. (2007). Missing data on the Center for Epidemiologic Studies Depression Scale: A comparison of four imputation techniques. Research in Social and Administrative Pharmacy, 3(1), 1–27. https://doi.org/10.1016/j.sapharm.2006.04.001.
Bridgman, P. W. (1950). The operational aspect of meaning. Synthese, 8(6–7), 251–259.
Brunet, F., Malas, K., & Fleury, D. (2021). A model of an agile organization designed to better manage the COVID-19 crisis. Healthcare Management Forum, 34(2), 115–118. https://doi.org/10.1177/0840470420980478.
Burgess, J. A. (1990). The sorites paradox and higher-order vagueness. Synthese, 85(3), 414–474.
Cagle, K. (2019, August 23). The end of Agile. Forbes. [link].
Chen, S.-F., Wang, S., & Chen, C.-Y. (2012). A simulation study using EFA and CFA programs based on the impact of missing data on test dimensionality. Expert Systems with Applications, 39(4), 4026–4031. https://doi.org/10.1016/j.eswa.2011.09.085.
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. (2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management, 41(2), 745–783. https://doi.org/10.1007/s10490-023-09871-y.
Cheung, G. W., & Wang, C. (2017). Current approaches for assessing convergent and discriminant validity with SEM: Issues and solutions. Proceedings of the Academy of Management, 2017(1), Article 12706. https://doi.org/10.5465/AMBPP.2017.12706.
Chronis, K., & Gren, L. (2016). Agility measurements mismatch: A validation study on three agile team assessments in software engineering. In H. Sharp & T. Hall (Eds.), Agile Processes in Software Engineering and Extreme Programming (pp. 16–27). Springer International Publishing. https://doi.org/10.1007/978-3-319-33515-5_2.
Churchill, G. A. (1979). A paradigm for developing better measures of marketing constructs. Journal of Marketing Research, 16(1), 64–73. https://doi.org/10.2307/3150876.
Cico, O., Jaccheri, L., Nguyen-Duc, A., & Zhang, H. (2021). Exploring the intersection between software industry and software engineering education—A systematic mapping of software engineering trends. Journal of Systems and Software, 172, 110736. https://doi.org/10.1016/j.jss.2020.110736.
Cockburn, A. (2000). Writing Effective Use Cases (1st ed.). Addison-Wesley Professional.
Cockburn, A. (2002). Agile Software Development. Addison-Wesley Longman.
Cohard, P., & Messeghem, K. (2022). A measurement scale for agile orientation. Systèmes d’Information & Management, 27(1), 39–66. https://doi.org/10.3917/sim.221.0039.
Cohen, D., Lindvall, M., & Costa, P. (2004). An introduction to agile methods. Advances in Computers, 62, 1–66. https://doi.org/10.1016/S0065-2458(03)62001-2.
Coltman, T., Devinney, T. M., Midgley, D. F., & Venaik, S. (2008). Formative versus reflective measurement models: Two applications of formative measurement. Journal of Business Research, 61(12), 1250–1262. https://doi.org/10.1016/j.jbusres.2008.01.013.
Conboy, K. (2009). Agility from first principles: Reconstructing the concept of agility in information systems development. Information Systems Research, 20(3), 329–354. https://doi.org/10.1287/isre.1090.0236.
Conboy, K., & Fitzgerald, B. (2004). Toward a conceptual framework of agile methods. In Proceedings of the 2004 ACM Workshop on Interdisciplinary Software Engineering Research, pages 37–44. https://doi.org/10.1145/1029997.1030005.
Corrêa Rodrigues, A., & Mantovani Fontana, R. (2019). Evaluation of an agile maturity model: Empirical evidences for agility assessments. In G. S. Tonin, B. Estácio, A. Goldman, & E. Guerra (Eds.), Agile Methods (pp. 49–62). Springer International Publishing. https://doi.org/10.1007/978-3-030-14310-7_4.
Darwish, N. (2014). Enhancements in SCRUM framework using extreme programming practices. International Journal of Intelligent Computing and Information Sciences, 14(2), 53–67. https://doi.org/10.21608/IJICIS.2014.15773.
De Barros, L. M., Tam, C., & Varajão, J. (2024). Agile software development projects – Unveiling the human-related critical success factors. Information and Software Technology, 170, 107432. https://doi.org/10.1016/j.infsof.2024.107432.
De O Luna, A. J. H., & Marinho, M. (2023). Agile governance theory: A multi-scenario empirical assessment. Observatorio de la Economía Latinoamericana, 21(6), 5767–5800. https://doi.org/10.55905/OELV21N6-135.
Denning, S. (2015). Updating the Agile Manifesto. Strategy & Leadership, 43(5). https://doi.org/10.1108/SL-07-2015-0058.
Diamantopoulos, A. (2006). The error term in formative measurement models: Interpretation and modeling implications. Journal of Modelling in Management, 1(1), 7–17. https://doi.org/10.1108/17465660610667775.
Diamantopoulos, A., Riefler, P., & Zeugner-Roth, K. P. (2008). Advancing formative measurement models. Journal of Business Research, 61(12), 1203–1218. https://doi.org/10.1016/j.jbusres.2008.01.009.
Dingsøyr, T., Nerur, S., Balijepally, V., & Moe, N. B. (2012). A decade of agile methodologies: Towards explaining agile software development. Journal of Systems and Software, 85(6), 1213–1221. https://doi.org/10.1016/j.jss.2012.02.033.
Drechsler, A., & Ahlemann, F. (2015). Toward a general theory of agile project management—A research design. ECIS 2015 Research-in-Progress Papers. [link].
Duka, D. (2012). Agile experiences in software development. In Proceedings of the 35th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pages 692–697.
Dybå, T., & Dingsøyr, T. (2008). Empirical studies of agile software development: A systematic review. Information and Software Technology, 50(9–10), 833–859. https://doi.org/10.1016/j.infsof.2008.01.006.
Eilers, K., Peters, C., & Leimeister, J. M. (2022). Why the agile mindset matters. Technological Forecasting and Social Change, 179, 121650. https://doi.org/10.1016/j.techfore.2022.121650.
Eilers, K., Simmert, B., & Peters, C. (2020). Doing agile vs. being agile—Understanding their effects to improve agile work. ICIS 2020 Proceedings, 6. [link].
Enders, C. K. (2022). Applied Missing Data Analysis (2nd ed.). The Guilford Press.
Fewell, J. (2015). Agile everything: An iterative approach can deliver solutions to nearly any problem—Whether at work or in life. PM Network. [link].
Fornell, C., & Larcker, D. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.2307/3151312.
Fowler, M. (2006). Semantic diffusion. [link].
Fowler, M., Beck, K., Brant, J., & Opdyke, W. (1999). Refactoring: Improving the Design of Existing Code. Addison-Wesley.
Fuchs, C., & Golenhofen, F. J. (2019). Agile for mechatronics and hardware. In C. Fuchs & F. J. Golenhofen (Eds.), Mastering Disruption and Innovation in Product Management: Connecting the Dots (pp. 147–162). Springer International Publishing. https://doi.org/10.1007/978-3-319-93512-6_8.
Geiger, J. R. (2020). Agility measurement for large organizations (Doctoral dissertation, Air Force Institute of Technology). [link].
Gemino, A., Reich, B. H., & Serrador, P. (2020). Agile, traditional, and hybrid approaches to project success: Is hybrid a poor second choice? Project Management Journal, 52(2), 161–175. https://doi.org/10.1177/8756972820973082.
Ghimire, D., & Charters, S. (2022). The impact of agile development practices on project outcomes. Software, 1(3), 265–275. https://doi.org/10.3390/software1030012.
Gnizy, I. (2025). When does business agility matter to firm strategic performance? Journal of Asia Business Studies, 20(1), 23–46. https://doi.org/10.1108/JABS-09-2024-0509.
Goldman, S. L., Nagel, R. N., & Preiss, K. (1995). Agile Competitors and Virtual Organizations: Strategies for Enriching the Customer. Van Nostrand Reinhold.
Greineder, M., Blohm, I., & Leicht, N. (2020). Conceptualizing the agile work organization: A systematic literature review, framework and research agenda. In Proceedings of the 33rd Bled eConference. https://doi.org/10.18690/978-961-286-362-3.18.
Gren, L., Torkar, R., & Feldt, R. (2015). The prospects of a quantitative measurement of agility: A validation study on an agile maturity model. Journal of Systems and Software, 107, 38–49. https://doi.org/10.1016/j.jss.2015.05.008.
Gunasekaran, A., Yusuf, Y. Y., Adeleye, E. O., Papadopoulos, T., Kovvuri, D., & Geyi, D. G. (2019). Agile manufacturing: An evolutionary review of practices. International Journal of Production Research, 57(15–16), 5154–5174. https://doi.org/10.1080/00207543.2018.1530478.
Haase, M., Jöhnk, J., Lipowsky, S., & Urbach, N. (2017). Der Einfluss des Agilitätsgrads auf den Erfolg von Softwareentwicklungsprojekten unter Berücksichtigung der Unternehmenskultur. In J. M. Leimeister & W. Brenner (Eds.), Proceedings der 13. Internationalen Tagung Wirtschaftsinformatik (pp. 454–468). [link].
Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139–152. https://doi.org/10.2753/MTP1069-6679190202.
Haskin, J. (2022). Agile software development and successful project completion: A quantitative study (Doctoral dissertation, University of Phoenix). [link].
Henriques, V., & Tanner, M. (2017). A systematic literature review of agile maturity model research. Interdisciplinary Journal of Information, Knowledge, and Management, 12, 053–073. https://doi.org/10.28945/3666.
Henseler, J., Ringle, C. M., & Sarstedt, M. (2014). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8.
Highsmith, J. (2000). Adaptive Software Development. Dorset House Publishing.
Highsmith, J., & Cockburn, A. (2001). Agile software development: The business of innovation. Computer, 34(9), 120–127. https://doi.org/10.1109/2.947100.
Hoda, R., Salleh, N., & Grundy, J. (2018). The rise and evolution of agile software development. IEEE Software, 35(5), 58–63. https://doi.org/10.1109/MS.2018.290111318.
Hohl, P., Klünder, J., van Bennekum, A., Lockard, R., Gifford, J., Münch, J., Stupperich, M., & Schneider, K. (2018). Back to the future: Origins and directions of the “Agile Manifesto” – Views of the originators. Journal of Software Engineering Research and Development, 6(1). https://doi.org/10.1186/s40411-018-0059-z.
Holden, R. J., Boustani, M., & Azar, J. (2021). Agile innovation to transform healthcare: Innovating in complex adaptive systems is an everyday process, not a light bulb event. BMJ Innovations, 7(2), 499–505. https://doi.org/10.1136/bmjinnov-2020-000574.
Horlach, B., & Drechsler, A. (2020). It’s not easy being agile: Unpacking paradoxes in agile environments. In M. Paasivaara & P. Kruchten (Eds.), Agile Processes in Software Engineering and Extreme Programming – Workshops (pp. 182–189). Springer International Publishing. https://doi.org/10.1007/978-3-030-58858-8_19.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.
Huisman, M. (2000). Imputation of missing item responses: Some simple techniques. Quality and Quantity, 34(4), 331–351. https://doi.org/10.1023/A:1004782230065.
Hulland, J. (1999). Use of partial least squares (PLS) in strategic management research: A review of four recent studies. Strategic Management Journal, 20(2), 195–204. https://doi.org/10.1002/(SICI)1097-0266(199902)20:2<195::AID-SMJ13>3.0.CO;2-7.
Hunt, A., & Thomas, D. (1999). The Pragmatic Programmer: From Journeyman to Master. Addison-Wesley Professional.
Itzik, D., & Roy, G. (2023). Does agile methodology fit all characteristics of software projects? Review and analysis. Empirical Software Engineering, 28(4), 105. https://doi.org/10.1007/s10664-023-10334-7.
Jalali, S., Wohlin, C., & Angelis, L. (2014). Investigating the applicability of agility assessment surveys: A case study. Journal of Systems and Software, 98, 172–190. https://doi.org/10.1016/j.jss.2014.08.067.
Jeffries, R. (2025, July 29). Enterprise agility?? [link].
Jin-Hai, L., Anderson, A. R., & Harrison, R. T. (2003). The evolution of agile manufacturing. Business Process Management Journal, 9(2), 170–189. https://doi.org/10.1108/14637150310468380.
Joiner, B. (2019). Leadership agility for organizational agility. Journal of Creating Value, 5(2), 139–149. https://doi.org/10.1177/2394964319868321.
Junker, T., Bakker, A. B., Derks, D., & Molenaar, D. (2022). Agile work practices: Measurement and mechanisms. European Journal of Work and Organizational Psychology, 32(1), 1–22. https://doi.org/10.1080/1359432X.2022.2096439.
Junker, T., Bakker, A. B., Gorgievski, M. J., & Derks, D. (2021). Agile work practices and employee proactivity: A multilevel study. Human Relations, 75(12), 2189–2217. https://doi.org/10.1177/00187267211030101.
Kakar, A. K. S. (2017). Investigating the motivating potential of software development methods: Insights from a work design perspective. Pacific Asia Journal of the Association for Information Systems, 65–96. https://doi.org/10.17705/1PAIS.09404.
Kanwal, F., & Khurram, F. (2022). Understanding agile practices for job satisfaction through job characteristics. Journal of Professional & Applied Psychology, 3(2), 208–217. https://doi.org/10.52053/jpap.v3i2.100.
Karekar, H. (2024). An empirical investigation of the relationship between agile mindset and agile transformation outcomes (Doctoral dissertation, Swiss School of Business and Management Geneva). https://doi.org/10.13140/RG.2.2.36660.05767.
Kassab, M., DeFranco, J. F., & Graciano Neto, V. V. (2018). An empirical investigation on the satisfaction levels with the requirements engineering practices: Agile vs. Waterfall. In 2018 IEEE International Professional Communication Conference (ProComm), pages 118–124. https://doi.org/10.1109/ProComm.2018.00033.
Kiv, S., Heng, S., Kolp, M., & Wautelet, Y. (2017). An intentional perspective on partial agile adoption. In Proceedings of the 12th International Conference on Software Technologies, pages 116–127. https://doi.org/10.5220/0006429301160127.
Kiv, S., Heng, S., Wautelet, Y., & Kolp, M. (2018). Towards a goal-oriented framework for partial agile adoption. In International Conference on Software Technologies, 868, 69–90.
Knutsen, L. Z., Hannay, J. E., & Tanilkan, S. S. (2024). The problem of the agile bandwagon: Related phenomena in search of conceptual coherence (SSRN Scholarly Paper No. 4975543). SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4975543.
Kuhrmann, M., Tell, P., Hebig, R., Klunder, J. A.-C., Munch, J., Linssen, O., Pfahl, D., Felderer, M., Prause, C., Macdonell, S., Nakatumba-Nabende, J., Raffo, D., Beecham, S., Tuzun, E., Lopez, G., Paez, N., Fontdevila, D., Licorish, S., Kupper, S., … Richardson, I. (2021). What makes agile software development agile. IEEE Transactions on Software Engineering, 48(9), 3523–3539. https://doi.org/10.1109/TSE.2021.3099532.
Laanti, M., Similä, J., & Abrahamsson, P. (2013). Definitions of agile software development and agility. In F. McCaffery, R. V. O’Connor, & R. Messnarz (Eds.), Systems, Software and Services Process Improvement (pp. 247–258). Springer. https://doi.org/10.1007/978-3-642-39179-8_22.
Lalić, D., Lalić, B., Delić, M., Gračanin, D., & Stefanović, D. (2022). How project management approach impacts project success? From traditional to agile. International Journal of Managing Projects in Business, 15(3), 494–521. https://doi.org/10.1108/IJMPB-04-2021-0108.
Lance, C. E., Butts, M. M., & Michels, L. C. (2006). The sources of four commonly reported cutoff criteria. Organizational Research Methods, 9(2), 202–220. https://doi.org/10.1177/1094428105284919.
Layik, D. (2021). Agile vs. Lean: A systematic literature review comparing underlying principles, work-floor practices, and team-level behaviours (Master’s thesis, University of Twente). [link].
Leppänen, M. (2013). A comparative analysis of agile maturity models. In R. Pooley, J. Coady, C. Schneider, H. Linger, C. Barry, & M. Lang (Eds.), Information Systems Development: Reflections, Challenges and New Directions (pp. 329–343). Springer. https://doi.org/10.1007/978-1-4614-4951-5_27.
Li, C.-H. (2016). The performance of ML, DWLS, and ULS estimation with robust corrections in structural equation models with ordinal variables. Psychological Methods, 21(3), 369–387. https://doi.org/10.1037/met0000093.
Looks, H., Fangmann, J., Thomaschewski, J., Escalona, M.-J., & Schön, E.-M. (2021). Towards a standardized questionnaire for measuring agility at team level. In P. Gregory, C. Lassenius, X. Wang, & P. Kruchten (Eds.), Agile Processes in Software Engineering and Extreme Programming (pp. 71–85). Springer International Publishing. https://doi.org/10.1007/978-3-030-78098-2_5.
Madsen, D. Ø. (2020). The evolutionary trajectory of the agile concept viewed from a management fashion perspective. Social Sciences, 9(5), 69. https://doi.org/10.3390/socsci9050069.
Magistretti, S., & Trabucchi, D. (2025). Agile-as-a-tool and agile-as-a-culture: A comprehensive review of agile approaches adopting contingency and configuration theories. Review of Managerial Science, 19(1), 223–253. https://doi.org/10.1007/s11846-024-00745-1.
Mellor, S., & Balcer, M. (2002). Executable UML: A Foundation for Model-Driven Architecture. Addison-Wesley.
Memeti, A., Huck-Fries, V., Wiesche, M., Thatcher, J. B., & Krcmar, H. (2021). Motivation in IT projects: Investigating the effect of agile practices on team members’ intrinsic motivation. PACIS 2021 Proceedings. [link].
Meyer, S., Newsome, D., Fuller, T., Newsome, K., & Ghezzi, P. M. (2021). Agility: What it is, how to measure it, and how to use it. Behavior Analysis in Practice, 14(3), 598–607. https://doi.org/10.1007/s40617-020-00465-4.
Michaelides, G., Thomson, C., & Wood, S. (2010). Measuring fidelity to extreme programming: A psychometric approach. Empirical Software Engineering, 15(6), 599–617. https://doi.org/10.1007/s10664-010-9130-z.
Miller, G. G. (2001). The characteristics of agile software processes. In Proceedings of the 14th International Conference on Technology of Object-Orientated Languages and Systems, pages 385–388. https://doi.org/10.1109/TOOLS.2001.10035.
Mîndrilă, D. (2010). Maximum likelihood (ML) and diagonally weighted least squares (DWLS) estimation procedures: A comparison of estimation bias with ordinal and multivariate non-normal data. International Journal for Digital Society, 1(1), 60–66. https://doi.org/10.20533/IJDS.2040.2570.2010.0010.
Miranda, E. (2011). Time boxing planning. ACM SIGSOFT Software Engineering Notes, 36(6), 1–5. https://doi.org/10.1145/2047414.2047428.
Moh’d, S., Gregory, P., Barroca, L., & Sharp, H. (2024). Agile human resource management: A systematic mapping study. German Journal of Human Resource Management, 38(4), 345–374. https://doi.org/10.1177/23970022231226316.
Mortensen, R., Boje-Nielsen, T., & Jasemian, T. (2007). Measuring agility—A quantitative survey among IT professionals (Master’s thesis). [link].
Mushtaq, Z., & Qureshi, M. R. J. (2012). Novel hybrid model: Integrating Scrum and XP. International Journal of Information Technology and Computer Science, 4(6), 39–44. https://doi.org/10.5815/IJITCS.2012.06.06.
Nájera Catalán, H. E. (2019). Reliability, population classification and weighting in multidimensional poverty measurement: A Monte Carlo study. Social Indicators Research, 142(3), 887–910. https://doi.org/10.1007/s11205-018-1950-z.
Nguyen, T., Le, C. V., Nguyen, M., Nguyen, G., Lien, T. T. H., & Nguyen, O. (2024). The organisational impact of agility: A systematic literature review. Management Review Quarterly, 75, 2709–2757. https://doi.org/10.1007/s11301-024-00446-9.
Nunnally, J. C. (1978). Psychometric Theory (2nd ed.). McGraw-Hill.
Osigweh, C. A. B. (1989). Concept fallibility in organizational science. The Academy of Management Review, 14(4), 579–594. https://doi.org/10.2307/258560.
Ozkan, N., & Gok, M. S. (2022). Definition synthesis of agility in software development: Comprehensive review of theory to practice. International Journal of Modern Education and Computer Science, 14(3), 26–44.
Palmer, S., & Felsing, J. (2002). A Practical Guide to Feature-Driven Development. Prentice Hall.
Parent, M. C. (2013). Handling item-level missing data: Simpler is just as good. The Counseling Psychologist, 41(4), 568–600. https://doi.org/10.1177/0011000012445176.
Petermann, M. K. H., & Zacher, H. (2022). Workforce agility: Development and validation of a multidimensional measure. Frontiers in Psychology, 13, Article 841862. https://doi.org/10.3389/fpsyg.2022.841862.
Peterson, R. A., & Kim, Y. (2013). On the relationship between coefficient alpha and composite reliability. Journal of Applied Psychology, 98(1), 194–198. https://doi.org/10.1037/a0030767.
Peyre, H., Leplège, A., & Coste, J. (2011). Missing data methods for dealing with missing items in quality of life questionnaires: A comparison by simulation of personal mean score, full information maximum likelihood, multiple imputation, and hot deck techniques applied to the SF-36 in the French 2003 decennial health survey. Quality of Life Research, 20(2), 287–300. https://doi.org/10.1007/s11136-010-9740-3.
Pinho, C. R. A., Pinho, M. L. C. A., Deligonul, S., & Çavuşgil, S. T. (2022). The agility construct in the literature: Conceptualization and bibliometric assessment. Journal of Business Research, 153, 517–532. https://doi.org/10.1016/j.jbusres.2022.08.011.
Poppendieck, M., & Poppendieck, T. (2003). Lean Software Development: An Agile Toolkit. Addison-Wesley.
Rahman, A., Agrawal, A., Krishna, R., & Menzies, T. (2018). “Doing” agile versus “being” agile: Empirical results from 250+ projects. In Proceedings of the 15th International Conference on Mining Software Repositories, pages 311–321.
Rath, S. P., Jain, N. K., Tomer, G., & Singh, A. K. (2025). A systematic literature review of agile software development projects. Information and Software Technology, 182, 107727. https://doi.org/10.1016/j.infsof.2025.107727.
Rathor, S., Xia, W., & Batra, D. (2023). Achieving software development agility: Different roles of team, methodological and process factors. Information Technology & People, 37(2), 835–873. https://doi.org/10.1108/ITP-10-2021-0832.
Recker, J., Holten, R., Hummel, M., & Rosenkranz, C. (2017). How agile practices impact customer responsiveness and development success: A field study. Project Management Journal, 48(2), 99–121. https://doi.org/10.1177/875697281704800208.
Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373. https://doi.org/10.1037/a0029315.
Rietze, S., & Zacher, H. (2022). Relationships between agile work practices and occupational well-being: The role of job demands and resources. International Journal of Environmental Research and Public Health, 19(3), Article 1258. https://doi.org/10.3390/ijerph19031258.
Rönkkö, M., & Cho, E. (2020). An updated guideline for assessing discriminant validity. Organizational Research Methods, 25(1), 6–14. https://doi.org/10.1177/1094428120968614.
Roth, P. L., Switzer, F. S., & Switzer, D. M. (1999). Missing data in multiple item scales: A Monte Carlo analysis of missing data techniques. Organizational Research Methods, 2(3), 211–232. https://doi.org/10.1177/109442819923001.
Rubia, J. M. de la. (2019). Review of the criteria for convergent validity estimated through the Extracted Average Variance. Psychologia. Avances de la Disciplina, 13(2), 25–41. https://doi.org/10.21500/19002386.4119.
Rytkönen, J., Mikkonen, T., & Mäkitalo, N. (2025). Empirical evidence on benefits of agile methods: How much we really know? In D. Pfahl, J. Gonzalez Huerta, J. Klünder, & H. Anwar (Eds.), Product-Focused Software Process Improvement (pp. 317–324). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-78386-9_21.
Sandstø, R., & Reme-Ness, C. (2021). Agile practices and impacts on project success. Journal of Engineering, Project and Production Management, 11(3), 255–262. https://doi.org/10.2478/jeppm-2021-0024.
Sarstedt, M., Ringle, C. M., & Hair, J. F. (2022). Partial least squares structural equation modeling. In C. Homburg, M. Klarmann, & A. E. Vomberg (Eds.), Handbook of Market Research (pp. 587–632). Springer, Cham. https://doi.org/10.1007/978-3-319-05542-8_15-2.
Sartori, G. (1970). Concept misformation in comparative politics. The American Political Science Review, 64(4), 1033–1053. https://doi.org/10.2307/1958356.
Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7(2), 147–177. https://doi.org/10.1037/1082-989X.7.2.147.
Schirrmacher, A., & Schoop, M. (2018). Agility in information systems – A literature review on terms and definitions. UK Academy for Information Systems Conference Proceedings 2018, 25. [link].
Schlein, B. K. (2022, April 20). We need a revised Agile Manifesto. Agile Insider. [link].
Schwaber, K., & Beedle, M. (2001). Agile Software Development with Scrum. Pearson.
Schweigert, T., Vohwinkel, D., Korsaa, M., Nevalainen, R., & Biro, M. (2013). Agile maturity model: Analysing agile maturity characteristics from the SPICE perspective. Journal of Software: Evolution and Process, 26(5), 513–520. https://doi.org/10.1002/smr.1617.
Schweizer, K., Troche, S. J., & DiStefano, C. (2019). Scaling the variance of a latent variable while assuring constancy of the model. Frontiers in Psychology, 10, Article 887. https://doi.org/10.3389/fpsyg.2019.00887.
Serrador, P., & Pinto, J. K. (2015). Does agile work? A quantitative analysis of agile project success. International Journal of Project Management, 33(5), 1040–1051. https://doi.org/10.1016/j.ijproman.2015.01.006.
Sharma, N., & Wadhwa, M. (2015). eXSRUP: Hybrid software development model integrating Extreme Programming, Scrum & Rational Unified Process. Indonesian Journal of Electrical Engineering, 16(2), 377. https://doi.org/10.11591/tijee.v16i2.1627.
Silva-Martinez, J., Barth, T. S., Beil, R. J., Holladay, J., & Pawlikowski, G. (2024). Results from NASA agile teams study. In AIAA SCITECH 2024 Forum (Paper 0408). https://doi.org/10.2514/6.2024-0408.
Sjøberg, D. I. K., & Bergersen, G. R. (2023). Construct validity in software engineering. IEEE Transactions on Software Engineering, 49(3), 1374–1396. https://doi.org/10.1109/TSE.2022.3176725.
So, C., & Scholl, W. (2009). Perceptive agile measurement: New instruments for quantitative studies in the pursuit of the social-psychological effect of agile practices. In P. Abrahamsson, M. Marchesi, & F. Maurer (Eds.), Agile Processes in Software Engineering and Extreme Programming (pp. 83–93). Springer. https://doi.org/10.1007/978-3-642-01853-4_11.
Solinger, O. N., Heusinkveld, S., & Cornelissen, J. P. (2024). Redefining concepts to build theory: A repertoire for conceptual innovation. Human Resource Management Review, 34(1), 100988. https://doi.org/10.1016/j.hrmr.2023.100988.
Stapleton, J. (1997). DSDM Dynamic Systems Development Method: The Method in Practice: A Framework for Business Centered Development. Pearson Education Limited.
Strode, D. E. (2005). The agile methods: An analytical comparison of five agile methods and an investigation of their target environment (Master’s thesis, Massey University). [link].
Syed-Abdullah, S., Holcombe, M., & Gheorge, M. (2006). The impact of an agile methodology on the well being of development teams. Empirical Software Engineering, 11, 143–167. https://doi.org/10.1007/s10664-006-5968-5.
Telemaco, U., Alencar, P., Cowan, D., & Oliveira, T. (2022). Agile assessment methods: Current state of the art (arXiv:2212.10808). arXiv. https://doi.org/10.48550/arXiv.2212.10808.
Thomas, D. (2014, March). Agile is dead (long live agility). PragDave. [link].
Tripp, J., Rienemschneider, C., & Thatcher, J. (2016). Job satisfaction in agile development teams: Agile development as work redesign. Journal of the Association for Information Systems, 17(4), 267–307. https://doi.org/10.17705/1jais.00426.
Tripp, J., Saltz, J., & Turk, D. (2018). Thoughts on current and future research on agile and lean: Ensuring relevance and rigor. Proceedings of the 51st Hawaii International Conference on System Sciences, 5465–5472. https://doi.org/10.24251/HICSS.2018.681.
Tuncel, D., Körner, C., & Plösch, R. (2020). Comparison of agile maturity models: Reflecting the real needs. 2020 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), 51–58. https://doi.org/10.1109/SEAA51224.2020.00019.
Tuncel, D., Körner, C., & Plösch, R. (2022). Questionnaire development for a scientifically founded agile assessment model. Joint Conference of the 31st International Workshop on Software Measurement (IWSM) and the 16th International Conference on Software Process and Product Measurement (MENSURA), 3272, 1–16.
Umer, M., Nazır, T., Muhammad, N., Maqsoom, A., Nawab, S., Fatima, S. T., Shafi, K., & Butt, F. S. (2021). Impact of agile management on project performance: Evidence from I.T sector of Pakistan. PLOS ONE, 16(4), Article e0249311. https://doi.org/10.1371/journal.pone.0249311.
Uraon, R. S., Chauhan, A., Bharati, R., & Sahu, K. (2023). Do agile work practices impact team performance through project commitment? Evidence from the information technology industry. International Journal of Productivity and Performance Management, 73(4), 1212–1234. https://doi.org/10.1108/IJPPM-03-2023-0114.
Vallon, R., da Silva Estácio, B. J., Prikladnicki, R., & Grechenig, T. (2018). Systematic literature review on agile practices in global software development. Information and Software Technology, 96, 161–180. https://doi.org/10.1016/j.infsof.2017.12.004.
Vasylieva, K., Kuhrmann, M., Xavier, M. K., & Klünder, J. (2023). How agile are you? Discussing maturity levels of agile maturity models. 2023 49th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), 270–277. https://doi.org/10.1109/SEAA60479.2023.00049.
Vihovde, E. H., & Meng, Q. (2024). Test-driven development: Ensuring code quality in integration with CI/CD. Proceedings of the 2024 8th International Conference on Management Engineering, Software Engineering and Service Sciences (ICMSS), 8–11. https://doi.org/10.1109/ICMSS61211.2024.00009.
Visconti, M., & Cook, C. R. (2004). An ideal process model for agile methods. In F. Bomarius & H. Iida (Eds.), Product Focused Software Process Improvement (Vol. 3009, pp. 431–441). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-24659-6_31.
Walter, A.-T. (2021). Organizational agility: Ill-defined and somewhat confusing? A systematic literature review and conceptualization. Management Review Quarterly, 71(2), 343–391. https://doi.org/10.1007/s11301-020-00186-6.
Welch, C., Rumyantseva, M., & Hewerdine, L. J. (2016). Using case research to reconstruct concepts: A methodology and illustration. Organizational Research Methods, 19(1), 111–130. https://doi.org/10.1177/1094428115596435.
Wendler, R. (2013). The structure and components of agility – A multi-perspective view. Informatyka Ekonomiczna, 2(28), 148–169.
Whiteley, A., Pollack, J., & Matouš, P. (2021). The origins of agile and iterative methods. The Journal of Modern Project Management, 8(3), 20–29. https://doi.org/10.19255/jmpm02502.
Wieland, A., Durach, C. F., Kembro, J., & Treiblmaier, H. (2017). Statistical and judgmental criteria for scale purification. Supply Chain Management: An International Journal, 22(4), 321–328. https://doi.org/10.1108/SCM-07-2016-0230.
Williams, L., Krebs, W., & Layman, L. (2004). Extreme programming valuation framework for object-oriented languages version 1.3 (Technical Report TR-2004-11). North Carolina State University, Department of Computer Science. [link].
Wood, S., Michaelides, G., & Thomson, C. J. (2013). Successful extreme programming: Fidelity to the methodology or good teamworking? Information & Software Technology, 55(4), 660–672. https://doi.org/10.1016/j.infsof.2012.10.002.
Yang, N., Wang, X., Zhang, Z., Siemon, D., & Hyrynsalmi, S. (2025). Core theories in agile software development. In S. Peter, M. Kropp, A. Aguiar, C. Anslow, M. I. Lunesu, & A. Pinna (Eds.), Agile Processes in Software Engineering and Extreme Programming (pp. 3–18). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-94544-1_1.
Yauch, C. A. (2011). Measuring agility as a performance outcome. Journal of Manufacturing Technology Management, 22(3), 384–404. https://doi.org/10.1108/17410381111112738.
Yusuf, Y. Y., Sarhadi, M., & Gunasekaran, A. (1999). Agile manufacturing: The drivers, concepts and attributes. International Journal of Production Economics, 62(1), 33–43. https://doi.org/10.1016/S0925-5273(98)00219-9.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Vincent Tchikanmou, Tabea
This work is licensed under a Creative Commons Attribution 4.0 International License.
