Investigating UX work in Software Startups: A Survey about Attitudes, Methods, and Key Challenges

Guilherme Guerino; Suéllen  Martinelli; Joelma  Choma; Gislaine Camila  Leal; Renato  Balancieri; Luciana  Zaina

doi:10.5753/jbcs.2024.4260

Authors

Guilherme Guerino State University of Paraná https://orcid.org/0000-0002-4979-5831
Suéllen Martinelli Federal University of São Carlos https://orcid.org/0000-0002-4421-2940
Joelma Choma Federal University of São Carlos https://orcid.org/0000-0002-8516-2943
Gislaine Camila Leal State University of Maringá https://orcid.org/0000-0001-8599-0776
Renato Balancieri State University of Paraná https://orcid.org/0000-0002-8532-2011
Luciana Zaina Federal University of São Carlos https://orcid.org/0000-0002-1736-544X

DOI:

https://doi.org/10.5753/jbcs.2024.4260

Keywords:

UX Work, Software Startups, Challenges, Long-Term UX, UX Methods, UX Attitudes

Abstract

User eXperience (UX) work within the software industry entails implementing user-centered practices and techniques to acquire and apply insights about users. Given their challenging context characterized by small teams and limited resources, this application can provide software startups with a competitive edge. Despite a growing interest in this field, the perspectives of startup professionals regarding UX work and the challenges they face remain largely unexplored. This paper seeks to explore the perceptions of startup professionals regarding the usefulness of methods and techniques used in UX work, as well as the moments during user interactions with the product or service when they are applied, alongside the challenges inherent in the startup environment. To achieve this, we conducted a survey involving 90 professionals from software startups in Brazil, employing descriptive and inferential statistical methods for data analysis. Our findings reveal that software startup professionals prioritize understanding user needs, capturing feedback, and conducting user tests in their UX work. Interviews are the most commonly utilized method, although usability testing, competitive analysis, and high-fidelity prototyping are also valued across various stages of startup maturity. Furthermore, UX data is primarily collected during user interactions with the product. Additionally, we identified that specific challenges may have a reciprocal relationship with UX attitudes. These findings underscore the perceived value of UX work among software startup professionals, although perspectives vary depending on the startup's stage.

Downloads

Download data is not yet available.

References

Alhadreti, O. (2020). Exploring ux maturity in software development environments in saudi arabia. International Journal of Advanced Computer Science and Applications (IJACSA), 11(12):168-174. DOI: 10.14569/IJACSA.2020.0111221.

Alves, D. D. and Matos, E. (2019). A survey on interaction design in distributed software development. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, IHC '19, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3357155.3358485.

Associação Brasileira de Startups (2020). Fases de uma startup: saiba tudo sobre cada etapa. Abstartup, 2020. Online; accessed 02 May 2023.

Au, I., Boardman, R., Jeffries, R., Larvie, P., Pavese, A., Riegelsberger, J., Rodden, K., and Stevens, M. (2008). User experience at google: Focus on the user and all else will follow. In SIGCHI Conference on Human Factors in Computing Systems (CHI '08), page 3681–3686, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/1358628.1358912.

Bargas-Avila, J. and Hornbaek, K. (2011). Old Wine in New Bottles or Novel Challenges: A Critical Analysis of Empirical Studies of User Experience. In 29th SIGCHI Conference on Human Factors in Computing Systems, page 2689–2698, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/1978942.1979336.

Bjarnason, E. (2021). Prototyping practices in software startups: Initial case study results. In IEEE 29th International Requirements Engineering Conference Workshops (REW), pages 206-211, Notre Dame, IN, USA. IEEE. DOI: 10.1109/REW53955.2021.00038.

Brewer, J., Joyce, G., and Dutta, S. (2017). Converging data with design within agile and continuous delivery environments. In Design, User Experience, and Usability: Theory, Methodology, and Management, pages 533-542, Cham. Springer International Publishing. DOI: 10.1007/978-3-319-58634-2_39.

Chilana, P., Holsberry, C., Oliveira, F., and Ko, A. (2012). Designing for a billion users: A case study of facebook. In Extended Abstracts on Human Factors in Computing Systems (CHI '12), page 419–432, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2212776.2212819.

Choma, J., Guerra, E. M., Alvaro, A., Pereira, R., and Zaina, L. (2022). Influences of ux factors in the agile ux context of software startups. Information and Software Technology, 152:107041. DOI: 10.1016/j.infsof.2022.107041.

de Jesús Álvarez Robles, T., Álvarez Rodríguez, F. J., Benítez-Guerrero, E., and Rusu, C. (2019). Adapting card sorting for blind people: Evaluation of the interaction design in talkback. Computer Standards & Interfaces, 66:103356. DOI: 10.1016/j.csi.2019.103356.

de Quincey, E. and Mitchell, J. (2022). Card Sorting for User Experience Design. Interacting with Computers, 33(4):442-457. DOI: 10.1093/iwc/iwac002.

Douglas, C. E. and Michael, F. A. (1991). On distribution-free multiple comparisons in the one-way analysis of variance. Communications in Statistics-Theory and Methods, 20(1):127-139. DOI: 10.1080/03610929108830487.

Ghazi, A. N., Petersen, K., Reddy, S. S. V. R., and Nekkanti, H. (2019). Survey research in software engineering: Problems and mitigation strategies. IEEE Access, 7:24703-24718. DOI: 10.1109/ACCESS.2018.2881041.

Giardino, C., Bajwa, S. S., Wang, X., and Abrahamsson, P. (2015). Key challenges in early-stage software startups. In Agile Processes in Software Engineering and Extreme Programming, pages 52-63, Cham. Springer International Publishing. DOI: https://doi.org/10.1007/978-3-319-18612-2_5.

Giardino, C., Unterkalmsteiner, M., Paternoster, N., Gorschek, T., and Abrahamsson, P. (2014). What Do We Know about Software Development in Startups? IEEE Software, 31(5):28-32. DOI: 10.1109/MS.2014.129.

Guerino, G., de Assumpção, M., da Silva, T., Hokkanen, L., Balancieri, R., and Leal, G. (2022). User Experience Practices in Software Startups: A Systematic Mapping Study. Advances in Human-Computer Interaction, 2022. DOI: 10.1155/2022/9701739.

Guerino, G. C., Dias, N. S. B. C., Chanin, R., Prikladnicki, R., Balancieri, R., and Leal, G. C. L. (2021). User experience practices in early-stage software startups - an exploratory study. In Software Business, pages 122-136, Cham. Springer International Publishing. DOI: 10.1007/978-3-030-91983-2_10.

Guerino, G. C., Martinelli, S., Choma, J., Leal, G. C. L., Balancieri, R., and Zaina, L. (2024). Perceptions about Usefulness and Attitudes toward UX work: a survey with software startup Brazilian professionals. In Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems, IHC '23, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3638067.3638069.

Guo, H. (2016). Lean but not mean ux: Towards a spiral ux design model. In Design, User Experience, and Usability: Design Thinking and Methods, pages 25-33, Cham. Springer International Publishing. DOI: 10.1007/978-3-319-40409-7_3.

Guo, Y. R. and Goh, D. H.-L. (2016). From storyboard to software: User evaluation of an information literacy game. In Proceedings of the 31st Annual ACM Symposium on Applied Computing, SAC '16, page 199–201, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2851613.2851909.

Hassenzahl, M. (2018). The thing and i (summer of '17 remix). In Funology 2: From Usability to Enjoyment, pages 17-31, Cham. Springer International Publishing. DOI: 10.1007/978-3-319-68213-6_2.

Hassenzahl, M. and Tractinsky, N. (2006). User experience-a research agenda. Behaviour & information technology, 25(2):91-97. DOI: 10.1080/01449290500330331.

Hokkanen, L., Kuusinen, K., and Väänänen, K. (2016a). Minimum viable user experience: A framework for supporting product design in startups. In Agile Processes, in Software Engineering, and Extreme Programming (XP 2016), volume 251, pages 66-78, Cham. Springer International Publishing. DOI: 10.1007/978-3-319-33515-5_6.

Hokkanen, L. and Leppänen, M. (2015). Three patterns for user involvement in startups. In 20th European Conference on Pattern Languages of Programs, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2855321.2855373.

Hokkanen, L. and Väänänen-Vainio-Mattila, K. (2015). Ux work in startups: Current practices and future needs. In Agile Processes in Software Engineering and Extreme Programming (XP 2015), pages 81-92, Cham. Springer International Publishing. DOI: 10.1007/978-3-319-18612-2_7.

Hokkanen, L., Xu, Y., and V"a"an"anen, K. (2016b). Focusing on User Experience and Business Models in Startups: Investigation of Two-Dimensional Value Creation. In 20th International Academic Mindtrek Conference, page 59–67, New York, NY, USA. ACM. DOI: 10.1145/2994310.2994371.

ISO (2009). Iso: 9241-210:2009 - ergonomics of human system interaction-part 210: Human-centred design for interactive systems. In International Standardization Organization, Switzerland. (ISO). Available online [link]. Accessed 03 May 2022.

Kashfi, P., Feldt, R., and Nilsson, A. (2019). Integrating ux principles and practices into software development organizations: A case study of influencing events. Journal of Systems and Software, 154:37-58. DOI: 10.1016/j.jss.2019.03.066.

Kevic, K., Murphy, B., Williams, L., and Beckmann, J. (2017). Characterizing experimentation in continuous deployment: A case study on bing. In 39th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP), pages 123-132, Buenos Aires, Argentina. IEEE. DOI: 10.1109/ICSE-SEIP.2017.19.

Kieffer, S., Rukonic, L., de Meerendré, V. K., and Vanderdonckt, J. (2019). Specification of a ux process reference model towards the strategic planning of ux activities. In VISIGRAPP 2019 - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, volume 2, pages 74-85, Prague, Czech Republic. SCITEPRESS – Science and Technology Publications. DOI: 10.5220/0007693600740085.

Kitchenham, B. A. and Pfleeger, S. L. (2008). Personal Opinion Surveys, pages 63-92. Springer London, London. DOI: 10.1007/978-1-84800-044-5_3.

Klotins, E., Unterkalmsteiner, M., Chatzipetrou, P., Gorschek, T., Prikladnicki, R., Tripathi, N., and Pompermaier, L. (2019a). A Progression Model of Software Engineering Goals, Challenges, and Practices in Start-Ups. IEEE Transactions on Software Engineering, 47(3):498-521. DOI: 10.1109/TSE.2019.2900213.

Klotins, E., Unterkalmsteiner, M., and Gorschek, T. (2019b). Software engineering in start-up companies: An analysis of 88 experience reports. Empirical Software Engineering, 24(68-102):68–102. DOI: 10.1007/s10664-018-9620-y.

Kujala, S., Roto, V., Väänänen-Vainio-Mattila, K., Karapanos, E., and Sinnelä, A. (2011). Ux curve: A method for evaluating long-term user experience. Interacting with computers, 23(5):473-483. DOI: 10.1016/j.intcom.2011.06.005.

Kujala, S., Vogel, M., Pohlmeyer, A. E., and Obrist, M. (2013). Lost in time: The meaning of temporal aspects in user experience. In Extended Abstracts on Human Factors in Computing Systems (CHI EA '13), page 559–564, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2468356.2468455.

Kunneman, Y., da Motta-Filho, M. A., and van der Waa, J. (2022). Data science for service design: An introductory overview of methods and opportunities. The Design Journal, 25(2):186-204. DOI: 10.1080/14606925.2022.2042108.

Kuusinen, K. (2015). Overcoming Challenges in Agile User Experience Work: Cross-Case Analysis of Two Large Software Organizations. In 41st Euromicro Conference on Software Engineering and Advanced Applications, pages 454-458, Madeira, Portugal. IEEE. DOI: 10.1109/SEAA.2015.38.

Kuusinen, K., Sorensen, M. K., Frederiksen, N. M., Laugesen, N. K., and Juul, S. H. (2019). From startup to scaleup: An interview study of the development of user experience work in a data-intensive company. In Human-Centered Software Engineering, pages 3-14, Cham. Springer International Publishing. DOI: 10.1007/978-3-030-05909-5_1.

Lindgren, E. and Münch, J. (2016). Raising the odds of success: the current state of experimentation in product development. Information and Software Technology, 77:80-91. DOI: 10.1016/j.infsof.2016.04.008.

Marti, P. and Iacono, I. (2016). Anticipated, momentary, episodic, remembered: the many facets of user experience. In Federated Conference on Computer Science and Information Systems (FedCSIS 2016), pages 1647-1655, Gdansk, Poland. IEEE. Available online [link].

Martinelli, S., Lopes, L., and Zaina, L. (2022). UX Research in the Software Industry: An Investigation of Long-Term UX Practices. In Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems, IHC '22, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3554364.3559126.

McCrum-Gardner, E. (2008). Which is the correct statistical test to use? British Journal of Oral and Maxillofacial Surgery, 46(1):38-41. DOI: 10.1016/j.bjoms.2007.09.002.

Meingast, M., Packard, H., Ballew, T., Edwards, R., Nordquist, E., Sader, C., and Smith, D. (2013). Agile and ux: The road to integration-the challenges of the ux practitioner in an agile environment. volume 57, pages 1002-1006. Scopus. DOI: 10.1177/1541931213571224.

Melo, B. and Darin, T. (2019). Scope and Definition of User Experience in Brazil: A Survey to Explore Community's Perspectives. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, IHC '19, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3357155.3358444.

Mkpojiogu, E., Okeke-Uzodike, O., and Omopariola, V. (2022). Methods for the Evaluation of UX Over Time. In International Conferences Interfaces and Human Computer Interaction (IHCI), pages 1-9, Lisbon, Portugal. Available online [link].

Nguyen-Duc, A., Wang, X., and Abrahamsson, P. (2017). What influences the speed of prototyping? an empirical investigation of twenty software startups. In Agile Processes in Software Engineering and Extreme Programming: 18th International Conference, XP 2017, Cologne, Germany, May 22-26, 2017, Proceedings 18, pages 20-36, Cologne, Germany. Springer International Publishing. DOI: 10.1007/978-3-319-57633-6_2.

Norman, D. and Nielsen, J. (2020). The Definition of User Experience (UX). Available online [link]. Online; accessed 02 May 2023.

Paternoster, N., Giardino, C., Unterkalmsteiner, M., Gorschek, T., and Abrahamsson, P. (2014). Software development in startup companies: A systematic mapping study. Information and Software Technology, 56(10):1200-1218. DOI: 10.1016/j.infsof.2014.04.014.

Pichiliani, T. C. P. B. and Pizzolato, E. B. (2019). A survey on the awareness of brazilian web development community about cognitive accessibility. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, IHC '19, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3357155.3358448.

Pohlmeyer, A. (2012). Identifying Attribute Importance in Early Product Development. Exemplified by Interactive Technologies and Age. PhD thesis. Available online [link].

Rivero, L. and Conte, T. (2017). A systematic mapping study on research contributions on ux evaluation technologies. In XVI Brazilian Symposium on Human Factors in Computing Systems, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3160504.3160512.

Roto, V., Law, E.-C., Vermeeren, A. P., and Hoonhout, J. (2011). User experience white paper: Bringing clarity to the concept of user experience. Dagstuhl seminar on demarcating user experience, 1. Available online [link].

Saad, J., Martinelli, S., Machado, L. S., de Souza, C. R., Alvaro, A., and Zaina, L. (2021). Ux work in software startups: A thematic analysis of the literature. Information and Software Technology, 140:106688. DOI: 10.1016/j.infsof.2021.106688.

Salgado, A. d. L., Amaral, L. A., Freire, A. P., and Fortes, R. P. M. (2016). Usability and UX Practices in Small Enterprises: Lessons from a Survey of the Brazilian Context. In Proceedings of the 34th ACM International Conference on the Design of Communication, SIGDOC '16, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2987592.2987616.

Silveira, S. A. M., Choma, J., Pereira, R., Guerra, E. M., and Zaina, L. A. M. (2021). Ux work in software start-ups: Challenges from the current state of practice. In Agile Processes in Software Engineering and Extreme Programming, pages 19-35, Cham. Springer International Publishing. DOI: 10.1007/978-3-030-78098-2_2.

Teka, D., Dittrich, Y., and Kifle, M. (2018). Adapting lightweight user-centered design with the scrum-based development process. In International Conference on Software Engineering in Africa (SEiA '18), page 35–42, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3195528.3195530.

Tullis, T. and Albert, B. (2013). Measuring the User Experience. Interactive Technologies. Morgan Kaufmann, Boston, second edition edition. DOI: 10.1016/C2011-0-00016-9.

Unterkalmsteiner, M., Abrahamsson, P., Wang, X., Nguyen-Duc, A., Shah, S. Q., Bajwa, S. S., Baltes, G. H., Conboy, K., Cullina, E., Dennehy, D., et al. (2016). Software startups-a research agenda. e-Informatica Software Engineering Journal, 10(1):89-123. DOI: 10.5277/e-Inf160105.

Varsaluoma, J. and Sahar, F. (2014). Usefulness of Long-Term User Experience Evaluation to Product Development: Practitioners' Views from Three Case Studies. In 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational, page 79–88, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/2639189.2641218.

Victorelli, E. Z., Dos Reis, J. C., Hornung, H., and Prado, A. B. (2020). Understanding human-data interaction: Literature review and recommendations for design. International Journal of Human-Computer Studies, 134:13-32. DOI: 10.1016/j.ijhcs.2019.09.004.

Vukovac, D. P., Dzeko, M., Stapic, Z., and Orehovacki, T. (2019). User Experience Design and Architecture of IoT Ecosystem Employed in Students' Activities Tracking. In Rebelo, F. and Soares, M., editors, International Conference on Ergonomics in Design (AHFE 2018), volume 777 of Advances in Intelligent Systems and Computing, pages 440-452, Orlando, FL, USA. Springer International Publishing. DOI: 10.1007/978-3-319-94706-8_48.

Wang, X., Edison, H., Bajwa, S. S., Giardino, C., and Abrahamsson, P. (2016). Key challenges in software startups across life cycle stages. In Agile Processes, in Software Engineering, and Extreme Programming: 17th International Conference, XP 2016, Edinburgh, UK, May 24-27, 2016, Proceedings 17, pages 169-182. Springer International Publishing. DOI: 10.1007/978-3-319-33515-5_14.

Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., and Wesslén, A. (2012). Experimentation in software engineering. Springer Science & Business Media, Springer Berlin, Heidelberg. DOI: 10.1007/978-3-662-69306-3.

Zaina, L., Choma, J., Saad, J., Barroca, L., Sharp, H., Machado, L. S., and de Souza, C. R. (2023). What do software startups need from ux work? Empirical Software Engineering, 80:45. DOI: 10.1007/s10664-023-10322-x.

Zaina, L. A., Sharp, H., and Barroca, L. (2021). Ux information in the daily work of an agile team: A distributed cognition analysis. International Journal of Human-Computer Studies, 147:102574. DOI: 10.1016/j.ijhcs.2020.102574.