On the investigation of Usability in the Caixa Tem Application





Usability Testing, Heuristic Evaluation, System Design and Usability, Public Systems, Caixa Tem


There is a growing advancement of technologies, with an increasing number of services being carried out through them. This trend also prompts the Public Sector to join this movement by providing its services digitally, making them more convenient and cost-effective. However, the challenge arises in ensuring that everyone has equal access to these services, thereby avoiding segregation, particularly among the most vulnerable segment of society. Hence, we investigate the usability of the Caixa Tem application, which provided access to emergency aid during the pandemic. Our goal is to verify whether this application ensures usability for its users. Therefore, we assess usability through high-fidelity prototypes faithful to the real application, conducting Heuristic Evaluations, and Usability Tests with carefully selected individuals. Therefore, we are able to identify a number of usability issues regarding time and interaction efficiency, satisfaction, user experience, and effectiveness. At last, we propose a set of modifications that enhances the usability of the Caixa Tem application.


Download data is not yet available.


Alotaibi, M. B. (2016). Comparing the usability of m-business and m-government software in saudi arabia. International Journal of Advanced Computer Science and Applications, 7(1):117–123.

Boren, T. and Ramey, J. (2000). Thinking aloud: Reconciling theory and practice. IEEE transactions on professional communication, 43(3):261–278.

Brooke, J., Jordan, P., Thomas, B., Weerdmeester, B., and McClelland, I. (1996). Usability evaluation in industry. CRC Press.

Budde, R., Kautz, K., Kuhlenkamp, K., and Züllighoven, H. (1990). What is prototyping? Information Technology & People, 6(2/3):89–95.

Caixa Econômica Federal - CEF (2020). Aplicativo Caixa Tem. [link], Access on 16 May 2024.

Cardoso, B. B. (2020). A implementação do auxílio emergencial como medida excepcional de proteção social. Revista de Administração Pública, 54:1052–1063. DOI: https://doi.org/10.1590/0034-761220200267.

Chisman, J., Diller, K., and Walbridge, S. (1999). Usability testing: A case study. College & research libraries, 60(6):552–569.

Cristóvam, J. S. d. S., Saikali, L. B., and Sousa, T. P. d. (2020). Governo digital na implementação de serviços públicos para a concretização de direitos sociais no brasil. Sequência: estudios jurídicos e políticos, (84):209–242. DOI: https://doi.org/10.5007/2177-7055.2020v43n89p209.

Cunha, M. A. V. C. d. and Miranda, P. R. d. M. (2013). O uso de tic pelos governos: uma proposta de agenda de pesquisa a partir da produção acadêmica e da prática nacional. Organizações & sociedade, 20:543–566.

Figma (2011). Figma. [link], Access on 16 May 2024.

Filho, G. K., Guerino, G. C., and Valentim, N. M. C. (2023). Usability and user experience of multi-touch systems: A systematic mapping study and benchmark. Journal on Interactive Systems, 14(1):292–316. DOI: https://doi.org/10.5753/jis.2023.3279.

Gere, C. (2009). Digital culture.

Gumussoy, C. A. (2016). Usability guideline for banking software design. Computers in Human Behavior, 62:277–285. DOI: https://doi.org/10.1016/j.chb.2016.04.001.

Gupta, M., Mehta, D., Punj, A., and Thies, I. M. (2022). Sophistication with limitation: Understanding smartphone usage by emergent users in india. In Proceedings of the 5th ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies, page 386–400. DOI: https://doi.org/10.1145/3530190.3534824.

Hasan, L. (2013). Heuristic evaluation of three jordanian university websites. Informatics in Education, 12(2):231–21.

IBGE (2018). Pesquisa nacional por amostra de domicílios contínua. [link], Access on 16 May 2024.

IBGE (2019). PNS - pesquisa nacional de saúde. [link], Access on 16 May 2024.

Jardim, J. M. (2000). Capacidade governativa, informação e governo eletrônico. DataGramaZero – Revista de Ciência da Informação, 1(5).

Kosakowski, J. (1998). The benefits of information technology. ERIC Digest.

Laugwitz, B., Held, T., and Schrepp, M. (2008). Construction and evaluation of a user experience questionnaire. In Symposium of the Austrian HCI and usability engineering group, pages 63–76.

Lewis, J. R. (2006). Usability testing. John Wiley Sons.

Lichter, H., Schneider-Hufschmidt, M., and Zullighoven, H. (1994). Prototyping in industrial software projects-bridging the gap between theory and practice. IEEE transactions on software engineering, 20(11):825–832.

Lisbôa, D., Rocha, T. d., Machado, L., Caldeira, C., and de Souza, C. (2021). Working in the covid-19 pandemic: an observational study. Journal on Interactive Systems, 12(1):283–293. DOI: https://doi.org/10.5753/jis.2021.2178.

Marchionini, G., Samet, H., and Brandt, L. (2003). Digital government. Communications of the ACM, 46(1):25–27.

Marky, K., Zimmermann, V., Funk, M., Daubert, J., Bleck, K., and Mühlhäuser, M. (2020). Improving the usability and ux of the swiss internet voting interface. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pages 1–13. DOI: https://doi.org/10.1145/3313831.3376769.

Monteiro, I. T., Lourenço, E. L. d. Q., Brilhante, M. Q. d. L., de Freitas, A. T., Oliveira, F. C. d. M. B., de Castro, F. E. B., and de Oliveira, A. C. B. (2022). Design and evaluation of a prototype of a children’s educational application during and for the covid-19 pandemic and beyond. Journal on Interactive Systems, 13(1):54–76. DOI: https://doi.org/10.5753/jis.2022.2004.

Monteiro, M. d. S., Batista, G. O. d. S., and Salgado, L. C. d. C. (2023). Investigating usability pitfalls in brazilian and foreign governmental chatbots. Journal on Interactive Systems, 14(1):331–340. DOI: https://doi.org/10.5753/jis.2023.3104.

Motta, P. R. F. (2003). Agências reguladoras. Editora Manole Ltda.

Nielsen, J. (1994). Usability engineering. Morgan Kaufmann.

Nielsen, J. (1995). How to conduct a heuristic evaluation. Nielsen Norman Group, 1(1):8.

Nielsen, J. (2005). Ten usability heuristics. [link], Access on 16 May 2024.

O’neill, J., Dhareshwar, A., and Muralidhar, S. (2017). Working digital money into a cash economy: The collaborative work of loan payment. Computer Supported Cooperative Work: CSCW: An International Journal, 26:1–36. DOI: https://doi.org/10.1007/s10606-017-9289-6.

Riihiaho, S. (2018). Usability testing. The Wiley Handbook of Human Computer Interaction, 1:255–275.

Rudd, J., Stern, K., and Isensee, S. (1996). Low vs. high-fidelity prototyping debate. interactions, 3(1):76–85.

Sahasrabudhe, S. and Lockley, M. (2014). Understanding blind user’s accessibility and usability problems in the context of myitlab simulated environment. In Proceedings of the 20th Americas Conference on Information Systems, pages 1–14.

Staiano, F. (2022). Designing and Prototyping Interfaces with Figma: Learn essential UX/UI design principles by creating interactive prototypes for mobile, tablet, and desktop. Packt Publishing Ltd.

Viana, A. C. A. (2020). Aplicativo utilizado para cadastro do auxílio emergencial pode ser excludente.

Vieira and Andrade (2024). Online appendix. [link].

Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., and Wesslén, A. (2012). Experimentation in software engineering. Springer Science Business Media.




How to Cite

VIEIRA, J.; ANDRADE, R. On the investigation of Usability in the Caixa Tem Application. Journal on Interactive Systems, Porto Alegre, RS, v. 15, n. 1, p. 417–433, 2024. DOI: 10.5753/jis.2024.3889. Disponível em: https://journals-sol.sbc.org.br/index.php/jis/article/view/3889. Acesso em: 25 jun. 2024.



Regular Paper