Improving a smart city application through evaluation of Quality Metrics and Usability


  • Alexandre Aragão Universidade Federal do Maranhão (UFMA)
  • Lucas Machado Universidade Federal do Maranhão (UFMA)
  • Nathyane Moreno Universidade Federal do Maranhão (UFMA)
  • Davi Viana Universidade Federal do Maranhão (UFMA)
  • Francisco Silva Universidade Federal do Maranhão (UFMA)
  • Tércio Sousa Instituto Federal do Maranhão (IFMA)
  • Luis Rivero Universidade Federal do Maranhão (UFMA)
  • Ariel Teles Instituto Federal do Maranhão (IFMA)
  • Arlindo F. da Conceição Universidade Federal de São Paulo (UNIFESP)
  • Inaldo Costa Instituto Tecnológico de Aeronáutica (ITA)



Smart Cities, Quality of software, Usability


Several software applications have been changing people's lifestyles in technological and social aspects. Applications in the context of Smart Cities (SCs) may contain characteristics that are not normally evaluated in traditional applications, since they may involve aspects related to sensor networks, management of large amounts of data and applications that have specific behaviors according to the context of use. This paper presents a study on the evaluation of three software quality characteristics considered relevant for SCs: context, calmness and Mobility. Within the context of the study, two tests were performed to evaluate an application for SCs. Additionally, an heuristic evaluation was carried out, aiming to verify the usability of the application and the impacts of this type of evaluation in applications for SCs. We identified that both the evaluated characteristics and the heuristics are adequate for the evaluation of applications for ICs, but that their results may be influenced by aspects of development and characteristics of the context of use.


Download data is not yet available.


AgBrasil (2019). Brasil é 5o pa ́ıs em ranking de uso diário de celulares no mundo. Acessado em: 25 de fevereiro de 2019. Disponível em: de-uso-diario-de-celulares-no-mundo.
Araga ̃o, A., Moreno, N., Viana, D., Silva, F., Sousa, T., Rivero, L., Teles, A., da Conceic ̧a ̃o, A., and Costa, I. (2019). Utilizando me ́tricas de qualidade na avaliac ̧a ̃o de uma aplicac ̧a ̃o para cidades inteligentes. In Anais do IV Workshop sobre Aspectos Sociais, Humanos e Econoˆmicos de Software, pages 51–60. SBC.
Arasteh, H., Hosseinnezhad, V., Loia, V., Tommasetti, A., Troisi, O., Shafie-Khah, M., and Siano, P. (2016). Iot-based smart cities: a survey. In 2016 IEEE 16th International Conference on Environment and Electrical Engineering (EEEIC), pages 1–6. IEEE.
Atzori, L., Iera, A., and Morabito, G. (2010). The Internet of Things: A survey. Computer Networks, 54(15):2787–2805.
Bakıcı, T., Almirall, E., and Wareham, J. (2013). A smart city initiative: the case of barcelona. Journal of the Knowledge Economy, 4(2):135–148.
Carvalho, R. M., de Castro Andrade, R. M., and de Oliveira, K. M. (2018). Aquarium - a suite of software measures for hci quality evaluation of ubiquitous mobile applications. Journal of Systems and Software, 136:101 – 136.
Cavalcante, E., Cacho, N., Lopes, F., and Batista, T. (2017). Challenges to the develop- ment of smart city systems: A system-of-systems view. In Proceedings of the 31st Brazilian Symposium on Software Engineering, pages 244–249.
Chourabi, H., Nam, T., Walker, S., Gil-Garcia, J. R., Mellouli, S., Nahon, K., Pardo, T. A., and Scholl, H. J. (2012). Understanding smart cities: An integrative framework. In 2012 45th Hawaii international conference on system sciences, pages 2289–2297. IEEE.
Darin, T., Barbosa, J., Rodrigues, B., and Andrade, R. (2016). Greatroom: Uma aplicac ̧a ̃o android baseada em proximidade para a criac ̧a ̃o de salas virtuais inteligentes. In Workshop de Ferramentas e Aplicac ̧o ̃es (WFA). WebMedia 2019.
Dey, A. K. (2001). Understanding and using context. Personal Ubi. Computing, 5(1):4–7.
Herna ́ndez-Mun ̃oz, J. M., Vercher, J. B., Mun ̃oz, L., Galache, J. A., Presser, M., Go ́mez, L. A. H., and Pettersson, J. (2011). Smart cities at the forefront of the future internet. In The future internet assembly, pages 447–462. Springer.
Jagadish, H., Gehrke, J., Labrinidis, A., Papakonstantinou, Y., Patel, J. M., Ramakrishnan, R., and Shahabi, C. (2014). Big data and its technical challenges. Communications of the ACM, 57(7):86–94.
Koscianski, A. and Soares, M. d. S. (2007). Qualidade de software: aprenda as meto- dologias e te ́cnicas mais modernas para o desenvolvimento de software.[sl]: Novatec, 2007. Citado na, page 26.
Kourouthanassis, P. E., Giaglis, G. M., and Karaiskos, D. C. (2008). Delineating the degree of ’pervasiveness’ in pervasive information systems: An assessment framework and design implications. In 2008 Panhellenic Conference on Informatics, pages 251– 255.
Larrucea, X., Combelles, A., Favaro, J., and Taneja, K. (2017). Software engineering for
the internet of things. IEEE Software, 34(1):24–28.
Maia, R., Andrade, R., Oliveira, K., Santos, I. D. S., and Bezerra, C. I. M. (2016). Quality characteristics and measures for human–computer interaction evaluation in ubiquitous systems. Software Quality Journal.
Nielsen, J. (1994). Enhancing the explanatory power of usability heuristics. In Pro- ceedings of the SIGCHI conference on Human Factors in Computing Systems, pages 152–158. ACM.
Nielsen, J. and Molich, R. (1990). Heuristic evaluation of user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 249–256. ACM.
Riekki, J., Isomursu, P., and Isomursu, M. (2004). Evaluating the calmness of ubiquitous applications. volume 3009, pages 105–119.
Ryu, H., Hong, G., and James, H. (2006). Quality assessment technique for ubiquitous software and middleware. Res. Lett. Inf. Math. Sci, 9:13–87.
Santana, E. F. Z., Chaves, A. P., Gerosa, M. A., Kon, F., and Milojicic, D. S. (2017). Software platforms for smart cities: Concepts, requirements, challenges, and a unified reference architecture. ACM Computing Surveys (Csur), 50(6):1–37.
Thomas, M. O., Onyimbo, B. A., and Logeswaran, R. (2016). Usability evaluation criteria for internet of things. Int J Inf Technol Comput Sci, 8:10–18.
Ya ́n ̃ez Go ́mez, R., Cascado Caballero, D., and Sevillano, J.-L. (2014). Heuristic evaluation on mobile interfaces: A new checklist. The Scientific World Journal, 2014.
Zambonelli, F. (2017). Key abstractions for iot-oriented software engineering. IEEE Software, (1):38–45.



How to Cite

Aragão, A., Machado, L., Moreno, N., Viana, D., Silva, F., Sousa, T., Rivero, L., Teles, A., da Conceição, A. F., & Costa, I. (2020). Improving a smart city application through evaluation of Quality Metrics and Usability. ISys - Brazilian Journal of Information Systems, 13(3), 55–81.



Extended versions of selected articles

Most read articles by the same author(s)