A Scalable Data Integration Architecture for Smart Cities: Implementation and Evaluation
DOI:
https://doi.org/10.5753/jidm.2022.2485Keywords:
Smart Cities, Data Integration, Data ManagementAbstract
The collection, processing, and analysis of data generated by varied sources can help us better understand the functioning and demands of the cities. However, developing efficient solutions to explore urban data is challenging due to the large volume, heterogeneity, and lack of accessibility and integration of this kind of data. In this work, we identify the main requirements of a data integration system to support decision-making in cities, focusing on its challenges. We analyze some existing data integration solutions, to uncover their features and limitations. Based on these results, we propose a new microservice architecture to support the development of software platforms for integrating smart cities’ heterogeneous data and a guideline to assess their performance. We also present details of a proof-of-concept implementation of the proposed architecture and its performance evaluation. The results demonstrate that the platform can scale horizontally to handle the highly dynamic demands of a smart city while maintaining low response times.
Downloads
References
Al Nuaimi, E., Al Neyadi, H., Mohamed, N., and Al-Jaroodi, J. Applications of big data to smart cities. Journal of Internet Services and Applications 6 (1): 25, 2015.
Albino, V., Berardi, U., and Dangelico, R. M. Smart cities: Definitions, dimensions, performance, and initiatives. Journal of Urban Technology 22 (1): 3–21, 2015.
Cheng, B., Longo, S., Cirillo, F., Bauer, M., and Kovacs, E. Building a big data platform for smart cities: Experience and lessons from Santander. In 2015 IEEE International Congress on Big Data. IEEE BigData 2015. IEEE, New York, pp. 592–599, 2015.
Consoli, S., Mongiovic, M., Nuzzolese, A. G., Peroni, S., Presutti, V., Reforgiato Recupero, D., and Spampinato, D. A smart city data model based on semantics best practice and principles. In Proceedings of the 24th International Conference on World Wide Web. WWW ’15 Companion. Association for Computing Machinery, New York, NY, USA, pp. 1395–1400, 2015.
Costa, C. and Santos, M. Y. The SusCity big data warehousing approach for smart cities. In Proceedings of the 21st international database engineering & applications symposium. IDEAS 2017. Association for Computing Machinery, New York, NY, USA, pp. 264–273, 2017.
Del Esposte, A. d. M., Santana, E. F., Kanashiro, L., Costa, F. M., Braghetto, K. R., Lago, N., and Kon, F. Design and evaluation of a scalable smart city software platform with large-scale simulations. Future Generation Computer Systems vol. 93, pp. 427 – 441, 2019.
Del Esposte, A. M., Kon, F., M. Costa, F., and Lago, N. Interscity: A scalable microservice-based open source platform for smart cities. In Proceedings of the 6th International Conference on Smart Cities and Green ICT Systems. SMARTGREENS 2017. SCITEPRESS - Science and Technology Publications, Lda, Setubal, PRT, pp. 35–46, 2017.
Dragoni, N., Giallorenzo, S., Lafuente, A. L., Mazzara, M., Montesi, F., Mustafin, R., and Safina, L. Microservices: Yesterday, today, and tomorrow. In Present and Ulterior Software Engineering, M. Mazzara and B. Meyer (Eds.). Springer International Publishing, Cham, pp. 195–216, 2017.
Hashem, I. A. T., Chang, V., Anuar, N. B., Adewole, K., Yaqoob, I., Gani, A., Ahmed, E., and Chiroma, H. The role of big data in smart city. International Journal of Information Management 36 (5): 748 – 758, 2016.
Klemm, P., Lawonn, K., Glaser, S., Niemann, U., Hegenscheid, K., Volzke, H., and Preim, B. 3d regression heat map analysis of population study data. IEEE Transactions on Visualization & Computer Graphics 22 (01): 81–90, jan, 2016.
Li, Z., OBrien, L., and Zhang, H. Ceem: A practical methodology for cloud services evaluation. In 2013 IEEE Ninth World Congress on Services. IEEE, Santa Clara, CA, USA, pp. 44–51, 2013.
Li, Z., O’Brien, L., Zhang, H., and Cai, R. A factor framework for experimental design for performance evaluation of commercial cloud services. In 4th IEEE Intl. Conf. on Cloud Computing Technology and Science Proceedings. IEEE, Taipei, Taiwan, pp. 169–176, 2012a.
Li, Z., O’Brien, L., Zhang, H., and Cai, R. On a catalogue of metrics for evaluating commercial cloud services. In 2012 ACM/IEEE 13th International Conference on Grid Computing. IEEE, Beijing, China, pp. 164–173, 2012b.
Mehmood, H., Gilman, E., Cortes, M., Kostakos, P., Byrne, A., Valta, K., Tekes, S., and Riekki, J. Implementing big data lake for heterogeneous data sources. In IEEE 35th Intl. Conference on Data Engineering Workshops (ICDEW 2019). IEEE, Macao, China, pp. 37–44, 2019.
Psyllidis, A., Bozzon, A., Bocconi, S., and Titos Bolivar, C. A platform for urban analytics and semantic data integration in city planning. In Computer-Aided Architectural Design Futures. The Next City - New Technologies and the Future of the Built Environment. CAAD Futures 2015. Springer Berlin Heidelberg, São Paulo, Brazil, pp. 21–36, 2015.
Raghavan, S., Simon, B. Y. L., Lee, Y. L., Tan, W. L., and Kee, K. K. Data integration for smart cities: Opportunities and challenges. In Computational Science and Technology, R. Alfred, Y. Lim, H. Haviluddin, and C. K. On (Eds.). Springer, Singapore, pp. 393–403, 2020.
Rathore, M. M., Ahmad, A., Paul, A., and Rho, S. Urban planning and building smart cities based on the internet of things using big data analytics. Computer Networks vol. 101, pp. 63 – 80, 2016.
Ribeiro, M. and Braghetto, K. A data integration architecture for smart cities. In Anais do XXXVI Simpósio Brasileiro de Bancos de Dados. SBC, Porto Alegre, RS, Brasil, pp. 205–216, 2021.
Silva, B. N., Khan, M., and Han, K. Towards sustainable smart cities: A review of trends, architectures, components, and open challenges in smart cities. Sustainable Cities and Society vol. 38, pp. 697 – 713, 2018.
Taibi, D., Lenarduzzi, V., and Pahl, C. Architectural patterns for microservices: a systematic mapping study. In CLOSER 2018: Proceedings of the 8th International Conference on Cloud Computing and Services Science. SCITEPRESS - Science and Technology Publications, Lda., Funchal, Madeira, Portugal, pp. 221–232, 2018.
Yue, M., Fan, L., and Shahabi, C. Inferring traffic incident start time with loop sensor data. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. CIKM ’16. Association for Computing Machinery, New York, NY, USA, pp. 2481–2484, 2016.
Zheng, Y., Capra, L., Wolfson, O., and Yang, H. Urban computing: Concepts, methodologies, and applications. ACM Trans. Intell. Syst. Technol. 5 (3): 1–55, sep, 2014.
