A Catalog of Heuristics to Support the Design of Systems-of-Systems

Authors

DOI:

https://doi.org/10.5753/isys.2024.3774

Keywords:

Systems-of-Systems, SoS, heuristics, design

Abstract

As the presence of systems-of-systems (SoS) intensifies in daily life, professionals face challenges concerning the independence of constituent systems. Addressing these challenges at the design phase is imperative to ensure seamless integration and operational efficiency. In this context, we introduce a catalog of design concerns and practices, herein referred as ``heuristics'', which aims to offer direction for SoS design. To do so, we grounded in a three-step research method. Firstly, we conducted a systematic mapping study (SMS) to identify which heuristics have been applied to SoS design. Next, we discussed the SMS results in a focus group with professionals to analyze and refine the heuristics. Finally, we surveyed experts to evaluate which heuristics are appropriate to SoS design, resulting in a heuristics catalog. This catalog serves as a resource for professionals, enabling them to pinpoint pivotal concerns at the design phase. Moreover, it offers a repository of knowledge, ensuring that professionals do not have to ``reinvent the wheel'' but can leverage tried-and-true practices to enhance their efficacy.

Downloads

Download data is not yet available.

References

Axelsson, J. (2022). Systems-of-systems design patterns: A systematic literature review and synthesis. In System of Systems Engineering Conference (SoSE), pages 171–176, Rochester, EUA.

Batista, T. (2013). Challenges for SoS architecture description. In International Workshop on Software Engineering for Systems-of-Systems (SESoS), pages 35–37, Montpellier, France.

Beale, D., McKinney, D., Oosthuizen, R., Smith, G., and Watson, M. D. (2022). System engineering heuristics for complex systems. In INCOSE International Symposium, volume 32, pages 293–312. Wiley Online Library.

Beale, D., Oosthuizen, R., McKinney, D., Smith, G., and Watson, M. (2023). Systems engineering heuristics for complex systems revisited. In System of Systems Engineering Conference (SoSE), pages 1–7, Lille, France.

Beck, S. E. and Manuel, K. (2008). Practical research methods for librarians and information professionals. Neal-Schuman Publishers New York.

Boardman, J. and Sauser, B. J. (2006). System of systems - the meaning of of. In International Conference on System of Systems Engineering (SoSE), pages 1–6, Los Angeles, USA.

Bouziat, T., Camps, V., and Combettes, S. (2018). A cooperative sos architecting approach based on adaptive multi-agent systems. In International Workshop on Software Engineering for Systems-of-Systems (SESoS), pages 8–16, Gothenburg, Sweden. IEEE.

Butterfield, M., Pearlman, J., and Vickroy, S. (2008). A Systemof-Systems Engineering GEOSS: Architectural Approach. IEEE Systems Journal, 2(3):321–332.

Caplan, S. (1990). Using focus group methodology for ergonomic design. Ergonomics, 33(5):527–533.

Chueri, L. (2021). SIDE: A Framework for managing social innovation digital ecosystems. PhD thesis, Universidade Federal do Estado do Rio de Janeiro.

Churcher, N., Frater, S., Huynh, C. P., and Irwin, W. (2007). Supporting OO design heuristics. In Australian Software Engineering Conference (ASWEC), pages 101–110, Melbourne, Australia. IEEE.

da Silva Amorim, S., de Almeida, E. S., McGregor, J. D., and von Flach G. Chavez, C. (2014). When ecosystems collide: making systems of systems work. In ECSA, pages 1–4, Vienna, Austria.

Dahmann, J., Rebovich, G., and Lane, J. (2008). Systems engineering for capabilities. CrossTalk, 21:7.

Dersin, P. (2014). Systems of Systems. IEEE-Reliability Society. Technical Committee on “Systems of Systems”, [link].

Dhawan, S. (2020). Online learning: A panacea in the time of COVID-19 crisis. Journal of Educational Technology Systems, 49(1):5–22.

Dietterle, R. (2005). The future combat systems (FCS) overview. In Military Communications Conference (MILCOM), pages 3269–3273 Vol. 5, Atlantic City, USA.

Ferreira, F. H., Nakagawa, E. Y., and Santos, R. P. (2021). Reliability in software-intensive systems: Challenges, solutions, and future perspectives. In Euromicro SEAA, pages 54–61, Palermo, Italy.

Garces, L. and Nakagawa, E. Y. (2017). A process to establish, model and validate missions of systems-of-systems in reference architectures. In SAC, pages 1765–1772, Marrakech, Morocco.

Gigerenzer, G. and Gaissmaier, W. (2011a). Heuristic decision making. Annual Review of Psychology, 62(1):451–482.

Gigerenzer, G. and Gaissmaier, W. (2011b). Heuristic decision making. Annual review of psychology, 62:451–482.

Gonçalves, M. B., Oquendo, F., and Nakagawa, E. Y. (2015). A meta-process to construct software architectures for system of systems. In Symposium on Applied Computing (SAC), pages 1411–1416, Salamanca, Spain.

Hacker, J., Vom Brocke, J., Handali, J., Otto, M., and Schneider, J. (2020). Virtually in this together – how web-conferencing systems enabled a new virtual togetherness during the COVID-19 crisis. European Journal of Information Systems, 29(5):563–584.

Imamura, M., Ferreira, F. H., Fernandes, J., Neto, V. V. G., and dos Santos, R. P. (2023). Towards a catalog of heuristics for the design of systems-of-systems. In da Cunha, M. X. C., de Souza Junior, M. F., Marques, J. C., de Classe, T. M., and Araujo, R. D., editors, Proceedings of the XIX Brazilian Symposium on Information Systems, SBSI 2023, Maceio, Brazil, 29 May 2023- 1 June 2023 , pages 128–135. ACM.

Kazman, R., Schmid, K., Nielsen, C. B., and Klein, J. (2013). Understanding patterns for system of systems integration. In International Conference on System of Systems Engineering (SoSE), pages 141–146, Hawaii, USA. IEEE.

Keating, C., Rogers, R., Unal, R., Dryer, D., Sousa-Poza, A., Safford, R., Peterson, W., and Rabadi, G. (2003). System of Systems Engineering. Engineering Management Journal, 15(3):36–45.

Kitchenham, B., Budgen, D., and Brereton, P. (2015). Evidencebased software engineering and systematic reviews, volume 4. CRC Press.

Kitchenham, B. and Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering.

Liang, Q. and Rubin, S. H. (2012). Randomisation in designing software tests for systems of systems. International Journal of Information and Decision Sciences, 4(2-3):108–129.

Lopes, F., Loss, S., Mendes, A., Batista, T., and Lea, R. (2016). Soscentric middleware services for interoperability in smart cities systems. In Middleware, pages 1–6, Trento, Italy.

Maier, M. W. (1998). Architecting principles for systems-of-systems. Systems Engineering, 1(4):267–284.

McDermott, T. (2018). Developing systems thinking skills using healthcare as a case study. In International Conference on System of Systems Engineering (SoSE), pages 240–244, Paris, France. IEEE.

Mittal, S. and Rainey, L. (2015). Harnessing emergence: The control and design of emergent behavior in system of systems engineering. In Proceedings of the Conference on Summer Computer Simulation (SummerSim), pages 1–10, San Diego, USA.

Nielsen, C., Larsen, P., Fitzgerald, J., Woodcock, J., and Peleska, J. (2015). Systems of systems engineering: Basic concepts, model-based techniques, and research directions. ACM Computing Surveys, 48(2).

Nielsen, J. (1994). Enhancing the explanatory power of usability heuristics. In Proceedings of the Conference on Human Factors in Computing Systems (SIGCHI), pages 152–158, Boston, USA.

Oquendo, F. (2016). Formally describing the software architecture of systems-of-systems with sosadl. In System-of-Systems Engineering Conference (SoSE), pages 1–6, Kongsberg, Norway.

Raman, R. and Murugesan, A. (2022). Framework for complex sos emergent behavior evolution using deep reinforcement learning. INCOSE International Symposium, 32(1):809–823.

Ricci, N., Ross, A. M., and Rhodes, D. H. (2013). A generalized optionsbased approach to mitigate perturbations in a maritime security system-of-systems. Procedia Computer Science, 16:718–727.

Riel, A. (1996). Object-Oriented Design Heuristics. Addison-Wesley.

[Sage and Cuppan 2001] Sage, A. P. and Cuppan, C. D. (2001). On the systems engineering and management of systems of systems and federations of systems. Information knowledge systems management, 2(4):325–345.

Schneider, J.-P., Teodorov, C., Senn, E., and Champeau, J. (2014). Towards a dynamic infrastructure for playing with systems of systems. In European Conference on Software Architecture (ECSA), pages 1–4, Vienna, Austria.

Sherman, S. J. and Corty, E. (1984). Cognitive heuristics.

Singh, R. P., Javaid, M., Kataria, R., Tyagi, M., Haleem, A., and Suman, R. (2020). Significant applications of virtual reality for COVID-19 pandemic. Diabetes & Metabolic Syndrome: Clinical Research & Reviews, 14(4):661–664.

Sunstein, C. R. (2005). Moral heuristics. Behavioral and brain sciences, 28(4):531–541.

Westmattelmann, D., Grotenhermen, J., Sprenger, M., and Schewe, G. (2020). The show must go on - Virtualisation of sport events during the COVID-19 pandemic. European Journal of Information Systems, pages 1–18.

Weyns, D. and Andersson, J. (2013). On the challenges of self-adaptation in systems of systems. In International Workshop on Software Engineering for Systems-of-Systems (SESoS), pages 47–51, Montpellier, France.

Wickramasinghe, N., Chalasani, S., Boppana, R., and Madni, A. (2007). Healthcare system of systems. In International Conference on System of Systems Engineering (SoSE), pages 1–6, San Antonio, USA.

Zaganelli, B. M., Nisenbaum, M. A., Alves, K. d. S. G., Marques, S. B., and Olinto, G. (2015). O grupo focal na ciencia da informação. Informação & Sociedade, 25(3).

Downloads

Published

2024-03-29

How to Cite

Imamura, M., Henrique Ferreira, F., Fernandes, J., Vicente Graciano Neto, V., & Pereira dos Santos, R. (2024). A Catalog of Heuristics to Support the Design of Systems-of-Systems. ISys - Brazilian Journal of Information Systems, 17(1), 1:1 – 1:26. https://doi.org/10.5753/isys.2024.3774

Issue

Section

Extended versions of selected articles