Complexity and Risk in Systems Engineering

Abstract

This chapter is an introduction to the complexity of engineered systems in relationship to risk in the systems life cycle. It begins with definitions of complexity and some examples of current and previous efforts to capture and model complexity, then moves to some examples of complexity in engineered systems. Next, it briefly discusses the traditional view of risk assessment in SE and government agencies. Some examples of previous applications of risk and complexity on projects sponsored by SERC are briefly introduced. We will continue the chapter with some measurements of complexity from the literature on the SE lifecycle. We conclude with the needed research in complexity science with specific applications to the design of complex engineered systems.

Leads

Roshanak R. Nilchiani

Stevens Institute of Technology

Publications

Abbott , R. ( 2006 ). Emergence explained . arXiv preprint cs/0602045.
Bedau , M.A. ( 1997 ). Weak emergence . Philosophical Perspectives 11 : 375 – 399 .
Black , L.J. and Repenning , N.P. ( 2001 ). Why firefighting is never enough: preserving high-quality product development . System Dynamics Review 17 ( 1 ): 33 – 62 .
Callas , J.L. , Golombek , M.P. , and Fraeman , A.A. ( 2019 ). Mars Exploration Rover Opportunity End of Mission Report . Passadina, CA : Jet Propulsion Laboratory . JPL-CL-19-7647 .
Chaisson , E.J. ( 2004 ). Complexity: an energetics agenda: energy as the motor of evolution . Complexity 9 ( 3 ): 14 – 21 .
Chaisson , E. J. ( 2014 ). The natural science underlying big history . The Scientific World Journal , 2014 .
Chaisson , E.J. ( 2015 ). Energy flows in low-entropy complex systems . Entropy 17 ( 12 ): 8007 – 8018 .
Chalmers , D.J. ( 2006 ). Strong and weak emergence . In: The Re-emergence of Emergence , 244 – 256 . Oxford, England : Oxford University Press .
Checkland , P. ( 1981 ). Systems Thinking, Systems Practice . New York : Wiley .
Cilliers , P. ( 2000 ). What can we learn from a theory of complexity? Emergence , 2 ( 1 ), 23 – 33 .
Conrow , E.H. ( 2003 ). Effective risk Management: Some Keys to Success . Aiaa .
Cooper , K.G. ( 1994 ). The $2,000 hour: How managers influence project performance through the rework cycle . Project Management Journal 25 : 11 – 11 .
Cotler , J. , Hunter-Jones , N. , Liu , J. , & Yoshida , B. ( 2017 ). Chaos, complexity, and random matrices . Journal of High Energy Physics , ( 11 ), 48 .
DeRosa , J.K. , Grisogono , A.M. , Ryan , A.J. , and Norman , D.O. ( 2008 ). A research agenda for the engineering of complex systems . 2008 2nd Annual IEEE Systems Conference , Montreal, Canada (7–10 April 2008).
Érdi , P. ( 2008 ). Complexity Explained . Springer .
Fischi , J. , Nilchiani , R. , and Wade , J. ( 2015 ). Dynamic complexity measures for use in complexity-based system design . IEEE Systems Journal 11 ( 4 ): 2018 – 2027 .
Ford , D. N. , & White III , R. J. ( 2020 ). Social impact bonds: the goose and the golden eggs at risk . Systems Research and Behavioral Science , 37 ( 2 ), 333 – 344 .
Gerla , D. J. , Mooij , W. M. , & Huisman , J. ( 2011 ). Photoinhibition and the assembly of light-limited phytoplankton communities . Oikos , 120 ( 3 ), 359 – 368 .
Gutman , I. , & Shao , J.-Y. ( 2011 ). The energy change of weighted graphs . Linear Algebra and Its Applications , 435 ( 10 ), 2425 – 2431 , 15 November 2011.
Haskins , C. , Forsberg , K. , Krueger , M. et al. ( 2006 ). Systems Engineering Handbook . INCOSE .
Hodgson , D. , McDonald , J. L. , & Hosken , D. J. ( 2015 ). What do you mean, ‘resilient’? Trends in Ecology & Evolution , 30 ( 9 ), 503 – 506 .
Hodgson , D. , McDonald , J. L. , & Hosken , D. J. ( 2016 ). Resilience is complicated, but comparable: a reply to Yeung and Richardson . Trends in Ecology and Evolution , 31 ( 1 ), 3 – 4 .
Huntington , H. P. , Goodstein , E. , & Euskirchen , E. ( 2012 ). Towards a tipping point in responding to change: rising costs, fewer options for arctic and global societies . AMBIO , 41 ( 1 ), 66 – 74 .
Jansma , P. ( 2011 ). Open! Open! Open! Galileo high gain antenna anomaly workarounds . 2011 Aerospace Conference , Big Sky, MT, USA (5–12 March 2011).
Kauffman , S.A. ( 1996 ). At Home in the Universe . Oxford University Press .
Kauffman , S. ( 2007 ). Beyond reductionism: reinventing the sacred . Zygon® 42 ( 4 ): 903 – 914 .
Kiron , D. , Kruschwitz , N. , Haanaes , K. , and Velken , I.V.S. ( 2012 ). Sustainability nears a tipping point . MIT Sloan Management Review 53 ( 2 ): 69 – 74 .
Lamberson , P. and Page , S. ( 2012 ). Tipping points . Quarterly Journal of Political Science 7 ( 2 ): 175 – 208 .
Lenton , T. M. , Held , H. , Kriegler , E. , Hall , J. W. , Lucht , W. , Rahmstorf , S. , & Schellnhuber , H. J. ( 2008 ). Tipping elements in the Earth's climate system . Proceedings of the National Academy of Sciences of the United States of America , 105 ( 6 ), 1786 – 1793 .
Leveson , N. ( 2004 ). A new accident model for engineering safer systems . Safety Science 42 ( 4 ): 237 – 270 .
Longo , G. , Montévil , M. , and Kauffman , S. ( 2012 ). No entailing laws, but enablement in the evolution of the biosphere . Proceedings of the 14th Annual Conference Companion on Genetic and Evolutionary Computation , Philadelphia, PA, USA (7–11 July 2012).
MacCormack , A. , Rusnak , J. , and Baldwin , C.Y. ( 2006 ). Exploring the structure of complex software designs: an empirical study of open source and proprietary code . Management Science 52 ( 7 ): 1015 – 1030 .
Marr , J.C. ( 1994 ). Performing the Galileo mission using the S-band low-gain antenna . Proceedings of 1994 IEEE Aerospace Applications Conference Proceedings , Vail, CO, USA (5–12 February 1994).
McCabe , T. J. ( 1976 ). A complexity measure . IEEE Transactions on Software Engineering , SE-2 ( 4 ), 308 – 320 .
McManus , H. and Hastings , D. ( 2005 ). 3.4.1 A framework for understanding uncertainty and its mitigation and exploitation in complex systems . INCOSE International Symposium , Rochester, NY, USA (13–16 June 2005).
Milkoreit , M. , Hodbod , J. , Baggio , J. , Benessaiah , K. , Calderón-Contreras , R. , Donges , J. F. , Mathias , J.-D. , Rocha , J. C. , Schoon , M. , & Werners , S. E. ( 2018 ). Defining tipping points for social-ecological systems scholarship – an interdisciplinary literature review . Environmental Research Letters , 13 ( 3 ), 033005 .
van Nes , E. H. , Arani , B. M. S. , Staal , A. , van der Bolt , B. , Flores , B. M. , Bathiany , S. , & Scheffer , M. ( 2016 ). What do you mean, ‘tipping point’? Trends in Ecology & Evolution , 31 ( 12 ), 902 – 904 .
Nikiforov , V. ( 2007 ). The energy of graphs and matrices . Journal of Mathematical Analysis and Applications 326 ( 2 ): 1472 – 1475 .
Nilchiani , R.R. and Pugliese , A. ( 2017 ). A systems complexity-based assessment of risk in acquisition and development programs . Naval Postgraduate School (NPS) Annual Acquisition Research Symposium , Monterey, CA, USA , (26–27 April 2017).
Nilchiani , R. , Rifkin , S. , Mostashari , A. , et al. ( 2013 ). Quantitative Risk-Phases 1 & 2 . A013-Final Technical Report SERC-2013-TR-040-3. Stevens Institute of Technology. Systems Engineering Research Center .
Page , S.E. ( 1999 ). Computational models from A to Z . Complexity 5 ( 1 ): 35 – 41 .
Phelan , S. E. ( 2001 ). What is complexity science, really? Emergence , 3 ( 1 ), 120 – 136 .
Pugliese , A. and Nilchiani , R. ( 2019 ). Developing spectral structural complexity metrics . IEEE Systems Journal 13 ( 4 ): 3619 – 3626 .
Rasoulkhani , K. , & Mostafavi , A. ( 2018 ). Resilience as an emergent property of human-infrastructure dynamics: a multi-agent simulation model for characterizing regime shifts and tipping point behaviors in infrastructure systems . PLoS One , 13 ( 11 ), e0207674 .
Repenning , N. P. ( 2001 ). Understanding fire fighting in new product development . Journal of Product Innovation Management , 18 ( 5 ), 285 – 300 .
Repenning , N. P. , Gonçalves , P. , & Black , L. J. ( 2001 ). Past the tipping point: the persistence of firefighting in product development . California Management Review , 43 ( 4 ), 44 – 63 .
Rietkerk , M. , Bastiaansen , R. , Banerjee , S. , van de Koppel , J. , Baudena , M. , & Doelman , A. ( 2021 ). Evasion of tipping in complex systems through spatial pattern formation . Science , 374 ( 6564 ), eabj0359 .
Russill , C. , & Nyssa , Z. ( 2009 ). The tipping point trend in climate change communication . Global Environmental Change , 19 ( 3 ), 336 – 344 .
Salado , A. and Nilchiani , R. ( 2014 ). The concept of problem complexity . Procedia Computer Science 28 : 539 – 546 .
Salado , A. , & Nilchiani , R. ( 2015 ). A set of heuristics to support early identification of conflicting requirements . Proceedings of the INCOSE International Symposium , Seattle, WA, USA (13–16 July 2015).
Scheffer , M. ( 2010 ). Foreseeing tipping points . Nature , 467 ( 7314 ), 411 – 412 .
Scheffer , M. , Bascompte , J. , Brock , W. A. , Brovkin , V. , Carpenter , S. R. , Dakos , V. , Held , H. , van Nes , E. H. , Rietkerk , M. , & Sugihara , G. ( 2009 ). Early-warning signals for critical transitions . Nature , 461 ( 7260 ), 53 – 59 .
Shannon , C. E. ( 1948 ). A mathematical theory of communication . The Bell System Technical Journal , 27 ( 3 ), 379 – 423 .
Simpleman , L. , McMahon , P. , Bahnmaier , B. et al. ( 2003 ). Risk Management Guide for DOD Acquisition , ( Version 2.0 . Fort Belvoir, VA, USA : US Department of Defense, Defense Acquisition University .
Sinha , K. and de Weck , O. ( 2012 ). Structural complexity metric for engineered complex systems and its application . In: Gain Competitive Advantage by Managing Complexity (ed. M. Onishi , M. Maurer , K. Eben , and U. Lindemann ), 181 – 192 . Munich, Germany : Carl Hanser Verlag GmbH & Company .
Sinha , K. , and de Weck , O. L. ( 2013 ). A network-based structural complexity metric for engineered complex systems . Proceedings of the 2013 IEEE International Systems Conference (SysCon) , Orlando, FL, USA , (15–18 April 2013).
Snowden , D.J. and Boone , M.E. ( 2007 ). A leader's framework for decision making . Harvard Business Review 85 ( 11 ): 68 .
Solé , R. ( 2011 ). Phase Transitions , vol. 3 . Princeton University Press .
Sterman , J.S. ( 2000 ). Business Dynamics: Systems Thinking and Modeling for a Complex World . McGraw-Hill .
Strogatz , S.H. ( 2003 ). SYNC: the Emerging Science of Spontaneous Order . Hyperion .
Taylor , T. , & Ford , D. N. ( 2006 ). Tipping point failure and robustness in single development projects . System Dynamics Review , 22 ( 1 ), 51 – 71 .
Taylor , T.R.B. and Ford , D.N. ( 2008 ). Managing tipping point dynamics in complex construction projects . Journal of Construction Engineering and Management 134 ( 6 ): 421 – 431 .
US Department of Defense (Office of the Undersecretary of Defense Acquisition, T. L.) ( 2006 ). Risk Management Guide for DoD Acquisition , 6e , ver. 1.0).
Valerdi , R. and Boehm , B.W. ( 2010 ). COSYSMO: A Systems Engineering Cost Model . Software Engineering , March 2010.
Veraart , A. J. , Faassen , E. J. , Dakos , V. , van Nes , E. H. , Lürling , M. , & Scheffer , M. ( 2012 ). Recovery rates reflect distance to a tipping point in a living system . Nature , 481 ( 7381 ), 357 – 359 .
Wade , J. and Heydari , B. ( 2014 ). Complexity: definition and reduction techniques . Proceedings of the Poster Workshop at the 2014 Complex Systems Design and Management International Conference , Paris, France (12 November 2014).
Walden , D.D. , Roedler , G.J. , and Forsberg , K. ( 2015 ). INCOSE systems engineering handbook version 4: Updating the reference for practitioners . INCOSE International Symposium .
Weaver , W. ( 1948 ). Science and complexity . American Scientist 36 : 536 – 544 .
Willcox , K. , Allaire , D. , Deyst , J. , et al. ( 2011 ). Stochastic Process Decision Methods for Complex-Cyber-Physical Systems . Cambridge, MA : Massachusetts Institute of Technology (MIT) . AFRL-RZ-WP-TR-2011-2094 .