Set-Based Design: Foundations for Practice

Abstract

Product development efforts encounter challenges when developing innovative products with less resources than those their predecessors often utilized to execute similar efforts. In addition, these teams have to adapt to emerging technologies, increased system complexity, increased demand for mass customization, emerging competition, and market instabilities. To meet this demand, product development teams will have to develop systems in situations with high levels of uncertainty and ambiguity such as unclear stakeholder needs, ill-defined operational environments, low fidelity analysis tools, limited testing capability, and limited information on technologies. Traditional product development methodologies have been deemed to be ineffective in addressing these types of situations because of their quick convergence to a point solution. Set-based design has been demonstrated to be an effective methodology to address these types of concerns. However, it is still considered a new design methodology that is a paradigm shift from most organizations' product development process. With all the significant benefits, there are unique challenges that need to be addressed. Effective planning and knowledge development is essential for success. This chapter provides a basic reference for applied researchers and industrial practitioners by providing a foundation to aid in execution of SBD.

Leads

Shawn Dullen

Stevens Institute of Technology

Dinesh Verma

Stevens Institute Of Technology

Publications

ASME V&V 10-2006 ( 2006 ). Guide for Verification and Validation in Computational Solid Mechanics . New York : American Society of Mechanical Engineers .
Bernstein , J.I. ( 1998 ). Design methods in the aerospace industry: looking for evidence of set-based practices . Massachusetts Institute of Technology .
Braha , D. , Brown , D.C. , Chakrabarti , A. , et al. ( 2013 ). DTM at 25: essays on themes and future directions . Paper presented at the ASME 2013 international design engineering technical conferences and computers and information in engineering conference , Portland, Oregon, USA (4–7 August 2013). American Society of Mechanical Engineers .
Buhai , S. ( 2005 ). Quantile regression: overview and selected applications . Ad Astra 4 ( 2005 ): 1 – 17 .
Canbaz , B. , Yannou , B. , and Yvars , P.-A. ( 2014 ). Improving process performance of distributed set-based design systems by controlling wellbeing indicators of design actors . Journal of Mechanical Design 136 ( 2 ): 021005 .
Collopy , P.D. ( 2018 ). Tradespace exploration: promise and limits . In: Disciplinary Convergence in Systems Engineering Research (ed. A.M. Madni , B. Boehm , R.G. Ghanem , et al.), 297 – 307 . Cham : Springer .
Destercke , S. ( 2010 ). A decision rule for imprecise probabilities based on pair-wise comparison of expectation bounds . In: Combining Soft Computing and Statistical Methods in Data Analysis (ed. C. Borgelt , G. González-Rodríguez , W. Trutschnig , et al.), 189 – 197 . Springer .
Doerry , N. , Earnesty , M. , Weaver , C. , et al. ( 2014 ). Using set-based design in concept exploration . Paper presented at the SNAME Chesapeake Section Technical Meeting , Arlington, Virginia, USA (25 September 2014). Society of Naval Architects & Marine Engineers .
Dullen , S. , Verma , D. , Blackburn , M. , and Whitcomb , C. ( 2021 ). Survey on set-based design (SBD) quantitative methods . Systems Engineering 24 ( 5 ): 269 – 292 .
Dyer , J.S. and Sarin , R.K. ( 1979 ). Measurable multiattribute value functions . Operations Research 27 ( 4 ): 810 – 822 .
Eckert , C. , Isaksson , O. , and Earl , C. ( 2019 ). Design margins: a hidden issue in industry . Design Science 5 : 1 – 24 .
Ghosh , S. and Seering , W. ( 2014 ). Set-based thinking in the engineering design community and beyond . Paper Presented at the Proceedings of the ASME 2014 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference , Buffalo, New York, USA (17–20 August 2014). The American Society of Mechanical Engineers .
Gonçalves , D. ( 2006 ). An approach to simulation effectiveness . Paper Presented at the 16th Annual International Symposium of the International Council on Systems Engineering , Orlando, Florida, USA (10–13 July 2006). Wiley .
Greco , S. , Ishizaka , A. , Tasiou , M. , and Torrisi , G. ( 2019 ). On the methodological framework of composite indices: a review of the issues of weighting, aggregation, and robustness . Social Indicators Research 141 ( 1 ): 61 – 94 .
Gross , D.C. ( 1999 ). Report from the fidelity implementation study group . Paper Presented at the Fall Simulation Interoperability Workshop Papers .
Gunawan , S. and Azarm , S. ( 2005 ). Multi-objective robust optimization using a sensitivity region concept . Structural and Multidisciplinary Optimization 29 ( 1 ): 50 – 60 .
Hung , T.-C. and Chan , K.-Y. ( 2013a ). Multi-objective design and tolerance allocation for single-and multi-level systems . Journal of Intelligent Manufacturing 24 ( 3 ): 559 – 573 .
Hung , T.-C. and Chan , K.-Y. ( 2013b ). Uncertainty quantifications of Pareto optima in multiobjective problems . Journal of Intelligent Manufacturing 24 ( 2 ): 385 – 395 .
INCOSE ( 2014 ). Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities , Version 4 . Wiley .
ISO/IEC/IEEE 15288 ( 2015 ). Systems and Software Engineering – System Life Cycle Processes , IEEE .
Keeney , R.L. and Raiffa , H. ( 1993 ). Decisions with Multiple Objectives: Preferences and Value Trade-Offs . Cambridge University Press .
Keeney , R.L. and von Winterfeldt , D. ( 2007 ). Practical value models . In: Advances in Decision Analysis: From Foundations to Applications , 232 – 252 . Cambridge University Press .
Levi , I. ( 1975 ). On indeterminate probabilities . The Journal of Philosophy 71 ( 13 ): 391 – 418 .
Malak , R.J. Jr. and Paredis , C.J. ( 2009 ). Modeling design concepts under risk and uncertainty using parameterized efficient sets . SAE International Journal of Materials and Manufacturing 1 ( 1 ): 339 – 352 .
Matthews , J. , Klatt , T. , Seepersad , C.C. , et al. ( 2014 ). Bayesian network classifiers and design flexibility metrics for set-based, multiscale design with materials design applications . Paper presented at the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference , Buffalo, New York, USA (17–20 August 2014). The American Society of Mechanical Engineers .
Mendel , J.M. ( 1995 ). Fuzzy logic systems for engineering: a tutorial . Proceedings of the IEEE 83 ( 3 ): 345 – 377 .
Mendenhall , W.M. and Sincich , T.L. ( 2016 ). Statistics for Engineering and the Sciences . Chapman and Hall/CRC .
Miller , S.W. , Simpson , T.W. , Yukish , M.A. , et al. ( 2013 ). Preference construction, sequential decision making, and trade space exploration . Paper Presented at the ASME 2013 International design Engineering Technical Conferences and Computers and Information in Engineering Conference , Portland, Oregon, USA (4–7 August 2013). The American Society of Mechanical Engineers .
Oberkampf , W.L. and Trucano , T.G. ( 2002 ). Verification and validation in computational fluid dynamics . Progress in Aerospace Sciences 38 ( 3 ): 209 – 272 .
Odu , G. ( 2019 ). Weighting methods for multi-criteria decision making technique . Journal of Applied Sciences and Environmental Management 23 ( 8 ): 1449 – 1457 .
Parker , R.R. and Malak , R.J. , Jr. ( 2011 ). Technology characterization models and their use in designing complex systems . Paper Presented at the ASME 2011 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference , Washington, DC, USA (28–31 August 2011). The American Society of Mechanical Engineers .
Pöyhönen , M. and Hämäläinen , R.P. ( 2001 ). On the convergence of multiattribute weighting methods . European Journal of Operational Research 129 ( 3 ): 569 – 585 .
Pugh , S. ( 1981 ). Concept selection: a method that works . Paper Presented at the Proceedings of the International conference on Engineering Design , Rome, Italy (9–13 August 1981). The Design Society .
Quah , J.K.-H. and Strulovici , B. ( 2009 ). Comparative statics, informativeness, and the interval dominance order . Econometrica 77 ( 6 ): 1949 – 1992 .
Rapp , S. , Chinnam , R. , Doerry , N. et al. ( 2018 ). Product development resilience through set-based design . Systems Engineering 21 ( 5 ): 490 – 500 .
Rekuc , S. , Aughenbaugh , J. , Bruns , M. , and Paredis , C. ( 2006 ). Eliminating design alternatives based on imprecise information . SAE International Journal of Materials and Manufacturing , 115 ( 5 ): 208 – 220 .
Rockafellar , R.T. and Royset , J.O. ( 2010 ). On buffered failure probability in design and optimization of structures . Reliability Engineering & System Safety 95 ( 5 ): 499 – 510 .
Ross , J.E. ( 2017 ). Determining feasibility resilience: set based design iteration evaluation through permutation stability analysis .
Roszkowska , E. ( 2013 ). Rank ordering criteria weighting methods–a comparative overview . Optimum. Studia Ekonomiczne 5 ( 65 ): 14 – 33 .
Schlesinger , S. ( 1979 ). Terminology for model credibility . Simulation 32 ( 3 ): 103 – 104 .
Schrader , S. , Riggs , W.M. , and Smith , R.P. ( 1993 ). Choice over Uncertainty and Ambiguity in Technical Problem Solving . Elsevier .
Shallcross , N. , Parnell , G.S. , Pohl , E. , and Specking , E. ( 2020 ). Set-based design: The state-of-practice and research opportunities . Systems Engineering 23 ( 5 ): 557 – 578 .
Sitterle , V.B. , Brimhall , E.L. , Freeman , D.F. et al. ( 2017 ). Bringing operational perspectives into the analysis of engineered resilient systems . Insight 20 ( 3 ): 47 – 55 .
Sitterle , V.B. , Freeman , D.F. , Goerger , S.R. , and Ender , T.R. ( 2015 ). Systems engineering resiliency: guiding tradespace exploration within an engineered resilient systems context . Procedia Computer Science 44 : 649 – 658 .
Sobek , D.K. II , Ward , A.C. , and Liker , J.K. ( 1999 ). Toyota's principles of set-based concurrent engineering . MIT Sloan Management Review 40 ( 2 ): 67 .
Specking , E.A. , Whitcomb , C. , Parnell , G.S. et al. ( 2018 ). Literature review: exploring the role of set-based design in trade-off analytics . Naval Engineers Journal 130 ( 2 ): 51 – 62 .
Stump , G. , Lego , S. , Yukish , M. et al. ( 2009 ). Visual steering commands for trade space exploration: user-guided sampling with example . Journal of Computing and Information Science in Engineering 9 ( 4 ).
Stump , G. M. , Yukish , M. , Simpson , T. W. , and O'Hara , J. J. ( 2004 ). Trade space exploration of satellite datasets using a design by shopping paradigm . Paper Presented at the 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No. 04TH8720), Montana, USA (6–13 March 2004). Institute of Electrical and Electronics Engineers .
Taguchi , G. , Chowdhury , S. , and Wu , Y. ( 2005 ). Taguchi's Quality Engineering Handbook . Wiley .
Tahera , K. , Earl , C. , and Eckert , C. ( 2017 ). A method for improving overlapping of testing and design . IEEE Transactions on Engineering Management 64 ( 2 ): 179 – 192 .
Toche , B. , Pellerin , R. , and Fortin , C. ( 2020 ). Set-based design: a review and new directions . Design Science 6
Voorneveld , M. ( 2003 ). Characterization of Pareto dominance . Operations Research Letters 31 ( 1 ): 7 – 11 .
Wang , G.G. ( 2002 ). Definition and review of virtual prototyping . Journal of Computing and Information Science in Engineering 2 ( 3 ): 232 – 236 .
Ward , A. , Liker , J.K. , Cristiano , J.J. , and Sobek , D.K. ( 1995 ). The second Toyota paradox: how delaying decisions can make better cars faster . Sloan Management Review 36 : 43 – 43 .
Ward , A. and Sobek , D.K. ( 2014 ). Lean Product and Process Development . The Lean Enterprise Institute Incorporation .
Welo , T. , Lycke , A. , and Ringen , G. ( 2019 ). Investigating the use of set-based concurrent engineering in product manufacturing companies . Procedia CIRP 84 : 43 – 48 .
Wheelwright , S.C. and Clark , K.B. ( 1992 ). Revolutionizing Product Development: Quantum Leaps in Speed, Efficiency, and Quality . Simon and Schuster .