2021
DOI
bib
abs
The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
Saman Razavi,
Anthony J. Jakeman,
Andrea Saltelli,
Clémentine Prieur,
Bertrand Iooss,
Emanuele Borgonovo,
Elmar Plischke,
Samuele Lo Piano,
Takuya Iwanaga,
William E. Becker,
Stefano Tarantola,
Joseph H. A. Guillaume,
John Jakeman,
Hoshin V. Gupta,
Nicola Melillo,
Giovanni Rabitti,
Vincent Chabridon,
Qingyun Duan,
Xifu Sun,
Stefán Thor Smith,
Razi Sheikholeslami,
Nasim Hosseini,
Masoud Asadzadeh,
Arnald Puy,
Sergei Kucherenko,
Holger R. Maier,
Saman Razavi,
Anthony J. Jakeman,
Andrea Saltelli,
Clémentine Prieur,
Bertrand Iooss,
Emanuele Borgonovo,
Elmar Plischke,
Samuele Lo Piano,
Takuya Iwanaga,
William E. Becker,
Stefano Tarantola,
Joseph H. A. Guillaume,
John Jakeman,
Hoshin V. Gupta,
Nicola Melillo,
Giovanni Rabitti,
Vincent Chabridon,
Qingyun Duan,
Xifu Sun,
Stefán Thor Smith,
Razi Sheikholeslami,
Nasim Hosseini,
Masoud Asadzadeh,
Arnald Puy,
Sergei Kucherenko,
Holger R. Maier
Environmental Modelling & Software, Volume 137
Sensitivity analysis (SA) is en route to becoming an integral part of mathematical modeling. The tremendous potential benefits of SA are, however, yet to be fully realized, both for advancing mechanistic and data-driven modeling of human and natural systems, and in support of decision making. In this perspective paper, a multidisciplinary group of researchers and practitioners revisit the current status of SA, and outline research challenges in regard to both theoretical frameworks and their applications to solve real-world problems. Six areas are discussed that warrant further attention, including (1) structuring and standardizing SA as a discipline, (2) realizing the untapped potential of SA for systems modeling, (3) addressing the computational burden of SA, (4) progressing SA in the context of machine learning, (5) clarifying the relationship and role of SA to uncertainty quantification, and (6) evolving the use of SA in support of decision making. An outlook for the future of SA is provided that underlines how SA must underpin a wide variety of activities to better serve science and society. • Sensitivity analysis (SA) should be promoted as an independent discipline. • Several grand challenges hinder full realization of the benefits of SA. • The potential of SA for systems modeling & machine learning is untapped. • New prospects exist for SA to support uncertainty quantification & decision making. • Coordination rather than consensus is key to cross-fertilize new ideas.
DOI
bib
abs
The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
Saman Razavi,
Anthony J. Jakeman,
Andrea Saltelli,
Clémentine Prieur,
Bertrand Iooss,
Emanuele Borgonovo,
Elmar Plischke,
Samuele Lo Piano,
Takuya Iwanaga,
William E. Becker,
Stefano Tarantola,
Joseph H. A. Guillaume,
John Jakeman,
Hoshin V. Gupta,
Nicola Melillo,
Giovanni Rabitti,
Vincent Chabridon,
Qingyun Duan,
Xifu Sun,
Stefán Thor Smith,
Razi Sheikholeslami,
Nasim Hosseini,
Masoud Asadzadeh,
Arnald Puy,
Sergei Kucherenko,
Holger R. Maier,
Saman Razavi,
Anthony J. Jakeman,
Andrea Saltelli,
Clémentine Prieur,
Bertrand Iooss,
Emanuele Borgonovo,
Elmar Plischke,
Samuele Lo Piano,
Takuya Iwanaga,
William E. Becker,
Stefano Tarantola,
Joseph H. A. Guillaume,
John Jakeman,
Hoshin V. Gupta,
Nicola Melillo,
Giovanni Rabitti,
Vincent Chabridon,
Qingyun Duan,
Xifu Sun,
Stefán Thor Smith,
Razi Sheikholeslami,
Nasim Hosseini,
Masoud Asadzadeh,
Arnald Puy,
Sergei Kucherenko,
Holger R. Maier
Environmental Modelling & Software, Volume 137
Sensitivity analysis (SA) is en route to becoming an integral part of mathematical modeling. The tremendous potential benefits of SA are, however, yet to be fully realized, both for advancing mechanistic and data-driven modeling of human and natural systems, and in support of decision making. In this perspective paper, a multidisciplinary group of researchers and practitioners revisit the current status of SA, and outline research challenges in regard to both theoretical frameworks and their applications to solve real-world problems. Six areas are discussed that warrant further attention, including (1) structuring and standardizing SA as a discipline, (2) realizing the untapped potential of SA for systems modeling, (3) addressing the computational burden of SA, (4) progressing SA in the context of machine learning, (5) clarifying the relationship and role of SA to uncertainty quantification, and (6) evolving the use of SA in support of decision making. An outlook for the future of SA is provided that underlines how SA must underpin a wide variety of activities to better serve science and society. • Sensitivity analysis (SA) should be promoted as an independent discipline. • Several grand challenges hinder full realization of the benefits of SA. • The potential of SA for systems modeling & machine learning is untapped. • New prospects exist for SA to support uncertainty quantification & decision making. • Coordination rather than consensus is key to cross-fertilize new ideas.
Sensitivity analysis (SA) as a ‘formal’ and ‘standard’ component of scientific development and policy support is relatively young. Many researchers and practitioners from a wide range of disciplines have contributed to SA over the last three decades, and the SAMO (sensitivity analysis of model output) conferences, since 1995, have been the primary driver of breeding a community culture in this heterogeneous population. Now, SA is evolving into a mature and independent field of science, indeed a discipline with emerging applications extending well into new areas such as data science and machine learning. At this growth stage, the present editorial leads a special issue consisting of one Position Paper on “ The future of sensitivity analysis ” and 11 research papers on “ Sensitivity analysis for environmental modelling ” published in Environmental Modelling & Software in 2020–21. • Advances of science and policy has deep but informal roots in sensitivity analysis. • Modern sensitivity analysis is now evolving into a formal and independent discipline. • New areas such data science and machine learning benefit from sensitivity analysis. • Challenges, methodological progress, and outlook are outlined in this special issue.
Sensitivity analysis (SA) as a ‘formal’ and ‘standard’ component of scientific development and policy support is relatively young. Many researchers and practitioners from a wide range of disciplines have contributed to SA over the last three decades, and the SAMO (sensitivity analysis of model output) conferences, since 1995, have been the primary driver of breeding a community culture in this heterogeneous population. Now, SA is evolving into a mature and independent field of science, indeed a discipline with emerging applications extending well into new areas such as data science and machine learning. At this growth stage, the present editorial leads a special issue consisting of one Position Paper on “ The future of sensitivity analysis ” and 11 research papers on “ Sensitivity analysis for environmental modelling ” published in Environmental Modelling & Software in 2020–21. • Advances of science and policy has deep but informal roots in sensitivity analysis. • Modern sensitivity analysis is now evolving into a formal and independent discipline. • New areas such data science and machine learning benefit from sensitivity analysis. • Challenges, methodological progress, and outlook are outlined in this special issue.
DOI
bib
abs
Socio-technical scales in socio-environmental modeling: Managing a system-of-systems modeling approach
Takuya Iwanaga,
Hsiao‐Hsuan Wang,
Serena H. Hamilton,
Volker Grimm,
Tomasz E. Koralewski,
Alejandro Salado,
Sondoss Elsawah,
Saman Razavi,
Jing Yang,
Pierre D. Glynn,
Jennifer Badham,
Alexey Voinov,
Min Chen,
William E. Grant,
Tarla Rai Peterson,
Karin Frank,
Gary W. Shenk,
C. Michael Barton,
Anthony J. Jakeman,
John C. Little
Environmental Modelling & Software, Volume 135
System-of-systems approaches for integrated assessments have become prevalent in recent years. Such approaches integrate a variety of models from different disciplines and modeling paradigms to represent a socio-environmental (or social-ecological) system aiming to holistically inform policy and decision-making processes. Central to the system-of-systems approaches is the representation of systems in a multi-tier framework with nested scales. Current modeling paradigms, however, have disciplinary-specific lineage, leading to inconsistencies in the conceptualization and integration of socio-environmental systems. In this paper, a multidisciplinary team of researchers, from engineering, natural and social sciences, have come together to detail socio-technical practices and challenges that arise in the consideration of scale throughout the socio-environmental modeling process. We identify key paths forward, focused on explicit consideration of scale and uncertainty, strengthening interdisciplinary communication, and improvement of the documentation process. We call for a grand vision (and commensurate funding) for holistic system-of-systems research that engages researchers, stakeholders, and policy makers in a multi-tiered process for the co-creation of knowledge and solutions to major socio-environmental problems.
2019
DOI
bib
abs
Introductory overview of identifiability analysis: A guide to evaluating whether you have the right type of data for your modeling purpose
Joseph H. A. Guillaume,
John Jakeman,
Stefano Marsili-Libelli,
M. J. C. Asher,
Philip Brunner,
Barry Croke,
Mary C. Hill,
Anthony J. Jakeman,
Karel J. Keesman,
Saman Razavi,
J.D. Stigter
Environmental Modelling & Software, Volume 119
Identifiability is a fundamental concept in parameter estimation, and therefore key to the large majority of environmental modeling applications. Parameter identifiability analysis assesses whether it is theoretically possible to estimate unique parameter values from data, given the quantities measured, conditions present in the forcing data, model structure (and objective function), and properties of errors in the model and observations. In other words, it tackles the problem of whether the right type of data is available to estimate the desired parameter values. Identifiability analysis is therefore an essential technique that should be adopted more routinely in practice, alongside complementary methods such as uncertainty analysis and evaluation of model performance. This article provides an introductory overview to the topic. We recommend that any modeling study should document whether a model is non-identifiable, the source of potential non-identifiability, and how this affects intended project outcomes.