John Jakeman


2021

DOI bib
The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
Saman Razavi, Anthony J. Jakeman, Andrea Saltelli, Clémentine Prieur, Bertrand Iooss, Emanuele Borgonovo, Elmar Plischke, Samuele Lo Piano, Takuya Iwanaga, William E. Becker, Stefano Tarantola, Joseph H. A. Guillaume, John Jakeman, Hoshin V. Gupta, Nicola Melillo, Giovanni Rabitti, Vincent Chabridon, Qingyun Duan, Xifu Sun, Stefán Thor Smith, Razi Sheikholeslami, Nasim Hosseini, Masoud Asadzadeh, Arnald Puy, Sergei Kucherenko, Holger R. Maier, Saman Razavi, Anthony J. Jakeman, Andrea Saltelli, Clémentine Prieur, Bertrand Iooss, Emanuele Borgonovo, Elmar Plischke, Samuele Lo Piano, Takuya Iwanaga, William E. Becker, Stefano Tarantola, Joseph H. A. Guillaume, John Jakeman, Hoshin V. Gupta, Nicola Melillo, Giovanni Rabitti, Vincent Chabridon, Qingyun Duan, Xifu Sun, Stefán Thor Smith, Razi Sheikholeslami, Nasim Hosseini, Masoud Asadzadeh, Arnald Puy, Sergei Kucherenko, Holger R. Maier
Environmental Modelling & Software, Volume 137

Sensitivity analysis (SA) is en route to becoming an integral part of mathematical modeling. The tremendous potential benefits of SA are, however, yet to be fully realized, both for advancing mechanistic and data-driven modeling of human and natural systems, and in support of decision making. In this perspective paper, a multidisciplinary group of researchers and practitioners revisit the current status of SA, and outline research challenges in regard to both theoretical frameworks and their applications to solve real-world problems. Six areas are discussed that warrant further attention, including (1) structuring and standardizing SA as a discipline, (2) realizing the untapped potential of SA for systems modeling, (3) addressing the computational burden of SA, (4) progressing SA in the context of machine learning, (5) clarifying the relationship and role of SA to uncertainty quantification, and (6) evolving the use of SA in support of decision making. An outlook for the future of SA is provided that underlines how SA must underpin a wide variety of activities to better serve science and society. • Sensitivity analysis (SA) should be promoted as an independent discipline. • Several grand challenges hinder full realization of the benefits of SA. • The potential of SA for systems modeling & machine learning is untapped. • New prospects exist for SA to support uncertainty quantification & decision making. • Coordination rather than consensus is key to cross-fertilize new ideas.

DOI bib
The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
Saman Razavi, Anthony J. Jakeman, Andrea Saltelli, Clémentine Prieur, Bertrand Iooss, Emanuele Borgonovo, Elmar Plischke, Samuele Lo Piano, Takuya Iwanaga, William E. Becker, Stefano Tarantola, Joseph H. A. Guillaume, John Jakeman, Hoshin V. Gupta, Nicola Melillo, Giovanni Rabitti, Vincent Chabridon, Qingyun Duan, Xifu Sun, Stefán Thor Smith, Razi Sheikholeslami, Nasim Hosseini, Masoud Asadzadeh, Arnald Puy, Sergei Kucherenko, Holger R. Maier, Saman Razavi, Anthony J. Jakeman, Andrea Saltelli, Clémentine Prieur, Bertrand Iooss, Emanuele Borgonovo, Elmar Plischke, Samuele Lo Piano, Takuya Iwanaga, William E. Becker, Stefano Tarantola, Joseph H. A. Guillaume, John Jakeman, Hoshin V. Gupta, Nicola Melillo, Giovanni Rabitti, Vincent Chabridon, Qingyun Duan, Xifu Sun, Stefán Thor Smith, Razi Sheikholeslami, Nasim Hosseini, Masoud Asadzadeh, Arnald Puy, Sergei Kucherenko, Holger R. Maier
Environmental Modelling & Software, Volume 137

Sensitivity analysis (SA) is en route to becoming an integral part of mathematical modeling. The tremendous potential benefits of SA are, however, yet to be fully realized, both for advancing mechanistic and data-driven modeling of human and natural systems, and in support of decision making. In this perspective paper, a multidisciplinary group of researchers and practitioners revisit the current status of SA, and outline research challenges in regard to both theoretical frameworks and their applications to solve real-world problems. Six areas are discussed that warrant further attention, including (1) structuring and standardizing SA as a discipline, (2) realizing the untapped potential of SA for systems modeling, (3) addressing the computational burden of SA, (4) progressing SA in the context of machine learning, (5) clarifying the relationship and role of SA to uncertainty quantification, and (6) evolving the use of SA in support of decision making. An outlook for the future of SA is provided that underlines how SA must underpin a wide variety of activities to better serve science and society. • Sensitivity analysis (SA) should be promoted as an independent discipline. • Several grand challenges hinder full realization of the benefits of SA. • The potential of SA for systems modeling & machine learning is untapped. • New prospects exist for SA to support uncertainty quantification & decision making. • Coordination rather than consensus is key to cross-fertilize new ideas.

2019

DOI bib
Introductory overview of identifiability analysis: A guide to evaluating whether you have the right type of data for your modeling purpose
Joseph H. A. Guillaume, John Jakeman, Stefano Marsili-Libelli, M. J. C. Asher, Philip Brunner, Barry Croke, Mary C. Hill, Anthony J. Jakeman, Karel J. Keesman, Saman Razavi, J.D. Stigter
Environmental Modelling & Software, Volume 119

Identifiability is a fundamental concept in parameter estimation, and therefore key to the large majority of environmental modeling applications. Parameter identifiability analysis assesses whether it is theoretically possible to estimate unique parameter values from data, given the quantities measured, conditions present in the forcing data, model structure (and objective function), and properties of errors in the model and observations. In other words, it tackles the problem of whether the right type of data is available to estimate the desired parameter values. Identifiability analysis is therefore an essential technique that should be adopted more routinely in practice, alongside complementary methods such as uncertainty analysis and evaluation of model performance. This article provides an introductory overview to the topic. We recommend that any modeling study should document whether a model is non-identifiable, the source of potential non-identifiability, and how this affects intended project outcomes.