2023
DOI
bib
abs
Differentiable modelling to unify machine learning and physical models for geosciences
Chaopeng Shen,
Alison Appling,
Pierre Gentine,
Toshiyuki Bandai,
Hoshin V. Gupta,
Alexandre M. Tartakovsky,
Marco Baity‐Jesi,
Fabrizio Fenicia,
Daniel Kifer,
Li Li,
Xiaofeng Liu,
Wei Ren,
Yi Zheng,
C. J. Harman,
Martyn Clark,
Matthew W. Farthing,
Dapeng Feng,
Praveen Kumar,
Doaa Aboelyazeed,
Farshid Rahmani,
Yalan Song,
Hylke E. Beck,
Tadd Bindas,
Dipankar Dwivedi,
Kuai Fang,
Marvin Höge,
Christopher Rackauckas,
Binayak P. Mohanty,
Tirthankar Roy,
Chonggang Xu,
Kathryn Lawson,
Chaopeng Shen,
Alison Appling,
Pierre Gentine,
Toshiyuki Bandai,
Hoshin V. Gupta,
Alexandre M. Tartakovsky,
Marco Baity‐Jesi,
Fabrizio Fenicia,
Daniel Kifer,
Li Li,
Xiaofeng Liu,
Wei Ren,
Yi Zheng,
C. J. Harman,
Martyn Clark,
Matthew W. Farthing,
Dapeng Feng,
Praveen Kumar,
Doaa Aboelyazeed,
Farshid Rahmani,
Yalan Song,
Hylke E. Beck,
Tadd Bindas,
Dipankar Dwivedi,
Kuai Fang,
Marvin Höge,
Christopher Rackauckas,
Binayak P. Mohanty,
Tirthankar Roy,
Chonggang Xu,
Kathryn Lawson
Nature Reviews Earth & Environment, Volume 4, Issue 8
Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. In this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs. Differentiable modelling is an approach that flexibly integrates the learning capability of machine learning with the interpretability of process-based models. This Perspective highlights the potential of differentiable modelling to improve the representation of processes, parameter estimation, and predictive accuracy in the geosciences.
DOI
bib
abs
Differentiable modelling to unify machine learning and physical models for geosciences
Chaopeng Shen,
Alison Appling,
Pierre Gentine,
Toshiyuki Bandai,
Hoshin V. Gupta,
Alexandre M. Tartakovsky,
Marco Baity‐Jesi,
Fabrizio Fenicia,
Daniel Kifer,
Li Li,
Xiaofeng Liu,
Wei Ren,
Yi Zheng,
C. J. Harman,
Martyn Clark,
Matthew W. Farthing,
Dapeng Feng,
Praveen Kumar,
Doaa Aboelyazeed,
Farshid Rahmani,
Yalan Song,
Hylke E. Beck,
Tadd Bindas,
Dipankar Dwivedi,
Kuai Fang,
Marvin Höge,
Christopher Rackauckas,
Binayak P. Mohanty,
Tirthankar Roy,
Chonggang Xu,
Kathryn Lawson,
Chaopeng Shen,
Alison Appling,
Pierre Gentine,
Toshiyuki Bandai,
Hoshin V. Gupta,
Alexandre M. Tartakovsky,
Marco Baity‐Jesi,
Fabrizio Fenicia,
Daniel Kifer,
Li Li,
Xiaofeng Liu,
Wei Ren,
Yi Zheng,
C. J. Harman,
Martyn Clark,
Matthew W. Farthing,
Dapeng Feng,
Praveen Kumar,
Doaa Aboelyazeed,
Farshid Rahmani,
Yalan Song,
Hylke E. Beck,
Tadd Bindas,
Dipankar Dwivedi,
Kuai Fang,
Marvin Höge,
Christopher Rackauckas,
Binayak P. Mohanty,
Tirthankar Roy,
Chonggang Xu,
Kathryn Lawson
Nature Reviews Earth & Environment, Volume 4, Issue 8
Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. In this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs. Differentiable modelling is an approach that flexibly integrates the learning capability of machine learning with the interpretability of process-based models. This Perspective highlights the potential of differentiable modelling to improve the representation of processes, parameter estimation, and predictive accuracy in the geosciences.
2021
DOI
bib
abs
Fill‐and‐Spill: A Process Description of Runoff Generation at the Scale of the Beholder
Jeffrey J. McDonnell,
Christopher Spence,
Daniel J. Karran,
Ilja van Meerveld,
C. J. Harman,
Jeffrey J. McDonnell,
Christopher Spence,
Daniel J. Karran,
Ilja van Meerveld,
C. J. Harman
Water Resources Research, Volume 57, Issue 5
Descriptions of runoff generation processes continue to grow, helping to reveal complexities and hydrologic behavior across a wide range of environments and scales. But to date, there has been little grouping of these process facts. Here, we discuss how the “fill‐and‐spill” concept can provide a framework to group event‐based runoff generation processes. The fill‐and‐spill concept describes where vertical and lateral additions of water to a landscape unit are placed into storage (the fill)—and only when this storage reaches a critical level (the spill), and other storages are filled and become connected, does a previously infeasible (but subsequently important) outflow pathway become activated. We show that fill‐and‐spill can be observed at a range of scales and propose that future fieldwork should first define the scale of interest and then evaluate what is filling‐and‐spilling at that scale. Such an approach may be helpful for those instrumenting and modeling new hillslopes or catchments because it provides a structured way to develop perceptual models for runoff generation and to group behaviors at different sites and scales.
DOI
bib
abs
Fill‐and‐Spill: A Process Description of Runoff Generation at the Scale of the Beholder
Jeffrey J. McDonnell,
Christopher Spence,
Daniel J. Karran,
Ilja van Meerveld,
C. J. Harman,
Jeffrey J. McDonnell,
Christopher Spence,
Daniel J. Karran,
Ilja van Meerveld,
C. J. Harman
Water Resources Research, Volume 57, Issue 5
Descriptions of runoff generation processes continue to grow, helping to reveal complexities and hydrologic behavior across a wide range of environments and scales. But to date, there has been little grouping of these process facts. Here, we discuss how the “fill‐and‐spill” concept can provide a framework to group event‐based runoff generation processes. The fill‐and‐spill concept describes where vertical and lateral additions of water to a landscape unit are placed into storage (the fill)—and only when this storage reaches a critical level (the spill), and other storages are filled and become connected, does a previously infeasible (but subsequently important) outflow pathway become activated. We show that fill‐and‐spill can be observed at a range of scales and propose that future fieldwork should first define the scale of interest and then evaluate what is filling‐and‐spilling at that scale. Such an approach may be helpful for those instrumenting and modeling new hillslopes or catchments because it provides a structured way to develop perceptual models for runoff generation and to group behaviors at different sites and scales.