2023
DOI
bib
abs
Differentiable modelling to unify machine learning and physical models for geosciences
Chaopeng Shen,
Alison Appling,
Pierre Gentine,
Toshiyuki Bandai,
Hoshin V. Gupta,
Alexandre M. Tartakovsky,
Marco Baity‐Jesi,
Fabrizio Fenicia,
Daniel Kifer,
Li Li,
Xiaofeng Liu,
Wei Ren,
Yi Zheng,
C. J. Harman,
Martyn Clark,
Matthew W. Farthing,
Dapeng Feng,
Praveen Kumar,
Doaa Aboelyazeed,
Farshid Rahmani,
Yalan Song,
Hylke E. Beck,
Tadd Bindas,
Dipankar Dwivedi,
Kuai Fang,
Marvin Höge,
Christopher Rackauckas,
Binayak P. Mohanty,
Tirthankar Roy,
Chonggang Xu,
Kathryn Lawson,
Chaopeng Shen,
Alison Appling,
Pierre Gentine,
Toshiyuki Bandai,
Hoshin V. Gupta,
Alexandre M. Tartakovsky,
Marco Baity‐Jesi,
Fabrizio Fenicia,
Daniel Kifer,
Li Li,
Xiaofeng Liu,
Wei Ren,
Yi Zheng,
C. J. Harman,
Martyn Clark,
Matthew W. Farthing,
Dapeng Feng,
Praveen Kumar,
Doaa Aboelyazeed,
Farshid Rahmani,
Yalan Song,
Hylke E. Beck,
Tadd Bindas,
Dipankar Dwivedi,
Kuai Fang,
Marvin Höge,
Christopher Rackauckas,
Binayak P. Mohanty,
Tirthankar Roy,
Chonggang Xu,
Kathryn Lawson
Nature Reviews Earth & Environment, Volume 4, Issue 8
Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. In this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs. Differentiable modelling is an approach that flexibly integrates the learning capability of machine learning with the interpretability of process-based models. This Perspective highlights the potential of differentiable modelling to improve the representation of processes, parameter estimation, and predictive accuracy in the geosciences.
DOI
bib
abs
Differentiable modelling to unify machine learning and physical models for geosciences
Chaopeng Shen,
Alison Appling,
Pierre Gentine,
Toshiyuki Bandai,
Hoshin V. Gupta,
Alexandre M. Tartakovsky,
Marco Baity‐Jesi,
Fabrizio Fenicia,
Daniel Kifer,
Li Li,
Xiaofeng Liu,
Wei Ren,
Yi Zheng,
C. J. Harman,
Martyn Clark,
Matthew W. Farthing,
Dapeng Feng,
Praveen Kumar,
Doaa Aboelyazeed,
Farshid Rahmani,
Yalan Song,
Hylke E. Beck,
Tadd Bindas,
Dipankar Dwivedi,
Kuai Fang,
Marvin Höge,
Christopher Rackauckas,
Binayak P. Mohanty,
Tirthankar Roy,
Chonggang Xu,
Kathryn Lawson,
Chaopeng Shen,
Alison Appling,
Pierre Gentine,
Toshiyuki Bandai,
Hoshin V. Gupta,
Alexandre M. Tartakovsky,
Marco Baity‐Jesi,
Fabrizio Fenicia,
Daniel Kifer,
Li Li,
Xiaofeng Liu,
Wei Ren,
Yi Zheng,
C. J. Harman,
Martyn Clark,
Matthew W. Farthing,
Dapeng Feng,
Praveen Kumar,
Doaa Aboelyazeed,
Farshid Rahmani,
Yalan Song,
Hylke E. Beck,
Tadd Bindas,
Dipankar Dwivedi,
Kuai Fang,
Marvin Höge,
Christopher Rackauckas,
Binayak P. Mohanty,
Tirthankar Roy,
Chonggang Xu,
Kathryn Lawson
Nature Reviews Earth & Environment, Volume 4, Issue 8
Process-based modelling offers interpretability and physical consistency in many domains of geosciences but struggles to leverage large datasets efficiently. Machine-learning methods, especially deep networks, have strong predictive skills yet are unable to answer specific scientific questions. In this Perspective, we explore differentiable modelling as a pathway to dissolve the perceived barrier between process-based modelling and machine learning in the geosciences and demonstrate its potential with examples from hydrological modelling. ‘Differentiable’ refers to accurately and efficiently calculating gradients with respect to model variables or parameters, enabling the discovery of high-dimensional unknown relationships. Differentiable modelling involves connecting (flexible amounts of) prior physical knowledge to neural networks, pushing the boundary of physics-informed machine learning. It offers better interpretability, generalizability, and extrapolation capabilities than purely data-driven machine learning, achieving a similar level of accuracy while requiring less training data. Additionally, the performance and efficiency of differentiable models scale well with increasing data volumes. Under data-scarce scenarios, differentiable models have outperformed machine-learning models in producing short-term dynamics and decadal-scale trends owing to the imposed physical constraints. Differentiable modelling approaches are primed to enable geoscientists to ask questions, test hypotheses, and discover unrecognized physical relationships. Future work should address computational challenges, reduce uncertainty, and verify the physical significance of outputs. Differentiable modelling is an approach that flexibly integrates the learning capability of machine learning with the interpretability of process-based models. This Perspective highlights the potential of differentiable modelling to improve the representation of processes, parameter estimation, and predictive accuracy in the geosciences.
2020
Wet alpine meadow ecosystems generally act as a significant carbon sink due to their higher rate of photosynthesis than the rate of decomposition. However, it remains unclear whether the low decomposition rate is determined by low temperatures or by nearly-saturated soil conditions. Using five years of measurements from two sites on the Tibetan Plateau with significantly different soil water conditions, we showed that compared to the dry site (which had a deep water table), the much larger carbon sink at the site with a shallow groundwater was mainly caused by the inhibiting effects of the nearly-saturated soil condition on soil respiration rather than by the low temperature. The findings suggested that thawing of frozen soil may partially slow down soil carbon decomposition through increasing soil water. We highlights that a warming-induced shrinking cryosphere may largely affect the carbon dynamics of wet and cold ecosystems through changes in soil hydrology.
2019
DOI
bib
abs
The Community Land Model Version 5: Description of New Features, Benchmarking, and Impact of Forcing Uncertainty
David M. Lawrence,
Rosie A. Fisher,
Charles D. Koven,
Keith W. Oleson,
Sean Swenson,
G. B. Bonan,
Nathan Collier,
Bardan Ghimire,
Leo van Kampenhout,
Daniel Kennedy,
Erik Kluzek,
Peter Lawrence,
Fang Li,
Hong‐Yi Li,
Danica Lombardozzi,
W. J. Riley,
William J. Sacks,
Mingjie Shi,
Mariana Vertenstein,
William R. Wieder,
Chonggang Xu,
Ashehad A. Ali,
Andrew M. Badger,
Gautam Bisht,
M. R. van den Broeke,
Michael A. Brunke,
Sean P. Burns,
Jonathan Buzan,
Martyn Clark,
Anthony P Craig,
Kyla M. Dahlin,
Beth Drewniak,
Joshua B. Fisher,
M. Flanner,
A. M. Fox,
Pierre Gentine,
Forrest M. Hoffman,
G. Keppel‐Aleks,
R. G. Knox,
Sanjiv Kumar,
Jan T. M. Lenaerts,
L. Ruby Leung,
William H. Lipscomb,
Yaqiong Lü,
Ashutosh Pandey,
Jon D. Pelletier,
J. Perket,
James T. Randerson,
D. M. Ricciuto,
Benjamin M. Sanderson,
A. G. Slater,
Z. M. Subin,
Jinyun Tang,
R. Quinn Thomas,
Maria Val Martin,
Xubin Zeng
Journal of Advances in Modeling Earth Systems, Volume 11, Issue 12
The Community Land Model (CLM) is the land component of the Community Earth System Model (CESM) and is used in several global and regional modeling systems. In this paper, we introduce model developments included in CLM version 5 (CLM5), which is the default land component for CESM2. We assess an ensemble of simulations, including prescribed and prognostic vegetation state, multiple forcing data sets, and CLM4, CLM4.5, and CLM5, against a range of metrics including from the International Land Model Benchmarking (ILAMBv2) package. CLM5 includes new and updated processes and parameterizations: (1) dynamic land units, (2) updated parameterizations and structure for hydrology and snow (spatially explicit soil depth, dry surface layer, revised groundwater scheme, revised canopy interception and canopy snow processes, updated fresh snow density, simple firn model, and Model for Scale Adaptive River Transport), (3) plant hydraulics and hydraulic redistribution, (4) revised nitrogen cycling (flexible leaf stoichiometry, leaf N optimization for photosynthesis, and carbon costs for plant nitrogen uptake), (5) global crop model with six crop types and time‐evolving irrigated areas and fertilization rates, (6) updated urban building energy, (7) carbon isotopes, and (8) updated stomatal physiology. New optional features include demographically structured dynamic vegetation model (Functionally Assembled Terrestrial Ecosystem Simulator), ozone damage to plants, and fire trace gas emissions coupling to the atmosphere. Conclusive establishment of improvement or degradation of individual variables or metrics is challenged by forcing uncertainty, parametric uncertainty, and model structural complexity, but the multivariate metrics presented here suggest a general broad improvement from CLM4 to CLM5.