Community Workflows to Advance Reproducibility in Hydrologic Modeling: Separating Model‐Agnostic and Model‐Specific Configuration Steps in Applications of Large‐Domain Hydrologic Models

Despite the proliferation of computer‐based research on hydrology and water resources, such research is typically poorly reproducible. Published studies have low reproducibility due to incomplete availability of data and computer code, and a lack of documentation of workflow processes. This leads to...

Full description

Saved in:
Bibliographic Details
Published inWater resources research Vol. 58; no. 11
Main Authors Knoben, W. J. M., Clark, M. P., Bales, J., Bennett, A., Gharari, S., Marsh, C. B., Nijssen, B., Pietroniro, A., Spiteri, R. J., Tang, G., Tarboton, D. G., Wood, A. W.
Format Journal Article
LanguageEnglish
Published 01.11.2022
Subjects
Online AccessGet full text
ISSN0043-1397
1944-7973
1944-7973
DOI10.1029/2021WR031753

Cover

Abstract Despite the proliferation of computer‐based research on hydrology and water resources, such research is typically poorly reproducible. Published studies have low reproducibility due to incomplete availability of data and computer code, and a lack of documentation of workflow processes. This leads to a lack of transparency and efficiency because existing code can neither be quality controlled nor reused. Given the commonalities between existing process‐based hydrologic models in terms of their required input data and preprocessing steps, open sharing of code can lead to large efficiency gains for the modeling community. Here, we present a model configuration workflow that provides full reproducibility of the resulting model instantiations in a way that separates the model‐agnostic preprocessing of specific data sets from the model‐specific requirements that models impose on their input files. We use this workflow to create large‐domain (global and continental) and local configurations of the Structure for Unifying Multiple Modeling Alternatives (SUMMA) hydrologic model connected to the mizuRoute routing model. These examples show how a relatively complex model setup over a large domain can be organized in a reproducible and structured way that has the potential to accelerate advances in hydrologic modeling for the community as a whole. We provide a tentative blueprint of how community modeling initiatives can be built on top of workflows such as this. We term our workflow the “Community Workflows to Advance Reproducibility in Hydrologic Modeling” (CWARHM; pronounced “swarm”). Key Points Reproducible, transparent modeling increases confidence in model simulations and requires careful tracking of all model configuration steps We show an example of model configuration code applied globally that is traced and shared through a version control system Standardizing file formats and sharing of code can increase efficiency and reproducibility of modeling studies
AbstractList Despite the proliferation of computer‐based research on hydrology and water resources, such research is typically poorly reproducible. Published studies have low reproducibility due to incomplete availability of data and computer code, and a lack of documentation of workflow processes. This leads to a lack of transparency and efficiency because existing code can neither be quality controlled nor reused. Given the commonalities between existing process‐based hydrologic models in terms of their required input data and preprocessing steps, open sharing of code can lead to large efficiency gains for the modeling community. Here, we present a model configuration workflow that provides full reproducibility of the resulting model instantiations in a way that separates the model‐agnostic preprocessing of specific data sets from the model‐specific requirements that models impose on their input files. We use this workflow to create large‐domain (global and continental) and local configurations of the Structure for Unifying Multiple Modeling Alternatives (SUMMA) hydrologic model connected to the mizuRoute routing model. These examples show how a relatively complex model setup over a large domain can be organized in a reproducible and structured way that has the potential to accelerate advances in hydrologic modeling for the community as a whole. We provide a tentative blueprint of how community modeling initiatives can be built on top of workflows such as this. We term our workflow the “Community Workflows to Advance Reproducibility in Hydrologic Modeling” (CWARHM; pronounced “swarm”). Key Points Reproducible, transparent modeling increases confidence in model simulations and requires careful tracking of all model configuration steps We show an example of model configuration code applied globally that is traced and shared through a version control system Standardizing file formats and sharing of code can increase efficiency and reproducibility of modeling studies
Author Knoben, W. J. M.
Wood, A. W.
Pietroniro, A.
Bennett, A.
Tang, G.
Bales, J.
Tarboton, D. G.
Nijssen, B.
Clark, M. P.
Gharari, S.
Spiteri, R. J.
Marsh, C. B.
Author_xml – sequence: 1
  givenname: W. J. M.
  orcidid: 0000-0001-8301-3787
  surname: Knoben
  fullname: Knoben, W. J. M.
  email: wouter.knoben@usask.ca
  organization: University of Saskatchewan
– sequence: 2
  givenname: M. P.
  orcidid: 0000-0002-2186-2625
  surname: Clark
  fullname: Clark, M. P.
  organization: University of Saskatchewan
– sequence: 3
  givenname: J.
  surname: Bales
  fullname: Bales, J.
  organization: Consortium of Universities for the Advancement of Hydrologic Science, Inc
– sequence: 4
  givenname: A.
  orcidid: 0000-0002-7742-3138
  surname: Bennett
  fullname: Bennett, A.
  organization: University of Arizona
– sequence: 5
  givenname: S.
  orcidid: 0000-0002-5358-5714
  surname: Gharari
  fullname: Gharari, S.
  organization: University of Saskatchewan
– sequence: 6
  givenname: C. B.
  orcidid: 0000-0002-1372-4513
  surname: Marsh
  fullname: Marsh, C. B.
  organization: University of Saskatchewan
– sequence: 7
  givenname: B.
  orcidid: 0000-0002-4062-0322
  surname: Nijssen
  fullname: Nijssen, B.
  organization: University of Washington
– sequence: 8
  givenname: A.
  orcidid: 0000-0001-5792-9177
  surname: Pietroniro
  fullname: Pietroniro, A.
  organization: University of Calgary
– sequence: 9
  givenname: R. J.
  orcidid: 0000-0002-3513-6237
  surname: Spiteri
  fullname: Spiteri, R. J.
  organization: University of Saskatchewan
– sequence: 10
  givenname: G.
  orcidid: 0000-0002-0923-583X
  surname: Tang
  fullname: Tang, G.
  organization: University of Saskatchewan
– sequence: 11
  givenname: D. G.
  orcidid: 0000-0002-1998-3479
  surname: Tarboton
  fullname: Tarboton, D. G.
  organization: Utah State University
– sequence: 12
  givenname: A. W.
  orcidid: 0000-0002-6231-0085
  surname: Wood
  fullname: Wood, A. W.
  organization: National Center for Atmospheric Research
BookMark eNptkU1OwzAQhS1UJNrCjgP4AgH_JHbNrgo_RSpCakFdRm5sRwbXjpKUKjuOwI24CychocCqqxk9fe-N9GYEBj54DcA5RhcYEXFJEMGrBaKYJ_QIDLGI44gLTgdgiFBMI0wFPwGjun5BCMcJ40PwmYbNZutt08JVqF6NC7saNgFO1Zv0uYYLXVZBbXO7tq6HrIezVlXBhcLm8CEo7awvruBSl7KSTbfvxa_3j2nhQ910lPTqX1yWOremE9PgjS22vSd4uGx0Wffh07J0Nv8RaxgMnMuq0J3vOmzkgdv1KTg20tX67HeOwfPtzVM6i-aPd_fpdB7JGGEWsUTma51LJoQSOEGUUs0nRvGYMDHhiinJCeJErY3BXE7MmhgdK6Q1ThRnmI5BtM_d-lK2O-lcVlZ2I6s2wyjr28_69nfVvv2Op3t-Z51uD7J_n8pWi3RBGBGMfgOOsJDb
CitedBy_id crossref_primary_10_1007_s10586_024_04318_5
crossref_primary_10_1016_j_jhydrol_2023_129820
crossref_primary_10_1029_2022WR033363
crossref_primary_10_1080_07011784_2023_2224280
crossref_primary_10_1016_j_envsoft_2023_105808
crossref_primary_10_1029_2022WR033767
crossref_primary_10_5194_hess_28_4127_2024
crossref_primary_10_1016_j_envsoft_2023_105902
crossref_primary_10_1016_j_softx_2023_101547
crossref_primary_10_1111_jfr3_12895
crossref_primary_10_5194_gmd_17_4561_2024
crossref_primary_10_1016_j_envsoft_2023_105689
ContentType Journal Article
Copyright 2022. The Authors.
Copyright_xml – notice: 2022. The Authors.
DBID 24P
ADTOC
UNPAY
DOI 10.1029/2021WR031753
DatabaseName Wiley Online Library (Open Access collection)
Unpaywall for CDI: Periodical Content
Unpaywall
DatabaseTitleList
Database_xml – sequence: 1
  dbid: 24P
  name: Wiley Online Library Open Access
  url: https://authorservices.wiley.com/open-science/open-access/browse-journals.html
  sourceTypes: Publisher
– sequence: 2
  dbid: UNPAY
  name: Unpaywall
  url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
Discipline Geography
Economics
EISSN 1944-7973
EndPage n/a
ExternalDocumentID 10.1029/2021wr031753
WRCR26296
Genre article
GrantInformation_xml – fundername: US National Science Foundation
  funderid: ICER 1928369; OAC 1835569; EAR 1849458
– fundername: DOD, US Army, U.S. Army Corps of Engineers, DOI, Bureau of Reclamation
  funderid: R16AC00039
– fundername: CFREF, Global Water Futures
GroupedDBID -~X
..I
.DC
05W
0R~
123
1OB
1OC
24P
31~
33P
3V.
50Y
5VS
6TJ
7WY
7XC
8-1
8CJ
8FE
8FG
8FH
8FL
8G5
8R4
8R5
8WZ
A00
A6W
AAESR
AAHBH
AAHHS
AAIHA
AAIKC
AAMNW
AANHP
AANLZ
AASGY
AAXRX
AAYCA
AAYJJ
AAYOK
AAZKR
ABCUV
ABJCF
ABJNI
ABPPZ
ABTAH
ABUWG
ACAHQ
ACBWZ
ACCFJ
ACCMX
ACCZN
ACGFO
ACGFS
ACIWK
ACKIV
ACNCT
ACPOU
ACPRK
ACRPL
ACXBN
ACXQS
ACYXJ
ADBBV
ADEOM
ADKYN
ADMGS
ADNMO
ADOZA
ADXAS
ADZMN
AEEZP
AEIGN
AENEX
AEQDE
AEUYN
AEUYR
AFBPY
AFGKR
AFKRA
AFPWT
AFRAH
AFWVQ
AFZJQ
AIDBO
AIURR
AIWBW
AJBDE
ALMA_UNASSIGNED_HOLDINGS
ALUQN
ALXUD
AMYDB
ASPBG
ATCPS
AVWKF
AZFZN
AZQEC
AZVAB
BDRZF
BENPR
BEZIV
BFHJK
BGLVJ
BHPHI
BKSAR
BMXJE
BPHCQ
BRXPI
CCPQU
CS3
D0L
D1J
DCZOG
DDYGU
DPXWK
DRFUL
DRSTM
DU5
DWQXO
EBS
EJD
F5P
FEDTE
FRNLG
G-S
GNUQQ
GODZA
GROUPED_ABI_INFORM_COMPLETE
GUQSH
HCIFZ
HVGLF
HZ~
K60
K6~
L6V
LATKE
LEEKS
LITHE
LK5
LOXES
LUTES
LYRES
M0C
M2O
M7R
M7S
MEWTI
MSFUL
MSSTM
MVM
MW2
MXFUL
MXSTM
MY~
O9-
OHT
OK1
P-X
P2P
P2W
PALCI
PATMY
PCBAR
PQBIZ
PQBZA
PQQKQ
PROAC
PTHSS
PYCSY
Q2X
R.K
RIWAO
RJQFR
ROL
SAMSI
SUPJJ
TAE
TN5
TWZ
UQL
VJK
VOH
WBKPD
WXSBR
WYJ
XOL
XSW
YHZ
YV5
ZCG
ZY4
ZZTAW
~02
~KM
~OA
~~A
AAMMB
ADTOC
ADXHL
AEFGJ
AETEA
AGQPQ
AGXDD
AIDQK
AIDYY
AIQQE
GROUPED_DOAJ
PHGZM
PHGZT
PQGLB
UNPAY
WIN
ID FETCH-LOGICAL-a4016-65acbeca699d9150333e78fd7426987d6da72072dbff17a8fb2fe4d0ee15d7613
IEDL.DBID UNPAY
ISSN 0043-1397
1944-7973
IngestDate Sun Oct 26 04:16:38 EDT 2025
Wed Jan 22 16:22:50 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 11
Language English
License Attribution
cc-by
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a4016-65acbeca699d9150333e78fd7426987d6da72072dbff17a8fb2fe4d0ee15d7613
ORCID 0000-0002-3513-6237
0000-0002-1372-4513
0000-0002-6231-0085
0000-0002-2186-2625
0000-0002-4062-0322
0000-0002-7742-3138
0000-0002-5358-5714
0000-0002-0923-583X
0000-0001-8301-3787
0000-0001-5792-9177
0000-0002-1998-3479
OpenAccessLink https://proxy.k.utb.cz/login?url=https://onlinelibrary.wiley.com/doi/pdfdirect/10.1029/2021WR031753
PageCount 37
ParticipantIDs unpaywall_primary_10_1029_2021wr031753
wiley_primary_10_1029_2021WR031753_WRCR26296
PublicationCentury 2000
PublicationDate November 2022
PublicationDateYYYYMMDD 2022-11-01
PublicationDate_xml – month: 11
  year: 2022
  text: November 2022
PublicationDecade 2020
PublicationTitle Water resources research
PublicationYear 2022
References 2017; 5
2016; XLI‐B4
2013; 27
2020; 240
2019; 55
2017; 44
2019; 15
2020; 17
2020; 12
2003; 19
2020; 125
2008; 3813
2014; 61
2019; 122
2019; 120
2016; 78
2013; 9
2020; 8
2020; 7
2020; 5
2020; 130
2019; 24
2019; 23
2013; 50
2010; 115
2012; 420–421
2014; 19
2020; 134
2021; 595
2011; 26
2014; 50
2006; 327
2019; 111
2006; 92
2015; 12
1995; 9
2021; 8
2019; 6
2011
2015; 51
2009
2016; 52
1970; 10
2020; 36
2020; 144
2020; 584
2020; 146
2015; 448
2016; 17
2007; 11
2010; 41
2019; 222
2022; 157
2015; 68
2021; 57
2021; 13
2017; 53
2016; 7
2016; 3
2010; 46
2021; 135
2022
2021
2015a; 51
2020
2017; 98
2017; 12
2019
1994; 99
2005; 4
2018
2008; 89
2022; 15
2017
2020; 24
2016
2014
2013
2015b; 51
2011; 49
2018; 11
2007; 45
2016; 9
1988; 116
References_xml – year: 2011
– volume: 12
  issue: 2
  year: 2017
  article-title: SoilGrids250m: Global gridded soil information based on machine learning
  publication-title: PLoS One
– volume: 57
  issue: 9
  year: 2021
  article-title: The abuse of popular performance metrics in hydrologic modeling
  publication-title: Water Resources Research
– volume: 9
  issue: 10
  year: 2013
  article-title: Ten simple rules for reproducible computational research
  publication-title: PLoS Computational Biology
– volume: 5
  start-page: 21
  issue: 1
  year: 2017
  end-page: 46
  article-title: Creative computing with Landlab: An open‐source toolkit for building, coupling, and exploring two‐dimensional numerical models of Earth‐surface dynamics
  publication-title: Earth Surface Dynamics
– volume: 135
  year: 2021
  article-title: Toward open and reproducible environmental modeling by integrating online data repositories, computational environments, and model Application Programming Interfaces
  publication-title: Environmental Modelling & Software
– volume: 9
  start-page: 2223
  issue: 6
  year: 2016
  end-page: 2238
  article-title: mizuRoute version 1: A river network routing tool for a continental domain water resources applications
  publication-title: Geoscientific Model Development
– volume: 51
  start-page: 2515
  issue: 4
  year: 2015b
  end-page: 2542
  article-title: A unified approach for process‐based hydrologic modeling: 2. Model implementation and case studies
  publication-title: Water Resources Research
– volume: 144
  year: 2020
  article-title: Automated Water Supply Model (AWSM): Streamlining and standardizing application of a physically based snow model for water resources and reproducible science
  publication-title: Computers & Geosciences
– year: 2014
– volume: 92
  year: 2006
– volume: 57
  issue: 4
  year: 2021
  article-title: Open science: Open data, open models, … and open publications?
  publication-title: Water Resources Research
– volume: 17
  start-page: 2293
  issue: 8
  year: 2016
  end-page: 2313
  article-title: The multibudget soil, vegetation, and snow (SVS) scheme for land surface parameterization: Offline warm season evaluation
  publication-title: Journal of Hydrometeorology
– year: 2022
– volume: 116
  start-page: 2417
  issue: 12
  year: 1988
  end-page: 2424
  article-title: Skill scores based on the mean square error and their relationships to the correlation coefficient
  publication-title: Monthly Weather Review
– volume: 26
  start-page: 1696
  issue: 12
  year: 2011
  end-page: 1709
  article-title: Extraction of hydrological proximity measures from DEMs using parallel processing
  publication-title: Environmental Modelling & Software
– volume: 7
  issue: 5
  year: 2020
  article-title: Environmental lapse rate for high‐resolution land surface downscaling: An application to ERA5
  publication-title: Earth and Space Science
– volume: 448
  start-page: 311
  year: 2015
  end-page: 320
– year: 2022
  article-title: CH‐Earth/CWARHM: CWARHM workflow updates during peer review
  publication-title: Zenodo
– volume: 52
  start-page: 7548
  issue: 10
  year: 2016
  end-page: 7555
  article-title: Most computational hydrology is not reproducible, so is it really science?: Reproducible computational hydrology
  publication-title: Water Resources Research
– volume: 12
  issue: 5
  year: 2017
  article-title: Singularity: Scientific containers for mobility of compute
  publication-title: PLoS One
– volume: 50
  start-page: 85
  year: 2013
  end-page: 96
  article-title: Essential Terrestrial Variable data workflows for distributed water resources modeling
  publication-title: Environmental Modelling & Software
– year: 2019
  article-title: Automated Water Supply Model (AWSM)
  publication-title: Zenodo
– year: 2019
– volume: 120
  year: 2019
  article-title: Enabling collaborative numerical modeling in Earth sciences using knowledge infrastructure
  publication-title: Environmental Modelling & Software
– volume: 15
  start-page: 728
  issue: 8
  year: 2019
  end-page: 730
  article-title: A FAIRer future
  publication-title: Nature Physics
– volume: 420–421
  start-page: 171
  year: 2012
  end-page: 182
  article-title: A review of efficiency criteria suitable for evaluating low‐flow simulations
  publication-title: Journal of Hydrology
– volume: 98
  start-page: 35
  year: 2017
  end-page: 53
  article-title: A user‐friendly software package for VIC hydrologic model development
  publication-title: Environmental Modelling & Software
– year: 2022
  article-title: hydrovorobey/Global_brook90: Zonedo
  publication-title: Zenodo
– volume: 44
  start-page: 5844
  issue: 11
  year: 2017
  end-page: 5853
  article-title: A high‐accuracy map of global terrain elevations: Accurate global terrain elevation map
  publication-title: Geophysical Research Letters
– volume: 9
  start-page: 423
  issue: 3–4
  year: 1995
  end-page: 436
  article-title: Delineating hydrological response units by geographical information system analyses for regional hydrological modelling using PRMS/MMS in the drainage basin of the River Bröl, Germany
  publication-title: Hydrological Processes
– volume: 99
  start-page: 14415
  issue: D7
  year: 1994
  end-page: 14428
  article-title: A simple hydrologically based model of land surface water and energy fluxes for general circulation models
  publication-title: Journal of Geophysical Research
– year: 2021
  article-title: chaneyn/geospatialtools: Geospatialtools_nov2021
  publication-title: Zenodo
– volume: 3
  start-page: 163
  issue: 4
  year: 2016
  end-page: 175
  article-title: Server‐side workflow execution using data grid technology for reproducible analyses of data‐intensive hydrologic systems
  publication-title: Earth and Space Science
– volume: 240
  year: 2020
  article-title: Have satellite precipitation products improved over last two decades? A comprehensive comparison of GPM IMERG with nine satellite and reanalysis datasets
  publication-title: Remote Sensing of Environment
– year: 2020
  article-title: Toward open and reproducible environmental modeling by integrating online data repositories, computational environments, and model application programming interfaces
  publication-title: HydroShare
– volume: 41
  start-page: 295
  issue: 3–4
  year: 2010
  end-page: 319
  article-title: Development and testing of the HYPE (Hydrological Predictions for the Environment) water quality model for different spatial scales
  publication-title: Hydrology Research
– volume: 4
  issue: 1
  year: 2005
  article-title: A set of analytical benchmarks to test numerical models of flow and transport in soils
  publication-title: Vadose Zone Journal
– volume: 115
  issue: D14
  year: 2010
  article-title: Surface temperature lapse rates over complex terrain: Lessons from the Cascade Mountains
  publication-title: Journal of Geophysical Research
– year: 2016
– volume: 46
  start-page: 1
  issue: 5
  year: 2010
  end-page: 25
  article-title: Multiscale parameter regionalization of a grid‐based hydrologic model at the mesoscale
  publication-title: Water Resources Research
– volume: 45
  issue: 2
  year: 2007
  article-title: The Shuttle Radar Topography Mission
  publication-title: Reviews of Geophysics
– volume: 68
  start-page: 205
  year: 2015
  end-page: 218
  article-title: Integration of an energy balance snowmelt model into an open source modeling framework
  publication-title: Environmental Modelling & Software
– volume: 6
  issue: 1
  year: 2019
  article-title: Assessing data availability and research reproducibility in hydrology and water resources
  publication-title: Scientific Data
– year: 2021
  article-title: The numerical implementation of land models: Problem formulation and laugh tests
  publication-title: Journal of Hydrometeorology
– volume: 12
  issue: 7
  year: 2020
  article-title: Global BROOK90 R package: An automatic framework to simulate the water balance at any location
  publication-title: Water
– volume: 3
  issue: 1
  year: 2016
  article-title: The FAIR Guiding Principles for scientific data management and stewardship
  publication-title: Scientific Data
– volume: 8
  issue: 1
  year: 2021
  article-title: A review of hydrologic signatures and their applications
  publication-title: WIREs Water
– volume: 19
  start-page: 101
  issue: 2
  year: 2003
  end-page: 121
  article-title: Redundancy and the choice of hydrologic indices for characterizing streamflow regimes
  publication-title: River Research and Applications
– volume: 146
  start-page: 1999
  issue: 730
  year: 2020
  end-page: 2049
  article-title: The ERA5 global reanalysis
  publication-title: Quarterly Journal of the Royal Meteorological Society
– volume: 222
  start-page: 183
  year: 2019
  end-page: 194
  article-title: Hierarchical mapping of annual global land cover 2001 to present: The MODIS Collection 6 Land Cover product
  publication-title: Remote Sensing of Environment
– start-page: 988
  year: 2009
  end-page: 994
– volume: 5
  issue: 47
  year: 2020
  article-title: MetSim: A Python package for estimation and disaggregation of meteorological data
  publication-title: Journal of Open Source Software
– year: 2009
– volume: 125
  year: 2020
  article-title: HydroDS: Data services in support of physically based, distributed hydrological models
  publication-title: Environmental Modelling & Software
– volume: 3813
  start-page: 3802
  issue: 22
  year: 2008
  end-page: 3813
  article-title: Reconciling theory with observations: Elements of a diagnostic approach to model evaluation
  publication-title: Hydrological Processes
– volume: 19
  start-page: 1374
  issue: 7
  year: 2014
  end-page: 1384
  article-title: Comparison of stochastic optimization algorithms in hydrological Model calibration
  publication-title: Journal of Hydrologic Engineering
– volume: 55
  start-page: 5053
  issue: 6
  year: 2019
  end-page: 5073
  article-title: MERIT Hydro: A high‐resolution global hydrography map based on latest topography dataset
  publication-title: Water Resources Research
– volume: 595
  year: 2021
  article-title: Evaluation of the ERA5 reanalysis precipitation dataset over Chinese Mainland
  publication-title: Journal of Hydrology
– year: 2021
– volume: 23
  start-page: 2601
  issue: 6
  year: 2019
  end-page: 2614
  article-title: On the choice of calibration metrics for “high‐flow” estimation using hydrologic models
  publication-title: Hydrology and Earth System Sciences
– volume: 584
  year: 2020
  article-title: Performance evaluation of satellite‐ and model‐based precipitation products over varying climate and complex topography
  publication-title: Journal of Hydrology
– volume: 7
  issue: 1
  year: 2016
  article-title: Estimating the volume and age of water stored in global lakes using a geo‐statistical approach
  publication-title: Nature Communications
– volume: 55
  start-page: 6499
  issue: 8
  year: 2019
  end-page: 6516
  article-title: Global reconstruction of naturalized river flows at 2.94 million reaches
  publication-title: Water Resources Research
– volume: 53
  start-page: 2568
  issue: 3
  year: 2017
  end-page: 2569
  article-title: Comment on “most computational hydrology is not reproducible, so is it really science?” by Christopher Hutton et al.: Reproducing computational studies
  publication-title: Water Resources Research
– volume: 327
  start-page: 564
  issue: 3–4
  year: 2006
  end-page: 577
  article-title: An advanced regularization methodology for use in watershed model calibration
  publication-title: Journal of Hydrology
– year: 2018
– volume: 89
  issue: 10
  year: 2008
  article-title: New global hydrography derived from spaceborne elevation data
  publication-title: Eos, Transactions American Geophysical Union
– volume: 24
  start-page: 535
  issue: 2
  year: 2020
  end-page: 559
  article-title: Global catchment modelling using World‐Wide HYPE (WWH), open data, and stepwise parameter estimation
  publication-title: Hydrology and Earth System Sciences
– volume: 134
  year: 2020
  article-title: A taxonomy for reproducible and replicable research in environmental modelling
  publication-title: Environmental Modelling & Software
– year: 2021
  article-title: hpcng/singularity: Singularity 3.7.3
  publication-title: Zenodo
– volume: 49
  start-page: 189
  issue: 3
  year: 2011
  end-page: 205
  article-title: Mesoscale temperature patterns in the Rocky Mountains and foothills region of Southern Alberta
  publication-title: Atmosphere‐Ocean
– volume: 10
  start-page: 282
  issue: 3
  year: 1970
  end-page: 290
  article-title: River flow forecasting through conceptual models part I—A discussion of principles
  publication-title: Journal of Hydrology
– volume: 51
  start-page: 7777
  issue: 9
  year: 2015
  end-page: 7784
  article-title: Do we need a community hydrological model?: DO we need a community hydrological model?
  publication-title: Water Resources Research
– volume: 53
  start-page: 2572
  issue: 3
  year: 2017
  end-page: 2574
  article-title: Comment on “most computational hydrology is not reproducible, so is it really science?” by Christopher Hutton et al.: Necessary conditions for reproducibility
  publication-title: Water Resources Research
– volume: 130
  year: 2020
  article-title: Integrating hydrologic modeling web services with online data sharing to prepare, store, and execute hydrologic models
  publication-title: Environmental Modelling & Software
– volume: 78
  start-page: 163
  year: 2016
  end-page: 178
  article-title: Visualization workflows for level‐12 HUC scales: Towards an expert system for watershed analysis in a distributed computing environment
  publication-title: Environmental Modelling & Software
– volume: 157
  year: 2022
  article-title: Watershed workflow: A toolset for parameterizing data‐intensive, integrated hydrologic models
  publication-title: Environmental Modelling & Software
– volume: 8
  start-page: 379
  issue: 2
  year: 2020
  end-page: 397
  article-title: Short communication: Landlab v2.0: A software package for Earth surface dynamics
  publication-title: Earth Surface Dynamics
– volume: 11
  start-page: 1279
  issue: 4
  year: 2007
  end-page: 1294
  article-title: Development of the MESH modelling system for hydrological ensemble forecasting of the Laurentian Great Lakes at the regional scale
  publication-title: Hydrology and Earth System Sciences
– volume: 51
  start-page: 10078
  issue: 12
  year: 2015
  end-page: 10091
  article-title: Accelerating advances in continental domain hydrologic modeling
  publication-title: Water Resources Research
– year: 2018
  article-title: UW‐Hydro/Metsim: Triangular precipitation reference
  publication-title: Zenodo
– volume: 53
  start-page: 4524
  issue: 5
  year: 2017
  end-page: 4526
  article-title: Comment on “Most computational hydrology is not reproducible, so is it really science?” by Christopher Hutton et al.: Let hydrologists learn the latest computer science by working with Research Software Engineers (RSEs) and not reinvent the waterwheel ourselves
  publication-title: Water Resources Research
– year: 2022
  article-title: A flexible multi‐scale framework to simulate lakes and reservoirs in Earth System models (preprint)
  publication-title: Hydrology
– volume: 23
  start-page: 2939
  issue: 7
  year: 2019
  end-page: 2963
  article-title: Using R in hydrology: A review of recent developments and future directions
  publication-title: Hydrology and Earth System Sciences
– volume: 12
  start-page: 10023
  issue: 9
  year: 2015
  end-page: 10066
  article-title: Parameter regionalization of a monthly water balance model for the conterminous United States
  publication-title: Hydrology and Earth System Sciences Discussions
– volume: 24
  start-page: 5953
  issue: 12
  year: 2020
  end-page: 5971
  article-title: Flexible vector‐based spatial configurations in land models
  publication-title: Hydrology and Earth System Sciences
– volume: 17
  start-page: 47
  issue: 1
  year: 2020
  end-page: 51
  article-title: Evaluation of the total, direct, and diffuse solar radiations from the ERA5 reanalysis data in China
  publication-title: IEEE Geoscience and Remote Sensing Letters
– volume: 15
  start-page: 4163
  issue: 10
  year: 2022
  end-page: 4192
  article-title: Evaluating a reservoir parametrization in the vector‐based global routing model mizuRoute (v2.0.1) for Earth system model coupling
  publication-title: Geoscientific Model Development
– volume: XLI‐B4
  start-page: 157
  year: 2016
  end-page: 162
  article-title: Generation of the 30 M‐MESH global digital surface model by Alos PRISM
  publication-title: ISPRS
– volume: 50
  start-page: 2795
  issue: 4
  year: 2014
  end-page: 2797
  article-title: On the future of journal publications in hydrology
  publication-title: Water Resources Research
– volume: 36
  start-page: 756
  year: 2020
  end-page: 765
– volume: 15
  start-page: 365
  issue: 2
  year: 2022
  end-page: 378
  article-title: Inishell 2.0: Semantically driven automatic GUI generation for scientific models
  publication-title: Geoscientific Model Development
– volume: 13
  issue: 6
  year: 2021
  article-title: A vector‐based river routing model for Earth System models: Parallelization and global applications
  publication-title: Journal of Advances in Modeling Earth Systems
– volume: 51
  start-page: 2498
  issue: 4
  year: 2015a
  end-page: 2514
  article-title: A unified approach for process‐based hydrologic modeling: 1. Modeling concept
  publication-title: Water Resources Research
– volume: 27
  start-page: 2171
  issue: 15
  year: 2013
  end-page: 2186
  article-title: Global river hydrography and network routing: Baseline data and new approaches to study the world’s large river systems: Global river hydrography and network routing
  publication-title: Hydrological Processes
– volume: 23
  start-page: 207
  issue: 1
  year: 2019
  end-page: 224
  article-title: Daily evaluation of 26 precipitation datasets using Stage‐IV gauge‐radar data for the CONUS
  publication-title: Hydrology and Earth System Sciences
– volume: 3
  start-page: 388
  issue: 10
  year: 2016
  end-page: 415
  article-title: Toward the Geoscience Paper of the future: Best practices for documenting and sharing research from data to software to provenance
  publication-title: Earth and Space Science
– volume: 11
  start-page: 3481
  issue: 8
  year: 2018
  end-page: 3496
  article-title: The Variable Infiltration Capacity model version 5 (VIC‐5): Infrastructure improvements for new applications and reproducibility
  publication-title: Geoscientific Model Development
– volume: 111
  start-page: 121
  year: 2019
  end-page: 133
  article-title: Development of a participatory Green Infrastructure design, visualization and evaluation system in a cloud supported jupyter notebook computing environment
  publication-title: Environmental Modelling & Software
– volume: 61
  start-page: 174
  year: 2014
  end-page: 190
  article-title: Automating data‐model workflows at a level 12 HUC scale: Watershed modeling in a distributed computing environment
  publication-title: Environmental Modelling & Software
– year: 2017
– year: 2013
  article-title: Best practices for computational science: Software infrastructure and environments for reproducible and extensible research
  publication-title: SSRN Electronic Journal
– volume: 122
  year: 2019
  article-title: Models of everywhere revisited: A technological perspective
  publication-title: Environmental Modelling & Software
– volume: 24
  year: 2019
  article-title: Evaluation of variability among different precipitation products in the Northern Great Plains
  publication-title: Journal of Hydrology: Regional Studies
SSID ssj0014567
Score 2.5015342
Snippet Despite the proliferation of computer‐based research on hydrology and water resources, such research is typically poorly reproducible. Published studies have...
SourceID unpaywall
wiley
SourceType Open Access Repository
Publisher
SubjectTerms community modeling
Earth System models
hydrology
reproducibility
SummonAdditionalLinks – databaseName: Wiley Online Library (Open Access collection)
  dbid: 24P
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dSsMwFA46L6YX4i_OP3IhXllc0i5ZvRvTMURFpmO7G2mTzMFsx9oxeucj-Ea-i09iTtONCd54V0LSFs5J8iXf-c5B6KIe0tDnUpljqqsdT3Pm-DT0HE95wuD3oMoCYHQfn1i76933a_3iwg20MDY_xPLCDWZGvl7DBBdBUiQbgByZ5tROep0q7H_uOtogBsqAh1PveckiGHDAFwwzIJ0i8N2Mv14dvYXKs2gisrkYj39j1HyTae2g7QId4oY15y5aU9EeKi_Ew4l5LoqWv2X76KsQd6QZhitvPY7nCU5j3LC0PjbYOk_nauNfMzyKcDuTU7vaYSiCBlL0G_yibP7vaGgbvz8-GxB-Z_4Bi0guG_NS9do0gkpwNJxZ38EQJ5bAyxsrXDiONX6AIHMz7jZ-F398OzlA3dbda7PtFPUYHGFOYcxhNREakwvm-9InwH-6ite15CCHrXPJpOC0yqkMtCZc1HVAtfJkVSlSk9zghkNUiuJIHSHMuKtdGpKQyNDjTAaShLxGjGMophjRFXS5NMlgYvNuDHK-nPoDsN18am1XQVe5vf7stDDwoNdpdiijPjv-X_cTtElB7pBrD09RKZ3O1JkBIWlwnnvaD0LQ208
  priority: 102
  providerName: Wiley-Blackwell
Title Community Workflows to Advance Reproducibility in Hydrologic Modeling: Separating Model‐Agnostic and Model‐Specific Configuration Steps in Applications of Large‐Domain Hydrologic Models
URI https://onlinelibrary.wiley.com/doi/abs/10.1029%2F2021WR031753
https://onlinelibrary.wiley.com/doi/pdfdirect/10.1029/2021WR031753
UnpaywallVersion publishedVersion
Volume 58
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3NTtwwEB7BckA9lNIfQQXIB8SpQWvHsde9RVC0qgpCS1fQ08rxD0VdktVuVqv01EfoG_EuPEntOFltKw6VuEVWxnHk8fgbzzdjgMOeIkpwbZybGtuIWs4iQRSNqKHS4fesyzIf0T2_YP0h_XyT3KzkwoT6EMsDN78yanvtF_hE22Dnm5IDwnvu-HrQ9XtgvA4bLHF4vAMbw4vL9FsbWvYQpw4tUxpxweOG_d6KL6ZB_AVszvOJrBZyPP4bqNY7zdkWqHaMgWDy43heZsfq5z_lG5_3E6_gZQNEURo0ZxvWTP4aNts85Zl7bu5H_169gYcmj6SskD9dt-NiMUNlgdLAIEAOxteVYwPVtkJ3OepXehoMK_L3rfms94_oyoRS4_ltaHz89Tv1TD83BiRzvWy8mpiaK4h8QuLd7TyoKfKUtJnvPF0Ju6PCoi-ez-7kTot7-cS3Z29hePbp60k_aq5-iKRz-FjEEqmcdkkmhBbYh1pjw3tWc5952-OaaclJlxOdWYu57NmMWEN11xicaO4gyjvo5EVudgAxHtuYKKywVpQznWmseIKdDhpmGLa7cLSc-NEklPgY1aF5IkarGrILH-qpfPKldgJH14OTAWFEsPf_2-8edMrp3Ow7cFNmB7BO6OVBo8N_AGg5_vs
linkProvider Unpaywall
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwELVYDoUDYhVl9QFxIqJ2XLvhVrGoQItQAcEtcmK7VCoJ6qIqNz6BP-Jf-BI8cVoViQu3yLKTSM_LG8-8GYSOajGNA6G0NVN94zEjuBfQmHlMM2n5e1ThEXh0W3e88cRuXqovRZ1T0MK4_BDTCzdYGfl-DQscLqSLbAOQJNOa7eS5XYED0J9Hi4wTDtYXZfdTN4JlB2LiYgaqU0S-2_Gns6OXUWmUvMtsLHu93yQ1P2WuVtFKQQ9x3eG5huZ0so5KE_XwwD4XVctfsw30Vag7hhmGO2_TS8cDPExx3fn1sSXXeT5XFwCb4W6CG5nqu-0OQxU00KKf4QftEoAnHdf4_fFZh_g7-w9YJmramNeqN7YRZILdzshNHgyBYgN4eX3GGY5Tg5sQZW7HXaRv8o9vDzbR09Xl43nDKwoyeNKaYdzjVRlbzCUPAhUQcID6WtSMEqCHrQnFlRS0IqiKjCFC1kxEjWaqojWpKmGJwxZaSNJEbyPMhW98GpOYqJgJriJFYlEldmZorjkxZXQ8hSR8d4k3wtxhToMQsBv3HXZldJLj9WenCcDhc_u8TTkN-M7_uh-iUuOx1Qyb13e3u2iJgvYhFyLuoYVhf6T3LSMZRgf5rPsBHLDeuw
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwELVYJJYDYhU7PiBORNSOYzfcqpaqrEIFBLfIiW1AKknVRVVufAJ_xL_wJXjitAKJC7fIspNIb2w_e-bNIHRYTWgSCqXtMdU3HjOCeyFNmMc0k5a_xxUeg0f3-oa3HtjFU_BU1jkFLYzLDzG5cIOZUazXMMF1V5ky2wAkybTHdvLYrsAG6E-jWRbYzRBSO7PbiRvBsgMxdjED1Skj3-34k5-jF9H8MO3KfCQ7nd8ktdhlmstoqaSHuObwXEFTOl1F82P1cN8-l1XLX_I19FmqOwY5hjtv08lGfTzIcM359bEl10U-VxcAm-PXFLdy1XPLHYYqaKBFP8V32iUAT59d49f7Rw3i7-w_YJmqSWNRq97YRpAJvj4PnfFgCBTrw8trP5zhODP4CqLM7bhG9ib_-HZ_HT00z-7rLa8syOBJewzjHg9kYjGXPAxVSMAB6mtRNUqAHrYqFFdS0IqgKjaGCFk1MTWaqYrWJFDCEocNNJNmqd5EmAvf-DQhCVEJE1zFiiQiINYyNNecmC10NIEk6rrEG1HhMKdhBNiNeg67LXRc4PVnpzHA0WO73qachnz7f90P0Nxtoxldnd9c7qAFCtKHQoe4i2YGvaHes4RkEO8XRvcNAZjeSg
linkToUnpaywall http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1Pa9swFBddcgg7tOv-0Ixt6FB2mksky1K0m0kXwmhLSRbanYKsP2loaofEIXinfoR9o32XfpJJlh2y0sOgNyP8ZBk9Pf2e3u89AXDclVhyprR1U0MTEMNowLEkAdFEWPyedGjiIrrnF3QwJt-vo-udXBhfH2J74OZWRmmv3QJfKOPtfFVygDvPHV0NO24PDF-AJo0sHm-A5vjiMv5Zh5YdxClDy4QEjLOwYr_X4pulF38JWut0IYqNmM__BarlTtM_ALIeoyeY3J6s8-RE_npUvvF5P_EK7FdAFMZecw7Bnk5fg1adp7yyz9X96DfFG_CnyiPJC-hO180826xgnsHYMwighfFl5VhPtS3gLIWDQi29YYXuvjWX9f4VjrQvNZ5OfePD_e_YMf3sGKBI1bZxtNAlVxC6hMTZdO3VFDpK2sp1Hu-E3WFm4Jnjs1u50-xOPPHt1Vsw7n_70RsE1dUPgbAOHw1oJKTVLkE5Vxy5UGuoWdco5jJvu0xRJRjuMKwSYxATXZNgo4nqaI0ixSxEeQcaaZbqIwApC02IJZJIScKoShSSLEJWBzXVFJk2-Lyd-MnCl_iYlKF5zCe7GtIGX8qpfPKlegInV8PeEFPM6fv_7fcDaOTLtf5owU2efKq09y90Yf4k
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Community+Workflows+to+Advance+Reproducibility+in+Hydrologic+Modeling%3A+Separating+Model%E2%80%90Agnostic+and+Model%E2%80%90Specific+Configuration+Steps+in+Applications+of+Large%E2%80%90Domain+Hydrologic+Models&rft.jtitle=Water+resources+research&rft.au=Knoben%2C+W.+J.+M.&rft.au=Clark%2C+M.+P.&rft.au=Bales%2C+J.&rft.au=Bennett%2C+A.&rft.date=2022-11-01&rft.issn=0043-1397&rft.eissn=1944-7973&rft.volume=58&rft.issue=11&rft.epage=n%2Fa&rft_id=info:doi/10.1029%2F2021WR031753&rft.externalDBID=10.1029%252F2021WR031753&rft.externalDocID=WRCR26296
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0043-1397&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0043-1397&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0043-1397&client=summon