Community Workflows to Advance Reproducibility in Hydrologic Modeling: Separating Model‐Agnostic and Model‐Specific Configuration Steps in Applications of Large‐Domain Hydrologic Models
Despite the proliferation of computer‐based research on hydrology and water resources, such research is typically poorly reproducible. Published studies have low reproducibility due to incomplete availability of data and computer code, and a lack of documentation of workflow processes. This leads to...
Saved in:
| Published in | Water resources research Vol. 58; no. 11 |
|---|---|
| Main Authors | , , , , , , , , , , , |
| Format | Journal Article |
| Language | English |
| Published |
01.11.2022
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 0043-1397 1944-7973 1944-7973 |
| DOI | 10.1029/2021WR031753 |
Cover
| Abstract | Despite the proliferation of computer‐based research on hydrology and water resources, such research is typically poorly reproducible. Published studies have low reproducibility due to incomplete availability of data and computer code, and a lack of documentation of workflow processes. This leads to a lack of transparency and efficiency because existing code can neither be quality controlled nor reused. Given the commonalities between existing process‐based hydrologic models in terms of their required input data and preprocessing steps, open sharing of code can lead to large efficiency gains for the modeling community. Here, we present a model configuration workflow that provides full reproducibility of the resulting model instantiations in a way that separates the model‐agnostic preprocessing of specific data sets from the model‐specific requirements that models impose on their input files. We use this workflow to create large‐domain (global and continental) and local configurations of the Structure for Unifying Multiple Modeling Alternatives (SUMMA) hydrologic model connected to the mizuRoute routing model. These examples show how a relatively complex model setup over a large domain can be organized in a reproducible and structured way that has the potential to accelerate advances in hydrologic modeling for the community as a whole. We provide a tentative blueprint of how community modeling initiatives can be built on top of workflows such as this. We term our workflow the “Community Workflows to Advance Reproducibility in Hydrologic Modeling” (CWARHM; pronounced “swarm”).
Key Points
Reproducible, transparent modeling increases confidence in model simulations and requires careful tracking of all model configuration steps
We show an example of model configuration code applied globally that is traced and shared through a version control system
Standardizing file formats and sharing of code can increase efficiency and reproducibility of modeling studies |
|---|---|
| AbstractList | Despite the proliferation of computer‐based research on hydrology and water resources, such research is typically poorly reproducible. Published studies have low reproducibility due to incomplete availability of data and computer code, and a lack of documentation of workflow processes. This leads to a lack of transparency and efficiency because existing code can neither be quality controlled nor reused. Given the commonalities between existing process‐based hydrologic models in terms of their required input data and preprocessing steps, open sharing of code can lead to large efficiency gains for the modeling community. Here, we present a model configuration workflow that provides full reproducibility of the resulting model instantiations in a way that separates the model‐agnostic preprocessing of specific data sets from the model‐specific requirements that models impose on their input files. We use this workflow to create large‐domain (global and continental) and local configurations of the Structure for Unifying Multiple Modeling Alternatives (SUMMA) hydrologic model connected to the mizuRoute routing model. These examples show how a relatively complex model setup over a large domain can be organized in a reproducible and structured way that has the potential to accelerate advances in hydrologic modeling for the community as a whole. We provide a tentative blueprint of how community modeling initiatives can be built on top of workflows such as this. We term our workflow the “Community Workflows to Advance Reproducibility in Hydrologic Modeling” (CWARHM; pronounced “swarm”).
Key Points
Reproducible, transparent modeling increases confidence in model simulations and requires careful tracking of all model configuration steps
We show an example of model configuration code applied globally that is traced and shared through a version control system
Standardizing file formats and sharing of code can increase efficiency and reproducibility of modeling studies |
| Author | Knoben, W. J. M. Wood, A. W. Pietroniro, A. Bennett, A. Tang, G. Bales, J. Tarboton, D. G. Nijssen, B. Clark, M. P. Gharari, S. Spiteri, R. J. Marsh, C. B. |
| Author_xml | – sequence: 1 givenname: W. J. M. orcidid: 0000-0001-8301-3787 surname: Knoben fullname: Knoben, W. J. M. email: wouter.knoben@usask.ca organization: University of Saskatchewan – sequence: 2 givenname: M. P. orcidid: 0000-0002-2186-2625 surname: Clark fullname: Clark, M. P. organization: University of Saskatchewan – sequence: 3 givenname: J. surname: Bales fullname: Bales, J. organization: Consortium of Universities for the Advancement of Hydrologic Science, Inc – sequence: 4 givenname: A. orcidid: 0000-0002-7742-3138 surname: Bennett fullname: Bennett, A. organization: University of Arizona – sequence: 5 givenname: S. orcidid: 0000-0002-5358-5714 surname: Gharari fullname: Gharari, S. organization: University of Saskatchewan – sequence: 6 givenname: C. B. orcidid: 0000-0002-1372-4513 surname: Marsh fullname: Marsh, C. B. organization: University of Saskatchewan – sequence: 7 givenname: B. orcidid: 0000-0002-4062-0322 surname: Nijssen fullname: Nijssen, B. organization: University of Washington – sequence: 8 givenname: A. orcidid: 0000-0001-5792-9177 surname: Pietroniro fullname: Pietroniro, A. organization: University of Calgary – sequence: 9 givenname: R. J. orcidid: 0000-0002-3513-6237 surname: Spiteri fullname: Spiteri, R. J. organization: University of Saskatchewan – sequence: 10 givenname: G. orcidid: 0000-0002-0923-583X surname: Tang fullname: Tang, G. organization: University of Saskatchewan – sequence: 11 givenname: D. G. orcidid: 0000-0002-1998-3479 surname: Tarboton fullname: Tarboton, D. G. organization: Utah State University – sequence: 12 givenname: A. W. orcidid: 0000-0002-6231-0085 surname: Wood fullname: Wood, A. W. organization: National Center for Atmospheric Research |
| BookMark | eNptkU1OwzAQhS1UJNrCjgP4AgH_JHbNrgo_RSpCakFdRm5sRwbXjpKUKjuOwI24CychocCqqxk9fe-N9GYEBj54DcA5RhcYEXFJEMGrBaKYJ_QIDLGI44gLTgdgiFBMI0wFPwGjun5BCMcJ40PwmYbNZutt08JVqF6NC7saNgFO1Zv0uYYLXVZBbXO7tq6HrIezVlXBhcLm8CEo7awvruBSl7KSTbfvxa_3j2nhQ910lPTqX1yWOremE9PgjS22vSd4uGx0Wffh07J0Nv8RaxgMnMuq0J3vOmzkgdv1KTg20tX67HeOwfPtzVM6i-aPd_fpdB7JGGEWsUTma51LJoQSOEGUUs0nRvGYMDHhiinJCeJErY3BXE7MmhgdK6Q1ThRnmI5BtM_d-lK2O-lcVlZ2I6s2wyjr28_69nfVvv2Op3t-Z51uD7J_n8pWi3RBGBGMfgOOsJDb |
| CitedBy_id | crossref_primary_10_1007_s10586_024_04318_5 crossref_primary_10_1016_j_jhydrol_2023_129820 crossref_primary_10_1029_2022WR033363 crossref_primary_10_1080_07011784_2023_2224280 crossref_primary_10_1016_j_envsoft_2023_105808 crossref_primary_10_1029_2022WR033767 crossref_primary_10_5194_hess_28_4127_2024 crossref_primary_10_1016_j_envsoft_2023_105902 crossref_primary_10_1016_j_softx_2023_101547 crossref_primary_10_1111_jfr3_12895 crossref_primary_10_5194_gmd_17_4561_2024 crossref_primary_10_1016_j_envsoft_2023_105689 |
| ContentType | Journal Article |
| Copyright | 2022. The Authors. |
| Copyright_xml | – notice: 2022. The Authors. |
| DBID | 24P ADTOC UNPAY |
| DOI | 10.1029/2021WR031753 |
| DatabaseName | Wiley Online Library (Open Access collection) Unpaywall for CDI: Periodical Content Unpaywall |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: 24P name: Wiley Online Library Open Access url: https://authorservices.wiley.com/open-science/open-access/browse-journals.html sourceTypes: Publisher – sequence: 2 dbid: UNPAY name: Unpaywall url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/ sourceTypes: Open Access Repository |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Geography Economics |
| EISSN | 1944-7973 |
| EndPage | n/a |
| ExternalDocumentID | 10.1029/2021wr031753 WRCR26296 |
| Genre | article |
| GrantInformation_xml | – fundername: US National Science Foundation funderid: ICER 1928369; OAC 1835569; EAR 1849458 – fundername: DOD, US Army, U.S. Army Corps of Engineers, DOI, Bureau of Reclamation funderid: R16AC00039 – fundername: CFREF, Global Water Futures |
| GroupedDBID | -~X ..I .DC 05W 0R~ 123 1OB 1OC 24P 31~ 33P 3V. 50Y 5VS 6TJ 7WY 7XC 8-1 8CJ 8FE 8FG 8FH 8FL 8G5 8R4 8R5 8WZ A00 A6W AAESR AAHBH AAHHS AAIHA AAIKC AAMNW AANHP AANLZ AASGY AAXRX AAYCA AAYJJ AAYOK AAZKR ABCUV ABJCF ABJNI ABPPZ ABTAH ABUWG ACAHQ ACBWZ ACCFJ ACCMX ACCZN ACGFO ACGFS ACIWK ACKIV ACNCT ACPOU ACPRK ACRPL ACXBN ACXQS ACYXJ ADBBV ADEOM ADKYN ADMGS ADNMO ADOZA ADXAS ADZMN AEEZP AEIGN AENEX AEQDE AEUYN AEUYR AFBPY AFGKR AFKRA AFPWT AFRAH AFWVQ AFZJQ AIDBO AIURR AIWBW AJBDE ALMA_UNASSIGNED_HOLDINGS ALUQN ALXUD AMYDB ASPBG ATCPS AVWKF AZFZN AZQEC AZVAB BDRZF BENPR BEZIV BFHJK BGLVJ BHPHI BKSAR BMXJE BPHCQ BRXPI CCPQU CS3 D0L D1J DCZOG DDYGU DPXWK DRFUL DRSTM DU5 DWQXO EBS EJD F5P FEDTE FRNLG G-S GNUQQ GODZA GROUPED_ABI_INFORM_COMPLETE GUQSH HCIFZ HVGLF HZ~ K60 K6~ L6V LATKE LEEKS LITHE LK5 LOXES LUTES LYRES M0C M2O M7R M7S MEWTI MSFUL MSSTM MVM MW2 MXFUL MXSTM MY~ O9- OHT OK1 P-X P2P P2W PALCI PATMY PCBAR PQBIZ PQBZA PQQKQ PROAC PTHSS PYCSY Q2X R.K RIWAO RJQFR ROL SAMSI SUPJJ TAE TN5 TWZ UQL VJK VOH WBKPD WXSBR WYJ XOL XSW YHZ YV5 ZCG ZY4 ZZTAW ~02 ~KM ~OA ~~A AAMMB ADTOC ADXHL AEFGJ AETEA AGQPQ AGXDD AIDQK AIDYY AIQQE GROUPED_DOAJ PHGZM PHGZT PQGLB UNPAY WIN |
| ID | FETCH-LOGICAL-a4016-65acbeca699d9150333e78fd7426987d6da72072dbff17a8fb2fe4d0ee15d7613 |
| IEDL.DBID | UNPAY |
| ISSN | 0043-1397 1944-7973 |
| IngestDate | Sun Oct 26 04:16:38 EDT 2025 Wed Jan 22 16:22:50 EST 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 11 |
| Language | English |
| License | Attribution cc-by |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-a4016-65acbeca699d9150333e78fd7426987d6da72072dbff17a8fb2fe4d0ee15d7613 |
| ORCID | 0000-0002-3513-6237 0000-0002-1372-4513 0000-0002-6231-0085 0000-0002-2186-2625 0000-0002-4062-0322 0000-0002-7742-3138 0000-0002-5358-5714 0000-0002-0923-583X 0000-0001-8301-3787 0000-0001-5792-9177 0000-0002-1998-3479 |
| OpenAccessLink | https://proxy.k.utb.cz/login?url=https://onlinelibrary.wiley.com/doi/pdfdirect/10.1029/2021WR031753 |
| PageCount | 37 |
| ParticipantIDs | unpaywall_primary_10_1029_2021wr031753 wiley_primary_10_1029_2021WR031753_WRCR26296 |
| PublicationCentury | 2000 |
| PublicationDate | November 2022 |
| PublicationDateYYYYMMDD | 2022-11-01 |
| PublicationDate_xml | – month: 11 year: 2022 text: November 2022 |
| PublicationDecade | 2020 |
| PublicationTitle | Water resources research |
| PublicationYear | 2022 |
| References | 2017; 5 2016; XLI‐B4 2013; 27 2020; 240 2019; 55 2017; 44 2019; 15 2020; 17 2020; 12 2003; 19 2020; 125 2008; 3813 2014; 61 2019; 122 2019; 120 2016; 78 2013; 9 2020; 8 2020; 7 2020; 5 2020; 130 2019; 24 2019; 23 2013; 50 2010; 115 2012; 420–421 2014; 19 2020; 134 2021; 595 2011; 26 2014; 50 2006; 327 2019; 111 2006; 92 2015; 12 1995; 9 2021; 8 2019; 6 2011 2015; 51 2009 2016; 52 1970; 10 2020; 36 2020; 144 2020; 584 2020; 146 2015; 448 2016; 17 2007; 11 2010; 41 2019; 222 2022; 157 2015; 68 2021; 57 2021; 13 2017; 53 2016; 7 2016; 3 2010; 46 2021; 135 2022 2021 2015a; 51 2020 2017; 98 2017; 12 2019 1994; 99 2005; 4 2018 2008; 89 2022; 15 2017 2020; 24 2016 2014 2013 2015b; 51 2011; 49 2018; 11 2007; 45 2016; 9 1988; 116 |
| References_xml | – year: 2011 – volume: 12 issue: 2 year: 2017 article-title: SoilGrids250m: Global gridded soil information based on machine learning publication-title: PLoS One – volume: 57 issue: 9 year: 2021 article-title: The abuse of popular performance metrics in hydrologic modeling publication-title: Water Resources Research – volume: 9 issue: 10 year: 2013 article-title: Ten simple rules for reproducible computational research publication-title: PLoS Computational Biology – volume: 5 start-page: 21 issue: 1 year: 2017 end-page: 46 article-title: Creative computing with Landlab: An open‐source toolkit for building, coupling, and exploring two‐dimensional numerical models of Earth‐surface dynamics publication-title: Earth Surface Dynamics – volume: 135 year: 2021 article-title: Toward open and reproducible environmental modeling by integrating online data repositories, computational environments, and model Application Programming Interfaces publication-title: Environmental Modelling & Software – volume: 9 start-page: 2223 issue: 6 year: 2016 end-page: 2238 article-title: mizuRoute version 1: A river network routing tool for a continental domain water resources applications publication-title: Geoscientific Model Development – volume: 51 start-page: 2515 issue: 4 year: 2015b end-page: 2542 article-title: A unified approach for process‐based hydrologic modeling: 2. Model implementation and case studies publication-title: Water Resources Research – volume: 144 year: 2020 article-title: Automated Water Supply Model (AWSM): Streamlining and standardizing application of a physically based snow model for water resources and reproducible science publication-title: Computers & Geosciences – year: 2014 – volume: 92 year: 2006 – volume: 57 issue: 4 year: 2021 article-title: Open science: Open data, open models, … and open publications? publication-title: Water Resources Research – volume: 17 start-page: 2293 issue: 8 year: 2016 end-page: 2313 article-title: The multibudget soil, vegetation, and snow (SVS) scheme for land surface parameterization: Offline warm season evaluation publication-title: Journal of Hydrometeorology – year: 2022 – volume: 116 start-page: 2417 issue: 12 year: 1988 end-page: 2424 article-title: Skill scores based on the mean square error and their relationships to the correlation coefficient publication-title: Monthly Weather Review – volume: 26 start-page: 1696 issue: 12 year: 2011 end-page: 1709 article-title: Extraction of hydrological proximity measures from DEMs using parallel processing publication-title: Environmental Modelling & Software – volume: 7 issue: 5 year: 2020 article-title: Environmental lapse rate for high‐resolution land surface downscaling: An application to ERA5 publication-title: Earth and Space Science – volume: 448 start-page: 311 year: 2015 end-page: 320 – year: 2022 article-title: CH‐Earth/CWARHM: CWARHM workflow updates during peer review publication-title: Zenodo – volume: 52 start-page: 7548 issue: 10 year: 2016 end-page: 7555 article-title: Most computational hydrology is not reproducible, so is it really science?: Reproducible computational hydrology publication-title: Water Resources Research – volume: 12 issue: 5 year: 2017 article-title: Singularity: Scientific containers for mobility of compute publication-title: PLoS One – volume: 50 start-page: 85 year: 2013 end-page: 96 article-title: Essential Terrestrial Variable data workflows for distributed water resources modeling publication-title: Environmental Modelling & Software – year: 2019 article-title: Automated Water Supply Model (AWSM) publication-title: Zenodo – year: 2019 – volume: 120 year: 2019 article-title: Enabling collaborative numerical modeling in Earth sciences using knowledge infrastructure publication-title: Environmental Modelling & Software – volume: 15 start-page: 728 issue: 8 year: 2019 end-page: 730 article-title: A FAIRer future publication-title: Nature Physics – volume: 420–421 start-page: 171 year: 2012 end-page: 182 article-title: A review of efficiency criteria suitable for evaluating low‐flow simulations publication-title: Journal of Hydrology – volume: 98 start-page: 35 year: 2017 end-page: 53 article-title: A user‐friendly software package for VIC hydrologic model development publication-title: Environmental Modelling & Software – year: 2022 article-title: hydrovorobey/Global_brook90: Zonedo publication-title: Zenodo – volume: 44 start-page: 5844 issue: 11 year: 2017 end-page: 5853 article-title: A high‐accuracy map of global terrain elevations: Accurate global terrain elevation map publication-title: Geophysical Research Letters – volume: 9 start-page: 423 issue: 3–4 year: 1995 end-page: 436 article-title: Delineating hydrological response units by geographical information system analyses for regional hydrological modelling using PRMS/MMS in the drainage basin of the River Bröl, Germany publication-title: Hydrological Processes – volume: 99 start-page: 14415 issue: D7 year: 1994 end-page: 14428 article-title: A simple hydrologically based model of land surface water and energy fluxes for general circulation models publication-title: Journal of Geophysical Research – year: 2021 article-title: chaneyn/geospatialtools: Geospatialtools_nov2021 publication-title: Zenodo – volume: 3 start-page: 163 issue: 4 year: 2016 end-page: 175 article-title: Server‐side workflow execution using data grid technology for reproducible analyses of data‐intensive hydrologic systems publication-title: Earth and Space Science – volume: 240 year: 2020 article-title: Have satellite precipitation products improved over last two decades? A comprehensive comparison of GPM IMERG with nine satellite and reanalysis datasets publication-title: Remote Sensing of Environment – year: 2020 article-title: Toward open and reproducible environmental modeling by integrating online data repositories, computational environments, and model application programming interfaces publication-title: HydroShare – volume: 41 start-page: 295 issue: 3–4 year: 2010 end-page: 319 article-title: Development and testing of the HYPE (Hydrological Predictions for the Environment) water quality model for different spatial scales publication-title: Hydrology Research – volume: 4 issue: 1 year: 2005 article-title: A set of analytical benchmarks to test numerical models of flow and transport in soils publication-title: Vadose Zone Journal – volume: 115 issue: D14 year: 2010 article-title: Surface temperature lapse rates over complex terrain: Lessons from the Cascade Mountains publication-title: Journal of Geophysical Research – year: 2016 – volume: 46 start-page: 1 issue: 5 year: 2010 end-page: 25 article-title: Multiscale parameter regionalization of a grid‐based hydrologic model at the mesoscale publication-title: Water Resources Research – volume: 45 issue: 2 year: 2007 article-title: The Shuttle Radar Topography Mission publication-title: Reviews of Geophysics – volume: 68 start-page: 205 year: 2015 end-page: 218 article-title: Integration of an energy balance snowmelt model into an open source modeling framework publication-title: Environmental Modelling & Software – volume: 6 issue: 1 year: 2019 article-title: Assessing data availability and research reproducibility in hydrology and water resources publication-title: Scientific Data – year: 2021 article-title: The numerical implementation of land models: Problem formulation and laugh tests publication-title: Journal of Hydrometeorology – volume: 12 issue: 7 year: 2020 article-title: Global BROOK90 R package: An automatic framework to simulate the water balance at any location publication-title: Water – volume: 3 issue: 1 year: 2016 article-title: The FAIR Guiding Principles for scientific data management and stewardship publication-title: Scientific Data – volume: 8 issue: 1 year: 2021 article-title: A review of hydrologic signatures and their applications publication-title: WIREs Water – volume: 19 start-page: 101 issue: 2 year: 2003 end-page: 121 article-title: Redundancy and the choice of hydrologic indices for characterizing streamflow regimes publication-title: River Research and Applications – volume: 146 start-page: 1999 issue: 730 year: 2020 end-page: 2049 article-title: The ERA5 global reanalysis publication-title: Quarterly Journal of the Royal Meteorological Society – volume: 222 start-page: 183 year: 2019 end-page: 194 article-title: Hierarchical mapping of annual global land cover 2001 to present: The MODIS Collection 6 Land Cover product publication-title: Remote Sensing of Environment – start-page: 988 year: 2009 end-page: 994 – volume: 5 issue: 47 year: 2020 article-title: MetSim: A Python package for estimation and disaggregation of meteorological data publication-title: Journal of Open Source Software – year: 2009 – volume: 125 year: 2020 article-title: HydroDS: Data services in support of physically based, distributed hydrological models publication-title: Environmental Modelling & Software – volume: 3813 start-page: 3802 issue: 22 year: 2008 end-page: 3813 article-title: Reconciling theory with observations: Elements of a diagnostic approach to model evaluation publication-title: Hydrological Processes – volume: 19 start-page: 1374 issue: 7 year: 2014 end-page: 1384 article-title: Comparison of stochastic optimization algorithms in hydrological Model calibration publication-title: Journal of Hydrologic Engineering – volume: 55 start-page: 5053 issue: 6 year: 2019 end-page: 5073 article-title: MERIT Hydro: A high‐resolution global hydrography map based on latest topography dataset publication-title: Water Resources Research – volume: 595 year: 2021 article-title: Evaluation of the ERA5 reanalysis precipitation dataset over Chinese Mainland publication-title: Journal of Hydrology – year: 2021 – volume: 23 start-page: 2601 issue: 6 year: 2019 end-page: 2614 article-title: On the choice of calibration metrics for “high‐flow” estimation using hydrologic models publication-title: Hydrology and Earth System Sciences – volume: 584 year: 2020 article-title: Performance evaluation of satellite‐ and model‐based precipitation products over varying climate and complex topography publication-title: Journal of Hydrology – volume: 7 issue: 1 year: 2016 article-title: Estimating the volume and age of water stored in global lakes using a geo‐statistical approach publication-title: Nature Communications – volume: 55 start-page: 6499 issue: 8 year: 2019 end-page: 6516 article-title: Global reconstruction of naturalized river flows at 2.94 million reaches publication-title: Water Resources Research – volume: 53 start-page: 2568 issue: 3 year: 2017 end-page: 2569 article-title: Comment on “most computational hydrology is not reproducible, so is it really science?” by Christopher Hutton et al.: Reproducing computational studies publication-title: Water Resources Research – volume: 327 start-page: 564 issue: 3–4 year: 2006 end-page: 577 article-title: An advanced regularization methodology for use in watershed model calibration publication-title: Journal of Hydrology – year: 2018 – volume: 89 issue: 10 year: 2008 article-title: New global hydrography derived from spaceborne elevation data publication-title: Eos, Transactions American Geophysical Union – volume: 24 start-page: 535 issue: 2 year: 2020 end-page: 559 article-title: Global catchment modelling using World‐Wide HYPE (WWH), open data, and stepwise parameter estimation publication-title: Hydrology and Earth System Sciences – volume: 134 year: 2020 article-title: A taxonomy for reproducible and replicable research in environmental modelling publication-title: Environmental Modelling & Software – year: 2021 article-title: hpcng/singularity: Singularity 3.7.3 publication-title: Zenodo – volume: 49 start-page: 189 issue: 3 year: 2011 end-page: 205 article-title: Mesoscale temperature patterns in the Rocky Mountains and foothills region of Southern Alberta publication-title: Atmosphere‐Ocean – volume: 10 start-page: 282 issue: 3 year: 1970 end-page: 290 article-title: River flow forecasting through conceptual models part I—A discussion of principles publication-title: Journal of Hydrology – volume: 51 start-page: 7777 issue: 9 year: 2015 end-page: 7784 article-title: Do we need a community hydrological model?: DO we need a community hydrological model? publication-title: Water Resources Research – volume: 53 start-page: 2572 issue: 3 year: 2017 end-page: 2574 article-title: Comment on “most computational hydrology is not reproducible, so is it really science?” by Christopher Hutton et al.: Necessary conditions for reproducibility publication-title: Water Resources Research – volume: 130 year: 2020 article-title: Integrating hydrologic modeling web services with online data sharing to prepare, store, and execute hydrologic models publication-title: Environmental Modelling & Software – volume: 78 start-page: 163 year: 2016 end-page: 178 article-title: Visualization workflows for level‐12 HUC scales: Towards an expert system for watershed analysis in a distributed computing environment publication-title: Environmental Modelling & Software – volume: 157 year: 2022 article-title: Watershed workflow: A toolset for parameterizing data‐intensive, integrated hydrologic models publication-title: Environmental Modelling & Software – volume: 8 start-page: 379 issue: 2 year: 2020 end-page: 397 article-title: Short communication: Landlab v2.0: A software package for Earth surface dynamics publication-title: Earth Surface Dynamics – volume: 11 start-page: 1279 issue: 4 year: 2007 end-page: 1294 article-title: Development of the MESH modelling system for hydrological ensemble forecasting of the Laurentian Great Lakes at the regional scale publication-title: Hydrology and Earth System Sciences – volume: 51 start-page: 10078 issue: 12 year: 2015 end-page: 10091 article-title: Accelerating advances in continental domain hydrologic modeling publication-title: Water Resources Research – year: 2018 article-title: UW‐Hydro/Metsim: Triangular precipitation reference publication-title: Zenodo – volume: 53 start-page: 4524 issue: 5 year: 2017 end-page: 4526 article-title: Comment on “Most computational hydrology is not reproducible, so is it really science?” by Christopher Hutton et al.: Let hydrologists learn the latest computer science by working with Research Software Engineers (RSEs) and not reinvent the waterwheel ourselves publication-title: Water Resources Research – year: 2022 article-title: A flexible multi‐scale framework to simulate lakes and reservoirs in Earth System models (preprint) publication-title: Hydrology – volume: 23 start-page: 2939 issue: 7 year: 2019 end-page: 2963 article-title: Using R in hydrology: A review of recent developments and future directions publication-title: Hydrology and Earth System Sciences – volume: 12 start-page: 10023 issue: 9 year: 2015 end-page: 10066 article-title: Parameter regionalization of a monthly water balance model for the conterminous United States publication-title: Hydrology and Earth System Sciences Discussions – volume: 24 start-page: 5953 issue: 12 year: 2020 end-page: 5971 article-title: Flexible vector‐based spatial configurations in land models publication-title: Hydrology and Earth System Sciences – volume: 17 start-page: 47 issue: 1 year: 2020 end-page: 51 article-title: Evaluation of the total, direct, and diffuse solar radiations from the ERA5 reanalysis data in China publication-title: IEEE Geoscience and Remote Sensing Letters – volume: 15 start-page: 4163 issue: 10 year: 2022 end-page: 4192 article-title: Evaluating a reservoir parametrization in the vector‐based global routing model mizuRoute (v2.0.1) for Earth system model coupling publication-title: Geoscientific Model Development – volume: XLI‐B4 start-page: 157 year: 2016 end-page: 162 article-title: Generation of the 30 M‐MESH global digital surface model by Alos PRISM publication-title: ISPRS – volume: 50 start-page: 2795 issue: 4 year: 2014 end-page: 2797 article-title: On the future of journal publications in hydrology publication-title: Water Resources Research – volume: 36 start-page: 756 year: 2020 end-page: 765 – volume: 15 start-page: 365 issue: 2 year: 2022 end-page: 378 article-title: Inishell 2.0: Semantically driven automatic GUI generation for scientific models publication-title: Geoscientific Model Development – volume: 13 issue: 6 year: 2021 article-title: A vector‐based river routing model for Earth System models: Parallelization and global applications publication-title: Journal of Advances in Modeling Earth Systems – volume: 51 start-page: 2498 issue: 4 year: 2015a end-page: 2514 article-title: A unified approach for process‐based hydrologic modeling: 1. Modeling concept publication-title: Water Resources Research – volume: 27 start-page: 2171 issue: 15 year: 2013 end-page: 2186 article-title: Global river hydrography and network routing: Baseline data and new approaches to study the world’s large river systems: Global river hydrography and network routing publication-title: Hydrological Processes – volume: 23 start-page: 207 issue: 1 year: 2019 end-page: 224 article-title: Daily evaluation of 26 precipitation datasets using Stage‐IV gauge‐radar data for the CONUS publication-title: Hydrology and Earth System Sciences – volume: 3 start-page: 388 issue: 10 year: 2016 end-page: 415 article-title: Toward the Geoscience Paper of the future: Best practices for documenting and sharing research from data to software to provenance publication-title: Earth and Space Science – volume: 11 start-page: 3481 issue: 8 year: 2018 end-page: 3496 article-title: The Variable Infiltration Capacity model version 5 (VIC‐5): Infrastructure improvements for new applications and reproducibility publication-title: Geoscientific Model Development – volume: 111 start-page: 121 year: 2019 end-page: 133 article-title: Development of a participatory Green Infrastructure design, visualization and evaluation system in a cloud supported jupyter notebook computing environment publication-title: Environmental Modelling & Software – volume: 61 start-page: 174 year: 2014 end-page: 190 article-title: Automating data‐model workflows at a level 12 HUC scale: Watershed modeling in a distributed computing environment publication-title: Environmental Modelling & Software – year: 2017 – year: 2013 article-title: Best practices for computational science: Software infrastructure and environments for reproducible and extensible research publication-title: SSRN Electronic Journal – volume: 122 year: 2019 article-title: Models of everywhere revisited: A technological perspective publication-title: Environmental Modelling & Software – volume: 24 year: 2019 article-title: Evaluation of variability among different precipitation products in the Northern Great Plains publication-title: Journal of Hydrology: Regional Studies |
| SSID | ssj0014567 |
| Score | 2.5015342 |
| Snippet | Despite the proliferation of computer‐based research on hydrology and water resources, such research is typically poorly reproducible. Published studies have... |
| SourceID | unpaywall wiley |
| SourceType | Open Access Repository Publisher |
| SubjectTerms | community modeling Earth System models hydrology reproducibility |
| SummonAdditionalLinks | – databaseName: Wiley Online Library (Open Access collection) dbid: 24P link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dSsMwFA46L6YX4i_OP3IhXllc0i5ZvRvTMURFpmO7G2mTzMFsx9oxeucj-Ea-i09iTtONCd54V0LSFs5J8iXf-c5B6KIe0tDnUpljqqsdT3Pm-DT0HE95wuD3oMoCYHQfn1i76933a_3iwg20MDY_xPLCDWZGvl7DBBdBUiQbgByZ5tROep0q7H_uOtogBsqAh1PveckiGHDAFwwzIJ0i8N2Mv14dvYXKs2gisrkYj39j1HyTae2g7QId4oY15y5aU9EeKi_Ew4l5LoqWv2X76KsQd6QZhitvPY7nCU5j3LC0PjbYOk_nauNfMzyKcDuTU7vaYSiCBlL0G_yibP7vaGgbvz8-GxB-Z_4Bi0guG_NS9do0gkpwNJxZ38EQJ5bAyxsrXDiONX6AIHMz7jZ-F398OzlA3dbda7PtFPUYHGFOYcxhNREakwvm-9InwH-6ite15CCHrXPJpOC0yqkMtCZc1HVAtfJkVSlSk9zghkNUiuJIHSHMuKtdGpKQyNDjTAaShLxGjGMophjRFXS5NMlgYvNuDHK-nPoDsN18am1XQVe5vf7stDDwoNdpdiijPjv-X_cTtElB7pBrD09RKZ3O1JkBIWlwnnvaD0LQ208 priority: 102 providerName: Wiley-Blackwell |
| Title | Community Workflows to Advance Reproducibility in Hydrologic Modeling: Separating Model‐Agnostic and Model‐Specific Configuration Steps in Applications of Large‐Domain Hydrologic Models |
| URI | https://onlinelibrary.wiley.com/doi/abs/10.1029%2F2021WR031753 https://onlinelibrary.wiley.com/doi/pdfdirect/10.1029/2021WR031753 |
| UnpaywallVersion | publishedVersion |
| Volume | 58 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3NTtwwEB7BckA9lNIfQQXIB8SpQWvHsde9RVC0qgpCS1fQ08rxD0VdktVuVqv01EfoG_EuPEntOFltKw6VuEVWxnHk8fgbzzdjgMOeIkpwbZybGtuIWs4iQRSNqKHS4fesyzIf0T2_YP0h_XyT3KzkwoT6EMsDN78yanvtF_hE22Dnm5IDwnvu-HrQ9XtgvA4bLHF4vAMbw4vL9FsbWvYQpw4tUxpxweOG_d6KL6ZB_AVszvOJrBZyPP4bqNY7zdkWqHaMgWDy43heZsfq5z_lG5_3E6_gZQNEURo0ZxvWTP4aNts85Zl7bu5H_169gYcmj6SskD9dt-NiMUNlgdLAIEAOxteVYwPVtkJ3OepXehoMK_L3rfms94_oyoRS4_ltaHz89Tv1TD83BiRzvWy8mpiaK4h8QuLd7TyoKfKUtJnvPF0Ju6PCoi-ez-7kTot7-cS3Z29hePbp60k_aq5-iKRz-FjEEqmcdkkmhBbYh1pjw3tWc5952-OaaclJlxOdWYu57NmMWEN11xicaO4gyjvo5EVudgAxHtuYKKywVpQznWmseIKdDhpmGLa7cLSc-NEklPgY1aF5IkarGrILH-qpfPKldgJH14OTAWFEsPf_2-8edMrp3Ow7cFNmB7BO6OVBo8N_AGg5_vs |
| linkProvider | Unpaywall |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwELVYDoUDYhVl9QFxIqJ2XLvhVrGoQItQAcEtcmK7VCoJ6qIqNz6BP-Jf-BI8cVoViQu3yLKTSM_LG8-8GYSOajGNA6G0NVN94zEjuBfQmHlMM2n5e1ThEXh0W3e88cRuXqovRZ1T0MK4_BDTCzdYGfl-DQscLqSLbAOQJNOa7eS5XYED0J9Hi4wTDtYXZfdTN4JlB2LiYgaqU0S-2_Gns6OXUWmUvMtsLHu93yQ1P2WuVtFKQQ9x3eG5huZ0so5KE_XwwD4XVctfsw30Vag7hhmGO2_TS8cDPExx3fn1sSXXeT5XFwCb4W6CG5nqu-0OQxU00KKf4QftEoAnHdf4_fFZh_g7-w9YJmramNeqN7YRZILdzshNHgyBYgN4eX3GGY5Tg5sQZW7HXaRv8o9vDzbR09Xl43nDKwoyeNKaYdzjVRlbzCUPAhUQcID6WtSMEqCHrQnFlRS0IqiKjCFC1kxEjWaqojWpKmGJwxZaSNJEbyPMhW98GpOYqJgJriJFYlEldmZorjkxZXQ8hSR8d4k3wtxhToMQsBv3HXZldJLj9WenCcDhc_u8TTkN-M7_uh-iUuOx1Qyb13e3u2iJgvYhFyLuoYVhf6T3LSMZRgf5rPsBHLDeuw |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwELVYJJYDYhU7PiBORNSOYzfcqpaqrEIFBLfIiW1AKknVRVVufAJ_xL_wJXjitAKJC7fIspNIb2w_e-bNIHRYTWgSCqXtMdU3HjOCeyFNmMc0k5a_xxUeg0f3-oa3HtjFU_BU1jkFLYzLDzG5cIOZUazXMMF1V5ky2wAkybTHdvLYrsAG6E-jWRbYzRBSO7PbiRvBsgMxdjED1Skj3-34k5-jF9H8MO3KfCQ7nd8ktdhlmstoqaSHuObwXEFTOl1F82P1cN8-l1XLX_I19FmqOwY5hjtv08lGfTzIcM359bEl10U-VxcAm-PXFLdy1XPLHYYqaKBFP8V32iUAT59d49f7Rw3i7-w_YJmqSWNRq97YRpAJvj4PnfFgCBTrw8trP5zhODP4CqLM7bhG9ib_-HZ_HT00z-7rLa8syOBJewzjHg9kYjGXPAxVSMAB6mtRNUqAHrYqFFdS0IqgKjaGCFk1MTWaqYrWJFDCEocNNJNmqd5EmAvf-DQhCVEJE1zFiiQiINYyNNecmC10NIEk6rrEG1HhMKdhBNiNeg67LXRc4PVnpzHA0WO73qachnz7f90P0Nxtoxldnd9c7qAFCtKHQoe4i2YGvaHes4RkEO8XRvcNAZjeSg |
| linkToUnpaywall | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1Pa9swFBddcgg7tOv-0Ixt6FB2mksky1K0m0kXwmhLSRbanYKsP2loaofEIXinfoR9o32XfpJJlh2y0sOgNyP8ZBk9Pf2e3u89AXDclVhyprR1U0MTEMNowLEkAdFEWPyedGjiIrrnF3QwJt-vo-udXBhfH2J74OZWRmmv3QJfKOPtfFVygDvPHV0NO24PDF-AJo0sHm-A5vjiMv5Zh5YdxClDy4QEjLOwYr_X4pulF38JWut0IYqNmM__BarlTtM_ALIeoyeY3J6s8-RE_npUvvF5P_EK7FdAFMZecw7Bnk5fg1adp7yyz9X96DfFG_CnyiPJC-hO180826xgnsHYMwighfFl5VhPtS3gLIWDQi29YYXuvjWX9f4VjrQvNZ5OfePD_e_YMf3sGKBI1bZxtNAlVxC6hMTZdO3VFDpK2sp1Hu-E3WFm4Jnjs1u50-xOPPHt1Vsw7n_70RsE1dUPgbAOHw1oJKTVLkE5Vxy5UGuoWdco5jJvu0xRJRjuMKwSYxATXZNgo4nqaI0ixSxEeQcaaZbqIwApC02IJZJIScKoShSSLEJWBzXVFJk2-Lyd-MnCl_iYlKF5zCe7GtIGX8qpfPKlegInV8PeEFPM6fv_7fcDaOTLtf5owU2efKq09y90Yf4k |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Community+Workflows+to+Advance+Reproducibility+in+Hydrologic+Modeling%3A+Separating+Model%E2%80%90Agnostic+and+Model%E2%80%90Specific+Configuration+Steps+in+Applications+of+Large%E2%80%90Domain+Hydrologic+Models&rft.jtitle=Water+resources+research&rft.au=Knoben%2C+W.+J.+M.&rft.au=Clark%2C+M.+P.&rft.au=Bales%2C+J.&rft.au=Bennett%2C+A.&rft.date=2022-11-01&rft.issn=0043-1397&rft.eissn=1944-7973&rft.volume=58&rft.issue=11&rft.epage=n%2Fa&rft_id=info:doi/10.1029%2F2021WR031753&rft.externalDBID=10.1029%252F2021WR031753&rft.externalDocID=WRCR26296 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0043-1397&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0043-1397&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0043-1397&client=summon |