Agricultural and applied economists' views on pre‐registration and pre‐analysis plans for empirical research

Given the widespread credibility crisis of empirical research, disciplines including economics have increasingly turned attention to replicability‐seeking venues to enhance trust. One of these approaches is to pre‐register a study and prepare a pre‐analysis plan. There are promising benefits but als...

Full description

Saved in:
Bibliographic Details
Published inJournal of the Agricultural and Applied Economics Association Vol. 4; no. 2; pp. 223 - 238
Main Authors Grebitus, Carola, Hu, Wuyang
Format Journal Article
LanguageEnglish
Published 01.06.2025
Subjects
credibility
open science
registry
replicability
transparency
Online AccessGet full text
ISSN2769-2485
2769-2485
DOI10.1002/jaa2.70011

Cover

Abstract Given the widespread credibility crisis of empirical research, disciplines including economics have increasingly turned attention to replicability‐seeking venues to enhance trust. One of these approaches is to pre‐register a study and prepare a pre‐analysis plan. There are promising benefits but also clear challenges, leading selected disciplines of economics to adopt pre‐registration and pre‐analysis plans for empirical research with caution. This study investigates how agricultural and applied economists view the current development of pre‐registration and pre‐analysis plans, and offers guidance for future advancements of these practices within the profession.
AbstractList Given the widespread credibility crisis of empirical research, disciplines including economics have increasingly turned attention to replicability‐seeking venues to enhance trust. One of these approaches is to pre‐register a study and prepare a pre‐analysis plan. There are promising benefits but also clear challenges, leading selected disciplines of economics to adopt pre‐registration and pre‐analysis plans for empirical research with caution. This study investigates how agricultural and applied economists view the current development of pre‐registration and pre‐analysis plans, and offers guidance for future advancements of these practices within the profession.
Author Hu, Wuyang
Grebitus, Carola
Author_xml – sequence: 1
  givenname: Carola
  orcidid: 0000-0001-6511-1690
  surname: Grebitus
  fullname: Grebitus, Carola
  email: Carola.Grebitus@asu.edu
  organization: Arizona State University
– sequence: 2
  givenname: Wuyang
  surname: Hu
  fullname: Hu, Wuyang
  email: hu.1851@osu.edu
  organization: The Ohio State University
BookMark eNp9kL1OwzAUhS1UJErpwhN4Q0JKuXYcpxmjil9VYoE5cv1TXLmJZbdU2XgEnpEnwSUMTEz36ug7Z_jO0ajtWo3QJYEZAaA3GyHorAQg5ASNacmrjLJ5Mfrzn6FpjBtIcFXlRUnHyNfrYOXe7fZBOCxahYX3zmqFtezabmvjLl7hd6sPEXct9kF_fXwGvU55EDubomNniEUrXB9txN6JNmLTBay33qb9NB101CLItwt0aoSLevp7J-j17vZl8ZAtn-8fF_Uyk4TkJDPU5FzwnFeG0IISJoAqAJlzs1JAOV8VUHFqSqYIUzJVgHFazoGpghkp8wm6HnZl6GIM2jQ-2K0IfUOgOepqjrqaH10JJgN8sE73_5DNU13TofMNJWFw_g
Cites_doi 10.1037/a0033242
10.1257/jep.24.2.3
10.1126/science.aaf0918
10.1257/jep.29.3.61
10.1016/j.joep.2020.102309
10.1257/aer.20210795
10.1002/aepp.13386
10.1002/aepp.13133
10.1093/qopen/qoae029
10.1086/706862
10.1017/S1537592721000931
10.1257/app.20150044
10.1257/jel.20171350
10.1093/ajae/aax096
10.1093/pan/mps021
10.1093/qje/qje027
10.3386/w26993
10.1126/science.1255484
10.3386/w27250
10.1126/science.aab2374
10.1037/0033-2909.86.3.638
10.1002/9781394260645
10.1257/aer.20190687
10.1007/s10640-019-00342-x
10.1126/science.aac4716
10.1073/pnas.1708274114
10.1093/aepp/ppz009
10.1257/jep.29.3.81
10.1177/0956797611417632
ContentType Journal Article
Copyright 2025 The Author(s). published by Wiley Periodicals LLC on behalf of Agricultural and Applied Economics Association.
Copyright_xml – notice: 2025 The Author(s). published by Wiley Periodicals LLC on behalf of Agricultural and Applied Economics Association.
DBID 24P
AAYXX
CITATION
DOI 10.1002/jaa2.70011
DatabaseName Wiley Online Library Open Access
CrossRef
DatabaseTitle CrossRef
DatabaseTitleList CrossRef
Database_xml – sequence: 1
  dbid: 24P
  name: Wiley Online Library Open Access
  url: https://authorservices.wiley.com/open-science/open-access/browse-journals.html
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Economics
EISSN 2769-2485
EndPage 238
ExternalDocumentID 10_1002_jaa2_70011
JAA270011
Genre article
GrantInformation_xml – fundername: None
GroupedDBID 0R~
1OC
24P
7X2
ACCMX
AEUYN
AFKRA
ALMA_UNASSIGNED_HOLDINGS
ALUQN
ATCPS
BENPR
BHPHI
CCPQU
EBS
HCIFZ
M0K
M~E
PHGZM
PHGZT
PIMPY
AAYXX
CITATION
WIN
ID FETCH-LOGICAL-c1131-f2f36a6369f125214a02d00c36fbd0266b50962f74d14dc13104627804d54fcc3
IEDL.DBID 24P
ISSN 2769-2485
IngestDate Thu Aug 14 00:04:25 EDT 2025
Sun Jul 06 04:45:26 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
License Attribution
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c1131-f2f36a6369f125214a02d00c36fbd0266b50962f74d14dc13104627804d54fcc3
ORCID 0000-0001-6511-1690
OpenAccessLink https://onlinelibrary.wiley.com/doi/abs/10.1002%2Fjaa2.70011
PageCount 0
ParticipantIDs crossref_primary_10_1002_jaa2_70011
wiley_primary_10_1002_jaa2_70011_JAA270011
PublicationCentury 2000
PublicationDate June 2025
2025-06-00
PublicationDateYYYYMMDD 2025-06-01
PublicationDate_xml – month: 06
  year: 2025
  text: June 2025
PublicationDecade 2020
PublicationTitle Journal of the Agricultural and Applied Economics Association
PublicationYear 2025
References 2018; 100
2021; 43
2019; 73
2013; 21
2020; 80
2020; 128
2024
2012; 127
2023; 21
2010; 24
2015; 29
2023; 45
2015b; 348
2019; 41
2020
2020; 110
2023; 113
2018; 115
2019
2015a; 349
2011; 22
2014
2018; 56
1979; 86
2014; 143
2016; 8
2016; 351
2014; 345
e_1_2_10_23_1
e_1_2_10_24_1
e_1_2_10_21_1
e_1_2_10_20_1
e_1_2_10_2_1
e_1_2_10_4_1
e_1_2_10_18_1
e_1_2_10_3_1
e_1_2_10_19_1
e_1_2_10_6_1
e_1_2_10_16_1
e_1_2_10_5_1
e_1_2_10_17_1
e_1_2_10_8_1
e_1_2_10_14_1
e_1_2_10_7_1
e_1_2_10_15_1
e_1_2_10_12_1
e_1_2_10_9_1
e_1_2_10_10_1
e_1_2_10_11_1
e_1_2_10_32_1
e_1_2_10_31_1
e_1_2_10_30_1
Josephson A. (e_1_2_10_22_1) 2024
e_1_2_10_29_1
e_1_2_10_27_1
e_1_2_10_28_1
Christensen G. (e_1_2_10_13_1) 2019
e_1_2_10_25_1
e_1_2_10_26_1
References_xml – volume: 22
  start-page: 1359
  issue: 11
  year: 2011
  end-page: 1366
  article-title: False‐Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
  publication-title: Psychological Science
– volume: 345
  start-page: 1502
  issue: 6203
  year: 2014
  end-page: 1505
  article-title: Publication Bias in the Social Sciences: Unlocking the File Drawer
  publication-title: Science
– volume: 113
  start-page: 2974
  issue: 11
  year: 2023
  end-page: 3002
  article-title: Unpacking P‐Hacking and Publication Bias
  publication-title: American Economic Review
– volume: 41
  start-page: 329
  issue: 3
  year: 2019
  end-page: 350
  article-title: Are You Estimating the Right Thing? An Editor Reflects
  publication-title: Applied Economic Perspectives and Policy
– volume: 127
  start-page: 1755
  year: 2012
  end-page: 1812
  article-title: Reshaping Institutions: Evidence on AID Impacts Using a Preanalysis Plan
  publication-title: The Quarterly Journal of Economics
– volume: 73
  start-page: 719
  year: 2019
  end-page: 742
  article-title: Behavioral and Experimental Agri‐Environmental Research: Methodological Challenges, Literature Gaps, and Recommendations
  publication-title: Environmental and Resource Economics
– volume: 45
  start-page: 1258
  issue: 3
  year: 2023
  end-page: 1274
  article-title: Replications in Agricultural Economics
  publication-title: Applied Economic Perspectives and Policy
– year: 2024
– volume: 143
  start-page: 534
  issue: 2
  year: 2014
  end-page: 547
  article-title: P‐Curve: A Key to the File‐Drawer
  publication-title: Journal of Experimental Psychology: General
– volume: 100
  start-page: 381
  issue: 2
  year: 2018
  end-page: 391
  article-title: Why Should I Believe Your Applied Economics
  publication-title: American Journal of Agricultural Economics
– volume: 86
  start-page: 638
  issue: 3
  year: 1979
  end-page: 641
  article-title: The File Drawer Problem and Tolerance for Null Results
  publication-title: Psychological Bulletin
– volume: 80
  year: 2020
  article-title: At the Eve of the 40 Anniversary of the Journal of Economic Psychology: Standards, Practices, and Challenges
  publication-title: Journal of Economic Psychology
– year: 2014
– volume: 349
  issue: 6251
  year: 2015a
  article-title: Estimating the Reproducibility of Psychological Science
  publication-title: Science
– volume: 24
  start-page: 3
  issue: 2
  year: 2010
  end-page: 30
  article-title: The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con Out of Econometrics
  publication-title: Journal of Economic Perspectives
– volume: 351
  start-page: 1433
  issue: 6280
  year: 2016
  end-page: 1436
  article-title: Evaluating Replicability of Laboratory Experiments in Economics
  publication-title: Science
– volume: 29
  start-page: 81
  issue: 3
  year: 2015
  end-page: 98
  article-title: Pre‐Analysis Plans Have Limited Upside, Especially Where Replications Are Feasible
  publication-title: Journal of Economic Perspectives
– volume: 29
  start-page: 61
  issue: 3
  year: 2015
  end-page: 80
  article-title: Promises and Perils of Pre‐Analysis Plans
  publication-title: Journal of Economic Perspectives
– volume: 8
  start-page: 1
  issue: 1
  year: 2016
  end-page: 32
  article-title: Star Wars: The Empirics Strike Back
  publication-title: American Economic Journal: Applied Economics
– year: 2024
  article-title: Open Science in Agricultural Economics
  publication-title: Q Open
– volume: 110
  start-page: 3634
  issue: 11
  year: 2020
  end-page: 3660
  article-title: Methods Matter: P‐Hacking and Publication Bias in Causal Analysis in Economics
  publication-title: American Economic Review
– volume: 348
  start-page: 1422
  issue: 6242
  year: 2015b
  end-page: 1425
  article-title: Promoting an Open Research Culture: Author Guidelines for Journals Could Help to Promote Transparency, Openness, and Reproducibility
  publication-title: Science
– volume: 115
  year: 2018
  article-title: The Preregistration Revolution
  publication-title: Proceedings of the National Academy of Sciences
– volume: 21
  start-page: 174
  issue: 1
  year: 2023
  end-page: 190
  article-title: Pre‐Analysis Plans: An Early Stocktaking
  publication-title: Perspectives on Politics
– volume: 43
  start-page: 1286
  issue: 4
  year: 2021
  end-page: 1304
  article-title: Ulysses' Pact or Ulysses' Raft: Using Pre‐Analysis Plans in Experimental and Non‐Experimental Research
  publication-title: Applied Economic Perspectives and Policy
– year: 2020
– volume: 21
  start-page: 1
  year: 2013
  end-page: 20
  article-title: Fishing, Commitment, and Communication: A Proposal for Comprehensive Nonbinding Research Registration
  publication-title: Political Analysis
– year: 2019
– volume: 128
  start-page: 2880
  issue: 8
  year: 2020
  end-page: 2924
  article-title: Debates: Voting and Expenditure Responses to Political Communication
  publication-title: Journal of Political Economy
– volume: 56
  start-page: 920
  issue: 3
  year: 2018
  end-page: 980
  article-title: Transparency, Reproducibility, and the Credibility of Economics Research
  publication-title: Journal of Economic Literature
– ident: e_1_2_10_31_1
  doi: 10.1037/a0033242
– ident: e_1_2_10_4_1
  doi: 10.1257/jep.24.2.3
– ident: e_1_2_10_10_1
  doi: 10.1126/science.aaf0918
– ident: e_1_2_10_27_1
  doi: 10.1257/jep.29.3.61
– ident: e_1_2_10_3_1
  doi: 10.1016/j.joep.2020.102309
– ident: e_1_2_10_9_1
  doi: 10.1257/aer.20210795
– ident: e_1_2_10_17_1
  doi: 10.1002/aepp.13386
– ident: e_1_2_10_21_1
  doi: 10.1002/aepp.13133
– ident: e_1_2_10_16_1
  doi: 10.1093/qopen/qoae029
– ident: e_1_2_10_6_1
  doi: 10.1086/706862
– ident: e_1_2_10_26_1
  doi: 10.1017/S1537592721000931
– ident: e_1_2_10_7_1
  doi: 10.1257/app.20150044
– ident: e_1_2_10_12_1
  doi: 10.1257/jel.20171350
– volume-title: Research Ethics in Applied Economics: A Practical Guide
  year: 2024
  ident: e_1_2_10_22_1
– ident: e_1_2_10_32_1
  doi: 10.1093/ajae/aax096
– ident: e_1_2_10_20_1
  doi: 10.1093/pan/mps021
– ident: e_1_2_10_11_1
  doi: 10.1093/qje/qje027
– ident: e_1_2_10_5_1
  doi: 10.3386/w26993
– ident: e_1_2_10_18_1
  doi: 10.1126/science.1255484
– ident: e_1_2_10_2_1
  doi: 10.3386/w27250
– ident: e_1_2_10_24_1
  doi: 10.1126/science.aab2374
– ident: e_1_2_10_29_1
  doi: 10.1037/0033-2909.86.3.638
– volume-title: Transparent and Reproducible Social Science Research: How to do Open Science
  year: 2019
  ident: e_1_2_10_13_1
– ident: e_1_2_10_15_1
  doi: 10.1002/9781394260645
– ident: e_1_2_10_8_1
  doi: 10.1257/aer.20190687
– ident: e_1_2_10_28_1
  doi: 10.1007/s10640-019-00342-x
– ident: e_1_2_10_23_1
  doi: 10.1126/science.aac4716
– ident: e_1_2_10_25_1
  doi: 10.1073/pnas.1708274114
– ident: e_1_2_10_19_1
  doi: 10.1093/aepp/ppz009
– ident: e_1_2_10_14_1
  doi: 10.1257/jep.29.3.81
– ident: e_1_2_10_30_1
  doi: 10.1177/0956797611417632
SSID ssj0002993572
Score 2.2971268
Snippet Given the widespread credibility crisis of empirical research, disciplines including economics have increasingly turned attention to replicability‐seeking...
SourceID crossref
wiley
SourceType Index Database
Publisher
StartPage 223
SubjectTerms credibility
open science
registry
replicability
transparency
Title Agricultural and applied economists' views on pre‐registration and pre‐analysis plans for empirical research
URI https://onlinelibrary.wiley.com/doi/abs/10.1002%2Fjaa2.70011
Volume 4
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlZ1JSwMxFMdDaQ96EVesSwkoCMLYyTJLwcsoLaVgKWKhtyGTxQWdDjP17kfwM_pJTDJL9SJ4DS-Xl-2f93i_B8C5Ur5KEOEO9yR2aGiKlRFSTqCQEERoDc1MRvdu6o_ndLLwFi1wXdfClHyIJuBmToa9r80BZ0nRX0NDXxjDVyZrqv8-Ha3qidnfmM6aCIu-aIlnuzfhwDdphNBr-KS4v57-60X6qVDtEzPaBluVNoRRuZg7oCXTXbBRlw4XeyCLHvOGlQFZKiArRSSUpVGxKi6gxYvCZQqzXH59fJrWCzUc184ph1lFI4HZq36toNauUL5lz5YYAisE0NM-mI-GD7djp2qZ4HCECHIUVsRnPvEHSisXjChzsXBdTvSKCP3d8hODe8EqoAJRwfUUU5xqIETCo4pzcgDa6TKVhwAaFiGnNAgTzE1LEhZKN9HLNwi0ZAwC0QVntdvirCRjxCUDGcfGubF1bhdcWo_-YRJPosimv9HRf4yPwSY2vXhtROQEtFf5uzzVAmGV9Ow-6IHOzXA6u_8GD3y4IQ
linkProvider Wiley-Blackwell
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlZ3JTsMwEIYtVA7lglhFWS2BhIQUWjuOkx4jRFVKW3Fopd4ixwuLII3acucReEaeBI-TpnBB4hrZl_Eyv2cy3yB0YQw3KfGlJwNNPRZBsTIhxgsNUcpXVkMLyOgOhrw7Zr1JMCn_zYFamIIPUQXc4GS4-xoOOASkmytq6IsQ9BrSpvbxs864fbsA2Jk9VCEWe9P6gWvfREMOeYQoqACltLma_ssl_ZSozsd0ttBmKQ5xXKzmNlrT2Q6qL2uH57sojx9nFSwDi0xhUahIrItB88X8Eju-KJ5mOJ_pr49P6L2wpOO6OcVnUeJIcP5q3RW24hXrt_zZIUNwyQB62kPjzu3opuuVPRM8SYhPPEONzwX3edtY6UIJEy2qWi3p2yVR9r3FU-C9UBMyRZiSdgpUpwKFSAXMSOnvo1o2zfQBwgAjlIyFUUol9CQRkW6ldv3aodWMYaga6HxptiQv0BhJAUGmCRg3ccZtoCtn0T-GJL04dvlvcvifwWeo3h0N-kn_bnh_hDYoNOZ14ZFjVFvM3vWJVQuL9NTtiW82s7nt
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlZ1JSwMxFMdDUVAv4op1DSgIwtjJMpkpeBnUUquWHiz0NmSyuKDToa13P4Kf0U9iklmqF8FrSC7vJXn_5PF-D4ATrZlOERGeCBT2aGSLlRHSXqiRlEQaDc1tRve-z7pD2hsFowa4qGphCj5E_eFmT4a7r-0Bz6VuzaGhL5zjc5s1NW-fRWo2nt3fmA7qHxZz0ZLAdW_CIbNphCio-aS4NV_-KyL9VKguxHTWwGqpDWFcOHMdNFS2AZar0uHpJsjjx0nNyoA8k5AXIhKqYtJ0Nj2FDi8KxxnMJ-rr49O2XqjguG5NMcxLGgnMX020gka7QvWWPztiCCwRQE9bYNi5frjsemXLBE8gRJCnsSaMM8La2igXjCj3sfR9QYxHpHlusdTiXrAOqURUCrPEFqdaCJEMqBaCbIOFbJypHQAti1BQGkYpFrYlCY-Unxr3tUMjGcNQNsFxZbYkL8gYScFAxok1buKM2wRnzqJ_TEl6cezS32j3P5OPwNLgqpPc3fRv98AKtm153efIPliYTd7VgdEKs_TQbYlvcJu5KA
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Agricultural+and+applied+economists%27+views+on+pre%E2%80%90registration+and+pre%E2%80%90analysis+plans+for+empirical+research&rft.jtitle=Journal+of+the+Agricultural+and+Applied+Economics+Association&rft.au=Grebitus%2C+Carola&rft.au=Hu%2C+Wuyang&rft.date=2025-06-01&rft.issn=2769-2485&rft.eissn=2769-2485&rft.volume=4&rft.issue=2&rft.spage=223&rft.epage=238&rft_id=info:doi/10.1002%2Fjaa2.70011&rft.externalDBID=10.1002%252Fjaa2.70011&rft.externalDocID=JAA270011
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2769-2485&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2769-2485&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2769-2485&client=summon