Beyond Standardization Improving External Validity and Reproducibility in Experimental Evolution
Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affectin...
Saved in:
| Published in | Bioscience Vol. 71; no. 5; pp. 543 - 552 |
|---|---|
| Main Authors | , , , , |
| Format | Journal Article |
| Language | English |
| Published |
Oxford
Oxford University Press
01.05.2021
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 0006-3568 1525-3244 |
| DOI | 10.1093/biosci/biab008 |
Cover
| Abstract | Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affecting the evolutionary process. A received view in experimental studies more generally is that standardization (i.e., rigorous homogenization of experimental conditions) is a solution to some issues of significance and internal validity. However, this solution hides several difficulties, including a reduction of external validity and reproducibility. After explaining the meaning of these two notions in the context of experimental evolution, we import from the fields of animal research and ecology and suggests that systematic heterogenization of experimental factors could prove a promising alternative. We also incorporate into our analysis some philosophical reflections on the nature and diversity of research objectives in experimental evolution. |
|---|---|
| AbstractList | Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affecting the evolutionary process. A received view in experimental studies more generally is that standardization (i.e., rigorous homogenization of experimental conditions) is a solution to some issues of significance and internal validity. However, this solution hides several difficulties, including a reduction of external validity and reproducibility. After explaining the meaning of these two notions in the context of experimental evolution, we import from the fields of animal research and ecology and suggests that systematic heterogenization of experimental factors could prove a promising alternative. We also incorporate into our analysis some philosophical reflections on the nature and diversity of research objectives in experimental evolution. Abstract Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affecting the evolutionary process. A received view in experimental studies more generally is that standardization (i.e., rigorous homogenization of experimental conditions) is a solution to some issues of significance and internal validity. However, this solution hides several difficulties, including a reduction of external validity and reproducibility. After explaining the meaning of these two notions in the context of experimental evolution, we import from the fields of animal research and ecology and suggests that systematic heterogenization of experimental factors could prove a promising alternative. We also incorporate into our analysis some philosophical reflections on the nature and diversity of research objectives in experimental evolution. |
| Author | DESJARDINS, ERIC RICHTER, S. HELENE KURTZ, JOACHIM LINDEZA, ANA KRANKE, NINA |
| Author_xml | – sequence: 1 givenname: ERIC surname: DESJARDINS fullname: DESJARDINS, ERIC – sequence: 2 givenname: JOACHIM surname: KURTZ fullname: KURTZ, JOACHIM – sequence: 3 givenname: NINA surname: KRANKE fullname: KRANKE, NINA – sequence: 4 givenname: ANA surname: LINDEZA fullname: LINDEZA, ANA – sequence: 5 givenname: S. HELENE surname: RICHTER fullname: RICHTER, S. HELENE |
| BookMark | eNqFkEtLxDAURoOMYGd0OztBcOWiY17NY6nD-IABF-o6pEkKKWNTk3Qx_nqrHVwI4urjwjn3Xr45mHWhcwAsEVwhKMl17UMyfgxdQyiOQIEqXJUEUzoDBYSQlaRi4gTMU2rHEVEiC7C8dfvQ2YvnrDuro_UfOvvQnYLjRu-SOzvkArzebV7WD-X26f5xfbMtDcEkl4zWFHEnKKsbKRGhRjonG4MZs5ZajZ1FBFGOieWokbrRzGpupJCSWyslWYDLaW8fw_vgUlZtGGI3nlS4YrTigjAxUnSiTAwpRdco4_P3nzlqv1MIqq8G1NSAOjQwaqtfWh_9m477v4WrSQhD_z97PrFtyiH-0JhDLjim5BPeeXle |
| CitedBy_id | crossref_primary_10_1111_ele_70053 crossref_primary_10_1007_s10539_022_09848_z crossref_primary_10_1371_journal_pbio_3001837 crossref_primary_10_1093_emph_eoab034 |
| Cites_doi | 10.1038/ismej.2015.259 10.1038/nrd3439-c1 10.1038/nrmicro.2015.13 10.1073/pnas.96.9.5083 10.1086/392587 10.1371/journal.pbio.2003693 10.1093/genetics/162.2.961 10.1046/j.1365-2540.2001.00961.x 10.1371/journal.pbio.1002169 10.1126/science.aam5979 10.1016/j.neubiorev.2018.01.003 10.1371/journal.pone.0147215 10.1038/nmeth.1312 10.1007/BF00413970 10.1038/nmeth0310-167 10.1002/ece3.3542 10.1038/ncomms7102 10.1038/s41559-020-1107-8 10.1016/j.tips.2016.05.003 10.1371/journal.pbio.3000397 10.1038/s41559-017-0434-x 10.1038/nmeth.3489 10.1126/science.1250939 10.1098/rspb.2015.2292 10.1007/978-94-007-4107-2 10.1038/hdy.2008.19 10.1016/j.ygeno.2014.09.007 10.1002/evl3.75 10.1038/533452a 10.5840/jphil20181151239 10.1038/81541 10.1002/bies.201800206 10.1101/gr.3832305 10.1073/pnas.1810004115 10.1038/nature12344 10.1128/AEM.72.4.3032-3035.2006 10.1038/42701 10.1108/S0743-41542018000036B009 10.1126/science.272.5269.1802 10.1111/evo.13654 10.5840/jphil20071041240 10.1371/journal.pbio.1002165 10.1038/505612a 10.1086/678257 10.1038/nature18959 10.1186/s12862-016-0662-8 10.1038/d41586-019-00857-9 10.1086/677956 10.1111/j.0014-3820.2003.tb00590.x 10.1525/9780520944473 10.1073/pnas.1410631112 10.1038/laban.1330 10.1534/genetics.119.300160 10.1111/eva.12397 10.1007/978-3-319-72577-2_11 10.1007/978-94-007-7347-9_11 10.1126/science.7809610 10.1073/pnas.0803151105 10.1073/pnas.91.15.6808 10.1111/evo.13806 10.1086/692111 10.1086/285289 10.1037/h0040950 10.1038/s41598-019-44705-2 10.1126/science.1213847 10.1073/pnas.1821386116 10.1093/molbev/msx158 10.1007/s10539-011-9256-4 10.1046/j.1601-1848.2001.00006.x 10.1038/s41583-020-0313-3 |
| ContentType | Journal Article |
| Copyright | The Author(s) 2021 The Author(s) 2021. Published by Oxford University Press on behalf of the American Institute of Biological Sciences. 2021 The Author(s) 2021. Published by Oxford University Press on behalf of the American Institute of Biological Sciences. |
| Copyright_xml | – notice: The Author(s) 2021 – notice: The Author(s) 2021. Published by Oxford University Press on behalf of the American Institute of Biological Sciences. 2021 – notice: The Author(s) 2021. Published by Oxford University Press on behalf of the American Institute of Biological Sciences. |
| DBID | AAYXX CITATION K9. |
| DOI | 10.1093/biosci/biab008 |
| DatabaseName | CrossRef ProQuest Health & Medical Complete (Alumni) |
| DatabaseTitle | CrossRef ProQuest Health & Medical Complete (Alumni) |
| DatabaseTitleList | ProQuest Health & Medical Complete (Alumni) CrossRef |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Biology |
| EISSN | 1525-3244 |
| EndPage | 552 |
| ExternalDocumentID | 10_1093_biosci_biab008 10.1093/biosci/biab008 27078724 |
| GroupedDBID | -DZ -JH -~X 0R~ 1HT 23N 2AX 4.4 48X 4P2 5GY 5RE 5VS 5WD 6J9 85S 8R4 8R5 97F 9EF A8Z AAHBH AAHKG AAILS AAIMJ AAJKP AAMDB AAMVS AAOGV AAPQZ AAPSS AAPXW AARHZ AAUAY AAVAP ABBHK ABDBF ABDFA ABEJV ABEUO ABGFU ABGNP ABIXL ABJNI ABMNT ABPLY ABPPZ ABPQP ABPTD ABQLI ABTLG ABVGC ABWST ABXVV ABXZS ACGFO ACGFS ACGOD ACIPB ACKOT ACNCT ACPRK ACUFI ACUHS ACUTJ ADBBV ADCFL ADGKP ADGZP ADHKW ADHSS ADHZD ADIPN ADNBA ADOCK ADQBN ADRTK ADVEK ADYVW ADZTZ ADZXQ AEGPL AEGXH AEHKS AEJOX AEKSI AELWJ AEMDU AENEX AENZO AEPUE AETBJ AEUPB AEWNT AFAZZ AFFNX AFFZL AFGWE AFIYH AFOFC AFRAH AFYAG AGINJ AGQXC AGSYK AHGBF AIAGR AJBYB AJEEA AJNCP AKWXX ALMA_UNASSIGNED_HOLDINGS ALUQC ALXQX ANHSF APEBS APIBT ARIXL ARTTT ATGXG AXUDD AYOIW BAYMD BCRHZ BES BEYMZ BHONS BQDIO BSS BSWAC C45 CBGCD CDBKE CS3 D0L DAKXR DILTD DO4 DU5 D~K EAD EAP EAS EAU EAZ EBC EBD EBS EBX EDH EE~ EGS EMF EMG EMH EMK EPL ESE ESN EST ESTFP ESX EVS EWM F5P F9B FHSFR FJW FLUFQ FOEOM FQBLK GAUVT GJXCC H13 H5~ HAR HW0 IAO IEA IGH IGS IHR IMI IOF IPO IPSME IRD ISE ITF ITG ITH IVC J21 JAAYA JBMMH JBS JENOY JHFFW JKQEH JLS JLXEF JPM JST JXSIZ KBUDW KOP KQ8 KSI KSN M0P MV1 NLBLG NOMLY O9- OAWHX OBOKY ODMLO OJQWA OJZSN OVD OWPYF P2P PAFKI PEELM PM3 PQ0 Q1. Q2X Q5Y QF4 QM9 QN7 QN8 RBO ROX ROZ RSU RUSNO RW1 RWL SA0 TAE TEORI TLC TN5 TUS U5U UKR WH7 XSW XZL YAYTL YKOAZ YOC YR2 YROCO YRY YXANX YZZ ZCA ~02 ~KM .-4 .GJ 0-V 1TH 2KS 41~ 53G 6TJ 7X2 7X7 88E 88I 8AF 8AO 8FE 8FH 8FI 8FJ 8G5 8GL AAJQQ AAUQX AAWDT ABDPE ABEFU ABIME ABPIB ABSMQ ABUWG ABXSQ ABZEO ACFRR ACHIC ACVCV ACZBC ADULT AEPYG AEUYN AFFIJ AFKRA AFNWH AGKRT AGMDO AGNAY AGUYK AHXOZ AJDVS AKPMI ALIPV ALSLI ANFBD APJGH AQDSO AQVQM ARALO ASAOO ATCPS ATDFG AZQEC BBNVY BCR BCU BEC BENPR BHPHI BLC BPHCQ BVXVI CAG CCPQU CJNVE COF CXTWN DC7 DFGAJ DWQXO EJD ELUNK FYUFA GICCO GNUQQ GTFYD GUQSH HCIFZ HGD HMCUK HTVGU IAG IBB IBG IEP IER ISN ITC LK8 M0K M1P M2O M2P M2Q M7P MBTAY MVM NEJ NHB NU- NVLIB OMK P-O PEA PHGZT PQEDU PQQKQ PROAC PSQYO Q5J QJJ QM4 QO2 QO4 R05 ROL S0X SJFOW TCN UBC UBY UHB UKHRP VOH WHG XOL YV5 YYP YYQ ZCG ZKG ZXP AAYXX CITATION K9. |
| ID | FETCH-LOGICAL-c323t-64b417e846bf99134c9ee9fc266dd4da2ed1314723d71f9afa6da7c98997dd993 |
| ISSN | 0006-3568 |
| IngestDate | Fri Oct 03 10:51:29 EDT 2025 Wed Oct 01 01:18:43 EDT 2025 Thu Apr 24 23:07:20 EDT 2025 Wed Apr 02 07:05:01 EDT 2025 Thu Oct 30 13:24:35 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 5 |
| Keywords | standardization experimental evolution reproducibility external validity heterogenization |
| Language | English |
| License | This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model) https://academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c323t-64b417e846bf99134c9ee9fc266dd4da2ed1314723d71f9afa6da7c98997dd993 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0001-9066-4852 |
| PQID | 2564578368 |
| PQPubID | 34924 |
| PageCount | 10 |
| ParticipantIDs | proquest_journals_2564578368 crossref_citationtrail_10_1093_biosci_biab008 crossref_primary_10_1093_biosci_biab008 oup_primary_10_1093_biosci_biab008 jstor_primary_27078724 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2021-05-01 |
| PublicationDateYYYYMMDD | 2021-05-01 |
| PublicationDate_xml | – month: 05 year: 2021 text: 2021-05-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | Oxford |
| PublicationPlace_xml | – name: Oxford |
| PublicationTitle | Bioscience |
| PublicationYear | 2021 |
| Publisher | Oxford University Press |
| Publisher_xml | – name: Oxford University Press |
| References | Kafkafi (2021050923564960000_bib35) 2018; 87 Fidler (2021050923564960000_bib24) 2017; 67 Bell (2021050923564960000_bib11) 2008; 100 Cooper (2021050923564960000_bib19) 2014; 104 O'Keefe (2021050923564960000_bib49) 2006; 72 Kryazhimskiy (2021050923564960000_bib38) 2014; 344 The Economist (2021050923564960000_bib71) 2013 Cook (2021050923564960000_bib18) 1986; 68 Heesen (2021050923564960000_bib31) 2018; 115 Leonelli (2021050923564960000_bib43) 2018 Wensing (2021050923564960000_bib82) 2017; 7 Plucain (2021050923564960000_bib54) 2016; 16 Didelot (2021050923564960000_bib22) 2016; 14 Blount (2021050923564960000_bib7) 2018; 362 Flatt (2021050923564960000_bib26) 2020; 214 Rebolleda-Gómez (2021050923564960000_bib60) 2019; 73 Chapman (2021050923564960000_bib15) 2001; 87 Scannell (2021050923564960000_bib66) 2016; 11 Garland (2021050923564960000_bib30) 2009 Lenski (2021050923564960000_bib42) 2015; 282 França (2021050923564960000_bib28) 2019; 41 Shadish (2021050923564960000_bib67) 2002 Würbel (2021050923564960000_bib84) 2002; 1 Ramiro (2021050923564960000_bib58) 2016; 9 Holland (2021050923564960000_bib32) 1999; 96 Ratcliff (2021050923564960000_bib59) 2015; 6 Barbosa (2021050923564960000_bib5) 2017; 34 Tenaillon (2021050923564960000_bib72) 2016; 536 Steinle (2021050923564960000_bib70) 1997; 64 Elena (2021050923564960000_bib23) 1996; 272 Radder (2021050923564960000_bib56) 1996 Voelkl (2021050923564960000_bib77) 2020; 21 Card (2021050923564960000_bib14) 2019; 17 Richter (2021050923564960000_bib62) 2017; 46 Hollis (2021050923564960000_bib33) 2019; 116 Parke (2021050923564960000_bib51) 2014; 81 Agrawal (2021050923564960000_bib2) 2017; 190 Blount (2021050923564960000_bib6) 2008; 105 Nahum (2021050923564960000_bib47) 2015; 112 Baker (2021050923564960000_bib4) 2016; 533 Fong (2021050923564960000_bib27) 2005; 15 Prinz (2021050923564960000_bib55) 2011; 10 Amrhein (2021050923564960000_bib3) 2019; 567 Bochdanovits (2021050923564960000_bib8) 2003; 57 Lenski (2021050923564960000_bib41) 1994; 91 Lenski (2021050923564960000_bib40) 1991; 138 Piatigorsky (2021050923564960000_bib53) 2008; 1 Collins (2021050923564960000_bib17) 2014; 505 Desjardins (2021050923564960000_bib21) 2016 Levins (2021050923564960000_bib44) 1966; 54 Desjardins (2021050923564960000_bib20) 2011; 26 Richter (2021050923564960000_bib63) 2009; 6 Weisberg (2021050923564960000_bib81) 2007; 104 Masri (2021050923564960000_bib45) 2015; 13 Turner (2021050923564960000_bib74) 2018; 2 Richter (2021050923564960000_bib64) 2010; 7 Travisano (2021050923564960000_bib73) 1995; 267 Chen (2021050923564960000_bib16) 2020; 4 Rheinberger (2021050923564960000_bib61) 1997 Fidler (2021050923564960000_bib25) 2018 Sniegowski (2021050923564960000_bib69) 1997; 387 Wahl (2021050923564960000_bib78) 2002; 162 Würbel (2021050923564960000_bib83) 2000; 26 Huber (2021050923564960000_bib34) 2018 Lang (2021050923564960000_bib39) 2013; 500 Bodden (2021050923564960000_bib9) 2019; 9 Campbell (2021050923564960000_bib13) 1963 Voelkl (2021050923564960000_bib76) 2018; 16 Campbell (2021050923564960000_bib12) 1957; 54 Burian (2021050923564960000_bib10) 1997; 19 National Academies of Sciences, Engineering, and Medicine (2021050923564960000_bib48) 2019 Weber (2021050923564960000_bib80) 2014; 81 Voelkl (2021050923564960000_bib75) 2016; 37 O'Malley (2021050923564960000_bib50) 2007; 29 Simões (2021050923564960000_bib68) 2019; 73 King (2021050923564960000_bib37) 2016; 10 Radder (2021050923564960000_bib57) 2012 Achaz (2021050923564960000_bib1) 2014 Milcu (2021050923564960000_bib46) 2018; 2 Roemhild (2021050923564960000_bib65) 2018; 115 Peng (2021050923564960000_bib52) 2011; 334 Waters (2021050923564960000_bib79) 2007; 29 Freedman (2021050923564960000_bib29) 2015; 13 Kenett (2021050923564960000_bib36) 2015; 12 |
| References_xml | – volume: 10 start-page: 1915 year: 2016 ident: 2021050923564960000_bib37 article-title: Rapid evolution of microbe-mediated protection against pathogens in a worm host publication-title: ISME Journal doi: 10.1038/ismej.2015.259 – volume-title: In and About the World: Philosophical Studies of Science and Technology year: 1996 ident: 2021050923564960000_bib56 – volume: 10 start-page: 712 year: 2011 ident: 2021050923564960000_bib55 article-title: Believe it or not: How much can we rely on published data on potential drug targets? publication-title: Nature Reviews Drug Discovery doi: 10.1038/nrd3439-c1 – volume: 29 start-page: 275 year: 2007 ident: 2021050923564960000_bib79 article-title: The nature and context of exploratory experimentation: An introduction to three case studies of exploratory research publication-title: History and Philosophy of the Life Sciences – volume: 14 start-page: 150 year: 2016 ident: 2021050923564960000_bib22 article-title: Within-host evolution of bacterial pathogens publication-title: Nature Reviews Microbiology doi: 10.1038/nrmicro.2015.13 – volume: 96 start-page: 5083 year: 1999 ident: 2021050923564960000_bib32 article-title: Experimental removal of sexual selection reverses intersexual antagonistic coevolution and removes a reproductive load publication-title: Proceedings of the National Academy of Sciences doi: 10.1073/pnas.96.9.5083 – volume: 64 start-page: S65 year: 1997 ident: 2021050923564960000_bib70 article-title: Entering new fields: Exploratory uses of experimentation publication-title: Philosophy of Science doi: 10.1086/392587 – volume: 16 start-page: e2003693 year: 2018 ident: 2021050923564960000_bib76 article-title: Reproducibility of preclinical animal research improves with heterogeneity of study samples publication-title: PLOS Biology doi: 10.1371/journal.pbio.2003693 – volume: 162 start-page: 961 year: 2002 ident: 2021050923564960000_bib78 article-title: Evaluating the impact of population bottlenecks in experimental evolution publication-title: Genetics doi: 10.1093/genetics/162.2.961 – volume: 87 start-page: 511 year: 2001 ident: 2021050923564960000_bib15 article-title: Seminal fluid-mediated fitness traits in Drosophila publication-title: Heredity doi: 10.1046/j.1365-2540.2001.00961.x – volume-title: The Stanford Encyclopedia of Philosophy year: 2018 ident: 2021050923564960000_bib25 article-title: Reproducibility of scientific results – volume: 13 start-page: e1002169 year: 2015 ident: 2021050923564960000_bib45 article-title: Host–pathogen coevolution: The selective advantage of Bacillus thuringiensis virulence and its cry toxin genes publication-title: PLOS Biology doi: 10.1371/journal.pbio.1002169 – volume-title: Experimental and Quasi-Experimental Designs for Generalized Causal Inference year: 2002 ident: 2021050923564960000_bib67 – volume: 362 start-page: eaam5979 year: 2018 ident: 2021050923564960000_bib7 article-title: Contingency and determinism in evolution: Replaying life's tape publication-title: Science doi: 10.1126/science.aam5979 – volume: 87 start-page: 218 year: 2018 ident: 2021050923564960000_bib35 article-title: Reproducibility and replicability of rodent phenotyping in preclinical studies publication-title: Neuroscience and Biobehavioral Reviews doi: 10.1016/j.neubiorev.2018.01.003 – volume: 11 start-page: e0147215 year: 2016 ident: 2021050923564960000_bib66 article-title: When quality beats quantity: Decision theory, drug discovery, and the reproducibility crisis publication-title: PLOS ONE doi: 10.1371/journal.pone.0147215 – volume: 6 start-page: 257 year: 2009 ident: 2021050923564960000_bib63 article-title: Environmental standardization: Cure or cause of poor reproducibility in animal experiments? publication-title: Nature Methods doi: 10.1038/nmeth.1312 – volume: 68 start-page: 141 year: 1986 ident: 2021050923564960000_bib18 article-title: The causal assumptions of quasi-experimental practice: The origins of quasi-experimental practice publication-title: Synthese doi: 10.1007/BF00413970 – volume: 7 start-page: 167 year: 2010 ident: 2021050923564960000_bib64 article-title: Systematic variation improves reproducibility of animal experiments publication-title: Nature Methods doi: 10.1038/nmeth0310-167 – volume: 7 start-page: 10361 year: 2017 ident: 2021050923564960000_bib82 article-title: Precopulatory but not postcopulatory male reproductive traits diverge in response to mating system manipulation in Drosophila melanogaster publication-title: Ecology and Evolution doi: 10.1002/ece3.3542 – volume: 6 start-page: 6102 year: 2015 ident: 2021050923564960000_bib59 article-title: Origins of multicellular evolvability in snowflake yeast publication-title: Nature Communications doi: 10.1038/ncomms7102 – volume: 4 start-page: 461 year: 2020 ident: 2021050923564960000_bib16 article-title: Antagonistic pleiotropy conceals molecular adaptations in changing environments publication-title: Nature Ecology and Evolution doi: 10.1038/s41559-020-1107-8 – volume: 37 start-page: 509 year: 2016 ident: 2021050923564960000_bib75 article-title: Reproducibility crisis: Are we ignoring reaction norms? publication-title: Trends in Pharmacological Sciences doi: 10.1016/j.tips.2016.05.003 – volume: 17 start-page: e3000397 year: 2019 ident: 2021050923564960000_bib14 article-title: Historical contingency in the evolution of antibiotic resistance after decades of relaxed selection publication-title: PLOS Biology doi: 10.1371/journal.pbio.3000397 – volume: 2 start-page: 279 year: 2018 ident: 2021050923564960000_bib46 article-title: Genotypic variability enhances the reproducibility of an ecological study publication-title: Nature Ecology and Evolution doi: 10.1038/s41559-017-0434-x – volume: 12 start-page: 699 year: 2015 ident: 2021050923564960000_bib36 article-title: Clarifying the terminology that describes scientific reproducibility publication-title: Nature Methods doi: 10.1038/nmeth.3489 – volume-title: Toward a History of Epistemic Things: Synthesizing Proteins in the Test Tube year: 1997 ident: 2021050923564960000_bib61 – volume: 344 start-page: 1519 year: 2014 ident: 2021050923564960000_bib38 article-title: Global epistasis makes adaptation predictable despite sequence-level stochasticity publication-title: Science doi: 10.1126/science.1250939 – volume: 19 start-page: 27 year: 1997 ident: 2021050923564960000_bib10 article-title: Exploratory experimentation and the role of histochemical techniques in the work of Jean Brachet, 1948–1952 publication-title: History and Philosophy of the Life Sciences – volume: 282 start-page: 20152292 year: 2015 ident: 2021050923564960000_bib42 article-title: Sustained fitness gains and variability in fitness trajectories in the long-term evolution experiment with Escherichia coli publication-title: Proceedings of the Royal Society B doi: 10.1098/rspb.2015.2292 – volume-title: The Material Realization of Science: From Habermas to Experimentation and Referential Realism year: 2012 ident: 2021050923564960000_bib57 doi: 10.1007/978-94-007-4107-2 – volume: 100 start-page: 441 year: 2008 ident: 2021050923564960000_bib11 article-title: Experimental evolution publication-title: Heredity doi: 10.1038/hdy.2008.19 – volume: 104 start-page: 447 year: 2014 ident: 2021050923564960000_bib19 article-title: Parallel evolution of small colony variants in Burkholderia cenocepacia biofilms publication-title: Genomics doi: 10.1016/j.ygeno.2014.09.007 – volume: 2 start-page: 355 year: 2018 ident: 2021050923564960000_bib74 article-title: Parallel genetic adaptation across environments differing in mode of growth or resource availability publication-title: Evolution Letters doi: 10.1002/evl3.75 – volume: 1 start-page: 403 year: 2008 ident: 2021050923564960000_bib53 article-title: A genetic perspective on eye evolution: Gene sharing, convergence, and parallelism publication-title: Evolution: Education and Outreach – volume: 533 start-page: 452 year: 2016 ident: 2021050923564960000_bib4 article-title: 1,500 scientists lift the lid on reproducibility publication-title: Nature doi: 10.1038/533452a – start-page: 223 volume-title: Chance in Evolution year: 2016 ident: 2021050923564960000_bib21 article-title: Contingent evolution: Not by chance alone – volume: 115 start-page: 661 year: 2018 ident: 2021050923564960000_bib31 article-title: Why the reward structure of science makes reproducibility problems inevitable publication-title: The Journal of Philosophy doi: 10.5840/jphil20181151239 – volume: 26 start-page: 263 year: 2000 ident: 2021050923564960000_bib83 article-title: Behaviour and the standardization fallacy publication-title: Nature Genetics doi: 10.1038/81541 – volume: 41 start-page: 1800206 year: 2019 ident: 2021050923564960000_bib28 article-title: To read more papers, or to read papers better? A crucial point for the reproducibility crisis publication-title: BioEssays doi: 10.1002/bies.201800206 – volume-title: Trouble at the lab year: 2013 ident: 2021050923564960000_bib71 – volume: 15 start-page: 1365 year: 2005 ident: 2021050923564960000_bib27 article-title: Parallel adaptive evolution cultures of Escherichia coli lead to convergent growth phenotypes with different gene expression states publication-title: Genome Research doi: 10.1101/gr.3832305 – volume: 115 start-page: 9767 year: 2018 ident: 2021050923564960000_bib65 article-title: Cellular hysteresis as a principle to maximize the efficacy of antibiotic therapy publication-title: Proceedings of the National Academy of Sciences doi: 10.1073/pnas.1810004115 – volume: 500 start-page: 571 year: 2013 ident: 2021050923564960000_bib39 article-title: Pervasive genetic hitchhiking and clonal interference in forty evolving yeast populations publication-title: Nature doi: 10.1038/nature12344 – volume: 54 start-page: 421 year: 1966 ident: 2021050923564960000_bib44 article-title: The strategy of model building in population biology publication-title: American Scientist – volume: 72 start-page: 3032 year: 2006 ident: 2021050923564960000_bib49 article-title: Laboratory-dependent bacterial ecology: A cautionary tale publication-title: Applied and Environmental Microbiology doi: 10.1128/AEM.72.4.3032-3035.2006 – volume: 387 start-page: 703 year: 1997 ident: 2021050923564960000_bib69 article-title: Evolution of high mutation rates in experimental populations of E. coli publication-title: Nature doi: 10.1038/42701 – volume-title: Experimental and Quasi-Experimental Designs for Research year: 1963 ident: 2021050923564960000_bib13 – start-page: 129 volume-title: Including a Symposium on Mary Morgan: Curiosity, Imagination, and Surprise. Research in the History of Economic Thought and Methodology year: 2018 ident: 2021050923564960000_bib43 article-title: Rethinking reproducibility as a criterion for research quality doi: 10.1108/S0743-41542018000036B009 – volume: 272 start-page: 1802 year: 1996 ident: 2021050923564960000_bib23 article-title: Punctuated evolution caused by selection of rare beneficial mutations publication-title: Science doi: 10.1126/science.272.5269.1802 – volume: 73 start-page: 73 year: 2019 ident: 2021050923564960000_bib60 article-title: Adaptation, chance, and history in experimental evolution reversals to unicellularity publication-title: Evolution doi: 10.1111/evo.13654 – volume: 104 start-page: 639 year: 2007 ident: 2021050923564960000_bib81 article-title: Three kinds of idealization publication-title: Journal of Philosophy doi: 10.5840/jphil20071041240 – volume: 13 start-page: e1002165 year: 2015 ident: 2021050923564960000_bib29 article-title: The economics of reproducibility in preclinical research publication-title: PLOS Biology doi: 10.1371/journal.pbio.1002165 – volume: 505 start-page: 612 year: 2014 ident: 2021050923564960000_bib17 article-title: Policy: NIH plans to enhance reproducibility publication-title: Nature News doi: 10.1038/505612a – volume: 81 start-page: 756 year: 2014 ident: 2021050923564960000_bib80 article-title: Experimental modeling in biology: In vivo representation and stand-ins as modeling strategies publication-title: Philosophy of Science doi: 10.1086/678257 – volume: 536 start-page: 165 year: 2016 ident: 2021050923564960000_bib72 article-title: Tempo and mode of genome evolution in a 50,000-generation experiment publication-title: Nature doi: 10.1038/nature18959 – volume: 16 start-page: 86 year: 2016 ident: 2021050923564960000_bib54 article-title: Contrasting effects of historical contingency on phenotypic and genomic trajectories during a two-step evolution experiment with bacteria publication-title: BMC Evolutionary Biology doi: 10.1186/s12862-016-0662-8 – volume: 567 start-page: 305 year: 2019 ident: 2021050923564960000_bib3 article-title: Scientists rise up against statistical significance publication-title: Nature doi: 10.1038/d41586-019-00857-9 – volume: 81 start-page: 516 year: 2014 ident: 2021050923564960000_bib51 article-title: Experiments, simulations, and epistemic privilege publication-title: Philosophy of Science doi: 10.1086/677956 – volume: 57 start-page: 1829 year: 2003 ident: 2021050923564960000_bib8 article-title: Experimental evolution in drosophila melanogaster: Interaction of temperature and food quality selection regimes publication-title: Evolution doi: 10.1111/j.0014-3820.2003.tb00590.x – volume-title: Experimental Evolution: Concepts, Methods, and Applications of Selection Experiments year: 2009 ident: 2021050923564960000_bib30 doi: 10.1525/9780520944473 – volume: 112 start-page: 7530 year: 2015 ident: 2021050923564960000_bib47 article-title: A tortoise–hare pattern seen in adapting structured and unstructured populations suggests a rugged fitness landscape in bacteria publication-title: Proceedings of the National Academy of Sciences doi: 10.1073/pnas.1410631112 – volume: 46 start-page: 343 year: 2017 ident: 2021050923564960000_bib62 article-title: Systematic heterogenization for better reproducibility in animal experimentation publication-title: Lab Animal doi: 10.1038/laban.1330 – volume: 214 start-page: 3 year: 2020 ident: 2021050923564960000_bib26 article-title: Life-history evolution and the genetics of fitness components in Drosophila melanogaster publication-title: Genetics doi: 10.1534/genetics.119.300160 – volume: 9 start-page: 994 year: 2016 ident: 2021050923564960000_bib58 article-title: Macrophage adaptation leads to parallel evolution of genetically diverse Escherichia coli small-colony variants with increased fitness in vivo and antibiotic collateral sensitivity publication-title: Evolutionary Applications doi: 10.1111/eva.12397 – start-page: 187 volume-title: Philosophy of Science: Between the Natural Sciences, the Social Sciences, and the Humanities year: 2018 ident: 2021050923564960000_bib34 article-title: From stability to validity: How standards serve epistemic ends doi: 10.1007/978-3-319-72577-2_11 – start-page: 211 volume-title: Ecological Genomics: Ecology and the Evolution of Genes and Genomes year: 2014 ident: 2021050923564960000_bib1 article-title: The reproducibility of adaptation in the light of experimental evolution with whole genome sequencing doi: 10.1007/978-94-007-7347-9_11 – volume: 267 start-page: 87 year: 1995 ident: 2021050923564960000_bib73 article-title: Experimental tests of the roles of adaptation, chance, and history in evolution publication-title: Science doi: 10.1126/science.7809610 – volume: 67 start-page: 282 year: 2017 ident: 2021050923564960000_bib24 article-title: Metaresearch for evaluating reproducibility in ecology and evolution publication-title: BioScience – volume: 29 start-page: 337 year: 2007 ident: 2021050923564960000_bib50 article-title: Exploratory experimentation and scientific practice: Metagenomics and the proteorhodopsin case publication-title: History and Philosophy of the Life Sciences – volume: 105 start-page: 7899 year: 2008 ident: 2021050923564960000_bib6 article-title: Historical contingency and the evolution of a key innovation in an experimental population of Escherichia coli publication-title: Proceedings of the National Academy of Sciences doi: 10.1073/pnas.0803151105 – volume: 91 start-page: 6808 year: 1994 ident: 2021050923564960000_bib41 article-title: Dynamics of adaptation and diversification: A 10,000-generation experiment with bacterial populations publication-title: Proceedings of the National Academy of Sciences doi: 10.1073/pnas.91.15.6808 – volume: 73 start-page: 1839 year: 2019 ident: 2021050923564960000_bib68 article-title: How phenotypic convergence arises in experimental evolution publication-title: Evolution doi: 10.1111/evo.13806 – volume: 190 start-page: S1 year: 2017 ident: 2021050923564960000_bib2 article-title: Toward a predictive framework for convergent evolution: Integrating natural history, genetic mechanisms, and consequences for the diversity of life publication-title: American Naturalist doi: 10.1086/692111 – volume: 138 start-page: 1315 year: 1991 ident: 2021050923564960000_bib40 article-title: Long-term experimental evolution in Escherichia coli: I. Adaptation and divergence during 2,000 generations publication-title: American Naturalist doi: 10.1086/285289 – volume: 54 start-page: 297 year: 1957 ident: 2021050923564960000_bib12 article-title: Factors relevant to the validity of experiments in social settings publication-title: Psychological Bulletin doi: 10.1037/h0040950 – volume: 9 start-page: 1 year: 2019 ident: 2021050923564960000_bib9 article-title: Heterogenising study samples across testing time improves reproducibility of behavioural data publication-title: Scientific Reports doi: 10.1038/s41598-019-44705-2 – volume: 334 start-page: 1226 year: 2011 ident: 2021050923564960000_bib52 article-title: Reproducible research in computational science publication-title: Science doi: 10.1126/science.1213847 – volume: 116 start-page: 8437 year: 2019 ident: 2021050923564960000_bib33 article-title: Sexual conflict drives male manipulation of female postmating responses in Drosophila melanogaster publication-title: Proceedings of the National Academy of Sciences doi: 10.1073/pnas.1821386116 – volume-title: Reproducibility and Replicability in Science year: 2019 ident: 2021050923564960000_bib48 – volume: 34 start-page: 2229 year: 2017 ident: 2021050923564960000_bib5 article-title: Alternative Evolutionary Paths to Bacterial Antibiotic Resistance Cause Distinct Collateral Effects publication-title: Molecular Biology and Evolution doi: 10.1093/molbev/msx158 – volume: 26 start-page: 339 year: 2011 ident: 2021050923564960000_bib20 article-title: Historicity and experimental evolution publication-title: Biology and Philosophy doi: 10.1007/s10539-011-9256-4 – volume: 1 start-page: 3 year: 2002 ident: 2021050923564960000_bib84 article-title: Behavioral phenotyping enhanced: Beyond (environmental) standardization publication-title: Genes, Brain, and Behavior doi: 10.1046/j.1601-1848.2001.00006.x – volume: 21 start-page: 384 year: 2020 ident: 2021050923564960000_bib77 article-title: Reproducibility of animal research in light of biological variation publication-title: Nature Reviews Neuroscience doi: 10.1038/s41583-020-0313-3 |
| SSID | ssj0001439 |
| Score | 2.3983307 |
| Snippet | Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not... Abstract Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is... |
| SourceID | proquest crossref oup jstor |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 543 |
| SubjectTerms | Animal research Evolution Reproducibility Standardization Thinking of Biology Validity |
| Subtitle | Improving External Validity and Reproducibility in Experimental Evolution |
| Title | Beyond Standardization |
| URI | https://www.jstor.org/stable/27078724 https://www.proquest.com/docview/2564578368 |
| Volume | 71 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVAFT databaseName: Open Access Digital Library customDbUrl: eissn: 1525-3244 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0001439 issn: 0006-3568 databaseCode: KQ8 dateStart: 19960101 isFulltext: true titleUrlDefault: http://grweb.coalliance.org/oadl/oadl.html providerName: Colorado Alliance of Research Libraries – providerCode: PRVEBS databaseName: EBSCOhost Academic Search Ultimate customDbUrl: https://search.ebscohost.com/login.aspx?authtype=ip,shib&custid=s3936755&profile=ehost&defaultdb=asn eissn: 1525-3244 dateEnd: 20241102 omitProxy: true ssIdentifier: ssj0001439 issn: 0006-3568 databaseCode: ABDBF dateStart: 19640101 isFulltext: true titleUrlDefault: https://search.ebscohost.com/direct.asp?db=asn providerName: EBSCOhost – providerCode: PRVEBS databaseName: EBSCOhost Food Science Source customDbUrl: eissn: 1525-3244 dateEnd: 20241102 omitProxy: false ssIdentifier: ssj0001439 issn: 0006-3568 databaseCode: A8Z dateStart: 19640101 isFulltext: true titleUrlDefault: https://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=fsr providerName: EBSCOhost |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3fb9MwELZKJyReEL8mCgNZCImHyVvjH_HC2wadpknwwob2FsWxIxVBmKBDYv8E_zLn3MVNC4PBSxRZrpv6vvo-O3ffMfbcG2AJQTdCqdoK8PhGFE7monLToF0FFLoTSXrzNj861cdn5mw0-jGIWrpYuJ368rd5Jf9jVWgDu8Ys2X-wbBoUGuAe7AtXsDBcr2VjSj95R8cBlFIZN_nLs4IZyTxvvwfG7SPnxpTE807qFWNju9y_2VDrf_aNHnzlpe-clC8TGGDX-iF-MZLxuKYOXg11lWK3j2PG1vxTao9F4gNisE0uIZ4MhEs84qVWOomQ2TLu708Zjiurby6UwTI6O4EWXGkEkDo9XJGxKAshzwyWV4OSTuSpDWrf_uIEUCDLdXPS3QDwpntLh5fCEK_ufINtSHAT0zHb2D94fXCYnDvQS9pR4U9JOqBqF8fYpRFWeA6Guq7lUPZOv2MyJ3fYbdqC8H3E0102Cu09dhOLkn6_zypEFV9D1UueMMV7TPEeUxy68jVM8XnLh5jiCVMP2Onh7OTVkaBCHKJWUi1Erp3ObACq6poihmrURQhFUwO58177SgafqUxbqbzNmqJqqtxXti5gL2-9Bwa8ycbt5zY8ZLyqgAzJRtnCBi3rxgGF90Y5q2AY2M1PmOinraxJpT4WS_lYYrSEKnGaS5rmCXuR-p-jPsuVPTc7K6RuMgpdWakn7BmY5a-f3uqtVtIK8LWUUYoppkHtPbrOGI_ZreXfZouNF18uwhOgtAv3lGD2EwxAqLU |
| linkProvider | EBSCOhost |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Beyond+Standardization%3A+Improving+External+Validity+and+Reproducibility+in+Experimental+Evolution&rft.jtitle=Bioscience&rft.au=Desjardins%2C+Eric&rft.au=Kurtz%2C+Joachim&rft.au=Kranke%2C+Nina&rft.au=Lindeza%2C+Ana&rft.date=2021-05-01&rft.pub=Oxford+University+Press&rft.issn=0006-3568&rft.eissn=1525-3244&rft.volume=71&rft.issue=5&rft.spage=543&rft.epage=552&rft_id=info:doi/10.1093%2Fbiosci%2Fbiab008&rft.externalDocID=10.1093%2Fbiosci%2Fbiab008 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0006-3568&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0006-3568&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0006-3568&client=summon |