Web-based experimental economics software: How do they compare to desirable features?

Web-based experiments that cut across the lab vs. field distinction are increasingly popular with economists. However, non-standardized software features and services hinder comparability and replication. This study reviews a wide selection of experimental economics software packages and evaluates t...

Full description

Saved in:
Bibliographic Details
Published inJournal of behavioral and experimental finance Vol. 23; pp. 138 - 160
Main Authors Chan, Shu Wing, Schilizzi, Steven, Iftekhar, Md Sayed, Da Silva Rosa, Raymond
Format Journal Article
LanguageEnglish
Published Elsevier B.V 01.09.2019
Subjects
Economic experiments
Experimental economics
Online experiments
Software
Web-based
Web-based experiments
C88
Experimental economics
Web-based
code
Web-based experiments
Online experiments
Software
C81
Economic experiments
Online AccessGet full text
ISSN2214-6350
2214-6350
DOI10.1016/j.jbef.2019.04.007

Cover

Abstract Web-based experiments that cut across the lab vs. field distinction are increasingly popular with economists. However, non-standardized software features and services hinder comparability and replication. This study reviews a wide selection of experimental economics software packages and evaluates them against criteria based on the logistics and operational requirements of economic experiments. We find that oTree and SoPHIE rank highest across criteria, but Veconlab and classEx might be suitable for those with a dominant need for a large library of ready-made experiments. We find a portability gap: no presently available software allows portability of experiments across platforms because of technical complexity and the challenging coordination needs of experimental economists. As a result, experiments may be replicated only on the same platform or with the same software, but general replicability is slow and costly. This constrains the development of experimental economics as a replicable science.
AbstractList Web-based experiments that cut across the lab vs. field distinction are increasingly popular with economists. However, non-standardized software features and services hinder comparability and replication. This study reviews a wide selection of experimental economics software packages and evaluates them against criteria based on the logistics and operational requirements of economic experiments. We find that oTree and SoPHIE rank highest across criteria, but Veconlab and classEx might be suitable for those with a dominant need for a large library of ready-made experiments. We find a portability gap: no presently available software allows portability of experiments across platforms because of technical complexity and the challenging coordination needs of experimental economists. As a result, experiments may be replicated only on the same platform or with the same software, but general replicability is slow and costly. This constrains the development of experimental economics as a replicable science.
Author Iftekhar, Md Sayed
Schilizzi, Steven
Chan, Shu Wing
Da Silva Rosa, Raymond
Author_xml – sequence: 1
  givenname: Shu Wing
  surname: Chan
  fullname: Chan, Shu Wing
  email: chansw@ieee.org
  organization: Agriculture and Resource Economics, UWA School of Agriculture and Environment, M087, The University of Western Australia (UWA), 35 Stirling Hwy, Crawley WA 6009, Australia
– sequence: 2
  givenname: Steven
  orcidid: 0000-0002-4063-074X
  surname: Schilizzi
  fullname: Schilizzi, Steven
  email: steven.schilizzi@uwa.edu.au
  organization: Agriculture and Resource Economics, UWA School of Agriculture and Environment, M087, The University of Western Australia (UWA), 35 Stirling Hwy, Crawley WA 6009, Australia
– sequence: 3
  givenname: Md Sayed
  surname: Iftekhar
  fullname: Iftekhar, Md Sayed
  email: mdsayed.iftekhar@uwa.edu.au
  organization: Agriculture and Resource Economics, UWA School of Agriculture and Environment, M087, The University of Western Australia (UWA), 35 Stirling Hwy, Crawley WA 6009, Australia
– sequence: 4
  givenname: Raymond
  surname: Da Silva Rosa
  fullname: Da Silva Rosa, Raymond
  email: ray.dasilvarosa@uwa.edu.au
  organization: Accounting and Finance (UWA Business School), The University of Western Australia (M250), 35 Stirling Highway, Crawley WA 6009, Australia
BookMark eNp9kMFKAzEURYNUsNb-gKv8wIwvmcxMRwSRolYouLG4DEnmBTO0k5JEa__eKXUhLrq6jwvnwT2XZNT7Hgm5ZpAzYNVNl3cabc6BNTmIHKA-I2POmciqooTRn_uCTGPsAICVFcygHpPVO-pMq4gtxe8tBrfBPqk1ReN7v3Em0uht2qmAt3Thd7T1NH3gnhq_2Q4lTZ62GF1Qeo3UokqfAeP9FTm3ah1x-psTsnp6fJsvsuXr88v8YZmZQoiUCVaUnBVGcSFaM9O6MhqYEpzXrERRWN4WQoNQQlkAa0xjm6axhusaFcO2mJDZ8a8JPsaAVhqXVHK-T0G5tWQgD4ZkJw-G5MGQBCEHQwPK_6HbYbwK-9PQ3RHCYdSXwyCjcdgbbF1Ak2Tr3Sn8BxH_gps
CitedBy_id crossref_primary_10_1007_s40881_020_00087_0
crossref_primary_10_1016_j_jenvp_2021_101710
crossref_primary_10_1016_j_jbef_2022_100652
crossref_primary_10_1111_cobi_13633
crossref_primary_10_23887_ijssb_v6i2_44260
Cites_doi 10.1016/j.euroecorev.2014.07.003
10.1026//1618-3169.49.4.243
10.1016/j.jss.2011.11.010
10.1086/256654
10.2139/ssrn.2806713
10.1016/j.jbef.2019.04.008
10.1038/d41586-018-02108-9
10.5751/ES-06895-190420
10.1145/1600150.1600162
10.3758/s13428-014-0458-y
10.1016/j.jbef.2015.02.001
10.1126/science.aaf0918
10.1016/j.jbef.2017.12.004
10.1111/ecoj.12461
10.1017/S1930297500002205
10.1007/s40881-015-0004-4
10.1007/s10683-006-9159-4
ContentType Journal Article
Copyright 2019 Elsevier B.V.
Copyright_xml – notice: 2019 Elsevier B.V.
DBID AAYXX
CITATION
DOI 10.1016/j.jbef.2019.04.007
DatabaseName CrossRef
DatabaseTitle CrossRef
DatabaseTitleList
DeliveryMethod fulltext_linktorsrc
EISSN 2214-6350
EndPage 160
ExternalDocumentID 10_1016_j_jbef_2019_04_007
S221463501830090X
GroupedDBID --M
.~1
1~.
4.4
457
4G.
7-5
8P~
AACTN
AADFP
AAEDT
AAEDW
AAGJA
AAIAV
AAIKJ
AAKOC
AALRI
AAOAW
AAXUO
ABJNI
ABMAC
ABOYX
ABXDB
ABYKQ
ACDAQ
ACGFS
ACRLP
ADBBV
ADEZE
AEBSH
AEKER
AEYQN
AFKWA
AFTJW
AFYLN
AGHFR
AGTHC
AGUBO
AIEXJ
AIIAU
AIKHN
AITUG
AJBFU
AJOXV
ALMA_UNASSIGNED_HOLDINGS
AMFUW
AMRAJ
AXJTR
AXLSJ
BKOJK
BLXMC
EBS
EFJIC
EFLBG
EJD
FDB
FEDTE
FIRID
FNPLU
FYGXN
GBLVA
HVGLF
KOM
OAUVE
P-8
P-9
PC.
ROL
SPCBC
SSB
SSF
SSY
SSZ
T5K
~G-
0R~
AAQFI
AATTM
AAXKI
AAYWO
AAYXX
ACVFH
ADCNI
AEIPS
AEUPX
AFJKZ
AFPUW
AFXIZ
AGCQF
AGRNS
AIGII
AIIUN
AKBMS
AKRWK
AKYEP
ANKPU
APXCP
BNPGV
CITATION
SSH
ID FETCH-LOGICAL-c344t-4135213ca244dc8bb6cb01a422715e43f2d34b04a4af00fcc9f999fc2b7ea1ed3
IEDL.DBID AIKHN
ISSN 2214-6350
IngestDate Thu Apr 24 22:52:16 EDT 2025
Tue Jul 01 03:12:54 EDT 2025
Fri Feb 23 02:30:07 EST 2024
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Keywords C88
Experimental economics
Web-based
code
Web-based experiments
Online experiments
Software
C81
Economic experiments
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c344t-4135213ca244dc8bb6cb01a422715e43f2d34b04a4af00fcc9f999fc2b7ea1ed3
ORCID 0000-0002-4063-074X
OpenAccessLink http://hdl.handle.net/10072/395014
PageCount 23
ParticipantIDs crossref_citationtrail_10_1016_j_jbef_2019_04_007
crossref_primary_10_1016_j_jbef_2019_04_007
elsevier_sciencedirect_doi_10_1016_j_jbef_2019_04_007
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate September 2019
2019-09-00
PublicationDateYYYYMMDD 2019-09-01
PublicationDate_xml – month: 09
  year: 2019
  text: September 2019
PublicationDecade 2010
PublicationTitle Journal of behavioral and experimental finance
PublicationYear 2019
Publisher Elsevier B.V
Publisher_xml – name: Elsevier B.V
References Gertler, Galiani, Romero (b14) 2018; 554
Croson, R., 2003. Why and How To Experiment: Methodologies from Experimental Economics. University of Illinois Law Review.
(accessed 15.10.06).
Gardner (b13) 2011; 11
Jansen, Lee, Waring (b20) 2014; 19
(accessed 15.10.03).
Wroblewski, L., 2011, RESS: Responsive Design + Server Side Components.
Selenium, ., 2015. Selenium – Web Browser Automation.
Hendriks, A., 2012. SoPHIE - Software Platform for Human Interaction Experiments. University of Osnabrueck, Working Paper, 2012.
Palan (b27) 2015; 5
(accessed 17.08.12).
Reips (b34) 2002; 49
Seithe, M., 2012. Introducing the Bonn Experiment System (BoXS) (No. 01/2012). Bonn Econ Discussion Papers.
Chen, D.L., Schonger, M., Wickens, C., 2015. oTree – An Open-Source Platform for Laboratory, Online, and Field Experiments. Working Paper, pp.1–16.
Friedman, Sunder (b12) 1994
Hibbert, C., 2005. Zocalo: An Open-Source Platform for Deploying Prediction Markets. CommerceNet Labs, 21.
de Leeuw (b23) 2015; 47
Chamberlin (b6) 1948; 56
Leff, Rayfield (b24) 2001
Robot Framework, 2017. Robot Framework.
jQuery, 2015. jQuery.
(accessed 18.06.01).
psiTurk.org, 2014. pisTurl: crowdsource your research.
Paolacci, Chandler, Ipeirotis (b29) 2010; 5
Reips (b33) 2000
(accessed 16.03.25).
Palan, Schitter (b28) 2018; 17
Arechar, Gächter, Molleman (b2) 2017
Giamattei, Lamsbdorff (b15) 2019; 29
LabSEE, 2015. LabSEE: Experiments Surveys Test online.
Prolific.ac, 2018. Prolific: Bringing people together to power the world’s research.
Camerer (b5) 2016
Greiner (b16) 2015; 1
Bootstrap, 2015. Bootstrap – The most popular HTML, CSS, and JS library in the world.
Fischbacher (b11) 2007; 10
Midha, Palvia (b25) 2012; 85
Amazon Mechanical Turk, 2015. Overview – Amazon Mechanical Turk.
.
Schaffner, M., 2014. Programming for Experimental Economics: Introducing CORAL - a lightweight framework for experimental economic experiments.
Chilton, L.B., et al., 2009. Seaweed: a web application for designing economic games. In: HComp09 Proceedings of the ACM SIGKDD Workshop on Human Computation, pp. 34–35.
Bock, Baetge, Nicklisch (b3) 2014; 71
Coelho, Valente (b9) 2017
Weel, J., McCabe, K., 2009. Willow: Experiments in Python. George Mason University.
Reips (b32) 1996
(accessed 18.07.01).
Ioannidis, Stanley, Doucouliagos (b19) 2017; 127
(accessed 15.08.01).
Nielsen, J., 2012. Usability 101: Introduction to Usability.
10.1016/j.jbef.2019.04.007_b36
de Leeuw (10.1016/j.jbef.2019.04.007_b23) 2015; 47
10.1016/j.jbef.2019.04.007_b37
10.1016/j.jbef.2019.04.007_b35
10.1016/j.jbef.2019.04.007_b10
10.1016/j.jbef.2019.04.007_b30
Fischbacher (10.1016/j.jbef.2019.04.007_b11) 2007; 10
10.1016/j.jbef.2019.04.007_b31
Giamattei (10.1016/j.jbef.2019.04.007_b15) 2019; 29
10.1016/j.jbef.2019.04.007_b18
Palan (10.1016/j.jbef.2019.04.007_b27) 2015; 5
Reips (10.1016/j.jbef.2019.04.007_b33) 2000
10.1016/j.jbef.2019.04.007_b38
Arechar (10.1016/j.jbef.2019.04.007_b2) 2017
10.1016/j.jbef.2019.04.007_b17
10.1016/j.jbef.2019.04.007_b39
Greiner (10.1016/j.jbef.2019.04.007_b16) 2015; 1
Leff (10.1016/j.jbef.2019.04.007_b24) 2001
Midha (10.1016/j.jbef.2019.04.007_b25) 2012; 85
10.1016/j.jbef.2019.04.007_b40
Chamberlin (10.1016/j.jbef.2019.04.007_b6) 1948; 56
Paolacci (10.1016/j.jbef.2019.04.007_b29) 2010; 5
Camerer (10.1016/j.jbef.2019.04.007_b5) 2016
10.1016/j.jbef.2019.04.007_b26
Gardner (10.1016/j.jbef.2019.04.007_b13) 2011; 11
Jansen (10.1016/j.jbef.2019.04.007_b20) 2014; 19
10.1016/j.jbef.2019.04.007_b21
10.1016/j.jbef.2019.04.007_b22
Ioannidis (10.1016/j.jbef.2019.04.007_b19) 2017; 127
10.1016/j.jbef.2019.04.007_b8
10.1016/j.jbef.2019.04.007_b7
10.1016/j.jbef.2019.04.007_b4
Reips (10.1016/j.jbef.2019.04.007_b32) 1996
Bock (10.1016/j.jbef.2019.04.007_b3) 2014; 71
10.1016/j.jbef.2019.04.007_b1
Palan (10.1016/j.jbef.2019.04.007_b28) 2018; 17
Friedman (10.1016/j.jbef.2019.04.007_b12) 1994
Coelho (10.1016/j.jbef.2019.04.007_b9) 2017
Reips (10.1016/j.jbef.2019.04.007_b34) 2002; 49
Gertler (10.1016/j.jbef.2019.04.007_b14) 2018; 554
References_xml – volume: 5
  start-page: 1
  year: 2015
  end-page: 14
  ident: b27
  article-title: GIMS—SOftware for asset market experiments
  publication-title: J. Behav. Exp. Finance
– reference: . (accessed 18.07.01).
– reference: . (accessed 15.10.03).
– year: 1994
  ident: b12
  article-title: Experimental Methods: A Primer for Economists
– start-page: 89
  year: 2000
  end-page: 117
  ident: b33
  article-title: The web experiment method: Advantages, disadvantages, and solutions
  publication-title: Proceeding in Psychological Experiments on the Internet
– reference: Nielsen, J., 2012. Usability 101: Introduction to Usability.
– reference: LabSEE, 2015. LabSEE: Experiments Surveys Test online.
– volume: 49
  start-page: 243
  year: 2002
  end-page: 256
  ident: b34
  article-title: Standards for internet-based experimenting
  publication-title: Exp. Psychol.
– volume: 554
  start-page: 417
  year: 2018
  end-page: 419
  ident: b14
  article-title: How to make replication the norm
  publication-title: Nature
– volume: 47
  start-page: 1
  year: 2015
  end-page: 12
  ident: b23
  article-title: Jspsych: A javascript library for creating behavioral experiments in a web browser
  publication-title: Behav. Res. Methods
– reference: Chen, D.L., Schonger, M., Wickens, C., 2015. oTree – An Open-Source Platform for Laboratory, Online, and Field Experiments. Working Paper, pp.1–16.
– reference: Amazon Mechanical Turk, 2015. Overview – Amazon Mechanical Turk.
– reference: Seithe, M., 2012. Introducing the Bonn Experiment System (BoXS) (No. 01/2012). Bonn Econ Discussion Papers.
– reference: Wroblewski, L., 2011, RESS: Responsive Design + Server Side Components.
– reference: Croson, R., 2003. Why and How To Experiment: Methodologies from Experimental Economics. University of Illinois Law Review.
– reference: Selenium, ., 2015. Selenium – Web Browser Automation.
– year: 1996
  ident: b32
  article-title: Experimenting in the world wide web
  publication-title: Proceedings of the 26th Society for Computers in Psychology Conference (SCiP–96)
– volume: 71
  start-page: 117
  year: 2014
  end-page: 120
  ident: b3
  article-title: Hroot: Hamburg registration and organization online tool
  publication-title: Eur. Econ. Rev.
– start-page: 186
  year: 2017
  end-page: 196
  ident: b9
  article-title: Why modern open source projects fail
  publication-title: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering
– volume: 5
  start-page: 411
  year: 2010
  end-page: 419
  ident: b29
  article-title: Running experiments on amazon mechanical turk
  publication-title: Judgment Decis. Mak.
– reference: (accessed 16.03.25).
– volume: 85
  start-page: 895
  year: 2012
  end-page: 905
  ident: b25
  article-title: Factors affecting the success of open source software
  publication-title: J. Syst. Softw.
– reference: (accessed 15.10.06).
– start-page: 118
  year: 2001
  end-page: 127
  ident: b24
  article-title: Web-application development using the model/view/controller design pattern
  publication-title: IEEE Enterprise Distributed Object Computing Conference
– reference: . (accessed 18.06.01).
– reference: Weel, J., McCabe, K., 2009. Willow: Experiments in Python. George Mason University.
– reference: Schaffner, M., 2014. Programming for Experimental Economics: Introducing CORAL - a lightweight framework for experimental economic experiments.
– start-page: 1
  year: 2017
  end-page: 33
  ident: b2
  article-title: Conducting interactive experiments online
  publication-title: Exp. Econom.
– reference: Prolific.ac, 2018. Prolific: Bringing people together to power the world’s research.
– reference: Bootstrap, 2015. Bootstrap – The most popular HTML, CSS, and JS library in the world.
– volume: 56
  start-page: 95
  year: 1948
  end-page: 108
  ident: b6
  article-title: An experimental imperfect market
  publication-title: J. Political Econ.
– reference: psiTurk.org, 2014. pisTurl: crowdsource your research.
– volume: 1
  start-page: 114
  year: 2015
  end-page: 125
  ident: b16
  article-title: Subject pool recruitment procedures: organizing experiments with ORSEE
  publication-title: J. Econom. Sci. Assoc.
– volume: 10
  start-page: 171
  year: 2007
  end-page: 178
  ident: b11
  article-title: Z-tree: Zurich toolbox for ready-made economic experiments
  publication-title: Exp. Econom.
– reference: .
– volume: 11
  start-page: 13
  year: 2011
  end-page: 19
  ident: b13
  article-title: Responsive web design: Enriching the user experience
  publication-title: Sigma J.: Inside Digit. Ecosyst.
– reference: (accessed 17.08.12).
– volume: 19
  start-page: 20
  year: 2014
  ident: b20
  article-title: Experimental platforms for behavioral experiments on social-ecological systems
  publication-title: Ecology Soc.
– reference: jQuery, 2015. jQuery.
– reference: Robot Framework, 2017. Robot Framework.
– year: 2016
  ident: b5
  article-title: Evaluating replicability of laboratory experiments in economics
  publication-title: Science
– reference: Hibbert, C., 2005. Zocalo: An Open-Source Platform for Deploying Prediction Markets. CommerceNet Labs, 21.
– reference: . (accessed 15.08.01).
– reference: Chilton, L.B., et al., 2009. Seaweed: a web application for designing economic games. In: HComp09 Proceedings of the ACM SIGKDD Workshop on Human Computation, pp. 34–35.
– volume: 17
  start-page: 22
  year: 2018
  end-page: 27
  ident: b28
  article-title: Prolific.ac – a subject pool for online experiments
  publication-title: J. Behav. Exp. Finance
– reference: Hendriks, A., 2012. SoPHIE - Software Platform for Human Interaction Experiments. University of Osnabrueck, Working Paper, 2012.
– volume: 127
  start-page: 236
  year: 2017
  end-page: 265
  ident: b19
  article-title: ‘The power of bias in economics research’
  publication-title: Econ. J.
– volume: 29
  start-page: 223
  year: 2019
  end-page: 231
  ident: b15
  article-title: classEx - An online tool for lab-in-the-field experiments with smartphones
  publication-title: J. Behav. Exp. Finance
– volume: 11
  start-page: 13
  issue: 1
  year: 2011
  ident: 10.1016/j.jbef.2019.04.007_b13
  article-title: Responsive web design: Enriching the user experience
  publication-title: Sigma J.: Inside Digit. Ecosyst.
– volume: 71
  start-page: 117
  year: 2014
  ident: 10.1016/j.jbef.2019.04.007_b3
  article-title: Hroot: Hamburg registration and organization online tool
  publication-title: Eur. Econ. Rev.
  doi: 10.1016/j.euroecorev.2014.07.003
– volume: 49
  start-page: 243
  issue: 4
  year: 2002
  ident: 10.1016/j.jbef.2019.04.007_b34
  article-title: Standards for internet-based experimenting
  publication-title: Exp. Psychol.
  doi: 10.1026//1618-3169.49.4.243
– ident: 10.1016/j.jbef.2019.04.007_b35
– ident: 10.1016/j.jbef.2019.04.007_b10
– volume: 85
  start-page: 895
  issue: 4
  year: 2012
  ident: 10.1016/j.jbef.2019.04.007_b25
  article-title: Factors affecting the success of open source software
  publication-title: J. Syst. Softw.
  doi: 10.1016/j.jss.2011.11.010
– ident: 10.1016/j.jbef.2019.04.007_b31
– volume: 56
  start-page: 95
  issue: 2
  year: 1948
  ident: 10.1016/j.jbef.2019.04.007_b6
  article-title: An experimental imperfect market
  publication-title: J. Political Econ.
  doi: 10.1086/256654
– ident: 10.1016/j.jbef.2019.04.007_b39
– ident: 10.1016/j.jbef.2019.04.007_b37
– ident: 10.1016/j.jbef.2019.04.007_b1
– year: 1996
  ident: 10.1016/j.jbef.2019.04.007_b32
  article-title: Experimenting in the world wide web
– start-page: 1
  year: 2017
  ident: 10.1016/j.jbef.2019.04.007_b2
  article-title: Conducting interactive experiments online
  publication-title: Exp. Econom.
– ident: 10.1016/j.jbef.2019.04.007_b18
– start-page: 186
  year: 2017
  ident: 10.1016/j.jbef.2019.04.007_b9
  article-title: Why modern open source projects fail
– ident: 10.1016/j.jbef.2019.04.007_b22
– ident: 10.1016/j.jbef.2019.04.007_b26
– ident: 10.1016/j.jbef.2019.04.007_b7
  doi: 10.2139/ssrn.2806713
– volume: 29
  start-page: 223
  year: 2019
  ident: 10.1016/j.jbef.2019.04.007_b15
  article-title: classEx - An online tool for lab-in-the-field experiments with smartphones
  publication-title: J. Behav. Exp. Finance
  doi: 10.1016/j.jbef.2019.04.008
– start-page: 118
  year: 2001
  ident: 10.1016/j.jbef.2019.04.007_b24
  article-title: Web-application development using the model/view/controller design pattern
– ident: 10.1016/j.jbef.2019.04.007_b30
– volume: 554
  start-page: 417
  year: 2018
  ident: 10.1016/j.jbef.2019.04.007_b14
  article-title: How to make replication the norm
  publication-title: Nature
  doi: 10.1038/d41586-018-02108-9
– ident: 10.1016/j.jbef.2019.04.007_b4
– volume: 19
  start-page: 20
  issue: 4
  year: 2014
  ident: 10.1016/j.jbef.2019.04.007_b20
  article-title: Experimental platforms for behavioral experiments on social-ecological systems
  publication-title: Ecology Soc.
  doi: 10.5751/ES-06895-190420
– ident: 10.1016/j.jbef.2019.04.007_b38
– ident: 10.1016/j.jbef.2019.04.007_b8
  doi: 10.1145/1600150.1600162
– volume: 47
  start-page: 1
  issue: 1
  year: 2015
  ident: 10.1016/j.jbef.2019.04.007_b23
  article-title: Jspsych: A javascript library for creating behavioral experiments in a web browser
  publication-title: Behav. Res. Methods
  doi: 10.3758/s13428-014-0458-y
– ident: 10.1016/j.jbef.2019.04.007_b36
– volume: 5
  start-page: 1
  year: 2015
  ident: 10.1016/j.jbef.2019.04.007_b27
  article-title: GIMS—SOftware for asset market experiments
  publication-title: J. Behav. Exp. Finance
  doi: 10.1016/j.jbef.2015.02.001
– year: 1994
  ident: 10.1016/j.jbef.2019.04.007_b12
– start-page: 89
  year: 2000
  ident: 10.1016/j.jbef.2019.04.007_b33
  article-title: The web experiment method: Advantages, disadvantages, and solutions
– ident: 10.1016/j.jbef.2019.04.007_b17
– year: 2016
  ident: 10.1016/j.jbef.2019.04.007_b5
  article-title: Evaluating replicability of laboratory experiments in economics
  publication-title: Science
  doi: 10.1126/science.aaf0918
– ident: 10.1016/j.jbef.2019.04.007_b21
– volume: 17
  start-page: 22
  year: 2018
  ident: 10.1016/j.jbef.2019.04.007_b28
  article-title: Prolific.ac – a subject pool for online experiments
  publication-title: J. Behav. Exp. Finance
  doi: 10.1016/j.jbef.2017.12.004
– ident: 10.1016/j.jbef.2019.04.007_b40
– volume: 127
  start-page: 236
  issue: 605
  year: 2017
  ident: 10.1016/j.jbef.2019.04.007_b19
  article-title: ‘The power of bias in economics research’
  publication-title: Econ. J.
  doi: 10.1111/ecoj.12461
– volume: 5
  start-page: 411
  issue: 5
  year: 2010
  ident: 10.1016/j.jbef.2019.04.007_b29
  article-title: Running experiments on amazon mechanical turk
  publication-title: Judgment Decis. Mak.
  doi: 10.1017/S1930297500002205
– volume: 1
  start-page: 114
  issue: 1
  year: 2015
  ident: 10.1016/j.jbef.2019.04.007_b16
  article-title: Subject pool recruitment procedures: organizing experiments with ORSEE
  publication-title: J. Econom. Sci. Assoc.
  doi: 10.1007/s40881-015-0004-4
– volume: 10
  start-page: 171
  issue: 2
  year: 2007
  ident: 10.1016/j.jbef.2019.04.007_b11
  article-title: Z-tree: Zurich toolbox for ready-made economic experiments
  publication-title: Exp. Econom.
  doi: 10.1007/s10683-006-9159-4
SSID ssj0001560807
Score 2.1320975
SecondaryResourceType review_article
Snippet Web-based experiments that cut across the lab vs. field distinction are increasingly popular with economists. However, non-standardized software features and...
SourceID crossref
elsevier
SourceType Enrichment Source
Index Database
Publisher
StartPage 138
SubjectTerms Economic experiments
Experimental economics
Online experiments
Software
Web-based
Web-based experiments
Title Web-based experimental economics software: How do they compare to desirable features?
URI https://dx.doi.org/10.1016/j.jbef.2019.04.007
Volume 23
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3PS8MwFA77cfEiiorzx8jBm3RL06RrvcgYjqq4iw53C0mTwIasY60ML_7tJm2qE2QHjw19ED7C-z6S974HwBXiIRUhij0Zxfa2yg88jij2ZEiDlFNlJIh90X2ahMmUPMzorAFGdS-MLat0ub_K6WW2dit9h2Z_NZ_3n7GdSV0a0gVGKKBZE7SxYfuoBdrD-8dk8nPVYli9apy2IZ6Nce0zVaXXQqjSzDPuVVbaf1PUFu2MD8C-04twWG3pEDTU8ghMX5XwLP9IuO3QD5XrMs5hbrLrhq_VDUyyDZQZNDrvA7qCc1hkUKp8vrZtU1Cr0tszvz0G0_Hdyyjx3HwELw0IKTzDP4Z8DaSGomUaCRGmAvmcYDzwqSKBxjIgAhFOuEZIp2msjRzUKRYDxX0lgxPQWmZLdQpgSCgPI04i6zaPsBQDiYiMaYTiSGtMOsCvIWGpMw-3MyzeWF0ltmAWRmZhZIgwA2MHXH_HrCrrjJ1_0xpp9usAMJPbd8Sd_TPuHOzZr6pc7AK0ivW7ujT6ohBd0Ox9-l13ir4A8-LNuw
linkProvider Elsevier
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3PS8MwFA5zO-hFFBXnzxy8SVzaJl3rRcZwdO7HxQ13C0mTwoasY60M_3uTNtUJsoPXpg_CR3jfR_Le9wC4w9ynwschkkFobqscD3FMXSR96sWcKi1BzIvuaOxHU_Iyo7Ma6Fa9MKas0ub-MqcX2dp-aVk0W6v5vPXqmpnUhSGdp4UCnu2BBjFDreug0ekPovHPVYtm9bJx2oQgE2PbZ8pKr4VQhZln-FBaaf9NUVu00zsCh1Yvwk65pWNQU8sTMH1TAhn-kXDboR8q22WcwUxn1w1fq0cYpRsoU6h13ie0BecwT6FU2Xxt2qZgogpvz-zpFEx7z5NuhOx8BBR7hORI848mXw2ppmgZB0L4scAOJ67bdqgiXuJKjwhMOOEJxkkch4mWg0nsirbijpLeGagv06U6B9AnlPsBJ4Fxm8euFG2JiQxpgMMgSVzSBE4FCYutebiZYfHOqiqxBTMwMgMjw4RpGJvg_jtmVVpn7PybVkizXweA6dy-I-7in3G3YD-ajIZs2B8PLsGBWSlLx65APV9_qGutNXJxY8_SF9Efz6E
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Web-based+experimental+economics+software%3A+How+do+they+compare+to+desirable+features%3F&rft.jtitle=Journal+of+behavioral+and+experimental+finance&rft.au=Chan%2C+Shu+Wing&rft.au=Schilizzi%2C+Steven&rft.au=Iftekhar%2C+Md+Sayed&rft.au=Da+Silva+Rosa%2C+Raymond&rft.date=2019-09-01&rft.issn=2214-6350&rft.eissn=2214-6350&rft.volume=23&rft.spage=138&rft.epage=160&rft_id=info:doi/10.1016%2Fj.jbef.2019.04.007&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_jbef_2019_04_007
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2214-6350&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2214-6350&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2214-6350&client=summon