Human misidentification in Turing tests
This paper presents some important issues on misidentification of human interlocutors in text-based communication during practical Turing tests. The study here presents transcripts in which human judges succumbed to theconfederate effect, misidentifying hidden human foils for machines. An attempt is...
Saved in:
| Published in | Journal of experimental & theoretical artificial intelligence Vol. 27; no. 2; pp. 123 - 135 |
|---|---|
| Main Authors | , |
| Format | Journal Article |
| Language | English |
| Published |
Abingdon
Taylor & Francis
04.03.2015
Taylor & Francis Ltd |
| Subjects | |
| Online Access | Get full text |
| ISSN | 0952-813X 1362-3079 |
| DOI | 10.1080/0952813X.2014.921734 |
Cover
| Abstract | This paper presents some important issues on misidentification of human interlocutors in text-based communication during practical Turing tests. The study here presents transcripts in which human judges succumbed to theconfederate effect, misidentifying hidden human foils for machines. An attempt is made to assess the reasons for this. The practical Turing tests in question were held on 23 June 2012 at Bletchley Park, England. A selection of actual full transcripts from the tests is shown and an analysis is given in each case. As a result of these tests, conclusions are drawn with regard to the sort of strategies which can perhaps lead to erroneous conclusions when one is involved as an interrogator. Such results also serve to indicate conversational directions to avoid for those machine designers who wish to create a conversational entity that performs well on the Turing test. |
|---|---|
| AbstractList | This paper presents some important issues on misidentification of human interlocutors in text-based communication during practical Turing tests. The study here presents transcripts in which human judges succumbed to theconfederate effect, misidentifying hidden human foils for machines. An attempt is made to assess the reasons for this. The practical Turing tests in question were held on 23 June 2012 at Bletchley Park, England. A selection of actual full transcripts from the tests is shown and an analysis is given in each case. As a result of these tests, conclusions are drawn with regard to the sort of strategies which can perhaps lead to erroneous conclusions when one is involved as an interrogator. Such results also serve to indicate conversational directions to avoid for those machine designers who wish to create a conversational entity that performs well on the Turing test. This paper presents some important issues on misidentification of human interlocutors in text-based communication during practical Turing tests. The study here presents transcripts in which human judges succumbed to the confederate effect, misidentifying hidden human foils for machines. An attempt is made to assess the reasons for this. The practical Turing tests in question were held on 23 June 2012 at Bletchley Park, England. A selection of actual full transcripts from the tests is shown and an analysis is given in each case. As a result of these tests, conclusions are drawn with regard to the sort of strategies which can perhaps lead to erroneous conclusions when one is involved as an interrogator. Such results also serve to indicate conversational directions to avoid for those machine designers who wish to create a conversational entity that performs well on the Turing test. |
| Author | Shah, Huma Warwick, Kevin |
| Author_xml | – sequence: 1 givenname: Kevin surname: Warwick fullname: Warwick, Kevin email: k.warwick@reading.ac.uk organization: School of Systems Engineering, University of Reading – sequence: 2 givenname: Huma surname: Shah fullname: Shah, Huma organization: School of Systems Engineering, University of Reading |
| BookMark | eNqFkD1PwzAYhC1UJFrgHzBEYoAlxV-JHRaEKqBIlViKxGY5jo1cpXaxE6H-exwCSweYbnnu3ntvBibOOw3ABYJzBDm8gVWBOSJvcwwRnVcYMUKPwBSREucEsmoCpgOSD8wJmMW4gRCiAqEpuFr2W-myrY220a6zxirZWe8y67J1H6x7zzodu3gGjo1soz7_0VPw-viwXizz1cvT8-J-lStKeJdThZQppCQVxYiWsqGMc1JXiNccKY21aUiDJWUNZKisZSlxwQtqmK4rIxkjp-B6zN0F_9GnyyJVU7ptpdO-jwKVjFVFmSShlwfoxvfBpXaJKikhkGCcqNuRUsHHGLQRynbfL3ZB2lYgKIYNxe-GYthQjBsmMz0w74LdyrD_z3Y32qwzPmzlpw9tIzq5b30wQTployB_JnwBqWmIYA |
| CitedBy_id | crossref_primary_10_1089_big_2017_0038 crossref_primary_10_1016_j_knosys_2018_10_006 crossref_primary_10_1080_0952813X_2015_1055826 crossref_primary_10_1007_s00146_016_0669_0 crossref_primary_10_1016_j_chbr_2024_100496 crossref_primary_10_3389_fpsyg_2015_00634 crossref_primary_10_1016_j_chb_2016_01_004 crossref_primary_10_2139_ssrn_4610978 crossref_primary_10_1177_02557614241249163 crossref_primary_10_1080_0952813X_2015_1132273 crossref_primary_10_1007_s12559_015_9372_6 crossref_primary_10_1086_715227 crossref_primary_10_4018_ijse_2014010106 crossref_primary_10_4236_jcc_2024_123014 crossref_primary_10_1007_s00146_015_0588_5 |
| Cites_doi | 10.1145/141420.141422 10.1093/oso/9780198250579.001.0001 10.1108/03684921011036187 10.1093/mind/LIX.236.433 10.1007/s11023-013-9301-y 10.1007/978-3-642-27660-6_11 10.1093/mind/LXXX.318.290 10.1007/s11023-010-9219-6 10.1007/BF00372497 10.1016/S1364-6613(00)01453-4 10.1109/TCIAIG.2283538 |
| ContentType | Journal Article |
| Copyright | 2014 Taylor & Francis 2014 Copyright Taylor & Francis Ltd. 2015 |
| Copyright_xml | – notice: 2014 Taylor & Francis 2014 – notice: Copyright Taylor & Francis Ltd. 2015 |
| DBID | AAYXX CITATION JQ2 7SC 8FD F28 FR3 L7M L~C L~D |
| DOI | 10.1080/0952813X.2014.921734 |
| DatabaseName | CrossRef ProQuest Computer Science Collection Computer and Information Systems Abstracts Technology Research Database ANTE: Abstracts in New Technology & Engineering Engineering Research Database Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
| DatabaseTitle | CrossRef ProQuest Computer Science Collection Technology Research Database Computer and Information Systems Abstracts – Academic Computer and Information Systems Abstracts Engineering Research Database Advanced Technologies Database with Aerospace ANTE: Abstracts in New Technology & Engineering Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | ProQuest Computer Science Collection Technology Research Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 1362-3079 |
| EndPage | 135 |
| ExternalDocumentID | 3628020061 10_1080_0952813X_2014_921734 921734 |
| Genre | Article Feature |
| GeographicLocations | Bletchley England |
| GeographicLocations_xml | – name: Bletchley England |
| GroupedDBID | .4S .7F .DC .QJ 0BK 0R~ 29K 2DF 30N 4.4 5GY 5VS 8VB AAENE AAGDL AAHIA AAJMT AALDU AAMIU AAPUL AAQRR ABCCY ABDBF ABFIM ABHAV ABIVO ABJNI ABLIJ ABPAQ ABPEM ABTAI ABXUL ABXYU ACGEJ ACGFS ACGOD ACTIO ACUHS ADCVX ADGTB ADMLS ADXPE AEGXH AEISY AEMOZ AENEX AEOZL AEPSL AEYOC AFKVX AFRVT AGDLA AGMYJ AHDZW AHQJS AIJEM AIYEW AJWEG AKBVH AKOOK AKVCP ALMA_UNASSIGNED_HOLDINGS ALQZU AQRUH AQTUD ARCSS AVBZW AWYRJ BLEHA CCCUG CS3 D-I DGEBU DKSSO EAP EBR EBS EBU ECS EDO EJD EMK EPL EST ESX E~A E~B F5P GTTXZ H13 HF~ HZ~ H~P I-F IPNFZ J.P K1G KYCEM M4Z MK~ NA5 NX~ O9- P2P PQQKQ QWB RIG RNANH ROSJB RTWRZ S-T SNACF TASJS TBQAZ TDBHL TEN TFL TFT TFW TH9 TNC TTHFI TUROJ TUS TWF UT5 UU3 ZGOLN ZL0 ~S~ AAYXX CITATION ADYSH JQ2 7SC 8FD F28 FR3 L7M L~C L~D |
| ID | FETCH-LOGICAL-c438t-4c1cf5aa3942146ad47883b918b81ce2efd3d2a47d0716ba6a25854f7eb9fa773 |
| ISSN | 0952-813X |
| IngestDate | Thu Aug 07 15:15:15 EDT 2025 Fri Jul 25 03:55:13 EDT 2025 Thu Apr 24 23:11:01 EDT 2025 Wed Oct 01 03:54:36 EDT 2025 Mon Oct 20 23:42:56 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 2 |
| Language | English |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c438t-4c1cf5aa3942146ad47883b918b81ce2efd3d2a47d0716ba6a25854f7eb9fa773 |
| Notes | SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 14 ObjectType-Article-1 ObjectType-Feature-2 content type line 23 |
| PQID | 1664330322 |
| PQPubID | 53008 |
| PageCount | 13 |
| ParticipantIDs | crossref_citationtrail_10_1080_0952813X_2014_921734 crossref_primary_10_1080_0952813X_2014_921734 informaworld_taylorfrancis_310_1080_0952813X_2014_921734 proquest_journals_1664330322 proquest_miscellaneous_1677956167 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2015-03-04 |
| PublicationDateYYYYMMDD | 2015-03-04 |
| PublicationDate_xml | – month: 03 year: 2015 text: 2015-03-04 day: 04 |
| PublicationDecade | 2010 |
| PublicationPlace | Abingdon |
| PublicationPlace_xml | – name: Abingdon |
| PublicationTitle | Journal of experimental & theoretical artificial intelligence |
| PublicationYear | 2015 |
| Publisher | Taylor & Francis Taylor & Francis Ltd |
| Publisher_xml | – name: Taylor & Francis – name: Taylor & Francis Ltd |
| References | cit0011 cit0012 Rickman P. (cit0015) 1999; 25 cit0010 cit0019 cit0017 cit0018 cit0016 cit0013 cit0014 cit0022 cit0001 cit0023 cit0020 cit0021 cit0008 cit0009 cit0006 cit0007 cit0004 cit0026 cit0005 cit0027 cit0002 cit0024 cit0003 cit0025 |
| References_xml | – ident: cit0011 – ident: cit0017 – ident: cit0009 – ident: cit0007 doi: 10.1145/141420.141422 – ident: cit0002 – ident: cit0013 doi: 10.1093/oso/9780198250579.001.0001 – ident: cit0027 – ident: cit0004 – ident: cit0026 doi: 10.1108/03684921011036187 – volume: 25 start-page: 10 year: 1999 ident: cit0015 publication-title: Philosophy Now – ident: cit0021 doi: 10.1093/mind/LIX.236.433 – ident: cit0025 doi: 10.1007/s11023-013-9301-y – ident: cit0018 – ident: cit0008 – ident: cit0016 – ident: cit0023 doi: 10.1007/978-3-642-27660-6_11 – ident: cit0010 – ident: cit0014 doi: 10.1093/mind/LXXX.318.290 – ident: cit0020 doi: 10.1007/s11023-010-9219-6 – ident: cit0012 doi: 10.1007/BF00372497 – ident: cit0003 – ident: cit0006 doi: 10.1016/S1364-6613(00)01453-4 – ident: cit0001 – ident: cit0005 – ident: cit0022 – ident: cit0019 – ident: cit0024 doi: 10.1109/TCIAIG.2283538 |
| SSID | ssj0001511 |
| Score | 2.1260304 |
| Snippet | This paper presents some important issues on misidentification of human interlocutors in text-based communication during practical Turing tests. The study here... |
| SourceID | proquest crossref informaworld |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 123 |
| SubjectTerms | Artificial intelligence chatbots confederate effect Expert systems Foils Human imitation game intelligence Judgment Parks philosophy of mind practical Turing tests Strategy Systems design Text messaging |
| Title | Human misidentification in Turing tests |
| URI | https://www.tandfonline.com/doi/abs/10.1080/0952813X.2014.921734 https://www.proquest.com/docview/1664330322 https://www.proquest.com/docview/1677956167 |
| Volume | 27 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVEBS databaseName: Academic Search Ultimate - eBooks customDbUrl: https://search.ebscohost.com/login.aspx?authtype=ip,shib&custid=s3936755&profile=ehost&defaultdb=asn eissn: 1362-3079 dateEnd: 20241028 omitProxy: true ssIdentifier: ssj0001511 issn: 0952-813X databaseCode: ABDBF dateStart: 19980701 isFulltext: true titleUrlDefault: https://search.ebscohost.com/direct.asp?db=asn providerName: EBSCOhost – providerCode: PRVEBS databaseName: Business Source Ultimate customDbUrl: eissn: 1362-3079 dateEnd: 20241028 omitProxy: false ssIdentifier: ssj0001511 issn: 0952-813X databaseCode: AKVCP dateStart: 19980701 isFulltext: true titleUrlDefault: https://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=bsu providerName: EBSCOhost – providerCode: PRVEBS databaseName: Inspec with Full Text customDbUrl: eissn: 1362-3079 dateEnd: 20241028 omitProxy: false ssIdentifier: ssj0001511 issn: 0952-813X databaseCode: ADMLS dateStart: 19890101 isFulltext: true titleUrlDefault: https://www.ebsco.com/products/research-databases/inspec-full-text providerName: EBSCOhost – providerCode: PRVLSH databaseName: aylor and Francis Online customDbUrl: mediaType: online eissn: 1362-3079 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001511 issn: 0952-813X databaseCode: AHDZW dateStart: 19960101 isFulltext: true providerName: Library Specific Holdings – providerCode: PRVAWR databaseName: Taylor & Francis Science and Technology Library-DRAA customDbUrl: eissn: 1362-3079 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001511 issn: 0952-813X databaseCode: 30N dateStart: 19970101 isFulltext: true titleUrlDefault: http://www.tandfonline.com/page/title-lists providerName: Taylor & Francis |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LT9tAEF6l4dJLgVLU8JKRKnEyYr1rr31EQIV49JIgcbP2qUaqTEWdC7-eGe_a2E0EpRcrcuzdzX7jmfFk5htCvkknEyvSLE6Z1jHnhYtl7lzsjFLcGaFPNAb0b39kl3f86j69H42mvaylRa2O9dPKupL_QRXOAa5YJfsOZLtB4QR8BnzhCAjD8Z8w9hF4QGpuQtKPbHMXZ778EBxJT9W0wgEdkPujBPSLGnG2QC4x77F2vsTfH9se7NdgWjsJm_6UTZwGV9YPKNC0yajig8ggKEnatOkFE-H1IhZXgToo-orTF_UHAUl6WpD6EuJgUKnnI1nS1SG5EWbDyTDLjh8X8IYUgpsDauy_TFaXSEhbhtMwSomjlH6UD2QtAVV_MiZrp-e3N9POQIOTQz0Fo_-dbUUlUq6vWM3AYxnw2S7Z78YpmW2QTwHM6NSLxiYZ2eozWW87dURBcW-Ro0ZSoiVJieZV5CUlaiTlC7n7fjE7u4xDi4xYc5bXMddUu1RKVnDs0C4NdkNgqqC5yqm2iXWGmURyYcCVzJTMZALvh9wJqwonhWDbZFw9VPYriTTslZSpzjQ1yJonlVWCKmOY0gWYxQlh7TaUOvDHYxuTX-VrIExI3N312_OnvHF93t_hsm7iVs43mSnZ67futWiU4SH9U9IMXG5w05JkQg67r2G78X8xWdmHBV4jBNZ3Z2LnnavdJR9fnqA9Mq4fF3YfnNRaHQShewb2PYmc |
| linkProvider | EBSCOhost |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3JTsMwEB2xHOBCWUWhQJCQOKXUsRMnR4RABdqeisTN8ipVoIBoeuHrGWepWARIcLadZWzPvEye3wCcSCcjy-MkjKnWIWOZC2XqXOiMUswZrnvaJ_SHo6R_x27u44ZNOK1plf4b2lVCEaWv9pvbJ6MbStwZwoIoJfTeM7NYN0NUTdkiLMeI9X0RA9obzZ0xBjRSye3hxschzem5b67yITp90C794qvLAHTVAtU8esU7eejOCtXVr59UHf_1buuwVsPT4LxaTxuwYPNNaDWlH4LaE2zBaZn8D3CRTEzNNyqnOJjkwbg8-Rgghi2m23B3dTm-6Id1zYVQM5oWIdNEu1hKmjFf8lsaL69PVUZSlRJtI-sMNZFk3CA2SZRMZIQfHMxxqzInOac7sJQ_5XYXAo1-VspYJ5oYL8MmlVWcKGOo0hn62TbQxtZC14Lkvi7GoyCNbmltC-FtISpbtCGcj3quBDl-6Z--n0ZRlIkQV1UtEfTnoZ1mykW9s6eCJIjhMO5HURuO581obv-jReb2aeb7cO4PDCd87-93P4KV_ng4EIPr0e0-rGJLXHLfWAeWipeZPUAwVKjDcrm_ASYB-_o |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LSwMxEB60gnixPrFadQXB09Zmk93sHkUt9VU8tNBbyBOKsi12e_HXm-yjtIoKek6yj0ky82Uy8w3AOTc80DSM_BBL6ROSGJ_HxvhGCUGMorItnUP_qRd1B-R-GA4XsvhdWKU7Q5uCKCLX1W5zT5SpIuIuLSoIYoSHLjCLtBILqjFZhbXIXYq5JI52b66LrT1DBdue3fd2SJU8981TlozTEnXpF1Wd259OHXj15UXYyUtrlomWfP9E6vifX9uCzRKcelfFatqGFZ3uQL0q_OCVemAXLnLXv2eXyEiV0Ub5BHuj1OvneY-eRbDZdA8Gndv-ddcvKy74kuA484lE0oSc44S4gt9cOXJ9LBIUixhJHWijsAo4ocoik0jwiAf2uEEM1SIxnFK8D7V0nOoD8KTVspyHMpJIORI2LrSgSCiFhUyslm0ArkTNZElH7qpivDJUsZaWsmBOFqyQRQP8-ahJQcfxS_94cRZZlrtBTFGzhOGfhzarGWflvp4yFFkEZ61-EDTgbN5sxe2uWXiqxzPXh1KXLhzRw7-__RTWn2867PGu93AEG7YhzAPfSBNq2dtMH1sklImTfLF_AAT5-p4 |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Human+misidentification+in+Turing+tests&rft.jtitle=Journal+of+experimental+%26+theoretical+artificial+intelligence&rft.au=Warwick%2C+Kevin&rft.au=Shah%2C+Huma&rft.date=2015-03-04&rft.issn=0952-813X&rft.eissn=1362-3079&rft.volume=27&rft.issue=2&rft.spage=123&rft.epage=135&rft_id=info:doi/10.1080%2F0952813X.2014.921734&rft.externalDBID=n%2Fa&rft.externalDocID=10_1080_0952813X_2014_921734 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0952-813X&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0952-813X&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0952-813X&client=summon |