Semi-autonomous avatar enabling unconstrained parallel conversations -seamless hybrid of WOZ and autonomous dialogue systems
Many people are now engaged in remote conversations for a wide variety of scenes such as interviewing, counseling, and consulting, but there is a limited number of skilled experts. We propose a novel framework of parallel conversations with semi-autonomous avatars, where one operator collaborates wi...
Saved in:
| Published in | Advanced robotics Vol. 35; no. 11; pp. 657 - 663 |
|---|---|
| Main Authors | , , , , |
| Format | Journal Article |
| Language | English |
| Published |
Taylor & Francis
03.06.2021
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 0169-1864 1568-5535 1568-5535 |
| DOI | 10.1080/01691864.2021.1928549 |
Cover
| Abstract | Many people are now engaged in remote conversations for a wide variety of scenes such as interviewing, counseling, and consulting, but there is a limited number of skilled experts. We propose a novel framework of parallel conversations with semi-autonomous avatars, where one operator collaborates with several remote robots or agents simultaneously. The autonomous dialogue system mostly manages the conversation, but switches to the human operator when necessary. This framework circumvents the requirement for autonomous systems to be completely perfect. Instead, we need to detect dialogue breakdown or disengagement. We present a prototype of this framework for attentive listening. |
|---|---|
| AbstractList | Many people are now engaged in remote conversations for a wide variety of scenes such as interviewing, counseling, and consulting, but there is a limited number of skilled experts. We propose a novel framework of parallel conversations with semi-autonomous avatars, where one operator collaborates with several remote robots or agents simultaneously. The autonomous dialogue system mostly manages the conversation, but switches to the human operator when necessary. This framework circumvents the requirement for autonomous systems to be completely perfect. Instead, we need to detect dialogue breakdown or disengagement. We present a prototype of this framework for attentive listening. |
| Author | Yamamoto, Kenta Muramatsu, Naoyuki Kawahara, Tatsuya Lala, Divesh Inoue, Koji |
| Author_xml | – sequence: 1 givenname: Tatsuya surname: Kawahara fullname: Kawahara, Tatsuya organization: Kyoto University – sequence: 2 givenname: Naoyuki surname: Muramatsu fullname: Muramatsu, Naoyuki organization: Kyoto University – sequence: 3 givenname: Kenta surname: Yamamoto fullname: Yamamoto, Kenta organization: Kyoto University – sequence: 4 givenname: Divesh surname: Lala fullname: Lala, Divesh organization: Kyoto University – sequence: 5 givenname: Koji surname: Inoue fullname: Inoue, Koji email: inoue@sap.ist.i.kyoto-u.ac.jp organization: Kyoto University |
| BookMark | eNqNkNFq2zAUhsXIYGm3RxjoBZxJlmUr7KYldO0gkIu2FHpjjqXjVEOWgmS3GPrwjZcUSi-6XR045_9-ON8JmfngkZDvnC04U-wH4-WSq7JY5CznC77MlSyWn8icy1JlUgo5I_Mpk02hL-QkpT-MMVWIak6er7GzGQx98KELQ6LwCD1Eih4aZ_2WDl4Hn_oI1qOhO4jgHDq6Xz5iTNDb_ZVmCaFzmBJ9GJtoDQ0tvdvcU_CGvuk2FlzYDkjTmHrs0lfyuQWX8NtxnpLbXxc3q6tsvbn8vTpfZ7ooqz7LKy4k4BK4qaBkrSo4NKLMAYQ2qDRKw1WrTVMZWQqFWjAlCtZgLpjW0ohTUh56B7-D8Wn_Qb2LtoM41pzVk8P61WE9OayPDvegPIA6hpQitv_N_XzHadv_dTWJdP-kzw609W2IHTyF6Ezdw-hCbCN4bVMtPq54ASq6oNM |
| CitedBy_id | crossref_primary_10_1126_scirobotics_adg1842 crossref_primary_10_1109_LRA_2024_3404752 crossref_primary_10_1080_01691864_2022_2155490 crossref_primary_10_1109_ACCESS_2024_3441233 |
| Cites_doi | 10.1609/aaai.v32i1.11321 10.3389/frobt.2020.00092 10.18653/v1/2020.acl-main.4 10.1145/1349822.1349863 10.1145/1349822.1349862 10.18653/v1/P17-1103 10.1017/ATSIP.2018.11 10.1145/3382507.3418839 10.1007/978-981-13-9443-0_6 10.18653/v1/2020.sigdial-1.15 10.1109/TRO.2010.2062550 |
| ContentType | Journal Article |
| Copyright | 2021 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group 2021 |
| Copyright_xml | – notice: 2021 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group 2021 |
| DBID | 0YH AAYXX CITATION ADTOC UNPAY |
| DOI | 10.1080/01691864.2021.1928549 |
| DatabaseName | Taylor & Francis Open Access CrossRef Unpaywall for CDI: Periodical Content Unpaywall |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: 0YH name: Taylor & Francis Open Access url: https://www.tandfonline.com sourceTypes: Publisher – sequence: 2 dbid: UNPAY name: Unpaywall url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/ sourceTypes: Open Access Repository |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1568-5535 |
| EndPage | 663 |
| ExternalDocumentID | 10.1080/01691864.2021.1928549 10_1080_01691864_2021_1928549 1928549 |
| Genre | Research Article |
| GroupedDBID | -~X .QJ 0BK 0R~ 0YH 23M 30N 4.4 5GY AAENE AAGDL AAHIA AAJMT AALDU AAMIU AAPUL AAQRR ABCCY ABDBF ABFIM ABJNI ABLIJ ABPAQ ABPEM ABTAI ABXUL ABXYU ACGFS ACTIO ACUHS ADCVX ADGTB ADMLS AEISY AENEX AEOZL AEPSL AEVUW AEYOC AFRVT AGDLA AGMYJ AHDZW AIJEM AIYEW AKBVH AKOOK ALMA_UNASSIGNED_HOLDINGS ALQZU AMFWP AQRUH AQTUD AVBZW AWYRJ BLEHA CCCUG CS3 DGEBU DKSSO EAP EBS EMK EPL EST ESX E~A E~B F5P GTTXZ H13 HF~ HZ~ H~P I-F IPNFZ J.P KYCEM LJTGL M4Z NX~ O9- P2P RIG RNANH ROSJB RTWRZ S-T SNACF TASJS TBQAZ TDBHL TEN TFL TFT TFW TTHFI TUROJ TUS UT5 ZGOLN ~S~ AAYXX CITATION 07I 5VS ACTTO ADTOC ADUMR ADXEU AEHZU AEZBV AFBWG AFION AGBKS AGVKY AGWUF AGYFW AKHJE AKMBP ALRRR ALXIB AMATQ BGSSV BWMZZ C0- CAG COF CYRSC DAOYK DEXXA EJD FETWF IFELN IL9 NUSFT OPCYK RNI RNS ROL RZC RZE S7E TAJZE UNPAY |
| ID | FETCH-LOGICAL-c467t-27135ae9a1d7a60f841ab362aa3cde8ce5d18fcdb7d5638ec308340be230cc5d3 |
| IEDL.DBID | UNPAY |
| ISSN | 0169-1864 1568-5535 |
| IngestDate | Tue Aug 19 09:21:20 EDT 2025 Wed Oct 01 01:55:49 EDT 2025 Thu Apr 24 23:05:57 EDT 2025 Mon Oct 20 23:48:37 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 11 |
| Language | English |
| License | open-access: http://creativecommons.org/licenses/by-nc-nd/4.0/: This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited, and is not altered, transformed, or built upon in any way. |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c467t-27135ae9a1d7a60f841ab362aa3cde8ce5d18fcdb7d5638ec308340be230cc5d3 |
| OpenAccessLink | https://proxy.k.utb.cz/login?url=https://www.tandfonline.com/doi/pdf/10.1080/01691864.2021.1928549?needAccess=true |
| PageCount | 7 |
| ParticipantIDs | informaworld_taylorfrancis_310_1080_01691864_2021_1928549 crossref_primary_10_1080_01691864_2021_1928549 unpaywall_primary_10_1080_01691864_2021_1928549 crossref_citationtrail_10_1080_01691864_2021_1928549 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2021-06-03 |
| PublicationDateYYYYMMDD | 2021-06-03 |
| PublicationDate_xml | – month: 06 year: 2021 text: 2021-06-03 day: 03 |
| PublicationDecade | 2020 |
| PublicationTitle | Advanced robotics |
| PublicationYear | 2021 |
| Publisher | Taylor & Francis |
| Publisher_xml | – name: Taylor & Francis |
| References | CIT0010 CIT0001 CIT0012 CIT0011 CIT0003 CIT0014 CIT0002 CIT0013 CIT0005 CIT0004 CIT0007 CIT0006 CIT0009 CIT0008 |
| References_xml | – ident: CIT0010 doi: 10.1609/aaai.v32i1.11321 – ident: CIT0013 doi: 10.3389/frobt.2020.00092 – ident: CIT0011 doi: 10.18653/v1/2020.acl-main.4 – ident: CIT0012 – ident: CIT0005 doi: 10.1145/1349822.1349863 – ident: CIT0009 – ident: CIT0006 doi: 10.1145/1349822.1349862 – ident: CIT0008 doi: 10.18653/v1/P17-1103 – ident: CIT0003 – ident: CIT0014 doi: 10.1017/ATSIP.2018.11 – ident: CIT0004 doi: 10.1145/3382507.3418839 – ident: CIT0001 doi: 10.1007/978-981-13-9443-0_6 – ident: CIT0002 doi: 10.18653/v1/2020.sigdial-1.15 – ident: CIT0007 doi: 10.1109/TRO.2010.2062550 |
| SSID | ssj0008437 |
| Score | 2.32251 |
| Snippet | Many people are now engaged in remote conversations for a wide variety of scenes such as interviewing, counseling, and consulting, but there is a limited... |
| SourceID | unpaywall crossref informaworld |
| SourceType | Open Access Repository Enrichment Source Index Database Publisher |
| StartPage | 657 |
| SubjectTerms | attentive listening conversational avatar parallel conversations Semi-autonomous dialogue spoken dialogue system |
| SummonAdditionalLinks | – databaseName: Taylor & Francis Open Access dbid: 0YH link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3JSgNBEG00HjQHccW40Qevncy-HEUMQVAPGlwuQ_UyKEwWkokS8OOtmiUkB1HwOMNUN9NVXRtVrxi78INQGktFAmUjFJ7Bmx6hoRQGwI-9UAdgUb_z7V3Q63s3z35dTTityiophk5LoIhCV9PlBjmtK-I6BCBiRwFlRBy7jS5KhEHOOttwQjsmwbZeegtlHHklbCaSCKKpm3h-WmbFPK2AlzbZ5mw4hvknZNmSCerusO3Kd-SXJbN32ZoZ7rHmEqLgPvt6MIN3AbOcehUwqOfwATlMuKEWKfyCoxkjj5AGQxjNCfg7y0zGi-LzSVXZwwXK_yBDHcjf5tTRxUcpf7p_5XhifGlt6jmhzA8v4aCnB6zfvX686olqwIJQqB9z4dB8PjAx2DqEwEojzwaJFg3AVdpEyvjajlKlZah9vKdGueiweZY0GLco5Wv3kDWGo6E5YtzXGl_7UjsOhmy4hKUsqaUba4V6A8IW8-pzTVSFPk7_miV2DVJasSMhdiQVO1qsvSAbl_AbvxHEy0xL8iLvkZZDShL3F9rOgsN_2-34H7udsC16LMrO3FPWyCczc4YOTi7PCxH-BgHy79U priority: 102 providerName: Taylor & Francis |
| Title | Semi-autonomous avatar enabling unconstrained parallel conversations -seamless hybrid of WOZ and autonomous dialogue systems |
| URI | https://www.tandfonline.com/doi/abs/10.1080/01691864.2021.1928549 https://www.tandfonline.com/doi/pdf/10.1080/01691864.2021.1928549?needAccess=true |
| UnpaywallVersion | publishedVersion |
| Volume | 35 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVEBS databaseName: Academic Search Ultimate - eBooks customDbUrl: https://search.ebscohost.com/login.aspx?authtype=ip,shib&custid=s3936755&profile=ehost&defaultdb=asn eissn: 1568-5535 dateEnd: 20241101 omitProxy: true ssIdentifier: ssj0008437 issn: 1568-5535 databaseCode: ABDBF dateStart: 19980901 isFulltext: true titleUrlDefault: https://search.ebscohost.com/direct.asp?db=asn providerName: EBSCOhost – providerCode: PRVEBS databaseName: Inspec with Full Text customDbUrl: eissn: 1568-5535 dateEnd: 20241101 omitProxy: false ssIdentifier: ssj0008437 issn: 1568-5535 databaseCode: ADMLS dateStart: 19980901 isFulltext: true titleUrlDefault: https://www.ebsco.com/products/research-databases/inspec-full-text providerName: EBSCOhost – providerCode: PRVLSH databaseName: aylor and Francis Online customDbUrl: mediaType: online eissn: 1568-5535 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0008437 issn: 1568-5535 databaseCode: AHDZW dateStart: 19970101 isFulltext: true providerName: Library Specific Holdings – providerCode: PRVAWR databaseName: Taylor & Francis Science and Technology Library-DRAA customDbUrl: eissn: 1568-5535 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0008437 issn: 1568-5535 databaseCode: 30N dateStart: 19970101 isFulltext: true titleUrlDefault: http://www.tandfonline.com/page/title-lists providerName: Taylor & Francis |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1JT9tQEB5Bcmg5UOgioG30Dlwd7NjPywGhiBZFSGURRCwX621WEcaJEhsUDlX_Q_8hv6QzXlBAqmilHm153tM8z_o08w3AJvcDaWwVWigbgeUZ1PQQHaVlhOCRF2hf2NTv_O3AHwy9_XN-vgDHTS8MlVVSDp1UQBGlrSblHuukqYjbIgARJ_TpRqTndDFECTHJ2cnQ2vfLIYPb-aQwi9D2OYbnLWgPD476FxXGd2QRYYmhSh1H3OVNV8-f1n3ir56gmS7BqyIbi9mdSNM5n7T3BiYNN1UpynW3yGVX3T8Devyv7K7Ach3Bsn4lcquwYLK3sDSHa_gOfpyYmytLFDl1TIyKKRO3IhcTZqhRC79g6EwpLqXxFEYzgh9PU5OysgR-UtcXsYefv1APb1LcnH2fUWcZGyXs7PCSIStsbnXqfaEbKFbBUk_fw3Dv6-nuwKoHPVgK7XRu9WhOoDCRcHQgfDsJPUdI9KxCuEqbUBmunTBRWgaao70wysXA0bOlwfxJKa7dD9DKRplZA8a1xtdc6l4PU0dcwla21NKNtEL7JYJ18JrfGasaBZ24TWOnAUutjzum447r416H7iPZuIIBeYkgmpeVOC_vX5JqWErsvkC79ShYf7fbxj9TfITX9FgWvbmfoEUy9BnDq1x2YNG-GHSg3R98uTzr1OrzG51oHTM |
| linkProvider | Unpaywall |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LT8JAEN4oHpCD8RnxuQevCy3ttuVojAQV8CBE9NJsd7fRpDyCRUPij3emD1IOBhOvbWc33dl5ZuYbQq644wbakB6Du-EyW4Oke2AomRaCN21XOcLAfuduz2kP7PshHxZ6YbCsEmPoMAWKSHQ1Cjcmo_OSuDoiiJiegymRhlkDH8WDKGeTbHFwF3F8g_HSXmpjz05xM4GEIU3exfPbMiv2aQW9tELK8_FULL5EFBVsUGuX7GTOI71Oub1HNvR4n1QKkIIH5PtJj96ZmMfYrABRPRWfIhYzqrFHCr6gYMfQJcTJEFpRRP6OIh3RpPp8lpX2UAYCMIpACdK3BbZ00UlInx9fKRwZLayNTSeY-qEpHvTHIRm0bvs3bZZNWGASFGTMGjigT-imMJUrHCP0bFMEYNKEsKTSntRcmV4oVeAqDoKqpQUem20EGgIXKbmyjkhpPBnrY0K5UvCYB6rRgJgNljCkEajAaioJikO4VWLn5-rLDH4c_zXyzRylNGOHj-zwM3ZUSW1JNk3xN9YRNItM8-Mk8RGmU0p8aw1tfcnhv-128o_dLkm53e92_M5d7-GUbOOrpAbNOiOleDbX5-DtxMFFcp1_AOXh8zg |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1ZS8NAEF60gtoH8cR67oOv2yZNNtk-ilrqVQUtHi9hs7tBIT1oU6Xgj3cmR6kPUsHXJLNLdmbnYuYbQk6454fGUoKBbPjMNXDTBRhKZqTkDdfXnrSw3_m27bU67tUzL6oJR3lZJcbQUQYUkepqvNwDHRUVcTUEELGFhxmRul0FF0VAkLNIlrgA8wYibb20pspYuBlsJpAwpCmaeH5b5od5-gFeWiYr495ATj5lHM-YoOY6Wct9R3qaMXuDLJjeJinPIApuka8H031ncpxgrwIE9VR-yEQOqcEWKfiCghlDjxAHQxhNEfg7jk1M0-LzYV7ZQxnIfzcGHUjfJtjRRfsRfbp7pXBidGZt7DnBzA_N4KBH26TTvHg8a7F8wAJToB8TVsf5fNI0pK196VmRcG0ZgkWT0lHaCGW4tkWkdOhrDvfUKAccNtcKDcQtSnHt7JBSr98zu4RyreExD3W9DiEbLGEpK9Sh09AK9Ib0K8QtzjVQOfo4_msc2AVIac6OANkR5OyokOqUbJDBb8wjaMwyLUjSvEeUDSkJnDm0tSmH_7bb3j92OybL9-fN4Oayfb1PVvFNWoHmHJBSMhybQ_B1kvAoleZvfkvyag |
| linkToUnpaywall | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1La9tAEB4S55Dk0EeSUjdN2UOvsiVLq8ehBFMaQqBOS2vq5CL2JVqqyEaRWpxD6X_IP-wv6YweQSkUJ5CjhGaXWc1zmfkG4DX3A2lsFVooG4HlGdT0EB2lZYTgkRdoX9jU7_x-4h9PvZMZn63Bx7YXhsoqKYdOaqCIylaTci900lbEDQlAxAl9uhEZOQMMUUJMcg4ztPbjasjgmyIvzTps-BzD8x5sTCcfxmc1xndkEWGFoUodR9zlbVfP_9a95a9uoZluw2aZLcTyp0jTjk86egx5y01divJ9UBZyoK7-AXp8UHafwKMmgmXjWuSewprJdmC7g2u4C78-mYtvligL6piYl5dM_BCFyJmhRi38gqEzpbiUxlMYzQh-PE1NyqoS-LypL2J_fl-jHl6kuDn7uqTOMjZP2JfTc4assM7q1PtCN1CshqW-3IPp0bvPb4-tZtCDpdBOF9aI5gQKEwlHB8K3k9BzhETPKoSrtAmV4doJE6VloDnaC6NcDBw9WxrMn5Ti2n0GvWyemefAuNb4mks9GmHqiEvYypZaupFWaL9E0Aev_Z2xalDQids0dlqw1Oa4YzruuDnuPgxuyBY1DMgqgqgrK3FR3b8k9bCU2F1BO7wRrLvt9uLeFPuwRY9V0Zv7EnokQwcYXhXyVaMwfwEcfRqg |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Semi-autonomous+avatar+enabling+unconstrained+parallel+conversations+-seamless+hybrid+of+WOZ+and+autonomous+dialogue+systems&rft.jtitle=Advanced+robotics&rft.au=Kawahara%2C+Tatsuya&rft.au=Muramatsu%2C+Naoyuki&rft.au=Yamamoto%2C+Kenta&rft.au=Lala%2C+Divesh&rft.date=2021-06-03&rft.pub=Taylor+%26+Francis&rft.issn=0169-1864&rft.eissn=1568-5535&rft.volume=35&rft.issue=11&rft.spage=657&rft.epage=663&rft_id=info:doi/10.1080%2F01691864.2021.1928549&rft.externalDBID=0YH&rft.externalDocID=1928549 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0169-1864&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0169-1864&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0169-1864&client=summon |