An Advanced Human-Robot Interaction Interface for Collaborative Robotic Assembly Tasks

This article introduces an advanced human-robot interaction (HRI) interface that allows teaching new assembly tasks to collaborative robotic systems. Using advanced perception and simulation technologies, the interface provides the proper tools for a non-expert user to teach a robot a new assembly t...

Full description

Saved in:
Bibliographic Details
Published inInternational journal of embedded and real-time communication systems Vol. 9; no. 2; pp. 79 - 96
Main Authors Papadopoulos, Christos, Mariolis, Ioannis, Topalidou-Kyniazopoulou, Angeliki, Piperagkas, Grigorios, Ioannidis, Dimosthenis, Tzovaras, Dimitrios
Format Journal Article
LanguageEnglish
Published Hershey IGI Global 01.07.2018
Subjects
Applications programs
Assembly
Collaboration
Communication
Human engineering
Interfaces
Man-machine interfaces
Portable equipment
Robotics
Robots
Simulation
Teaching
User experience
User interfaces
Online AccessGet full text
ISSN1947-3176
1947-3184
DOI10.4018/IJERTCS.2018070106

Cover

Abstract This article introduces an advanced human-robot interaction (HRI) interface that allows teaching new assembly tasks to collaborative robotic systems. Using advanced perception and simulation technologies, the interface provides the proper tools for a non-expert user to teach a robot a new assembly task in a short amount of time. An RGBD camera is used to allow the user to demonstrate the task and the system extracts the needed information for the assembly to be simulated and performed by the robot, while the user guides the process. The HRI interface is integrated with the ROS framework and is built as a web application allowing operation through portable devices, such as a tablet PC. The interface is evaluated with user experience rating from test subjects that are requested to teach a folding assembly task to the robot.
AbstractList This article introduces an advanced human-robot interaction (HRI) interface that allows teaching new assembly tasks to collaborative robotic systems. Using advanced perception and simulation technologies, the interface provides the proper tools for a non-expert user to teach a robot a new assembly task in a short amount of time. An RGBD camera is used to allow the user to demonstrate the task and the system extracts the needed information for the assembly to be simulated and performed by the robot, while the user guides the process. The HRI interface is integrated with the ROS framework and is built as a web application allowing operation through portable devices, such as a tablet PC. The interface is evaluated with user experience rating from test subjects that are requested to teach a folding assembly task to the robot.
Author Papadopoulos, Christos
Topalidou-Kyniazopoulou, Angeliki
Mariolis, Ioannis
Piperagkas, Grigorios
Ioannidis, Dimosthenis
Tzovaras, Dimitrios
AuthorAffiliation CERTH, Thermi, Greece
AuthorAffiliation_xml – name: CERTH, Thermi, Greece
Author_xml – sequence: 1
  givenname: Christos
  surname: Papadopoulos
  fullname: Papadopoulos, Christos
  organization: CERTH, Thermi, Greece
– sequence: 2
  givenname: Ioannis
  surname: Mariolis
  fullname: Mariolis, Ioannis
  organization: CERTH, Thermi, Greece
– sequence: 3
  givenname: Angeliki
  surname: Topalidou-Kyniazopoulou
  fullname: Topalidou-Kyniazopoulou, Angeliki
  organization: CERTH, Thermi, Greece
– sequence: 4
  givenname: Grigorios
  surname: Piperagkas
  fullname: Piperagkas, Grigorios
  organization: CERTH, Thermi, Greece
– sequence: 5
  givenname: Dimosthenis
  surname: Ioannidis
  fullname: Ioannidis, Dimosthenis
  organization: CERTH, Thermi, Greece
– sequence: 6
  givenname: Dimitrios
  surname: Tzovaras
  fullname: Tzovaras, Dimitrios
  organization: CERTH, Thermi, Greece
BookMark eNp1kMtKAzEUhoNUsNa-gKuAO2FqksnclmWotlIQanUbMrnI1GlSk2mhb2-cKbpQs8k58J8vOd8lGBhrFADXGE0owvnd4nG2WpfPExIalCGM0jMwxAXNohjndPBdZ-kFGHu_QeEkNEtzNASvUwOn8sCNUBLO91tuopWtbAsXplWOi7a2pq81Fwpq62Bpm4ZX1vG2PijYpWsBp96rbdUc4Zr7d38FzjVvvBqf7hF4uZ-ty3m0fHpYlNNlJMJ32iimvEBUEqXSpMKJyFGucVJwzEMvFZFcJ3Ei4yKTiUoJJ5oowTnWspJVLnU8Ajc9d-fsx175lm3s3pnwJCNFjAtMMaIhRfqUcNZ7pzTbuXrL3ZFhxL4UspNC9qMwDM37ofqt_qGeVLFOFeuWZ52e_0lFQN3-gfqdZLuw0if9z4x6
Cites_doi 10.1145/1228716.1228751
10.1177/0278364911410459
10.5244/C.25.101
10.1007/s12369-012-0157-8
10.5898/JHRI/3.2.Toris
10.1109/CVPR.2016.390
10.15607/RSS.2012.VIII.056
10.1177/875647939000600106
10.1007/s10462-012-9356-9
10.1109/ISR.2013.6695599
10.1145/57167.57203
10.1109/ICRA.2011.5980464
10.1109/SMC.2014.6974248
10.1109/LRA.2017.2662064
10.1016/j.robot.2008.10.024
10.1109/ICRA.2013.6630576
10.1016/j.promfg.2017.07.221
10.1007/978-3-319-66471-2_20
10.1109/ICRA.2015.7139971
10.1177/0018720816644364
ContentType Journal Article
Copyright Copyright © 2018, IGI Global. Copying or distributing in print or electronic forms without written permission of IGI Global is prohibited.
Copyright_xml – notice: Copyright © 2018, IGI Global. Copying or distributing in print or electronic forms without written permission of IGI Global is prohibited.
DBID AAYXX
CITATION
7SC
8FD
8FE
8FG
ABJCF
AFKRA
ARAPS
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
GNUQQ
HCIFZ
JQ2
K7-
L6V
L7M
L~C
L~D
M7S
P62
PHGZM
PHGZT
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PTHSS
DOI 10.4018/IJERTCS.2018070106
DatabaseName CrossRef
Computer and Information Systems Abstracts
Technology Research Database
ProQuest SciTech Collection
ProQuest Technology Collection
Materials Science & Engineering Collection
ProQuest Central UK/Ireland
Advanced Technologies & Aerospace Collection
ProQuest Central Essentials
ProQuest Central
Technology Collection
ProQuest One Community College
ProQuest Central Korea
ProQuest Central Student
SciTech Premium Collection
ProQuest Computer Science Collection
Computer Science Database
ProQuest Engineering Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
Engineering Database (subscription)
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Premium
ProQuest One Academic
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic
ProQuest One Academic UKI Edition
Engineering Collection
DatabaseTitle CrossRef
Computer Science Database
ProQuest Central Student
Technology Collection
Technology Research Database
Computer and Information Systems Abstracts – Academic
ProQuest One Academic Middle East (New)
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Essentials
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
SciTech Premium Collection
ProQuest One Community College
ProQuest Central
ProQuest One Applied & Life Sciences
ProQuest Engineering Collection
ProQuest Central Korea
ProQuest Central (New)
Advanced Technologies Database with Aerospace
Engineering Collection
Advanced Technologies & Aerospace Collection
Engineering Database
ProQuest One Academic Eastern Edition
ProQuest Technology Collection
ProQuest SciTech Collection
Computer and Information Systems Abstracts Professional
ProQuest One Academic UKI Edition
Materials Science & Engineering Collection
ProQuest One Academic
ProQuest One Academic (New)
DatabaseTitleList
Computer Science Database
CrossRef
Database_xml – sequence: 1
  dbid: 8FG
  name: ProQuest Technology Collection
  url: https://search.proquest.com/technologycollection1
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1947-3184
EndPage 96
ExternalDocumentID 10_4018_IJERTCS_2018070106
dvanced_Human_Robot_Inter10_4018_IJERTCS_20180701069
GroupedDBID 0R
ABEPT
ADEKF
ALMA_UNASSIGNED_HOLDINGS
COVLG
EBS
EJD
H13
HZ
JRD
MV1
NEEBM
O9-
RIF
0R~
4.4
AAYVP
AAYXX
ABJCF
ACOJC
AFKRA
ARAPS
BAAKF
BENPR
BGLVJ
BYHXH
CBWLS
CCPQU
CDTDJ
CIGCI
CITATION
CKMBR
CNQXE
CTSEY
HCIFZ
HZ~
IAO
ITC
K7-
M7S
N95
PHGZM
PHGZT
PQGLB
PTHSS
PUEGO
7SC
8FD
8FE
8FG
AZQEC
DWQXO
GNUQQ
JQ2
L6V
L7M
L~C
L~D
P62
PKEHL
PQEST
PQQKQ
PQUKI
ID FETCH-LOGICAL-c317t-34a904d2ee65b15c808f159a1a65bde2daf535d397d5e62a2f2ecaa1fdbdb8df3
IEDL.DBID BENPR
ISSN 1947-3176
IngestDate Fri Jul 25 11:40:20 EDT 2025
Wed Oct 01 04:28:06 EDT 2025
Tue Jan 05 23:27:23 EST 2021
Thu May 09 18:42:15 EDT 2019
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c317t-34a904d2ee65b15c808f159a1a65bde2daf535d397d5e62a2f2ecaa1fdbdb8df3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
PQID 2931914104
PQPubID 2045849
PageCount 18
ParticipantIDs igi_journals_dvanced_Human_Robot_Inter10_4018_IJERTCS_20180701069
proquest_journals_2931914104
crossref_primary_10_4018_IJERTCS_2018070106
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2018-07-01
PublicationDateYYYYMMDD 2018-07-01
PublicationDate_xml – month: 07
  year: 2018
  text: 2018-07-01
  day: 01
PublicationDecade 2010
PublicationPlace Hershey
PublicationPlace_xml – name: Hershey
PublicationTitle International journal of embedded and real-time communication systems
PublicationYear 2018
Publisher IGI Global
Publisher_xml – name: IGI Global
References IJERTCS.2018070106-4
IJERTCS.2018070106-25
IJERTCS.2018070106-5
IJERTCS.2018070106-24
IJERTCS.2018070106-3
IJERTCS.2018070106-26
IJERTCS.2018070106-21
IJERTCS.2018070106-9
IJERTCS.2018070106-20
IJERTCS.2018070106-6
IJERTCS.2018070106-23
IJERTCS.2018070106-22
M. C.Gombolay (IJERTCS.2018070106-8) 2015; Vol. 11
IJERTCS.2018070106-0
IJERTCS.2018070106-1
B. D.Argall (IJERTCS.2018070106-2) 2009; 57
R.O.S.About (IJERTCS.2018070106-16) 2017
IJERTCS.2018070106-18
IJERTCS.2018070106-17
IJERTCS.2018070106-19
IJERTCS.2018070106-14
IJERTCS.2018070106-13
IJERTCS.2018070106-10
IJERTCS.2018070106-12
IJERTCS.2018070106-11
(IJERTCS.2018070106-7) 2017
K.Qian (IJERTCS.2018070106-15) 2013; 7
References_xml – ident: IJERTCS.2018070106-3
  doi: 10.1145/1228716.1228751
– year: 2017
  ident: IJERTCS.2018070106-16
– ident: IJERTCS.2018070106-0
  doi: 10.1177/0278364911410459
– ident: IJERTCS.2018070106-10
  doi: 10.5244/C.25.101
– ident: IJERTCS.2018070106-22
– ident: IJERTCS.2018070106-12
  doi: 10.1007/s12369-012-0157-8
– volume: 7
  issue: 4
  year: 2013
  ident: IJERTCS.2018070106-15
  article-title: Developing a gesture based remote human-robot interaction system using Kinect.
  publication-title: International Journal of Smart Home
– ident: IJERTCS.2018070106-23
  doi: 10.5898/JHRI/3.2.Toris
– ident: IJERTCS.2018070106-6
  doi: 10.1109/CVPR.2016.390
– ident: IJERTCS.2018070106-26
  doi: 10.15607/RSS.2012.VIII.056
– ident: IJERTCS.2018070106-21
  doi: 10.1177/875647939000600106
– ident: IJERTCS.2018070106-18
  doi: 10.1007/s10462-012-9356-9
– ident: IJERTCS.2018070106-19
  doi: 10.1109/ISR.2013.6695599
– year: 2017
  ident: IJERTCS.2018070106-7
– ident: IJERTCS.2018070106-4
  doi: 10.1145/57167.57203
– ident: IJERTCS.2018070106-25
– ident: IJERTCS.2018070106-11
  doi: 10.1109/ICRA.2011.5980464
– ident: IJERTCS.2018070106-5
  doi: 10.1109/SMC.2014.6974248
– ident: IJERTCS.2018070106-14
  doi: 10.1109/LRA.2017.2662064
– ident: IJERTCS.2018070106-1
  doi: 10.1016/j.robot.2008.10.024
– ident: IJERTCS.2018070106-24
  doi: 10.1109/ICRA.2013.6630576
– ident: IJERTCS.2018070106-9
  doi: 10.1016/j.promfg.2017.07.221
– ident: IJERTCS.2018070106-13
  doi: 10.1007/978-3-319-66471-2_20
– volume: Vol. 11
  start-page: 2015
  year: 2015
  ident: IJERTCS.2018070106-8
  article-title: Coordination of Human-Robot Teaming with Human Task Preferences.
  publication-title: AAAI Fall Symposium Series on AI-HRI
– ident: IJERTCS.2018070106-17
  doi: 10.1109/ICRA.2015.7139971
– volume: 57
  start-page: 469
  issue: 5
  year: 2009
  ident: IJERTCS.2018070106-2
  article-title: A survey of robot learning from demonstration.
  publication-title: Robotics and Autonomous Systems
  doi: 10.1016/j.robot.2008.10.024
– ident: IJERTCS.2018070106-20
  doi: 10.1177/0018720816644364
SSID ssj0000547680
Score 2.0504336
Snippet This article introduces an advanced human-robot interaction (HRI) interface that allows teaching new assembly tasks to collaborative robotic systems. Using...
SourceID proquest
crossref
igi
SourceType Aggregation Database
Index Database
Enrichment Source
Publisher
StartPage 79
SubjectTerms Applications programs
Assembly
Collaboration
Communication
Human engineering
Interfaces
Man-machine interfaces
Portable equipment
Robotics
Robots
Simulation
Teaching
User experience
User interfaces
Title An Advanced Human-Robot Interaction Interface for Collaborative Robotic Assembly Tasks
URI http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/IJERTCS.2018070106
https://www.proquest.com/docview/2931914104
Volume 9
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVPQU
  databaseName: ProQuest Central (subscription)
  customDbUrl: http://www.proquest.com/pqcentral?accountid=15518
  eissn: 1947-3184
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0000547680
  issn: 1947-3176
  databaseCode: BENPR
  dateStart: 20100101
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3dT9swED_R8rI9IBibVmDI0nibLGoncZIHhErV8iFRTV2ZeLP8FVQBbaEFif-es5OsIAZviWIlys_23e_O9wGwlxaGoeFjaKp1TmPOU6p5zmgeGZuhgnAsBGOeD8TJRXx2mVyuwKDOhfFhlbVMDILaTo33ke-jWvKlyNB6OJzdUd81yp-u1i00VNVawR6EEmMNWOW-MlYTVo96g9_Df14XJCjIr0OWZB57B10qykwaNDOy_dOz3nDU_eMDvjLcCsy3QXqhrRrjq_EbkR30UH8d1ioCSTrljG_Aipt8gc8vygpuwt_OhHSqs30SvPR0ONXTBQnuvzKTobwulHEEaSvpLpfDoyNh9NgQfyJ8q2-eyEjNr-df4aLfG3VPaNU_gRr8sQWNYpW3Y8udE4lmicnaWYHsRTGF99Zxq4okSiwyEps4wRUvuDNKscJqqzNbRN-gOZlO3HcgJnKpEgwlEhIs5oRmwoh2ZJE8WCFS04JfNU5yVpbJkGheeFRlhapcotqCnwilrHbL_D8j5MwWLei8GlXhJgNuMiAhA1bvfyhvwU49XcsXLZfS1sePt-GTf1cZnbsDzcX9g_uBHGShd6GR9Y93q-X1DJ1X2DE
linkProvider ProQuest
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LbxMxEB71cQAOiKcILWAJOCGrsXfXu3uoUAipkj4iFFLUm_FrUdSSpCQt6p_jtzH2ekkRj1tvu1rLK30e-5sZzwPgVV4ZhoaPobnWJU05z6nmJaNlYmyBBOFYCMY8Gor-cbp_kp2swY8mF8aHVTZnYjio7cx4H_kO0pIvRYbWw9v5OfVdo_ztatNCQ8XWCnY3lBiLiR0H7uo7mnCL3cF7XO_XnO_1xt0-jV0GqEHuXNIkVWU7tdw5kWmWmaJdVMjxiil8t45bVWVJZpG3beYEV7zizijFKqutLmyV4LzrsJkmaYnG3-a73vDD6JeXBxUi1OdDVmaZeodgLurMHTRrip3Bfm807n70AWYFbj3m2y5dY8f1yZfJHxQReG_vHtyNCivp1BJ2H9bc9AHcuVbG8CF86kxJJ8YSkHArQEczPVuS4G6sMyfq50oZR1BNJt2V-F06EkZPDPE30F_12RUZq8Xp4hEc3wiSj2FjOpu6J0BM4nIlGJ6AqNAxJzQTRrQTi8qKFSI3LXjT4CTndVkOieaMR1VGVOUK1Ra8RChl3J2Lv4yQc1u1oPPbqIibDLjJgIQMWP37R2ULtpvlWk20Et2n___8Am71x0eH8nAwPNiC237eOjJ4GzaW3y7cM9R_lvp5FDICn29arn8C24sWoA
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+Advanced+Human-Robot+Interaction+Interface+for+Collaborative+Robotic+Assembly+Tasks&rft.jtitle=International+journal+of+embedded+and+real-time+communication+systems&rft.au=Papadopoulos%2C+Christos&rft.au=Mariolis%2C+Ioannis&rft.au=Topalidou-Kyniazopoulou%2C+Angeliki&rft.au=Piperagkas%2C+Grigorios&rft.date=2018-07-01&rft.issn=1947-3176&rft.eissn=1947-3184&rft.volume=9&rft.issue=2&rft.spage=79&rft.epage=96&rft_id=info:doi/10.4018%2FIJERTCS.2018070106&rft.externalDBID=n%2Fa&rft.externalDocID=10_4018_IJERTCS_2018070106
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1947-3176&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1947-3176&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1947-3176&client=summon