Cooperative Vision-Based Object Transportation by Two Humanoid Robots in a Cluttered Environment

Although in recent years, there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy object. Such a functionality is especially useful when transporting objects of differe...

Full description

Saved in:
Bibliographic Details
Published inInternational journal of HR : humanoid robotics Vol. 14; no. 3; pp. 1750018 - 30
Main Authors Rioux, Antoine, Esteves, Claudia, Hayet, Jean-Bernard, Suleiman, Wael
Format Journal Article
LanguageEnglish
Published Singapore World Scientific Publishing Company 01.09.2017
World Scientific Publishing Co. Pte., Ltd
World Scientific Publishing
Subjects
Online AccessGet full text
ISSN0219-8436
1793-6942
DOI10.1142/S0219843617500189

Cover

Abstract Although in recent years, there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy object. Such a functionality is especially useful when transporting objects of different shapes and weights without having to modify the robot hardware. In this work, we tackle the problem of making two humanoid robots navigate in a cluttered environment while transporting a very large object that simply could not be moved by a single robot. We present a complete navigation scheme, from the incremental construction of a map of the environment and the computation of collision-free trajectories to the design of the control to execute those trajectories. We present experiments made on real NAO robots, equipped with RGB-D sensors mounted on their heads, moving an object around obstacles. Our experiments show that a significantly large object can be transported without modifying the robot main hardware, and therefore that our scheme enhances the humanoid robots capacities in real-life situations. Our contributions are: (1) a low-dimension multi-robot motion planning algorithm that finds an obstacle-free trajectory, by using the constructed map of the environment as an input, (2) a framework that produces continuous and consistent odometry data, by fusing the visual and the robot odometry information, (3) a synchronization system that uses the projection of the robots based on their hands positions coupled with the visual feedback error computed from a frontal camera, (4) an efficient real-time whole-body control scheme that controls the motions of the closed-loop robot–object–robot system.
AbstractList Although in recent years there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy object. Such a functionality is especially useful when transporting objects of different shapes and weights without having to modify the robot hardware. In this work, we tackle the problem of making two humanoid robots navigate in a cluttered environment while transporting a very large object that simply could not be moved by a single robot. We present a complete navigation scheme, from the incremental construction of a map of the environment and the computation of collision-free trajec-tories to the design of the control to execute those trajectories. We present experiments made on real Nao robots, equipped with RGB-D sensors mounted on their heads, moving an object around obstacles. Our experiments show that a significantly large object can be transported without modifying the robot main hardware, and therefore that our scheme enhances the humanoid robots capacities in real-life situations. Our contributions are: (1) a low-dimension multi-robot motion planning algorithm that finds an obstacle-free trajectory, by using the constructed map of the environment as an input, (2) a framework that produces continuous and consistent odometry data, by fusing the visual and the robot odometry information, (3) a synchronization system that Two Nao robots holding an object together. We propose a motion planning strategy for the Nao-object-Nao system to navigate in a cluttered environment and a synchronization approach that allows the motions done by the two Naos without compromising the whole system stability because of the robots swinging movement. uses the projection of the robots based on their hands positions coupled with the visual feedback error computed from a frontal camera, (4) an efficient real-time whole-body control scheme that controls the motions of the closed-loop robot-object-robot system.
Although in recent years, there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy object. Such a functionality is especially useful when transporting objects of different shapes and weights without having to modify the robot hardware. In this work, we tackle the problem of making two humanoid robots navigate in a cluttered environment while transporting a very large object that simply could not be moved by a single robot. We present a complete navigation scheme, from the incremental construction of a map of the environment and the computation of collision-free trajectories to the design of the control to execute those trajectories. We present experiments made on real NAO robots, equipped with RGB-D sensors mounted on their heads, moving an object around obstacles. Our experiments show that a significantly large object can be transported without modifying the robot main hardware, and therefore that our scheme enhances the humanoid robots capacities in real-life situations. Our contributions are: (1) a low-dimension multi-robot motion planning algorithm that finds an obstacle-free trajectory, by using the constructed map of the environment as an input, (2) a framework that produces continuous and consistent odometry data, by fusing the visual and the robot odometry information, (3) a synchronization system that uses the projection of the robots based on their hands positions coupled with the visual feedback error computed from a frontal camera, (4) an efficient real-time whole-body control scheme that controls the motions of the closed-loop robot–object–robot system.
Although in recent years, there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy object. Such a functionality is especially useful when transporting objects of different shapes and weights without having to modify the robot hardware. In this work, we tackle the problem of making two humanoid robots navigate in a cluttered environment while transporting a very large object that simply could not be moved by a single robot. We present a complete navigation scheme, from the incremental construction of a map of the environment and the computation of collision-free trajectories to the design of the control to execute those trajectories. We present experiments made on real NAO robots, equipped with RGB-D sensors mounted on their heads, moving an object around obstacles. Our experiments show that a significantly large object can be transported without modifying the robot main hardware, and therefore that our scheme enhances the humanoid robots capacities in real-life situations.Our contributions are: (1) a low-dimension multi-robot motion planning algorithm that finds an obstacle-free trajectory, by using the constructed map of the environment as an input, (2) a framework that produces continuous and consistent odometry data, by fusing the visual and the robot odometry information, (3) a synchronization system that uses the projection of the robots based on their hands positions coupled with the visual feedback error computed from a frontal camera, (4) an efficient real-time whole-body control scheme that controls the motions of the closed-loop robot–object–robot system.
Author Suleiman, Wael
Rioux, Antoine
Hayet, Jean-Bernard
Esteves, Claudia
Author_xml – sequence: 1
  givenname: Antoine
  surname: Rioux
  fullname: Rioux, Antoine
– sequence: 2
  givenname: Claudia
  surname: Esteves
  fullname: Esteves, Claudia
– sequence: 3
  givenname: Jean-Bernard
  surname: Hayet
  fullname: Hayet, Jean-Bernard
– sequence: 4
  givenname: Wael
  surname: Suleiman
  fullname: Suleiman, Wael
BackLink https://hal.science/hal-01742643$$DView record in HAL
BookMark eNp9kEFPwyAUx4mZidv0A3gj8eShCoW15TgbdSZLluj0WimFyNJBBbZl316Wmh1c4gUS3v_33uM3AgNjjQTgGqM7jGl6_4ZSzApKMpxPEMIFOwNDnDOSZIymAzA8lJND_QKMvF8hRHCeF0PwWVrbSceD3kr4ob22JnngXjZwUa-kCHDpuPGddSFGrIH1Hi53Fs42a26sbuCrrW3wUBvIYdluQpAuso9mq501a2nCJThXvPXy6vceg_enx2U5S-aL55dyOk8EYXG1WjUZI3SS0SZnqECUKdHwjBWNQipNqRKKqSyeCNOCywnNBeHxmzWrU9lQRcbgtu_7xduqc3rN3b6yXFez6bw6vCGc0zSjZItj9qbPds5-b6QP1cpunInrVSnGUSEibBJTuE8JZ713Uh3bYlQdpFcn0iOT_2GE7s0Fx3X7L4l6cmdd23ihozuttDgOPUV-AOVhlpo
CitedBy_id crossref_primary_10_1515_bams_2020_0025
crossref_primary_10_1142_S0219843619500300
crossref_primary_10_7717_peerj_cs_1358
crossref_primary_10_1016_j_robot_2019_02_003
crossref_primary_10_3389_fnbot_2021_699820
Cites_doi 10.1109/TRA.2003.809592
10.1155/2006/683746
10.1016/S0921-8890(99)00066-4
10.1007/s10514-012-9321-0
10.1007/s10514-009-9143-x
10.1007/s10514-007-9075-2
10.1109/TMECH.2014.2316007
10.1109/TMECH.2015.2414173
10.1109/TRO.2008.2002312
10.1109/TMECH.2009.2032180
10.1016/j.asoc.2005.05.001
10.1142/S0219843604000046
10.1523/JNEUROSCI.5894-08.2010
10.1177/0278364914521306
10.1142/S0219843608001303
10.1007/978-1-84628-642-1
ContentType Journal Article
Copyright 2017, World Scientific Publishing Company
2017. World Scientific Publishing Company
Distributed under a Creative Commons Attribution 4.0 International License
Copyright_xml – notice: 2017, World Scientific Publishing Company
– notice: 2017. World Scientific Publishing Company
– notice: Distributed under a Creative Commons Attribution 4.0 International License
DBID AAYXX
CITATION
1XC
VOOES
DOI 10.1142/S0219843617500189
DatabaseName CrossRef
Hyper Article en Ligne (HAL)
Hyper Article en Ligne (HAL) (Open Access)
DatabaseTitle CrossRef
DatabaseTitleList


CrossRef
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Computer Science
EISSN 1793-6942
EndPage 30
ExternalDocumentID oai_HAL_hal_01742643v1
10_1142_S0219843617500189
S0219843617500189
GroupedDBID .DC
0R~
4.4
5GY
ADSJI
AENEX
ALMA_UNASSIGNED_HOLDINGS
CAG
COF
CS3
DU5
EBS
EJD
F5P
HZ~
O9-
P2P
P71
RWJ
AAYXX
ADMLS
CITATION
1XC
VOOES
ID FETCH-LOGICAL-c3919-bfd6934564d7908049fcda698df0f224fcf9f6fcf0148ae547c3a189b9b2ed4f3
ISSN 0219-8436
IngestDate Sat Sep 06 12:43:22 EDT 2025
Mon Jun 30 09:37:26 EDT 2025
Thu Apr 24 23:08:07 EDT 2025
Tue Jul 01 01:17:21 EDT 2025
Fri Aug 23 08:19:57 EDT 2024
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 3
Keywords collaborative tasks
Navigation
SLAM
motion planning
whole-body control
Motion planning
Whole-body control
Collaborative tasks
Language English
License Distributed under a Creative Commons Attribution 4.0 International License: http://creativecommons.org/licenses/by/4.0
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c3919-bfd6934564d7908049fcda698df0f224fcf9f6fcf0148ae547c3a189b9b2ed4f3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-1968-7207
OpenAccessLink https://hal.science/hal-01742643
PQID 2116170395
PQPubID 2049860
PageCount 30
ParticipantIDs worldscientific_primary_S0219843617500189
hal_primary_oai_HAL_hal_01742643v1
proquest_journals_2116170395
crossref_citationtrail_10_1142_S0219843617500189
crossref_primary_10_1142_S0219843617500189
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 20170900
2017-09-00
20170901
2017-09
PublicationDateYYYYMMDD 2017-09-01
PublicationDate_xml – month: 09
  year: 2017
  text: 20170900
PublicationDecade 2010
PublicationPlace Singapore
PublicationPlace_xml – name: Singapore
PublicationTitle International journal of HR : humanoid robotics
PublicationYear 2017
Publisher World Scientific Publishing Company
World Scientific Publishing Co. Pte., Ltd
World Scientific Publishing
Publisher_xml – name: World Scientific Publishing Company
– name: World Scientific Publishing Co. Pte., Ltd
– name: World Scientific Publishing
References S0219843617500189BIB009
S0219843617500189BIB019
S0219843617500189BIB005
S0219843617500189BIB016
S0219843617500189BIB026
S0219843617500189BIB018
S0219843617500189BIB006
S0219843617500189BIB039
S0219843617500189BIB001
S0219843617500189BIB045
S0219843617500189BIB033
S0219843617500189BIB044
S0219843617500189BIB046
S0219843617500189BIB041
S0219843617500189BIB020
S0219843617500189BIB042
References_xml – ident: S0219843617500189BIB006
  doi: 10.1109/TRA.2003.809592
– ident: S0219843617500189BIB018
  doi: 10.1155/2006/683746
– ident: S0219843617500189BIB005
  doi: 10.1016/S0921-8890(99)00066-4
– ident: S0219843617500189BIB041
  doi: 10.1007/s10514-012-9321-0
– ident: S0219843617500189BIB019
  doi: 10.1007/s10514-009-9143-x
– ident: S0219843617500189BIB042
  doi: 10.1007/s10514-007-9075-2
– ident: S0219843617500189BIB045
  doi: 10.1109/TMECH.2014.2316007
– ident: S0219843617500189BIB044
  doi: 10.1109/TMECH.2015.2414173
– ident: S0219843617500189BIB016
  doi: 10.1109/TRO.2008.2002312
– ident: S0219843617500189BIB046
  doi: 10.1109/TMECH.2009.2032180
– ident: S0219843617500189BIB020
  doi: 10.1016/j.asoc.2005.05.001
– ident: S0219843617500189BIB009
  doi: 10.1142/S0219843604000046
– ident: S0219843617500189BIB026
  doi: 10.1523/JNEUROSCI.5894-08.2010
– ident: S0219843617500189BIB039
  doi: 10.1177/0278364914521306
– ident: S0219843617500189BIB001
  doi: 10.1142/S0219843608001303
– ident: S0219843617500189BIB033
  doi: 10.1007/978-1-84628-642-1
SSID ssj0031778
Score 2.11985
Snippet Although in recent years, there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the...
Although in recent years there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the...
SourceID hal
proquest
crossref
worldscientific
SourceType Open Access Repository
Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 1750018
SubjectTerms Automatic
Collision avoidance
Collision dynamics
Computer Science
Engineering Sciences
Hardware
Humanoid
Motion planning
Multiple robots
Navigation
Odometers
Robot dynamics
Robotics
Robots
Synchronism
Trajectory control
Transporting
Title Cooperative Vision-Based Object Transportation by Two Humanoid Robots in a Cluttered Environment
URI http://www.worldscientific.com/doi/abs/10.1142/S0219843617500189
https://www.proquest.com/docview/2116170395
https://hal.science/hal-01742643
Volume 14
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVEBS
  databaseName: Inspec with Full Text
  customDbUrl:
  eissn: 1793-6942
  dateEnd: 20241001
  omitProxy: false
  ssIdentifier: ssj0031778
  issn: 0219-8436
  databaseCode: ADMLS
  dateStart: 20050301
  isFulltext: true
  titleUrlDefault: https://www.ebsco.com/products/research-databases/inspec-full-text
  providerName: EBSCOhost
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3fb9MwELa67gUeJn6KwkAW4gWmQJukSfxYSlGFNpCgg70FO7a1SFUzdS0w_iP-S-5iO3HXgRgvVhUl58b35e58Pn8m5Fmm00SmcYbkg5itSnWQ6SEPILiAOYvkknGcKB69T6bH8buT4Umn88urWlqvxMvi55X7Sv5Hq3AN9Iq7ZK-h2UYoXIDfoF9oQcPQ_pOOx1V1pix19-d6k3jwGrySPPggML3SMpcbLUOkOftembx9VUqsqq5WdT0sPxjP6xOr4dlJu_XNj1w3U4ce4cT0Y51WOHVSlyjVr6Evq_UPy1NQeav4k3M8UM0wHMz5Wpa8tYYXdolEcXgj7HYpvdUrVdq07RdX8G_TFuAKXV2Ws25gKoMsjiwPtrG-YCyChMWb5jn2YBh5thYCHzxS8Go_EIf1SjR0gn3YW1nr9NxC_yVf2FQomv3aYb4lYofshmmShF2yO3pzdPjJuX2Iw4zbd-9ll9BByKstIRtB0M4pluB685u9mizXbIjFejEv4JndInt2pkJHBna3SUct7pCbHn_lXfLVAyD1AUgNAOkmAKm4oABA6gBIDQBpuaCcNgCkHgDvkeO3k9l4GtgjO4IiYvDiQsuERUhRJFMGk5GY6ULyhGVS9zVEi7rQTCfQYiKbq2GcFhGHARFMhErGOrpPuotqoR4QKoTgTAyVVqGI-0pknMMQRwMps7DQA9YjfTeGeWH57PFYlXn-R931yIvmkTND5vK3m5-CYpr7kIZ9OjrM8RrAGScS0bdBj-w7veX2yzvPwwEmDfoRG_bI80u6bORt9ffwOn_uEbnRflT7pLtartVjiI5X4onF5W8lC7WA
linkProvider EBSCOhost
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Cooperative+Vision-Based+Object+Transportation+by+Two+Humanoid+Robots+in+a+Cluttered+Environment&rft.jtitle=International+journal+of+HR+%3A+humanoid+robotics&rft.au=Rioux%2C+Antoine&rft.au=Esteves%2C+Claudia&rft.au=Hayet%2C+Jean-Bernard&rft.au=Suleiman%2C+Wael&rft.date=2017-09-01&rft.issn=0219-8436&rft.eissn=1793-6942&rft.volume=14&rft.issue=3&rft.spage=1750018&rft_id=info:doi/10.1142%2FS0219843617500189&rft.externalDBID=n%2Fa&rft.externalDocID=10_1142_S0219843617500189
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0219-8436&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0219-8436&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0219-8436&client=summon