Cooperative Vision-Based Object Transportation by Two Humanoid Robots in a Cluttered Environment
Although in recent years, there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy object. Such a functionality is especially useful when transporting objects of differe...
Saved in:
Published in | International journal of HR : humanoid robotics Vol. 14; no. 3; pp. 1750018 - 30 |
---|---|
Main Authors | , , , |
Format | Journal Article |
Language | English |
Published |
Singapore
World Scientific Publishing Company
01.09.2017
World Scientific Publishing Co. Pte., Ltd World Scientific Publishing |
Subjects | |
Online Access | Get full text |
ISSN | 0219-8436 1793-6942 |
DOI | 10.1142/S0219843617500189 |
Cover
Abstract | Although in recent years, there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy object. Such a functionality is especially useful when transporting objects of different shapes and weights without having to modify the robot hardware. In this work, we tackle the problem of making two humanoid robots navigate in a cluttered environment while transporting a very large object that simply could not be moved by a single robot. We present a complete navigation scheme, from the incremental construction of a map of the environment and the computation of collision-free trajectories to the design of the control to execute those trajectories. We present experiments made on real NAO robots, equipped with RGB-D sensors mounted on their heads, moving an object around obstacles. Our experiments show that a significantly large object can be transported without modifying the robot main hardware, and therefore that our scheme enhances the humanoid robots capacities in real-life situations.
Our contributions are: (1) a low-dimension multi-robot motion planning algorithm that finds an obstacle-free trajectory, by using the constructed map of the environment as an input, (2) a framework that produces continuous and consistent odometry data, by fusing the visual and the robot odometry information, (3) a synchronization system that uses the projection of the robots based on their hands positions coupled with the visual feedback error computed from a frontal camera, (4) an efficient real-time whole-body control scheme that controls the motions of the closed-loop robot–object–robot system. |
---|---|
AbstractList | Although in recent years there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy object. Such a functionality is especially useful when transporting objects of different shapes and weights without having to modify the robot hardware. In this work, we tackle the problem of making two humanoid robots navigate in a cluttered environment while transporting a very large object that simply could not be moved by a single robot. We present a complete navigation scheme, from the incremental construction of a map of the environment and the computation of collision-free trajec-tories to the design of the control to execute those trajectories. We present experiments made on real Nao robots, equipped with RGB-D sensors mounted on their heads, moving an object around obstacles. Our experiments show that a significantly large object can be transported without modifying the robot main hardware, and therefore that our scheme enhances the humanoid robots capacities in real-life situations. Our contributions are: (1) a low-dimension multi-robot motion planning algorithm that finds an obstacle-free trajectory, by using the constructed map of the environment as an input, (2) a framework that produces continuous and consistent odometry data, by fusing the visual and the robot odometry information, (3) a synchronization system that Two Nao robots holding an object together. We propose a motion planning strategy for the Nao-object-Nao system to navigate in a cluttered environment and a synchronization approach that allows the motions done by the two Naos without compromising the whole system stability because of the robots swinging movement. uses the projection of the robots based on their hands positions coupled with the visual feedback error computed from a frontal camera, (4) an efficient real-time whole-body control scheme that controls the motions of the closed-loop robot-object-robot system. Although in recent years, there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy object. Such a functionality is especially useful when transporting objects of different shapes and weights without having to modify the robot hardware. In this work, we tackle the problem of making two humanoid robots navigate in a cluttered environment while transporting a very large object that simply could not be moved by a single robot. We present a complete navigation scheme, from the incremental construction of a map of the environment and the computation of collision-free trajectories to the design of the control to execute those trajectories. We present experiments made on real NAO robots, equipped with RGB-D sensors mounted on their heads, moving an object around obstacles. Our experiments show that a significantly large object can be transported without modifying the robot main hardware, and therefore that our scheme enhances the humanoid robots capacities in real-life situations. Our contributions are: (1) a low-dimension multi-robot motion planning algorithm that finds an obstacle-free trajectory, by using the constructed map of the environment as an input, (2) a framework that produces continuous and consistent odometry data, by fusing the visual and the robot odometry information, (3) a synchronization system that uses the projection of the robots based on their hands positions coupled with the visual feedback error computed from a frontal camera, (4) an efficient real-time whole-body control scheme that controls the motions of the closed-loop robot–object–robot system. Although in recent years, there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy object. Such a functionality is especially useful when transporting objects of different shapes and weights without having to modify the robot hardware. In this work, we tackle the problem of making two humanoid robots navigate in a cluttered environment while transporting a very large object that simply could not be moved by a single robot. We present a complete navigation scheme, from the incremental construction of a map of the environment and the computation of collision-free trajectories to the design of the control to execute those trajectories. We present experiments made on real NAO robots, equipped with RGB-D sensors mounted on their heads, moving an object around obstacles. Our experiments show that a significantly large object can be transported without modifying the robot main hardware, and therefore that our scheme enhances the humanoid robots capacities in real-life situations.Our contributions are: (1) a low-dimension multi-robot motion planning algorithm that finds an obstacle-free trajectory, by using the constructed map of the environment as an input, (2) a framework that produces continuous and consistent odometry data, by fusing the visual and the robot odometry information, (3) a synchronization system that uses the projection of the robots based on their hands positions coupled with the visual feedback error computed from a frontal camera, (4) an efficient real-time whole-body control scheme that controls the motions of the closed-loop robot–object–robot system. |
Author | Suleiman, Wael Rioux, Antoine Hayet, Jean-Bernard Esteves, Claudia |
Author_xml | – sequence: 1 givenname: Antoine surname: Rioux fullname: Rioux, Antoine – sequence: 2 givenname: Claudia surname: Esteves fullname: Esteves, Claudia – sequence: 3 givenname: Jean-Bernard surname: Hayet fullname: Hayet, Jean-Bernard – sequence: 4 givenname: Wael surname: Suleiman fullname: Suleiman, Wael |
BackLink | https://hal.science/hal-01742643$$DView record in HAL |
BookMark | eNp9kEFPwyAUx4mZidv0A3gj8eShCoW15TgbdSZLluj0WimFyNJBBbZl316Wmh1c4gUS3v_33uM3AgNjjQTgGqM7jGl6_4ZSzApKMpxPEMIFOwNDnDOSZIymAzA8lJND_QKMvF8hRHCeF0PwWVrbSceD3kr4ob22JnngXjZwUa-kCHDpuPGddSFGrIH1Hi53Fs42a26sbuCrrW3wUBvIYdluQpAuso9mq501a2nCJThXvPXy6vceg_enx2U5S-aL55dyOk8EYXG1WjUZI3SS0SZnqECUKdHwjBWNQipNqRKKqSyeCNOCywnNBeHxmzWrU9lQRcbgtu_7xduqc3rN3b6yXFez6bw6vCGc0zSjZItj9qbPds5-b6QP1cpunInrVSnGUSEibBJTuE8JZ713Uh3bYlQdpFcn0iOT_2GE7s0Fx3X7L4l6cmdd23ihozuttDgOPUV-AOVhlpo |
CitedBy_id | crossref_primary_10_1515_bams_2020_0025 crossref_primary_10_1142_S0219843619500300 crossref_primary_10_7717_peerj_cs_1358 crossref_primary_10_1016_j_robot_2019_02_003 crossref_primary_10_3389_fnbot_2021_699820 |
Cites_doi | 10.1109/TRA.2003.809592 10.1155/2006/683746 10.1016/S0921-8890(99)00066-4 10.1007/s10514-012-9321-0 10.1007/s10514-009-9143-x 10.1007/s10514-007-9075-2 10.1109/TMECH.2014.2316007 10.1109/TMECH.2015.2414173 10.1109/TRO.2008.2002312 10.1109/TMECH.2009.2032180 10.1016/j.asoc.2005.05.001 10.1142/S0219843604000046 10.1523/JNEUROSCI.5894-08.2010 10.1177/0278364914521306 10.1142/S0219843608001303 10.1007/978-1-84628-642-1 |
ContentType | Journal Article |
Copyright | 2017, World Scientific Publishing Company 2017. World Scientific Publishing Company Distributed under a Creative Commons Attribution 4.0 International License |
Copyright_xml | – notice: 2017, World Scientific Publishing Company – notice: 2017. World Scientific Publishing Company – notice: Distributed under a Creative Commons Attribution 4.0 International License |
DBID | AAYXX CITATION 1XC VOOES |
DOI | 10.1142/S0219843617500189 |
DatabaseName | CrossRef Hyper Article en Ligne (HAL) Hyper Article en Ligne (HAL) (Open Access) |
DatabaseTitle | CrossRef |
DatabaseTitleList | CrossRef |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering Computer Science |
EISSN | 1793-6942 |
EndPage | 30 |
ExternalDocumentID | oai_HAL_hal_01742643v1 10_1142_S0219843617500189 S0219843617500189 |
GroupedDBID | .DC 0R~ 4.4 5GY ADSJI AENEX ALMA_UNASSIGNED_HOLDINGS CAG COF CS3 DU5 EBS EJD F5P HZ~ O9- P2P P71 RWJ AAYXX ADMLS CITATION 1XC VOOES |
ID | FETCH-LOGICAL-c3919-bfd6934564d7908049fcda698df0f224fcf9f6fcf0148ae547c3a189b9b2ed4f3 |
ISSN | 0219-8436 |
IngestDate | Sat Sep 06 12:43:22 EDT 2025 Mon Jun 30 09:37:26 EDT 2025 Thu Apr 24 23:08:07 EDT 2025 Tue Jul 01 01:17:21 EDT 2025 Fri Aug 23 08:19:57 EDT 2024 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 3 |
Keywords | collaborative tasks Navigation SLAM motion planning whole-body control Motion planning Whole-body control Collaborative tasks |
Language | English |
License | Distributed under a Creative Commons Attribution 4.0 International License: http://creativecommons.org/licenses/by/4.0 |
LinkModel | OpenURL |
MergedId | FETCHMERGED-LOGICAL-c3919-bfd6934564d7908049fcda698df0f224fcf9f6fcf0148ae547c3a189b9b2ed4f3 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
ORCID | 0000-0002-1968-7207 |
OpenAccessLink | https://hal.science/hal-01742643 |
PQID | 2116170395 |
PQPubID | 2049860 |
PageCount | 30 |
ParticipantIDs | worldscientific_primary_S0219843617500189 hal_primary_oai_HAL_hal_01742643v1 proquest_journals_2116170395 crossref_citationtrail_10_1142_S0219843617500189 crossref_primary_10_1142_S0219843617500189 |
ProviderPackageCode | CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | 20170900 2017-09-00 20170901 2017-09 |
PublicationDateYYYYMMDD | 2017-09-01 |
PublicationDate_xml | – month: 09 year: 2017 text: 20170900 |
PublicationDecade | 2010 |
PublicationPlace | Singapore |
PublicationPlace_xml | – name: Singapore |
PublicationTitle | International journal of HR : humanoid robotics |
PublicationYear | 2017 |
Publisher | World Scientific Publishing Company World Scientific Publishing Co. Pte., Ltd World Scientific Publishing |
Publisher_xml | – name: World Scientific Publishing Company – name: World Scientific Publishing Co. Pte., Ltd – name: World Scientific Publishing |
References | S0219843617500189BIB009 S0219843617500189BIB019 S0219843617500189BIB005 S0219843617500189BIB016 S0219843617500189BIB026 S0219843617500189BIB018 S0219843617500189BIB006 S0219843617500189BIB039 S0219843617500189BIB001 S0219843617500189BIB045 S0219843617500189BIB033 S0219843617500189BIB044 S0219843617500189BIB046 S0219843617500189BIB041 S0219843617500189BIB020 S0219843617500189BIB042 |
References_xml | – ident: S0219843617500189BIB006 doi: 10.1109/TRA.2003.809592 – ident: S0219843617500189BIB018 doi: 10.1155/2006/683746 – ident: S0219843617500189BIB005 doi: 10.1016/S0921-8890(99)00066-4 – ident: S0219843617500189BIB041 doi: 10.1007/s10514-012-9321-0 – ident: S0219843617500189BIB019 doi: 10.1007/s10514-009-9143-x – ident: S0219843617500189BIB042 doi: 10.1007/s10514-007-9075-2 – ident: S0219843617500189BIB045 doi: 10.1109/TMECH.2014.2316007 – ident: S0219843617500189BIB044 doi: 10.1109/TMECH.2015.2414173 – ident: S0219843617500189BIB016 doi: 10.1109/TRO.2008.2002312 – ident: S0219843617500189BIB046 doi: 10.1109/TMECH.2009.2032180 – ident: S0219843617500189BIB020 doi: 10.1016/j.asoc.2005.05.001 – ident: S0219843617500189BIB009 doi: 10.1142/S0219843604000046 – ident: S0219843617500189BIB026 doi: 10.1523/JNEUROSCI.5894-08.2010 – ident: S0219843617500189BIB039 doi: 10.1177/0278364914521306 – ident: S0219843617500189BIB001 doi: 10.1142/S0219843608001303 – ident: S0219843617500189BIB033 doi: 10.1007/978-1-84628-642-1 |
SSID | ssj0031778 |
Score | 2.11985 |
Snippet | Although in recent years, there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the... Although in recent years there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the... |
SourceID | hal proquest crossref worldscientific |
SourceType | Open Access Repository Aggregation Database Enrichment Source Index Database Publisher |
StartPage | 1750018 |
SubjectTerms | Automatic Collision avoidance Collision dynamics Computer Science Engineering Sciences Hardware Humanoid Motion planning Multiple robots Navigation Odometers Robot dynamics Robotics Robots Synchronism Trajectory control Transporting |
Title | Cooperative Vision-Based Object Transportation by Two Humanoid Robots in a Cluttered Environment |
URI | http://www.worldscientific.com/doi/abs/10.1142/S0219843617500189 https://www.proquest.com/docview/2116170395 https://hal.science/hal-01742643 |
Volume | 14 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
journalDatabaseRights | – providerCode: PRVEBS databaseName: Inspec with Full Text customDbUrl: eissn: 1793-6942 dateEnd: 20241001 omitProxy: false ssIdentifier: ssj0031778 issn: 0219-8436 databaseCode: ADMLS dateStart: 20050301 isFulltext: true titleUrlDefault: https://www.ebsco.com/products/research-databases/inspec-full-text providerName: EBSCOhost |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3fb9MwELa67gUeJn6KwkAW4gWmQJukSfxYSlGFNpCgg70FO7a1SFUzdS0w_iP-S-5iO3HXgRgvVhUl58b35e58Pn8m5Fmm00SmcYbkg5itSnWQ6SEPILiAOYvkknGcKB69T6bH8buT4Umn88urWlqvxMvi55X7Sv5Hq3AN9Iq7ZK-h2UYoXIDfoF9oQcPQ_pOOx1V1pix19-d6k3jwGrySPPggML3SMpcbLUOkOftembx9VUqsqq5WdT0sPxjP6xOr4dlJu_XNj1w3U4ce4cT0Y51WOHVSlyjVr6Evq_UPy1NQeav4k3M8UM0wHMz5Wpa8tYYXdolEcXgj7HYpvdUrVdq07RdX8G_TFuAKXV2Ws25gKoMsjiwPtrG-YCyChMWb5jn2YBh5thYCHzxS8Go_EIf1SjR0gn3YW1nr9NxC_yVf2FQomv3aYb4lYofshmmShF2yO3pzdPjJuX2Iw4zbd-9ll9BByKstIRtB0M4pluB685u9mizXbIjFejEv4JndInt2pkJHBna3SUct7pCbHn_lXfLVAyD1AUgNAOkmAKm4oABA6gBIDQBpuaCcNgCkHgDvkeO3k9l4GtgjO4IiYvDiQsuERUhRJFMGk5GY6ULyhGVS9zVEi7rQTCfQYiKbq2GcFhGHARFMhErGOrpPuotqoR4QKoTgTAyVVqGI-0pknMMQRwMps7DQA9YjfTeGeWH57PFYlXn-R931yIvmkTND5vK3m5-CYpr7kIZ9OjrM8RrAGScS0bdBj-w7veX2yzvPwwEmDfoRG_bI80u6bORt9ffwOn_uEbnRflT7pLtartVjiI5X4onF5W8lC7WA |
linkProvider | EBSCOhost |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Cooperative+Vision-Based+Object+Transportation+by+Two+Humanoid+Robots+in+a+Cluttered+Environment&rft.jtitle=International+journal+of+HR+%3A+humanoid+robotics&rft.au=Rioux%2C+Antoine&rft.au=Esteves%2C+Claudia&rft.au=Hayet%2C+Jean-Bernard&rft.au=Suleiman%2C+Wael&rft.date=2017-09-01&rft.issn=0219-8436&rft.eissn=1793-6942&rft.volume=14&rft.issue=3&rft.spage=1750018&rft_id=info:doi/10.1142%2FS0219843617500189&rft.externalDBID=n%2Fa&rft.externalDocID=10_1142_S0219843617500189 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0219-8436&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0219-8436&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0219-8436&client=summon |