WhiskSight: A Reconfigurable, Vision-Based, Optical Whisker Sensing Array for Simultaneous Contact, Airflow, and Inertia Stimulus Detection
The development of whisker-based sensing systems faces at least two important technical challenges: scaling up the number of whiskers to large arrays while retaining a simple interface; and detecting the wide variety of stimuli that biological whiskers can sense, including both direct touch (contact...
Saved in:
| Published in | IEEE robotics and automation letters Vol. 6; no. 2; pp. 3357 - 3364 |
|---|---|
| Main Authors | , , , , , |
| Format | Journal Article |
| Language | English |
| Published |
Piscataway
IEEE
01.04.2021
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Subjects | |
| Online Access | Get full text |
| ISSN | 2377-3766 2377-3766 |
| DOI | 10.1109/LRA.2021.3062816 |
Cover
| Abstract | The development of whisker-based sensing systems faces at least two important technical challenges: scaling up the number of whiskers to large arrays while retaining a simple interface; and detecting the wide variety of stimuli that biological whiskers can sense, including both direct touch (contact) and airflow. Here we present the design for a whisker array that leverages a camera to measure whisker rotations without a complex interface. Whiskers are magnetically attached to an elastomer "skin," ensuring that the system is both scalable and reconfigurable. Direct contact is measured from the relative motion between each whisker and the skin, while airflow and inertia can be inferred from the signal experienced by all whiskers in the array. Individual whiskers can resolve the direction of contact transverse to the whisker within <inline-formula><tex-math notation="LaTeX">{6.2}^{\circ }</tex-math></inline-formula> and whisker rotation magnitude to within <inline-formula><tex-math notation="LaTeX">{0.5}^{\circ }</tex-math></inline-formula>. An algorithm is developed to distinguish inertial forces from airflow and contact. |
|---|---|
| AbstractList | The development of whisker-based sensing systems faces at least two important technical challenges: scaling up the number of whiskers to large arrays while retaining a simple interface; and detecting the wide variety of stimuli that biological whiskers can sense, including both direct touch (contact) and airflow. Here we present the design for a whisker array that leverages a camera to measure whisker rotations without a complex interface. Whiskers are magnetically attached to an elastomer “skin,” ensuring that the system is both scalable and reconfigurable. Direct contact is measured from the relative motion between each whisker and the skin, while airflow and inertia can be inferred from the signal experienced by all whiskers in the array. Individual whiskers can resolve the direction of contact transverse to the whisker within [Formula Omitted] and whisker rotation magnitude to within [Formula Omitted]. An algorithm is developed to distinguish inertial forces from airflow and contact. The development of whisker-based sensing systems faces at least two important technical challenges: scaling up the number of whiskers to large arrays while retaining a simple interface; and detecting the wide variety of stimuli that biological whiskers can sense, including both direct touch (contact) and airflow. Here we present the design for a whisker array that leverages a camera to measure whisker rotations without a complex interface. Whiskers are magnetically attached to an elastomer "skin," ensuring that the system is both scalable and reconfigurable. Direct contact is measured from the relative motion between each whisker and the skin, while airflow and inertia can be inferred from the signal experienced by all whiskers in the array. Individual whiskers can resolve the direction of contact transverse to the whisker within <inline-formula><tex-math notation="LaTeX">{6.2}^{\circ }</tex-math></inline-formula> and whisker rotation magnitude to within <inline-formula><tex-math notation="LaTeX">{0.5}^{\circ }</tex-math></inline-formula>. An algorithm is developed to distinguish inertial forces from airflow and contact. |
| Author | Bergbreiter, Sarah Yuan, Wenzhen Kornilowicz, Gabriel Kent, Teresa A Kim, Suhan Hartmann, Mitra J. Z. |
| Author_xml | – sequence: 1 givenname: Teresa A orcidid: 0000-0002-6935-9586 surname: Kent fullname: Kent, Teresa A email: tkent@andrew.cmu.edu organization: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA – sequence: 2 givenname: Suhan orcidid: 0000-0001-6866-2623 surname: Kim fullname: Kim, Suhan email: suhank@andrew.cmu.edu organization: Mechanical Engineering Department, Carnegie Mellon University, Pittsburgh, PA, USA – sequence: 3 givenname: Gabriel orcidid: 0000-0002-5025-9868 surname: Kornilowicz fullname: Kornilowicz, Gabriel email: gkornilo@andrew.cmu.edu organization: Mechanical Engineering Department, Carnegie Mellon University, Pittsburgh, PA, USA – sequence: 4 givenname: Wenzhen orcidid: 0000-0001-8014-356X surname: Yuan fullname: Yuan, Wenzhen email: yuanwz@cmu.edu organization: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA – sequence: 5 givenname: Mitra J. Z. orcidid: 0000-0003-0783-1483 surname: Hartmann fullname: Hartmann, Mitra J. Z. email: hartmann@northwestern.edu organization: Biomedical Engineering and Mechanical Engineering Departments, Northwestern University, Evanston, IL, USA – sequence: 6 givenname: Sarah orcidid: 0000-0003-2735-0206 surname: Bergbreiter fullname: Bergbreiter, Sarah email: sbergbre@andrew.cmu.edu organization: Mechanical Engineering Department, Carnegie Mellon University, Pittsburgh, PA, USA |
| BookMark | eNp9kE1PGzEQhi1EJWjKvRIXS1yz6Xgd27vctqEfSJGQCNDjynHGwbDYwfaq4jf0T3dDEEIcOHlkvc-8mucz2ffBIyFfGUwYg_rb_LKZlFCyCQdZVkzukcOSK1VwJeX-m_mAHKV0BwBMlIrX4pD8-3Pr0v3CrW_zKW3oJZrgrVv3US87HNMbl1zwxXedcDWmF5vsjO7oM4ORLtAn59e0iVE_URuGH_fQd1l7DH2is-CzNnlMGxdtF_6OqfYreu4xZqfpIm-zQ-wMM5o81Hwhn6zuEh69vCNy_fPH1ex3Mb_4dT5r5oUpa5YLhlqBhKlAzkBpsay4MCgt1FpVMLWCr5iulQUBK1Wj5ZWFii-xUsZAiYqPyMlu7yaGxx5Tbu9CH_1Q2ZYChGTAB2BEYJcyMaQU0bab6B50fGoZtFvr7WC93VpvX6wPiHyHGJf19rQctes-Ao93oEPE156aS8nrKf8P4hSRMw |
| CODEN | IRALC6 |
| CitedBy_id | crossref_primary_10_1109_MRA_2022_3182870 crossref_primary_10_1002_aisy_202400492 crossref_primary_10_1016_j_xcrp_2024_102064 crossref_primary_10_1109_TIM_2024_3451580 crossref_primary_10_3390_jmse11112108 crossref_primary_10_53469_wjimt_2024_07_05__16 crossref_primary_10_1109_JSEN_2024_3354290 crossref_primary_10_1016_j_optlaseng_2024_108125 crossref_primary_10_1109_JSEN_2024_3452206 |
| Cites_doi | 10.1002/cne.10277 10.3390/s17122762 10.1073/pnas.1317920111 10.1109/TOH.2014.2326871 10.1002/ar.23989 10.1109/CVPR.2010.5539960 10.1109/CVPR.2017.515 10.3389/fnbot.2012.00012 10.1038/443525a 10.1098/rstb.2011.0164 10.1177/0278364908104468 10.1109/ICRA.2016.7487228 10.1109/BIOROB.2018.8487886 10.1109/HUMANOIDS.2016.7803400 10.1098/rstb.2011.0167 10.1038/nn.4221 10.1016/j.neuron.2017.03.045 10.1109/LRA.2019.2899215 10.1089/soro.2017.0052 10.1109/TRO.2010.2069990 10.1145/1056808.1056859 10.1109/70.681246 10.1017/CBO9780511996504 10.1242/jeb.126896 10.15607/RSS.2018.XIV.059 |
| ContentType | Journal Article |
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021 |
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021 |
| DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D |
| DOI | 10.1109/LRA.2021.3062816 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE/IET Electronic Library CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 2377-3766 |
| EndPage | 3364 |
| ExternalDocumentID | 10_1109_LRA_2021_3062816 9366394 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: NSF grantid: BCS-1921251 |
| GroupedDBID | 0R~ 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFS AGQYO AGSQL AHBIQ AKJIK AKQYR ALMA_UNASSIGNED_HOLDINGS ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ EBS EJD IFIPE IPLJI JAVBF KQ8 M43 M~E O9- OCL RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D |
| ID | FETCH-LOGICAL-c291t-1ea706045e3107a5b835ce6f09a7804f53d1a97f050d79ef38f083be87cc02e73 |
| IEDL.DBID | RIE |
| ISSN | 2377-3766 |
| IngestDate | Sun Jun 29 16:46:41 EDT 2025 Wed Oct 01 04:32:22 EDT 2025 Thu Apr 24 22:59:49 EDT 2025 Wed Aug 27 02:47:25 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 2 |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c291t-1ea706045e3107a5b835ce6f09a7804f53d1a97f050d79ef38f083be87cc02e73 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0002-5025-9868 0000-0001-6866-2623 0000-0001-8014-356X 0000-0003-0783-1483 0000-0002-6935-9586 0000-0003-2735-0206 |
| PQID | 2505610308 |
| PQPubID | 4437225 |
| PageCount | 8 |
| ParticipantIDs | ieee_primary_9366394 crossref_primary_10_1109_LRA_2021_3062816 proquest_journals_2505610308 crossref_citationtrail_10_1109_LRA_2021_3062816 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2021-04-01 |
| PublicationDateYYYYMMDD | 2021-04-01 |
| PublicationDate_xml | – month: 04 year: 2021 text: 2021-04-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | Piscataway |
| PublicationPlace_xml | – name: Piscataway |
| PublicationTitle | IEEE robotics and automation letters |
| PublicationTitleAbbrev | LRA |
| PublicationYear | 2021 |
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref13 ref12 ref15 ref10 ref2 ref1 ref17 ref16 ref19 ref18 ref24 ref23 ref26 ref25 ref20 ref22 ref21 ref27 kim (ref11) 0 kent (ref28) 2020 ref8 ref7 ref9 ref4 ref3 ref6 ref5 lepora (ref14) 0 |
| References_xml | – ident: ref2 doi: 10.1002/cne.10277 – ident: ref16 doi: 10.3390/s17122762 – ident: ref13 doi: 10.1073/pnas.1317920111 – ident: ref17 doi: 10.1109/TOH.2014.2326871 – ident: ref1 doi: 10.1002/ar.23989 – ident: ref22 doi: 10.1109/CVPR.2010.5539960 – ident: ref23 doi: 10.1109/CVPR.2017.515 – ident: ref7 doi: 10.3389/fnbot.2012.00012 – ident: ref4 doi: 10.1038/443525a – ident: ref10 doi: 10.1098/rstb.2011.0164 – ident: ref5 doi: 10.1177/0278364908104468 – ident: ref9 doi: 10.1109/ICRA.2016.7487228 – ident: ref18 doi: 10.1109/BIOROB.2018.8487886 – ident: ref20 doi: 10.1109/HUMANOIDS.2016.7803400 – ident: ref8 doi: 10.1098/rstb.2011.0167 – ident: ref26 doi: 10.1038/nn.4221 – year: 2020 ident: ref28 article-title: Whisksight – ident: ref25 doi: 10.1016/j.neuron.2017.03.045 – ident: ref12 doi: 10.1109/LRA.2019.2899215 – ident: ref15 doi: 10.1089/soro.2017.0052 – ident: ref19 doi: 10.1109/TRO.2010.2069990 – ident: ref21 doi: 10.1145/1056808.1056859 – start-page: 7628 year: 0 ident: ref14 article-title: Biomimetic optical tactile whiskered robots publication-title: Proc IEEE/RSJ Int Conf Intell Robots Syst – ident: ref3 doi: 10.1109/70.681246 – ident: ref24 doi: 10.1017/CBO9780511996504 – start-page: 1330 year: 0 ident: ref11 article-title: A whisker-inspired fin sensor for multi-directional airflow sensing publication-title: Proc IEEE/RSJ Int Conf Intell Robots Syst – ident: ref27 doi: 10.1242/jeb.126896 – ident: ref6 doi: 10.15607/RSS.2018.XIV.059 |
| SSID | ssj0001527395 |
| Score | 2.2509518 |
| Snippet | The development of whisker-based sensing systems faces at least two important technical challenges: scaling up the number of whiskers to large arrays while... |
| SourceID | proquest crossref ieee |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 3357 |
| SubjectTerms | Air flow Algorithms Arrays Biologically-inspired robots Biomembranes Cameras Elastomers Force force and tactile sensing Inertia Magnetic resonance imaging Reconfiguration Sensor arrays Sensors soft sensors and actuators Tracking |
| Title | WhiskSight: A Reconfigurable, Vision-Based, Optical Whisker Sensing Array for Simultaneous Contact, Airflow, and Inertia Stimulus Detection |
| URI | https://ieeexplore.ieee.org/document/9366394 https://www.proquest.com/docview/2505610308 |
| Volume | 6 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVAFT databaseName: Open Access Digital Library customDbUrl: eissn: 2377-3766 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0001527395 issn: 2377-3766 databaseCode: KQ8 dateStart: 20160101 isFulltext: true titleUrlDefault: http://grweb.coalliance.org/oadl/oadl.html providerName: Colorado Alliance of Research Libraries – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 2377-3766 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001527395 issn: 2377-3766 databaseCode: RIE dateStart: 20160101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 2377-3766 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0001527395 issn: 2377-3766 databaseCode: M~E dateStart: 20160101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Nb9QwEB11e4IDUApioa184IKU7DofTtbctrRVQSxILIXeIscZt6tW3iqbCMGBP8CfxuNklwoQ4pbDOLE0duaN_eYNwHODqXFRDkNuojJMoyoJZaVEKLIUM52YqhRUnDx7l52epW_OxfkWBJtaGET05DMc0aO_y6-WuqWjsrFMXHyU6QAG-STrarV-naeQkpgU65tILsdvP0xd_hdHo4TqBKmh-a3I41up_PH_9UHl5D7M1tPpuCRXo7YpR_rbb0qN_zvfB3CvR5ds2i2HHdhC-xDu3tIc3IUfny8Xq6s55eQv2ZRR-mnN4qKtqYYqYJ98rXl46IJbFbD3N_6om_kxWLM50d3thftArb4yh3fZfEGURGVx2a4YSV0p3QRsuqjN9fJLwJSt2GtL3G3F5g3ZOrMjbDwBzD6Cs5Pjj69Ow74jQ6hjGTVhhMqr7Qh0qDBXonT4TWNmuFQkZGREUkVK5oYLXuUSTTIxDuKVOMm15jHmyWPYtkuLT4A5XCmpH2CUxSpNkUvtoFKGUhpeYlyJIYzX3ip0L1dOXTOuC5-2cFk4_xbk36L37xBebEbcdFId_7DdJXdt7HpPDWFvvSCKfi-vCg8SqRvb5OnfRz2DO_Tujs-zB9tN3eK-gypNeQCD2ffjA79SfwJl-ehB |
| linkProvider | IEEE |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Nb9QwELVKOQCH8lEqFlrwgQtSsuskdrLmthSqLewWiW2ht8ixx2XVKltlE1XwF_qn63GySwUIccthLFsaO_PGfvOGkNcWuHVRDkJmoyLkkUlCaZQIRcoh1Yk1hcDi5OlROj7hH0_F6QYJ1rUwAODJZ9DHT_-Wbxa6wauygUxcfJT8DrkrOOeirdb6daOCWmJSrN4imRxMvoxcBhhH_QQrBbGl-a3Y45up_PEH9mHl4CGZrhbUsknO-01d9PXP37Qa_3fFj8hWhy_pqN0Qj8kGlE_Ig1uqg9vk-tv3-fJ8hln5WzqimICWdn7WVFhFFdCvvto8fOfCmwno50t_2U39GKjoDAnv5ZmboFI_qEO8dDZHUqIqYdEsKYpdKV0HdDSv7MXiKqCqNPSwRPa2orMabZ3Ze6g9Bax8Sk4OPhzvj8OuJ0OoYxnVYQTK6-0IcLgwU6JwCE5DaplUKGVkRWIiJTPLBDOZBJsMrQN5BQwzrVkMWbJDNstFCc8IdchSYkfAKI0V58CkdmApBSktKyA2okcGK2_luhMsx74ZF7lPXJjMnX9z9G_e-bdH3qxHXLZiHf-w3UZ3re06T_XI7mpD5N1pXuYeJmI_tuHzv496Re6Nj6eTfHJ49OkFuY_ztOyeXbJZVw3sOeBSFy_9fr0BNT_qXQ |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=WhiskSight%3A+A+Reconfigurable%2C+Vision-Based%2C+Optical+Whisker+Sensing+Array+for+Simultaneous+Contact%2C+Airflow%2C+and+Inertia+Stimulus+Detection&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Kent%2C+Teresa+A&rft.au=Kim%2C+Suhan&rft.au=Kornilowicz%2C+Gabriel&rft.au=Yuan%2C+Wenzhen&rft.date=2021-04-01&rft.pub=IEEE&rft.eissn=2377-3766&rft.volume=6&rft.issue=2&rft.spage=3357&rft.epage=3364&rft_id=info:doi/10.1109%2FLRA.2021.3062816&rft.externalDocID=9366394 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon |