WhiskSight: A Reconfigurable, Vision-Based, Optical Whisker Sensing Array for Simultaneous Contact, Airflow, and Inertia Stimulus Detection

The development of whisker-based sensing systems faces at least two important technical challenges: scaling up the number of whiskers to large arrays while retaining a simple interface; and detecting the wide variety of stimuli that biological whiskers can sense, including both direct touch (contact...

Full description

Saved in:
Bibliographic Details
Published inIEEE robotics and automation letters Vol. 6; no. 2; pp. 3357 - 3364
Main Authors Kent, Teresa A, Kim, Suhan, Kornilowicz, Gabriel, Yuan, Wenzhen, Hartmann, Mitra J. Z., Bergbreiter, Sarah
Format Journal Article
LanguageEnglish
Published Piscataway IEEE 01.04.2021
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text
ISSN2377-3766
2377-3766
DOI10.1109/LRA.2021.3062816

Cover

Abstract The development of whisker-based sensing systems faces at least two important technical challenges: scaling up the number of whiskers to large arrays while retaining a simple interface; and detecting the wide variety of stimuli that biological whiskers can sense, including both direct touch (contact) and airflow. Here we present the design for a whisker array that leverages a camera to measure whisker rotations without a complex interface. Whiskers are magnetically attached to an elastomer "skin," ensuring that the system is both scalable and reconfigurable. Direct contact is measured from the relative motion between each whisker and the skin, while airflow and inertia can be inferred from the signal experienced by all whiskers in the array. Individual whiskers can resolve the direction of contact transverse to the whisker within <inline-formula><tex-math notation="LaTeX">{6.2}^{\circ }</tex-math></inline-formula> and whisker rotation magnitude to within <inline-formula><tex-math notation="LaTeX">{0.5}^{\circ }</tex-math></inline-formula>. An algorithm is developed to distinguish inertial forces from airflow and contact.
AbstractList The development of whisker-based sensing systems faces at least two important technical challenges: scaling up the number of whiskers to large arrays while retaining a simple interface; and detecting the wide variety of stimuli that biological whiskers can sense, including both direct touch (contact) and airflow. Here we present the design for a whisker array that leverages a camera to measure whisker rotations without a complex interface. Whiskers are magnetically attached to an elastomer “skin,” ensuring that the system is both scalable and reconfigurable. Direct contact is measured from the relative motion between each whisker and the skin, while airflow and inertia can be inferred from the signal experienced by all whiskers in the array. Individual whiskers can resolve the direction of contact transverse to the whisker within [Formula Omitted] and whisker rotation magnitude to within [Formula Omitted]. An algorithm is developed to distinguish inertial forces from airflow and contact.
The development of whisker-based sensing systems faces at least two important technical challenges: scaling up the number of whiskers to large arrays while retaining a simple interface; and detecting the wide variety of stimuli that biological whiskers can sense, including both direct touch (contact) and airflow. Here we present the design for a whisker array that leverages a camera to measure whisker rotations without a complex interface. Whiskers are magnetically attached to an elastomer "skin," ensuring that the system is both scalable and reconfigurable. Direct contact is measured from the relative motion between each whisker and the skin, while airflow and inertia can be inferred from the signal experienced by all whiskers in the array. Individual whiskers can resolve the direction of contact transverse to the whisker within <inline-formula><tex-math notation="LaTeX">{6.2}^{\circ }</tex-math></inline-formula> and whisker rotation magnitude to within <inline-formula><tex-math notation="LaTeX">{0.5}^{\circ }</tex-math></inline-formula>. An algorithm is developed to distinguish inertial forces from airflow and contact.
Author Bergbreiter, Sarah
Yuan, Wenzhen
Kornilowicz, Gabriel
Kent, Teresa A
Kim, Suhan
Hartmann, Mitra J. Z.
Author_xml – sequence: 1
  givenname: Teresa A
  orcidid: 0000-0002-6935-9586
  surname: Kent
  fullname: Kent, Teresa A
  email: tkent@andrew.cmu.edu
  organization: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA
– sequence: 2
  givenname: Suhan
  orcidid: 0000-0001-6866-2623
  surname: Kim
  fullname: Kim, Suhan
  email: suhank@andrew.cmu.edu
  organization: Mechanical Engineering Department, Carnegie Mellon University, Pittsburgh, PA, USA
– sequence: 3
  givenname: Gabriel
  orcidid: 0000-0002-5025-9868
  surname: Kornilowicz
  fullname: Kornilowicz, Gabriel
  email: gkornilo@andrew.cmu.edu
  organization: Mechanical Engineering Department, Carnegie Mellon University, Pittsburgh, PA, USA
– sequence: 4
  givenname: Wenzhen
  orcidid: 0000-0001-8014-356X
  surname: Yuan
  fullname: Yuan, Wenzhen
  email: yuanwz@cmu.edu
  organization: Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA
– sequence: 5
  givenname: Mitra J. Z.
  orcidid: 0000-0003-0783-1483
  surname: Hartmann
  fullname: Hartmann, Mitra J. Z.
  email: hartmann@northwestern.edu
  organization: Biomedical Engineering and Mechanical Engineering Departments, Northwestern University, Evanston, IL, USA
– sequence: 6
  givenname: Sarah
  orcidid: 0000-0003-2735-0206
  surname: Bergbreiter
  fullname: Bergbreiter, Sarah
  email: sbergbre@andrew.cmu.edu
  organization: Mechanical Engineering Department, Carnegie Mellon University, Pittsburgh, PA, USA
BookMark eNp9kE1PGzEQhi1EJWjKvRIXS1yz6Xgd27vctqEfSJGQCNDjynHGwbDYwfaq4jf0T3dDEEIcOHlkvc-8mucz2ffBIyFfGUwYg_rb_LKZlFCyCQdZVkzukcOSK1VwJeX-m_mAHKV0BwBMlIrX4pD8-3Pr0v3CrW_zKW3oJZrgrVv3US87HNMbl1zwxXedcDWmF5vsjO7oM4ORLtAn59e0iVE_URuGH_fQd1l7DH2is-CzNnlMGxdtF_6OqfYreu4xZqfpIm-zQ-wMM5o81Hwhn6zuEh69vCNy_fPH1ex3Mb_4dT5r5oUpa5YLhlqBhKlAzkBpsay4MCgt1FpVMLWCr5iulQUBK1Wj5ZWFii-xUsZAiYqPyMlu7yaGxx5Tbu9CH_1Q2ZYChGTAB2BEYJcyMaQU0bab6B50fGoZtFvr7WC93VpvX6wPiHyHGJf19rQctes-Ao93oEPE156aS8nrKf8P4hSRMw
CODEN IRALC6
CitedBy_id crossref_primary_10_1109_MRA_2022_3182870
crossref_primary_10_1002_aisy_202400492
crossref_primary_10_1016_j_xcrp_2024_102064
crossref_primary_10_1109_TIM_2024_3451580
crossref_primary_10_3390_jmse11112108
crossref_primary_10_53469_wjimt_2024_07_05__16
crossref_primary_10_1109_JSEN_2024_3354290
crossref_primary_10_1016_j_optlaseng_2024_108125
crossref_primary_10_1109_JSEN_2024_3452206
Cites_doi 10.1002/cne.10277
10.3390/s17122762
10.1073/pnas.1317920111
10.1109/TOH.2014.2326871
10.1002/ar.23989
10.1109/CVPR.2010.5539960
10.1109/CVPR.2017.515
10.3389/fnbot.2012.00012
10.1038/443525a
10.1098/rstb.2011.0164
10.1177/0278364908104468
10.1109/ICRA.2016.7487228
10.1109/BIOROB.2018.8487886
10.1109/HUMANOIDS.2016.7803400
10.1098/rstb.2011.0167
10.1038/nn.4221
10.1016/j.neuron.2017.03.045
10.1109/LRA.2019.2899215
10.1089/soro.2017.0052
10.1109/TRO.2010.2069990
10.1145/1056808.1056859
10.1109/70.681246
10.1017/CBO9780511996504
10.1242/jeb.126896
10.15607/RSS.2018.XIV.059
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/LRA.2021.3062816
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE/IET Electronic Library
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList Technology Research Database

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2377-3766
EndPage 3364
ExternalDocumentID 10_1109_LRA_2021_3062816
9366394
Genre orig-research
GrantInformation_xml – fundername: NSF
  grantid: BCS-1921251
GroupedDBID 0R~
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFS
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
IFIPE
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c291t-1ea706045e3107a5b835ce6f09a7804f53d1a97f050d79ef38f083be87cc02e73
IEDL.DBID RIE
ISSN 2377-3766
IngestDate Sun Jun 29 16:46:41 EDT 2025
Wed Oct 01 04:32:22 EDT 2025
Thu Apr 24 22:59:49 EDT 2025
Wed Aug 27 02:47:25 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c291t-1ea706045e3107a5b835ce6f09a7804f53d1a97f050d79ef38f083be87cc02e73
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-5025-9868
0000-0001-6866-2623
0000-0001-8014-356X
0000-0003-0783-1483
0000-0002-6935-9586
0000-0003-2735-0206
PQID 2505610308
PQPubID 4437225
PageCount 8
ParticipantIDs ieee_primary_9366394
crossref_primary_10_1109_LRA_2021_3062816
proquest_journals_2505610308
crossref_citationtrail_10_1109_LRA_2021_3062816
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2021-04-01
PublicationDateYYYYMMDD 2021-04-01
PublicationDate_xml – month: 04
  year: 2021
  text: 2021-04-01
  day: 01
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE robotics and automation letters
PublicationTitleAbbrev LRA
PublicationYear 2021
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref15
ref10
ref2
ref1
ref17
ref16
ref19
ref18
ref24
ref23
ref26
ref25
ref20
ref22
ref21
ref27
kim (ref11) 0
kent (ref28) 2020
ref8
ref7
ref9
ref4
ref3
ref6
ref5
lepora (ref14) 0
References_xml – ident: ref2
  doi: 10.1002/cne.10277
– ident: ref16
  doi: 10.3390/s17122762
– ident: ref13
  doi: 10.1073/pnas.1317920111
– ident: ref17
  doi: 10.1109/TOH.2014.2326871
– ident: ref1
  doi: 10.1002/ar.23989
– ident: ref22
  doi: 10.1109/CVPR.2010.5539960
– ident: ref23
  doi: 10.1109/CVPR.2017.515
– ident: ref7
  doi: 10.3389/fnbot.2012.00012
– ident: ref4
  doi: 10.1038/443525a
– ident: ref10
  doi: 10.1098/rstb.2011.0164
– ident: ref5
  doi: 10.1177/0278364908104468
– ident: ref9
  doi: 10.1109/ICRA.2016.7487228
– ident: ref18
  doi: 10.1109/BIOROB.2018.8487886
– ident: ref20
  doi: 10.1109/HUMANOIDS.2016.7803400
– ident: ref8
  doi: 10.1098/rstb.2011.0167
– ident: ref26
  doi: 10.1038/nn.4221
– year: 2020
  ident: ref28
  article-title: Whisksight
– ident: ref25
  doi: 10.1016/j.neuron.2017.03.045
– ident: ref12
  doi: 10.1109/LRA.2019.2899215
– ident: ref15
  doi: 10.1089/soro.2017.0052
– ident: ref19
  doi: 10.1109/TRO.2010.2069990
– ident: ref21
  doi: 10.1145/1056808.1056859
– start-page: 7628
  year: 0
  ident: ref14
  article-title: Biomimetic optical tactile whiskered robots
  publication-title: Proc IEEE/RSJ Int Conf Intell Robots Syst
– ident: ref3
  doi: 10.1109/70.681246
– ident: ref24
  doi: 10.1017/CBO9780511996504
– start-page: 1330
  year: 0
  ident: ref11
  article-title: A whisker-inspired fin sensor for multi-directional airflow sensing
  publication-title: Proc IEEE/RSJ Int Conf Intell Robots Syst
– ident: ref27
  doi: 10.1242/jeb.126896
– ident: ref6
  doi: 10.15607/RSS.2018.XIV.059
SSID ssj0001527395
Score 2.2509518
Snippet The development of whisker-based sensing systems faces at least two important technical challenges: scaling up the number of whiskers to large arrays while...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 3357
SubjectTerms Air flow
Algorithms
Arrays
Biologically-inspired robots
Biomembranes
Cameras
Elastomers
Force
force and tactile sensing
Inertia
Magnetic resonance imaging
Reconfiguration
Sensor arrays
Sensors
soft sensors and actuators
Tracking
Title WhiskSight: A Reconfigurable, Vision-Based, Optical Whisker Sensing Array for Simultaneous Contact, Airflow, and Inertia Stimulus Detection
URI https://ieeexplore.ieee.org/document/9366394
https://www.proquest.com/docview/2505610308
Volume 6
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAFT
  databaseName: Open Access Digital Library
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: KQ8
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: http://grweb.coalliance.org/oadl/oadl.html
  providerName: Colorado Alliance of Research Libraries
– providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: RIE
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: M~E
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Nb9QwEB11e4IDUApioa184IKU7DofTtbctrRVQSxILIXeIscZt6tW3iqbCMGBP8CfxuNklwoQ4pbDOLE0duaN_eYNwHODqXFRDkNuojJMoyoJZaVEKLIUM52YqhRUnDx7l52epW_OxfkWBJtaGET05DMc0aO_y6-WuqWjsrFMXHyU6QAG-STrarV-naeQkpgU65tILsdvP0xd_hdHo4TqBKmh-a3I41up_PH_9UHl5D7M1tPpuCRXo7YpR_rbb0qN_zvfB3CvR5ds2i2HHdhC-xDu3tIc3IUfny8Xq6s55eQv2ZRR-mnN4qKtqYYqYJ98rXl46IJbFbD3N_6om_kxWLM50d3thftArb4yh3fZfEGURGVx2a4YSV0p3QRsuqjN9fJLwJSt2GtL3G3F5g3ZOrMjbDwBzD6Cs5Pjj69Ow74jQ6hjGTVhhMqr7Qh0qDBXonT4TWNmuFQkZGREUkVK5oYLXuUSTTIxDuKVOMm15jHmyWPYtkuLT4A5XCmpH2CUxSpNkUvtoFKGUhpeYlyJIYzX3ip0L1dOXTOuC5-2cFk4_xbk36L37xBebEbcdFId_7DdJXdt7HpPDWFvvSCKfi-vCg8SqRvb5OnfRz2DO_Tujs-zB9tN3eK-gypNeQCD2ffjA79SfwJl-ehB
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Nb9QwELVKOQCH8lEqFlrwgQtSsuskdrLmthSqLewWiW2ht8ixx2XVKltlE1XwF_qn63GySwUIccthLFsaO_PGfvOGkNcWuHVRDkJmoyLkkUlCaZQIRcoh1Yk1hcDi5OlROj7hH0_F6QYJ1rUwAODJZ9DHT_-Wbxa6wauygUxcfJT8DrkrOOeirdb6daOCWmJSrN4imRxMvoxcBhhH_QQrBbGl-a3Y45up_PEH9mHl4CGZrhbUsknO-01d9PXP37Qa_3fFj8hWhy_pqN0Qj8kGlE_Ig1uqg9vk-tv3-fJ8hln5WzqimICWdn7WVFhFFdCvvto8fOfCmwno50t_2U39GKjoDAnv5ZmboFI_qEO8dDZHUqIqYdEsKYpdKV0HdDSv7MXiKqCqNPSwRPa2orMabZ3Ze6g9Bax8Sk4OPhzvj8OuJ0OoYxnVYQTK6-0IcLgwU6JwCE5DaplUKGVkRWIiJTPLBDOZBJsMrQN5BQwzrVkMWbJDNstFCc8IdchSYkfAKI0V58CkdmApBSktKyA2okcGK2_luhMsx74ZF7lPXJjMnX9z9G_e-bdH3qxHXLZiHf-w3UZ3re06T_XI7mpD5N1pXuYeJmI_tuHzv496Re6Nj6eTfHJ49OkFuY_ztOyeXbJZVw3sOeBSFy_9fr0BNT_qXQ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=WhiskSight%3A+A+Reconfigurable%2C+Vision-Based%2C+Optical+Whisker+Sensing+Array+for+Simultaneous+Contact%2C+Airflow%2C+and+Inertia+Stimulus+Detection&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Kent%2C+Teresa+A&rft.au=Kim%2C+Suhan&rft.au=Kornilowicz%2C+Gabriel&rft.au=Yuan%2C+Wenzhen&rft.date=2021-04-01&rft.pub=IEEE&rft.eissn=2377-3766&rft.volume=6&rft.issue=2&rft.spage=3357&rft.epage=3364&rft_id=info:doi/10.1109%2FLRA.2021.3062816&rft.externalDocID=9366394
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon