Multi-sensor system for driver's hand-gesture recognition

We propose a novel multi-sensor system for accurate and power-efficient dynamic car-driver hand-gesture recognition, using a short-range radar, a color camera, and a depth camera, which together make the system robust against variable lighting conditions. We present a procedure to jointly calibrate...

Full description

Saved in:
Bibliographic Details
Published in2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) Vol. 1; pp. 1 - 8
Main Authors Molchanov, Pavlo, Gupta, Shalini, Kim, Kihwan, Pulli, Kari
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.05.2015
Subjects
Cameras
Gesture recognition
Image color analysis
Radar imaging
Sensor systems
Online AccessGet full text
DOI10.1109/FG.2015.7163132

Cover

Abstract We propose a novel multi-sensor system for accurate and power-efficient dynamic car-driver hand-gesture recognition, using a short-range radar, a color camera, and a depth camera, which together make the system robust against variable lighting conditions. We present a procedure to jointly calibrate the radar and depth sensors. We employ convolutional deep neural networks to fuse data from multiple sensors and to classify the gestures. Our algorithm accurately recognizes 10 different gestures acquired indoors and outdoors in a car during the day and at night. It consumes significantly less power than purely vision-based systems.
AbstractList We propose a novel multi-sensor system for accurate and power-efficient dynamic car-driver hand-gesture recognition, using a short-range radar, a color camera, and a depth camera, which together make the system robust against variable lighting conditions. We present a procedure to jointly calibrate the radar and depth sensors. We employ convolutional deep neural networks to fuse data from multiple sensors and to classify the gestures. Our algorithm accurately recognizes 10 different gestures acquired indoors and outdoors in a car during the day and at night. It consumes significantly less power than purely vision-based systems.
Author Gupta, Shalini
Molchanov, Pavlo
Pulli, Kari
Kim, Kihwan
Author_xml – sequence: 1
  givenname: Pavlo
  surname: Molchanov
  fullname: Molchanov, Pavlo
  organization: NVIDIA Res., Santa Clara, CA, USA
– sequence: 2
  givenname: Shalini
  surname: Gupta
  fullname: Gupta, Shalini
  organization: NVIDIA Res., Santa Clara, CA, USA
– sequence: 3
  givenname: Kihwan
  surname: Kim
  fullname: Kim, Kihwan
  organization: NVIDIA Res., Santa Clara, CA, USA
– sequence: 4
  givenname: Kari
  surname: Pulli
  fullname: Pulli, Kari
  organization: NVIDIA Res., Santa Clara, CA, USA
BookMark eNotjzFLAzEYhiMoqPVmB5fbnHLmS74kl1GKrULFReeSu3xXA21OkqvQf--BnZ6HZ3jhvWWXaUzE2D2IBkC4p9W6kQJ0Y8EoUPKCVc62gNY5I6SR16wqJXazWoNW4A1z78f9FHmhVMZcl1OZ6FAPs4Ycfyk_lvrbp8B3VKZjpjpTP-5SnOKY7tjV4PeFqjMX7Gv18rl85ZuP9dvyecMjaIdcSt06rTwI2YYOCTSFgNhrkmQR54zaCHLCozXgggbdd0TOS2q9FYNasIf_3UhE258cDz6ftueD6g9-VkaU
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/FG.2015.7163132
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Xplore Digital Library (LUT)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9781479960262
1479960268
EndPage 8
ExternalDocumentID 7163132
Genre orig-research
GroupedDBID 6IE
6IL
ALMA_UNASSIGNED_HOLDINGS
CBEJK
RIB
RIC
RIE
RIL
ID FETCH-LOGICAL-i1594-2258953a1028db4e15edd44c5e2e7441024560e90a47619d515cbee9a2e8a70f3
IEDL.DBID RIE
IngestDate Wed Dec 20 05:19:31 EST 2023
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i1594-2258953a1028db4e15edd44c5e2e7441024560e90a47619d515cbee9a2e8a70f3
PageCount 8
ParticipantIDs ieee_primary_7163132
PublicationCentury 2000
PublicationDate 20150501
PublicationDateYYYYMMDD 2015-05-01
PublicationDate_xml – month: 05
  year: 2015
  text: 20150501
  day: 01
PublicationDecade 2010
PublicationTitle 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
PublicationTitleAbbrev FG
PublicationYear 2015
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssib026764704
Score 2.095312
Snippet We propose a novel multi-sensor system for accurate and power-efficient dynamic car-driver hand-gesture recognition, using a short-range radar, a color camera,...
SourceID ieee
SourceType Publisher
StartPage 1
SubjectTerms Cameras
Gesture recognition
Image color analysis
Radar imaging
Sensor systems
Title Multi-sensor system for driver's hand-gesture recognition
URI https://ieeexplore.ieee.org/document/7163132
Volume 1
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3PS8MwFH5sO3lS2cTf5CB4MV3a5kdzFucQFA8OdhtJ-goitNKtF__6JW03UTx4C4WQpkl4X9_7vi8AN5nKYqdZQRWmlvLUINU2CHzipLDaMLS2Zfm-yPmCPy3FcgB3ey0MIrbkM4xCs63l55VrQqps6rF9cBocwlBlstNq7fZOIpXkivHevSdmejp7DMwtEfW9flyf0kaP2SE878btSCMfUbOxkfv6Zcn43xc7gsm3To-87iPQMQywHINuNbV07f9Pq5p0Ts3EQ1OS14GDcbsmIVlOQ12pqZHsGURVOYHF7OHtfk77CxLou0chnPqzmGmRmgAScssxFpjnnDuBCSqPc0JZVTLUzPCQrcg9dnEWUZsEM6NYkZ7AqKxKPAXi4nB2pUJlkTvtdFawQhqhcsdEkYozGIdprz47D4xVP-Pzvx9fwEH49B0x8BJGm7rBKx-8N_a6XbUtZ0uZtQ
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3PS8MwFH7MedCTyib-NgfBi-nSNmmaszinbsPDBruNJn0FEVrp1ot_vUnbTRQP3kIhtCF5vK_vfd8XgJtYxr5RLKMSQ015mCBV2gl8_CDTKmGodc3ynUajOX9eiEUH7rZaGESsyWfouWHdy08LU7lS2cBie-c0uAO7gnMuGrXW5vQEkYy4ZLz17_GZGgwfHXdLeO28Hxeo1PljeACTzZsb2si7V621Zz5_mTL-99MOof-t1COv2xx0BB3Me6BqVS1d2T_UoiSNVzOx4JSkpWNh3K6IK5dT11mqSiRbDlGR92E-fJjdj2h7RQJ9sziEUxuNsRJh4mBCqjn6AtOUcyMwQGmRjmusRgwVS7irV6QWvRiNqJIA40SyLDyGbl7keALE-C56I4lSIzfKqDhjWZQImRomslCcQs8te_nRuGAs2xWf_f34GvZGs8l4OX6avpzDvtuGhiZ4Ad11WeGlTeVrfVXv4Benop0C
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2015+11th+IEEE+International+Conference+and+Workshops+on+Automatic+Face+and+Gesture+Recognition+%28FG%29&rft.atitle=Multi-sensor+system+for+driver%27s+hand-gesture+recognition&rft.au=Molchanov%2C+Pavlo&rft.au=Gupta%2C+Shalini&rft.au=Kim%2C+Kihwan&rft.au=Pulli%2C+Kari&rft.date=2015-05-01&rft.pub=IEEE&rft.volume=1&rft.spage=1&rft.epage=8&rft_id=info:doi/10.1109%2FFG.2015.7163132&rft.externalDocID=7163132