Learning Siamese Features for Finger Spelling Recognition

This paper is devoted to finger spelling recognition on the basis of images acquired by a single color camera. The recognition is realized on the basis of learned low-dimensional embeddings. The embeddings are calculated both by single as well as multiple siamese-based convolutional neural networks....

Full description

Saved in:
Bibliographic Details
Published inAdvanced Concepts for Intelligent Vision Systems Vol. 10617; pp. 225 - 236
Main Authors Kwolek, Bogdan, Sako, Shinji
Format Book Chapter
LanguageEnglish
Published Switzerland Springer International Publishing AG 2017
Springer International Publishing
SeriesLecture Notes in Computer Science
Subjects
Online AccessGet full text
ISBN3319703528
9783319703527
ISSN0302-9743
1611-3349
DOI10.1007/978-3-319-70353-4_20

Cover

Abstract This paper is devoted to finger spelling recognition on the basis of images acquired by a single color camera. The recognition is realized on the basis of learned low-dimensional embeddings. The embeddings are calculated both by single as well as multiple siamese-based convolutional neural networks. We train classifiers operating on such features as well as convolutional neural networks operating on raw images. The evaluations are performed on freely available dataset with finger spellings of Japanese Sign Language. The best results are achieved by a classifier trained on concatenated features of multiple siamese networks.
AbstractList This paper is devoted to finger spelling recognition on the basis of images acquired by a single color camera. The recognition is realized on the basis of learned low-dimensional embeddings. The embeddings are calculated both by single as well as multiple siamese-based convolutional neural networks. We train classifiers operating on such features as well as convolutional neural networks operating on raw images. The evaluations are performed on freely available dataset with finger spellings of Japanese Sign Language. The best results are achieved by a classifier trained on concatenated features of multiple siamese networks.
Author Sako, Shinji
Kwolek, Bogdan
Author_xml – sequence: 1
  givenname: Bogdan
  surname: Kwolek
  fullname: Kwolek, Bogdan
  email: bkw@agh.edu.pl
  organization: AGH University of Science and Technology, Krakow, Poland
– sequence: 2
  givenname: Shinji
  surname: Sako
  fullname: Sako, Shinji
  email: sako@msp.nitech.ac.jp
  organization: Frontier Research Institute for Information Science, Nagoya Institute of Technology, Showa-ku Nagoya, Japan
BookMark eNpFkN1OwzAMhQMMxDb2Blz0BQJO3ObnEk0MkCYhMbiO0tYdHaMtSff-tBsSN7Z0jo9lfzM2adqGGLsVcCcA9L3VhiNHYbkGzJCnTsIZm-GgHAV1zqZCCcERU3vxb0gzYVNAkNzqFK_YTIBAK5XV8potYtwBgBwcI_WU2TX50NTNNtnU_psiJSvy_SFQTKo2JKvBoZBsOtrvx6E3KtptU_d129ywy8rvIy3--px9rB7fl898_fr0snxY8x2C7XmlhFGQI-lSWFmkpa-UMcZWijIFQpSpKr2RqLHMVZ75SmSlxqEYMqVEwjmTp72xC8drXN62X9EJcCMmN2By6Ibf3ZGKGzENofQU6kL7c6DYOxpTBTV98Pvi03c9heiyzMpUCyelcTIF_AVmUGcl
ContentType Book Chapter
Copyright Springer International Publishing AG 2017
Copyright_xml – notice: Springer International Publishing AG 2017
DBID FFUUA
DEWEY 5.8
DOI 10.1007/978-3-319-70353-4_20
DatabaseName ProQuest Ebook Central - Book Chapters - Demo use only
DatabaseTitleList
DeliveryMethod fulltext_linktorsrc
Discipline Applied Sciences
Computer Science
EISBN 3319703536
9783319703534
EISSN 1611-3349
Editor Scheunders, Paul
Penne, Rudi
Popescu, Dan
Philips, Wilfried
Blanc-Talon, Jacques
Editor_xml – sequence: 1
  fullname: Scheunders, Paul
– sequence: 2
  fullname: Penne, Rudi
– sequence: 3
  fullname: Popescu, Dan
– sequence: 4
  fullname: Philips, Wilfried
– sequence: 5
  fullname: Blanc-Talon, Jacques
EndPage 236
ExternalDocumentID EBC5592471_228_240
GroupedDBID 0D6
0DA
38.
AABBV
AALVI
ABBVZ
ABHTH
ABQUB
ACDJR
ADCXD
AEDXK
AEJLV
AEKFX
AETDV
AEZAY
AGIGN
AGYGE
AIODD
ALBAV
ALMA_UNASSIGNED_HOLDINGS
AZZ
BATQV
BBABE
CVWCR
CZZ
FFUUA
I4C
IEZ
SBO
SWYDZ
TPJZQ
TSXQS
Z5O
Z7R
Z7S
Z7U
Z7W
Z7X
Z7Y
Z7Z
Z81
Z82
Z83
Z84
Z85
Z87
Z88
-DT
-GH
-~X
1SB
29L
2HA
2HV
5QI
875
AASHB
ABMNI
ACGFS
AEFIE
EJD
F5P
FEDTE
HVGLF
LAS
LDH
P2P
RNI
RSU
SVGTG
VI1
~02
ID FETCH-LOGICAL-j309t-f61860b3e7d192c4daf68889f6e56011d46da82373db6b5af15d7315d8e8d23e3
ISBN 3319703528
9783319703527
ISSN 0302-9743
IngestDate Wed Sep 17 02:30:29 EDT 2025
Thu Aug 28 21:50:56 EDT 2025
IsPeerReviewed true
IsScholarly true
LCCallNum TA1634
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-j309t-f61860b3e7d192c4daf68889f6e56011d46da82373db6b5af15d7315d8e8d23e3
OCLC 1013926972
PQID EBC5592471_228_240
PageCount 12
ParticipantIDs springer_books_10_1007_978_3_319_70353_4_20
proquest_ebookcentralchapters_5592471_228_240
PublicationCentury 2000
PublicationDate 2017
PublicationDateYYYYMMDD 2017-01-01
PublicationDate_xml – year: 2017
  text: 2017
PublicationDecade 2010
PublicationPlace Switzerland
PublicationPlace_xml – name: Switzerland
– name: Cham
PublicationSeriesSubtitle Image Processing, Computer Vision, Pattern Recognition, and Graphics
PublicationSeriesTitle Lecture Notes in Computer Science
PublicationSeriesTitleAlternate Lect.Notes Computer
PublicationSubtitle 18th International Conference, ACIVS 2017, Antwerp, Belgium, September 18-21, 2017, Proceedings
PublicationTitle Advanced Concepts for Intelligent Vision Systems
PublicationYear 2017
Publisher Springer International Publishing AG
Springer International Publishing
Publisher_xml – name: Springer International Publishing AG
– name: Springer International Publishing
RelatedPersons Kleinberg, Jon M.
Mattern, Friedemann
Naor, Moni
Mitchell, John C.
Terzopoulos, Demetri
Steffen, Bernhard
Pandu Rangan, C.
Kanade, Takeo
Kittler, Josef
Weikum, Gerhard
Hutchison, David
Tygar, Doug
RelatedPersons_xml – sequence: 1
  givenname: David
  surname: Hutchison
  fullname: Hutchison, David
  organization: Lancaster University, Lancaster, United Kingdom
– sequence: 2
  givenname: Takeo
  surname: Kanade
  fullname: Kanade, Takeo
  organization: Carnegie Mellon University, Pittsburgh, USA
– sequence: 3
  givenname: Josef
  surname: Kittler
  fullname: Kittler, Josef
  organization: University of Surrey, Guildford, United Kingdom
– sequence: 4
  givenname: Jon M.
  surname: Kleinberg
  fullname: Kleinberg, Jon M.
  organization: Cornell University, Ithaca, USA
– sequence: 5
  givenname: Friedemann
  surname: Mattern
  fullname: Mattern, Friedemann
  organization: CNB H 104.2, ETH Zurich, Zürich, Switzerland
– sequence: 6
  givenname: John C.
  surname: Mitchell
  fullname: Mitchell, John C.
  organization: Stanford, USA
– sequence: 7
  givenname: Moni
  surname: Naor
  fullname: Naor, Moni
  organization: Weizmann Institute of Science, Rehovot, Israel
– sequence: 8
  givenname: C.
  surname: Pandu Rangan
  fullname: Pandu Rangan, C.
  organization: Madras, Indian Institute of Technology, Chennai, India
– sequence: 9
  givenname: Bernhard
  surname: Steffen
  fullname: Steffen, Bernhard
  organization: Fakultät Informatik, TU Dortmund, Dortmund, Germany
– sequence: 10
  givenname: Demetri
  surname: Terzopoulos
  fullname: Terzopoulos, Demetri
  organization: University of California, Los Angeles, USA
– sequence: 11
  givenname: Doug
  surname: Tygar
  fullname: Tygar, Doug
  organization: University of California, Berkeley, USA
– sequence: 12
  givenname: Gerhard
  surname: Weikum
  fullname: Weikum, Gerhard
  organization: Max Planck Institute for Informatics, Saarbrücken, Germany
SSID ssj0002743827
ssj0002792
Score 2.1111336
Snippet This paper is devoted to finger spelling recognition on the basis of images acquired by a single color camera. The recognition is realized on the basis of...
SourceID springer
proquest
SourceType Publisher
StartPage 225
SubjectTerms CNNs
Finger spelling recognition
Siamese neural networks
Title Learning Siamese Features for Finger Spelling Recognition
URI http://ebookcentral.proquest.com/lib/SITE_ID/reader.action?docID=5592471&ppg=240&c=UERG
http://link.springer.com/10.1007/978-3-319-70353-4_20
Volume 10617
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV05b8IwFLYKXaoOvVV6yUM35IrEOcxIERQh1IVDbBaOHakd6EFY-uv7XmIDiVjaxYqsxLLf59jvfoQ8ai5UFC9aDO5GzYLUU0wlScCEAf7U4CYzebbP12gwDYbzcO5qldvokkw9JT9740r-gyr0Aa4YJfsHZDeDQgc8A77QAsLQVpjfspq1cC921vtuEXmYJ1awYSGYYjNrzvK48VJScrs5Rk4hMn5DL1nTRE5wDZJ3Pka_SE44RsNM4Z1nnYwshFZJ4MUVJYFTElbUjDuars5LSbDk8GfGmCo1Lp2UyO_sPXd3XS0wLAq_5SyQfmt7zzjbuh9UOvPbtPfcBeHGh7tS-r6Q-NLnF8PqYGhFt6VSaqQGc6uTw05vOJptdGkgWXPhY_nFzbxFkVxpu46dsMl90ywJGBWbeM5qTE7JMYafUIwLgYmfkQOzPCcnVlig9iheXZC2w5BaDKnDkAKGtMCQOgzpDoaXZNrvTboDZutgsHfeamcsxZoGLcVNrIEfTwK9SCMhRDuNDMrTng4ivcCkQ1yrSIWL1At1zKERRmifG35F6suPpbkmlHupUVHIY6-dBML34NDVoYIPE6x_EqUNwhwZZG6tty7CSbHolaxg1CBNRyuJr6-kS4MNRJZcApFlTmSJRL754-i35Gi7me9IPftem3vgATP1YLfAL1EVV90
linkProvider Library Specific Holdings
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.title=Advanced+Concepts+for+Intelligent+Vision+Systems&rft.atitle=Learning+Siamese+Features+for+Finger+Spelling+Recognition&rft.date=2017-01-01&rft.pub=Springer+International+Publishing+AG&rft.isbn=9783319703527&rft.volume=10617&rft_id=info:doi/10.1007%2F978-3-319-70353-4_20&rft.externalDBID=240&rft.externalDocID=EBC5592471_228_240
thumbnail_s http://utb.summon.serialssolutions.com/2.0.0/image/custom?url=https%3A%2F%2Febookcentral.proquest.com%2Fcovers%2F5592471-l.jpg