The KIT Robo-kitchen data set for the evaluation of view-based activity recognition systems

Human action and activity recognition from videos has attracted an increasing number of researchers in recent years. However, most of the works aim at multimedia retrieval and surveillance applications, but rarely at humanoid household robots, even though the robotic perception of human activities w...

Full description

Saved in:
Bibliographic Details
Published in2011 11th IEEE-RAS International Conference on Humanoid Robots pp. 128 - 133
Main Authors Rybok, Lukas, Friedberger, Simon, Hanebeck, Uwe D., Stiefelhagen, Rainer
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.10.2011
Subjects
Online AccessGet full text
ISBN9781612848662
1612848664
ISSN2164-0572
DOI10.1109/Humanoids.2011.6100854

Cover

Abstract Human action and activity recognition from videos has attracted an increasing number of researchers in recent years. However, most of the works aim at multimedia retrieval and surveillance applications, but rarely at humanoid household robots, even though the robotic perception of human activities would allow a more natural human-robot interaction (HRI). To encourage future studies in this domain, we present in this work a novel data set specifically designed for the application in HRI scenarios. This Robo-kitchen data set consists of 14 typical kitchen activities recorded in two different stereo-camera setups, and each performed by 17 subjects. To establish a baseline for future work, we extend a state-of-the-art action recognition method to be applicable on the activity classification problem and evaluate it on the Robo-kitchen data set showing promising results.
AbstractList Human action and activity recognition from videos has attracted an increasing number of researchers in recent years. However, most of the works aim at multimedia retrieval and surveillance applications, but rarely at humanoid household robots, even though the robotic perception of human activities would allow a more natural human-robot interaction (HRI). To encourage future studies in this domain, we present in this work a novel data set specifically designed for the application in HRI scenarios. This Robo-kitchen data set consists of 14 typical kitchen activities recorded in two different stereo-camera setups, and each performed by 17 subjects. To establish a baseline for future work, we extend a state-of-the-art action recognition method to be applicable on the activity classification problem and evaluate it on the Robo-kitchen data set showing promising results.
Author Rybok, Lukas
Friedberger, Simon
Hanebeck, Uwe D.
Stiefelhagen, Rainer
Author_xml – sequence: 1
  givenname: Lukas
  surname: Rybok
  fullname: Rybok, Lukas
  email: rybok@kit.edu
  organization: Karlsruhe Inst. of Technol. (KIT), Karlsruhe, Germany
– sequence: 2
  givenname: Simon
  surname: Friedberger
  fullname: Friedberger, Simon
  email: friedberger@kit.edu
  organization: Karlsruhe Inst. of Technol. (KIT), Karlsruhe, Germany
– sequence: 3
  givenname: Uwe D.
  surname: Hanebeck
  fullname: Hanebeck, Uwe D.
  email: uwe.hanebeck@ieee.org
  organization: Karlsruhe Inst. of Technol. (KIT), Karlsruhe, Germany
– sequence: 4
  givenname: Rainer
  surname: Stiefelhagen
  fullname: Stiefelhagen, Rainer
  email: rainer.stiefelhagen@kit.edu
  organization: Karlsruhe Inst. of Technol. (KIT), Karlsruhe, Germany
BookMark eNpVkNFOwjAUhmvERESewMT0BYY9Xdd1l4YoEElMDF55sbRrK9WxkrVA9vaCgIlXJ3_O__0X3w3qNb4xCN0DGQGQ4mG6WcnGOx1GlACMOBAiMnaBhkUugAMVTHDBL_9lTnuoT4GzhGQ5vUbDEL4IISkIUVDeRx-LpcEvswV-88on3y5WS9NgLaPEwURsfYvjvmG2st7I6HyDvcVbZ3aJksFoLKvoti52uDWV_2zcbyV0IZpVuEVXVtbBDE93gN6fnxbjaTJ_nczGj_PEQSpYQgsFgheWMm45EXnOqkwTSDNBqBWpgNSm1GqrQAGxGTAqLdW5ZkpZwzWkA5QfdzfNWnY7WdflunUr2XYlkPKgrlye1ZUHdeVJ3Z68O5LOGPMHnb8__Apshw
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
ADTOC
UNPAY
DOI 10.1109/Humanoids.2011.6100854
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
Accès INSA - IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Xplore
IEEE Proceedings Order Plans (POP All) 1998-Present
Unpaywall for CDI: Periodical Content
Unpaywall
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Xplore
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
– sequence: 2
  dbid: UNPAY
  name: Unpaywall
  url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISBN 9781612848686
1612848680
1612848672
9781612848679
EndPage 133
ExternalDocumentID oai:fraunhofer.de:N-198762
6100854
Genre orig-research
GroupedDBID 6IE
6IF
6IH
6IK
6IL
6IN
AAJGR
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IPLJI
OCL
RIE
RIL
ADTOC
UNPAY
ID FETCH-LOGICAL-i1384-29b1869f246f608774c5d0135802f83813f32fdfb1b10f5142af2d7d4bbfe6d13
IEDL.DBID RIE
ISBN 9781612848662
1612848664
ISSN 2164-0572
IngestDate Sun Oct 26 03:58:12 EDT 2025
Wed Aug 27 03:11:47 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
License other-oa
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i1384-29b1869f246f608774c5d0135802f83813f32fdfb1b10f5142af2d7d4bbfe6d13
OpenAccessLink https://proxy.k.utb.cz/login?url=http://publica.fraunhofer.de/documents/N-198762.html
PageCount 6
ParticipantIDs ieee_primary_6100854
unpaywall_primary_10_1109_humanoids_2011_6100854
PublicationCentury 2000
PublicationDate 2011-Oct.
PublicationDateYYYYMMDD 2011-10-01
PublicationDate_xml – month: 10
  year: 2011
  text: 2011-Oct.
PublicationDecade 2010
PublicationTitle 2011 11th IEEE-RAS International Conference on Humanoid Robots
PublicationTitleAbbrev Humanoids
PublicationYear 2011
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0003188926
ssj0000669175
Score 1.606867
Snippet Human action and activity recognition from videos has attracted an increasing number of researchers in recent years. However, most of the works aim at...
SourceID unpaywall
ieee
SourceType Open Access Repository
Publisher
StartPage 128
SubjectTerms Accuracy
Cameras
Propulsion
Robots
Time factors
SummonAdditionalLinks – databaseName: Unpaywall
  dbid: UNPAY
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1BS8MwGA26HcSLyiZOVHLwmq1J27Q9ijim4hiywsRDaZoEx2Y7thbRX--XtusET7v00gZKX8r3PvK99xC6hRoQJCrghGtLE8cTHvxSPCHUT-yYxYK50pzovoz5KHSeZu5sJwqrvJ3jvl7HRfqRabU2kxYyS4pS8DUYE9MkcwaN5efyELW5Cwy8hdrheHL3VguAqRUMyoC7bC43lUknNxY2peO_SVA5RkdFuoq_v-Ll8k8xGZ6gcCvJqWZIFv0iF_3k579D417veYq6O_kenjSF6QwdqLSD3mFD4OfHKX7NREYWc4NWis2AKN6oHAN3xcAF8c79G2cam3MDYgqdxEYAYXImcDNyBI9UPtCbLgqHD9P7EamTFcic2r5DWCBMFJVmDtfcWAI6iSuBDLq-xbQPRdzWNtNSCyqopYFTsVgz6UlHCK24pPY5aqVZqi4QDmhCPa49wRzhcLgABwFSAyxMUcDZ76GO-ebRqjLPiGooeshqMGjulQ2JFUQNepFBb7vkcv8lV6iVrwt1DbwhFzf1NvkFSeDH_A
  priority: 102
  providerName: Unpaywall
Title The KIT Robo-kitchen data set for the evaluation of view-based activity recognition systems
URI https://ieeexplore.ieee.org/document/6100854
http://publica.fraunhofer.de/documents/N-198762.html
UnpaywallVersion submittedVersion
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LS8QwEB50PehefOP6WHLwaNYmTdP2KOLiA0VkFxQPS9MkuCjt4u4i-uud9OUiHryUhj5CMtPON8nMNwDHaAPi1MSSSutZKkIV4iclU8qi1E94onig3Y7u7Z28HIrrx-BxCU6aXBhjTBF8ZnrutNjL13k6d0tlp9Ix0QRiGZbDSJa5Ws16CprOuDaFro26GsVFtTWOHgFFWOKcMsQ3-D-OpBQV3VPd5lX2MPPi02L5PB_racnwWfValV9pw-o8mySfH8nb24Il6q_DbT2GMgDltTefqV769Yve8b-D3ICdn5w_ct9Ys01YMtkWtBfoCrfhGXWK3FwNyEOucvo6dgLPiIsxJVMzIwh_CcJJ8kMgTnJL3NYDdbZSE5dD4UpVkCZqCW8pqaSnOzDsXwzOL2lVnIGOmR8JymPlqllZLqSVjlVQpIFGPBlEHrcR4gDf-txqq5hinkVYxhPLdaiFUtZIzfxdaGV5ZvaAxCxlobSh4kIJiQeEMYiLEMgZhqoSdWDbTdNoUvJvjKoZ6oDXSKK5Vvg0Xjx6qWU4cjKsH9n_-00HsMbr0D52CK3Z-9wcIdaYqW6hZF1YGd7dnz19A4a2zD0
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LS8QwEB58HNSLj1V8m4NHszZpmrZnUdbHLiIrLHgoTZPgorTi7iL665305SIevJSGPkIy0843ycw3AKdoA-LMxJJK61kqQhXiJyUzyqLMT3mqeKDdjm5_IHuP4mYUjBbgrM2FMcaUwWem607LvXxdZDO3VHYuHRNNIBZhORBCBFW2VruigsYzboyha6O2RnFZb42jT0ARmDi3DBEO_pEjKUVN-NS0eZ0_zLz4vFxAL8Z6UnF81v3WBVjWYGWWv6WfH-nr65wtulqHfjOKKgTlpTubqm729Yvg8b_D3IDtn6w_ct_as01YMPkWrM0RFnbgCbWK3F4PyUOhCvoydiLPiYsyJRMzJQiACQJK8kMhTgpL3OYDddZSE5dF4YpVkDZuCW-pyKQn2_B4dTm86NG6PAMdMz8SlMfK1bOyXEgrHa-gyAKNiDKIPG4jRAK-9bnVVjHFPIvAjKeW61ALpayRmvk7sJQXudkFErOMhdKGigslJB4QyCAyQihnGCpLtAcdN03JW8XAkdQztAdeK4n2WunVeHHy3MgwcTJsHtn_-00nsNIb9u-Su-vB7QGs8ibQjx3C0vR9Zo4QeUzVcalw3_owzdo
linkToUnpaywall http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1BS8MwGA26HcSLyiZOVHLwmq1J27Q9ijim4hiywsRDaZoEx2Y7thbRX--XtusET7v00gZKX8r3PvK99xC6hRoQJCrghGtLE8cTHvxSPCHUT-yYxYK50pzovoz5KHSeZu5sJwqrvJ3jvl7HRfqRabU2kxYyS4pS8DUYE9MkcwaN5efyELW5Cwy8hdrheHL3VguAqRUMyoC7bC43lUknNxY2peO_SVA5RkdFuoq_v-Ll8k8xGZ6gcCvJqWZIFv0iF_3k579D417veYq6O_kenjSF6QwdqLSD3mFD4OfHKX7NREYWc4NWis2AKN6oHAN3xcAF8c79G2cam3MDYgqdxEYAYXImcDNyBI9UPtCbLgqHD9P7EamTFcic2r5DWCBMFJVmDtfcWAI6iSuBDLq-xbQPRdzWNtNSCyqopYFTsVgz6UlHCK24pPY5aqVZqi4QDmhCPa49wRzhcLgABwFSAyxMUcDZ76GO-ebRqjLPiGooeshqMGjulQ2JFUQNepFBb7vkcv8lV6iVrwt1DbwhFzf1NvkFSeDH_A
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2011+11th+IEEE-RAS+International+Conference+on+Humanoid+Robots&rft.atitle=The+KIT+Robo-kitchen+data+set+for+the+evaluation+of+view-based+activity+recognition+systems&rft.au=Rybok%2C+Lukas&rft.au=Friedberger%2C+Simon&rft.au=Hanebeck%2C+Uwe+D.&rft.au=Stiefelhagen%2C+Rainer&rft.date=2011-10-01&rft.pub=IEEE&rft.isbn=9781612848662&rft.issn=2164-0572&rft.spage=128&rft.epage=133&rft_id=info:doi/10.1109%2FHumanoids.2011.6100854&rft.externalDocID=6100854
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2164-0572&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2164-0572&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2164-0572&client=summon