On-line simultaneous learning and recognition of everyday activities from virtual reality performances

Tamas Bates, Karinne Ramirez-Amaro, Tetsunari Inamura, Gordon Cheng

Publikation: Beitrag in Buch/Bericht/KonferenzbandKonferenzbeitragBegutachtung

42 Zitate (Scopus)

Abstract

Capturing realistic human behaviors is essential to learn human models that can later be transferred to robots. Recent improvements in virtual reality (VR) head-mounted displays provide a viable way to collect natural examples of human behavior without the difficulties often associated with capturing performances in a physical environment. We present a realistic, cluttered, VR environment for experimentation with household tasks paired with a semantic extraction and reasoning system able to utilize data collected in real-time and apply ontology-based reasoning to learn and classify activities performed in VR. The system performs continuous segmentation of the motions of users' hands and simultaneously classifies known actions while learning new ones on demand. The system then constructs a graph of all related activities in the environment through its observations, extracting the task space utilized by observed users during their performance. The action recognition and learning system was able to maintain a high degree of accuracy of around 92% while dealing with a more complex and realistic environment compared to earlier work in both physical and virtual spaces.

OriginalspracheEnglisch
TitelIROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
Seiten3510-3515
Seitenumfang6
ISBN (elektronisch)9781538626825
DOIs
PublikationsstatusVeröffentlicht - 13 Dez. 2017
Veranstaltung2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2017 - Vancouver, Kanada
Dauer: 24 Sept. 201728 Sept. 2017

Publikationsreihe

NameIEEE International Conference on Intelligent Robots and Systems
Band2017-September
ISSN (Print)2153-0858
ISSN (elektronisch)2153-0866

Konferenz

Konferenz2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2017
Land/GebietKanada
OrtVancouver
Zeitraum24/09/1728/09/17

Fingerprint

Untersuchen Sie die Forschungsthemen von „On-line simultaneous learning and recognition of everyday activities from virtual reality performances“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren