Home environment interaction via service robots and the leap motion controller

C. Georgoulas, A. Raza, J. Güttler, T. Linner, T. Bock

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

9 Scopus citations

Abstract

Ageing society and individuals with disabilities faces numerous challenges in performing simple tasks in Activities of Daily Living (ADLs), [1]. ADLs represent the everyday tasks people usually need to be able to independently accomplish. Nowadays caring of elderly people becomes more and more important. Performance of ADLs in the long term view can be considered as a serious concern, especially when dealing with individuals who require extreme caregiver assistance. The objective of this paper is to introduce an Ambient Intelligence [2], real-scale home environment implementation, embedded with sensors and actuators, which enhances the independence and autonomy of the individuals upon performing ADLs. A real 1:1 scale experimental flat has been design and developed (Figure 1), in the authors experimental laboratory. A study was made to be able to determine the actual needs, required services, and functionality of the proposed augmented environment. In order to allow a high quality service delivery, a mobile autonomous rover [3] was introduced to act as the main human-machine interface between the user and the distributed robotic systems and actuators. The mobile rover was wirelessly interfaced with the distributed intelligence to allow efficient interaction with the user, either passively, by vocal commands issued by the user, or adaptively, by autonomously navigating into the home environment. Moreover the Leap Motion hand gesture driven controller [4] is used as an intuitive user interface, which allows sub-millimeter accuracy capabilities, interfaced to a Jaco 6-Degrees of freedom robotic arm [5]. Many robotic systems have been designed and produced for assisting ADLs, in order to compensate this loss of mobility. However most of these solution are operated via a keyboard or joystick, which according to the complexity of the robotic system, require a series of configurations and mode selection routines in order to allow a specific trajectory path to be implemented. The authors developed new intuitive interfaces to operate such devices, in order to reduce the involved operation complexity. The user is able with simple gestures to operate and control complex robotic manipulators and mobile robots, without requiring the use of a joystick or a keyboard. The resulting accuracy and evaluated performance of the implemented interfaces, allow error free, continuous, and adaptive interaction between user queries and actuated environment responses.

Original languageEnglish
Title of host publication31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Proceedings
EditorsQuang Ha, Ali Akbarnezhad, Xuesong Shen
PublisherUniversity of Technology Sydney
Pages795-803
Number of pages9
ISBN (Electronic)9780646597119
StatePublished - 2014
Event31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Sydney, Australia
Duration: 9 Jul 201411 Jul 2014

Publication series

Name31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014 - Proceedings

Conference

Conference31st International Symposium on Automation and Robotics in Construction and Mining, ISARC 2014
Country/TerritoryAustralia
CitySydney
Period9/07/1411/07/14

Keywords

  • Ambient assisted living
  • Autonomous navigation
  • Jaco robotic arm
  • Leap motion controller
  • Robotics and mechatronics
  • Sensor fusion

Fingerprint

Dive into the research topics of 'Home environment interaction via service robots and the leap motion controller'. Together they form a unique fingerprint.

Cite this