SeleCon: Scalable IoT device selection and control using hand gestures

Amr Alanwar, Moustafa Alzantot, Bo Jhang Ho, Paul Martin, Mani Srivastava

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

19 Scopus citations

Abstract

Although different interaction modalities have been proposed in the field of human-computer interface (HCI), only a few of these techniques could reach the end users because of scalability and usability issues. Given the popularity and the growing number of IoT devices, selecting one out of many devices becomes a hurdle in a typical smarthome environment. Therefore, an easy-to-learn, scalable, and non-intrusive interaction modality has to be explored. In this paper, we propose a pointing approach to interact with devices, as pointing is arguably a natural way for device selection. We introduce SeleCon for device selection and control which uses an ultra-wideband (UWB) equipped smartwatch. To interact with a device in our system, people can point to the device to select it then draw a hand gesture in the air to specify a control action. To this end, SeleCon employs inertial sensors for pointing gesture detection and a UWB transceiver for identifying the selected device from ranging measurements. Furthermore, SeleCon supports an alphabet of gestures that can be used for controlling the selected devices. We performed our experiment in a 9m-by-10m lab space with eight deployed devices. The results demonstrate that SeleCon can achieve 84:5% accuracy for device selection and 97% accuracy for hand gesture recognition. We also show that SeleCon is power efficient to sustain daily use by turning o? the UWB transceiver, when a user's wrist is stationary.

Original languageEnglish
Title of host publicationProceedings - 2017 IEEE/ACM 2nd International Conference on Internet-of-Things Design and Implementation, IoTDI 2017 (part of CPS Week)
PublisherAssociation for Computing Machinery, Inc
Pages47-58
Number of pages12
ISBN (Electronic)9781450349666
DOIs
StatePublished - 18 Apr 2017
Externally publishedYes
Event2nd IEEE/ACM International Conference on Internet-of-Things Design and Implementation, IoTDI 2017 - Pittsburgh, United States
Duration: 18 Apr 201720 Apr 2017

Publication series

NameProceedings - 2017 IEEE/ACM 2nd International Conference on Internet-of-Things Design and Implementation, IoTDI 2017 (part of CPS Week)

Conference

Conference2nd IEEE/ACM International Conference on Internet-of-Things Design and Implementation, IoTDI 2017
Country/TerritoryUnited States
CityPittsburgh
Period18/04/1720/04/17

Keywords

  • Hand gestures
  • IoT
  • Pointing

Fingerprint

Dive into the research topics of 'SeleCon: Scalable IoT device selection and control using hand gestures'. Together they form a unique fingerprint.

Cite this