Instructing cooperating assembly robots through situated dialogues in natural language

A. Knoll, B. Hildebrandt, J. Zhang

Research output: Contribution to journalConference articlepeer-review

37 Scopus citations

Abstract

We present an assembly cell consisting of two cooperating robots and a variety of sensors. It offers a number of complex skills necessary for constructing aggregates from elements of a toy construction set. A high degree of flexibility was achieved because the skills were realized only through sensory feedback, not by resorting to fixtures or specialized tools. The operation of the cell is completely controlled through natural language. Results from experiments in cognitive sciences and computer linguistics were incorporated to integrate natural language with vision as well as to control the construction dialogue between a human instructor and the robotic system. The experimental setup is described; a sample dialogue demonstrates the capabilities of the cell. A brief discussion of issues for further research concludes the paper.

Original languageEnglish
Pages (from-to)888-894
Number of pages7
JournalProceedings - IEEE International Conference on Robotics and Automation
Volume1
StatePublished - 1997
Externally publishedYes
EventProceedings of the 1997 IEEE International Conference on Robotics and Automation, ICRA. Part 3 (of 4) - Albuquerque, NM, USA
Duration: 20 Apr 199725 Apr 1997

Fingerprint

Dive into the research topics of 'Instructing cooperating assembly robots through situated dialogues in natural language'. Together they form a unique fingerprint.

Cite this