Complex continuous meaningful humanoid interaction: A multi sensory-cue based approach

A humanoid system capable of simultaneously detecting the spatial orientation of a sound source, and is also able to detect and mimic the motion of the upper body of a person is presented. For demonstration purposes, the humanoid is made to interact with a person. Through the use of spatial hearing and multiple visual cues, the system is able to track a person, while mimicking the person's upper body motion. The system is shown to be robust and tolerable to failure, in performing experiments for a long duration of time.