Motion encoding with asynchronous trajectories of repetitive teleoperation tasks and its extension to human-agent shared teleoperation

Affan Pervez, Hiba Latifee, Jee Hwan Ryu, Dongheui Lee

Research output: Contribution to journalArticlepeer-review

13 Scopus citations


Teleoperating a robot for complex and intricate tasks demands a high mental workload from a human operator. Deploying multiple operators can mitigate this problem, but it can be also a costly solution. Learning from Demonstrations can reduce the human operator’s burden by learning repetitive teleoperation tasks. Yet, the demonstrations via teleoperation tend to be inconsistent compared to other modalities of human demonstrations. In order to handle less consistent and asynchronous demonstrations effectively, this paper proposes a learning scheme based on Dynamic Movement Primitives. In particular, a new Expectation Maximization algorithm which synchronizes and encodes demonstrations with high temporal and spatial variances is proposed. Furthermore, we discuss two shared teleoperation architectures, where, instead of multiple human operators, a learned artificial agent and a human operator share authority over a task while teleoperating cooperatively. The agent controls the more mundane and repetitive motion in the task whereas human takes charge of the more critical and uncertain motion. The proposed algorithm together with the two shared teleoperation architectures (human-synchronized and agent-synchronized shared teleoperation) has been tested and validated through simulation and experiments on 3 Degrees-of-Freedom Phantom-to-Phantom teleoperation. Conclusively, the both proposed shared teleoperation architectures have shown superior performance when compared with the human-only teleoperation for a peg-in-hole task.

Original languageEnglish
Pages (from-to)2055-2069
Number of pages15
JournalAutonomous Robots
Issue number8
StatePublished - 1 Dec 2019
Externally publishedYes


  • Agent-synchronized
  • Cooperative teleoperation
  • Dynamic movement primitives
  • Haptic feedback
  • Human-agent shared teleoperation
  • Human-synchronized
  • Learning from demonstrations
  • Teleoperation


Dive into the research topics of 'Motion encoding with asynchronous trajectories of repetitive teleoperation tasks and its extension to human-agent shared teleoperation'. Together they form a unique fingerprint.

Cite this