Interactive mixed reality for muscle structure and function learning

Meng Ma, Philipp Jutzi, Felix Bork, Ina Seelbach, Anna Maria Von Der Heide, Nassir Navab, Pascal Fallavollita

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Scopus citations


Understanding the structure and function of the muscular system is important in many different medical scenarios, such as student and patient education, muscle training, and rehabilitation of patients with kinetic problems. The structure and function of muscles are difficult to learn as muscle movement is imperceptible using the traditional methods. In this paper, an interactive mixed reality system is proposed for facilitating the learning of the muscles of the upper extremities. The proposed system consists of two main components: an AR view, overlaying the virtual model of the arm on top of the video stream, and a VR view, providing a more detailed understanding of the muscles. The mixed reality view helps the user to mentally map the behaviour of muscles to his/her own body during different movements. A user study including twenty students was performed by a questionnaire framework. The results indicate that our system is useful for learning the structure and function of the muscle and can be a valuable supplement to established muscle learning paradigms.

Original languageEnglish
Title of host publicationMedical Imaging and Augmented Reality - 7th International Conference, MIAR 2016, Proceedings
EditorsHongen Liao, Guoyan Zheng, Su-Lin Lee, Philippe Cattin, Pierre Jannin
PublisherSpringer Verlag
Number of pages12
ISBN (Print)9783319437743
StatePublished - 2016
Event7th International Conference on Medical Imaging and Augmented Reality, MIAR 2016 - Bern, Switzerland
Duration: 24 Aug 201626 Aug 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9805 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference7th International Conference on Medical Imaging and Augmented Reality, MIAR 2016


  • Anatomy learning
  • Augmented reality
  • Kinect
  • Mixed reality
  • Muscle learning
  • User interface


Dive into the research topics of 'Interactive mixed reality for muscle structure and function learning'. Together they form a unique fingerprint.

Cite this