Interactive mixed reality for muscle structure and function learning

Meng Ma; Philipp Jutzi; Felix Bork; Ina Seelbach; Anna Maria Von Der Heide; Nassir Navab; Pascal Fallavollita

doi:10.1007/978-3-319-43775-0_11

Interactive mixed reality for muscle structure and function learning

Meng Ma, Philipp Jutzi, Felix Bork, Ina Seelbach, Anna Maria Von Der Heide, Nassir Navab, Pascal Fallavollita

Informatics 16 - Chair of Computer Aided Medical Procedures

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

8 Scopus citations

Abstract

Understanding the structure and function of the muscular system is important in many different medical scenarios, such as student and patient education, muscle training, and rehabilitation of patients with kinetic problems. The structure and function of muscles are difficult to learn as muscle movement is imperceptible using the traditional methods. In this paper, an interactive mixed reality system is proposed for facilitating the learning of the muscles of the upper extremities. The proposed system consists of two main components: an AR view, overlaying the virtual model of the arm on top of the video stream, and a VR view, providing a more detailed understanding of the muscles. The mixed reality view helps the user to mentally map the behaviour of muscles to his/her own body during different movements. A user study including twenty students was performed by a questionnaire framework. The results indicate that our system is useful for learning the structure and function of the muscle and can be a valuable supplement to established muscle learning paradigms.

Original language	English
Title of host publication	Medical Imaging and Augmented Reality - 7th International Conference, MIAR 2016, Proceedings
Editors	Hongen Liao, Guoyan Zheng, Su-Lin Lee, Philippe Cattin, Pierre Jannin
Publisher	Springer Verlag
Pages	117-128
Number of pages	12
ISBN (Print)	9783319437743
DOIs	https://doi.org/10.1007/978-3-319-43775-0_11
State	Published - 2016
Event	7th International Conference on Medical Imaging and Augmented Reality, MIAR 2016 - Bern, Switzerland Duration: 24 Aug 2016 → 26 Aug 2016

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9805 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	7th International Conference on Medical Imaging and Augmented Reality, MIAR 2016
Country/Territory	Switzerland
City	Bern
Period	24/08/16 → 26/08/16

Keywords

Anatomy learning
Augmented reality
Kinect
Mixed reality
Muscle learning
User interface

Access to Document

10.1007/978-3-319-43775-0_11

Cite this

Ma, M., Jutzi, P., Bork, F., Seelbach, I., Von Der Heide, A. M., Navab, N., & Fallavollita, P. (2016). Interactive mixed reality for muscle structure and function learning. In H. Liao, G. Zheng, S.-L. Lee, P. Cattin, & P. Jannin (Eds.), Medical Imaging and Augmented Reality - 7th International Conference, MIAR 2016, Proceedings (pp. 117-128). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9805 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-43775-0_11

Ma, Meng ; Jutzi, Philipp ; Bork, Felix et al. / Interactive mixed reality for muscle structure and function learning. Medical Imaging and Augmented Reality - 7th International Conference, MIAR 2016, Proceedings. editor / Hongen Liao ; Guoyan Zheng ; Su-Lin Lee ; Philippe Cattin ; Pierre Jannin. Springer Verlag, 2016. pp. 117-128 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{cd4558138ec24bdd933453ed58f61d1a,

title = "Interactive mixed reality for muscle structure and function learning",

abstract = "Understanding the structure and function of the muscular system is important in many different medical scenarios, such as student and patient education, muscle training, and rehabilitation of patients with kinetic problems. The structure and function of muscles are difficult to learn as muscle movement is imperceptible using the traditional methods. In this paper, an interactive mixed reality system is proposed for facilitating the learning of the muscles of the upper extremities. The proposed system consists of two main components: an AR view, overlaying the virtual model of the arm on top of the video stream, and a VR view, providing a more detailed understanding of the muscles. The mixed reality view helps the user to mentally map the behaviour of muscles to his/her own body during different movements. A user study including twenty students was performed by a questionnaire framework. The results indicate that our system is useful for learning the structure and function of the muscle and can be a valuable supplement to established muscle learning paradigms.",

keywords = "Anatomy learning, Augmented reality, Kinect, Mixed reality, Muscle learning, User interface",

author = "Meng Ma and Philipp Jutzi and Felix Bork and Ina Seelbach and {Von Der Heide}, {Anna Maria} and Nassir Navab and Pascal Fallavollita",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing Switzerland 2016.; 7th International Conference on Medical Imaging and Augmented Reality, MIAR 2016 ; Conference date: 24-08-2016 Through 26-08-2016",

year = "2016",

doi = "10.1007/978-3-319-43775-0_11",

language = "English",

isbn = "9783319437743",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "117--128",

editor = "Hongen Liao and Guoyan Zheng and Su-Lin Lee and Philippe Cattin and Pierre Jannin",

booktitle = "Medical Imaging and Augmented Reality - 7th International Conference, MIAR 2016, Proceedings",

}

Ma, M, Jutzi, P, Bork, F, Seelbach, I, Von Der Heide, AM, Navab, N & Fallavollita, P 2016, Interactive mixed reality for muscle structure and function learning. in H Liao, G Zheng, S-L Lee, P Cattin & P Jannin (eds), Medical Imaging and Augmented Reality - 7th International Conference, MIAR 2016, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9805 LNCS, Springer Verlag, pp. 117-128, 7th International Conference on Medical Imaging and Augmented Reality, MIAR 2016, Bern, Switzerland, 24/08/16. https://doi.org/10.1007/978-3-319-43775-0_11

Interactive mixed reality for muscle structure and function learning. / Ma, Meng; Jutzi, Philipp; Bork, Felix et al.
Medical Imaging and Augmented Reality - 7th International Conference, MIAR 2016, Proceedings. ed. / Hongen Liao; Guoyan Zheng; Su-Lin Lee; Philippe Cattin; Pierre Jannin. Springer Verlag, 2016. p. 117-128 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9805 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Interactive mixed reality for muscle structure and function learning

AU - Ma, Meng

AU - Jutzi, Philipp

AU - Bork, Felix

AU - Seelbach, Ina

AU - Von Der Heide, Anna Maria

AU - Navab, Nassir

AU - Fallavollita, Pascal

N1 - Publisher Copyright: © Springer International Publishing Switzerland 2016.

PY - 2016

Y1 - 2016

N2 - Understanding the structure and function of the muscular system is important in many different medical scenarios, such as student and patient education, muscle training, and rehabilitation of patients with kinetic problems. The structure and function of muscles are difficult to learn as muscle movement is imperceptible using the traditional methods. In this paper, an interactive mixed reality system is proposed for facilitating the learning of the muscles of the upper extremities. The proposed system consists of two main components: an AR view, overlaying the virtual model of the arm on top of the video stream, and a VR view, providing a more detailed understanding of the muscles. The mixed reality view helps the user to mentally map the behaviour of muscles to his/her own body during different movements. A user study including twenty students was performed by a questionnaire framework. The results indicate that our system is useful for learning the structure and function of the muscle and can be a valuable supplement to established muscle learning paradigms.

AB - Understanding the structure and function of the muscular system is important in many different medical scenarios, such as student and patient education, muscle training, and rehabilitation of patients with kinetic problems. The structure and function of muscles are difficult to learn as muscle movement is imperceptible using the traditional methods. In this paper, an interactive mixed reality system is proposed for facilitating the learning of the muscles of the upper extremities. The proposed system consists of two main components: an AR view, overlaying the virtual model of the arm on top of the video stream, and a VR view, providing a more detailed understanding of the muscles. The mixed reality view helps the user to mentally map the behaviour of muscles to his/her own body during different movements. A user study including twenty students was performed by a questionnaire framework. The results indicate that our system is useful for learning the structure and function of the muscle and can be a valuable supplement to established muscle learning paradigms.

KW - Anatomy learning

KW - Augmented reality

KW - Kinect

KW - Mixed reality

KW - Muscle learning

KW - User interface

UR - http://www.scopus.com/inward/record.url?scp=84984848299&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-43775-0_11

DO - 10.1007/978-3-319-43775-0_11

M3 - Conference contribution

AN - SCOPUS:84984848299

SN - 9783319437743

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 117

EP - 128

BT - Medical Imaging and Augmented Reality - 7th International Conference, MIAR 2016, Proceedings

A2 - Liao, Hongen

A2 - Zheng, Guoyan

A2 - Lee, Su-Lin

A2 - Cattin, Philippe

A2 - Jannin, Pierre

PB - Springer Verlag

T2 - 7th International Conference on Medical Imaging and Augmented Reality, MIAR 2016

Y2 - 24 August 2016 through 26 August 2016

ER -

Ma M, Jutzi P, Bork F, Seelbach I, Von Der Heide AM, Navab N et al. Interactive mixed reality for muscle structure and function learning. In Liao H, Zheng G, Lee SL, Cattin P, Jannin P, editors, Medical Imaging and Augmented Reality - 7th International Conference, MIAR 2016, Proceedings. Springer Verlag. 2016. p. 117-128. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-43775-0_11

Interactive mixed reality for muscle structure and function learning

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this