TY - GEN
T1 - MR-Sense
T2 - 6th IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality, AIxVR 2024
AU - Schieber, Hannah
AU - Kleinbeck, Constantin
AU - Theelke, Luisa
AU - Kraft, Miriam
AU - Kreimeier, Julian
AU - Roth, Daniel
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Search tasks can be challenging for blind or visually impaired people. To determine an object's location and to navigate there, they often rely on the limited sensory capabilities of a white cane, search haptically, or ask for help. We introduce MR-Sense, a mixed reality assistant to support search and navigation tasks. The system is designed in a participatory fashion and utilizes sensory data of a standalone mixed reality head-mounted display to perform deep learning-driven object recognition and environment mapping. The user is supported in object search tasks via spatially mapped audio and vibrotactile feedback. We conducted a preliminary user study including ten blind or visually impaired participants and a final user evaluation with thirteen blind or visually impaired participants. The final study reveals that MR-Sense alone cannot replace the cane but provides a valuable addition in terms of usability and task load. We further propose a standardized evaluation setup for replicable studies and highlight relevant potentials and challenges fostering future work towards employing technology in accessibility.
AB - Search tasks can be challenging for blind or visually impaired people. To determine an object's location and to navigate there, they often rely on the limited sensory capabilities of a white cane, search haptically, or ask for help. We introduce MR-Sense, a mixed reality assistant to support search and navigation tasks. The system is designed in a participatory fashion and utilizes sensory data of a standalone mixed reality head-mounted display to perform deep learning-driven object recognition and environment mapping. The user is supported in object search tasks via spatially mapped audio and vibrotactile feedback. We conducted a preliminary user study including ten blind or visually impaired participants and a final user evaluation with thirteen blind or visually impaired participants. The final study reveals that MR-Sense alone cannot replace the cane but provides a valuable addition in terms of usability and task load. We further propose a standardized evaluation setup for replicable studies and highlight relevant potentials and challenges fostering future work towards employing technology in accessibility.
KW - accessibility
KW - blind and visually impaired people
KW - mixed reality
UR - http://www.scopus.com/inward/record.url?scp=85187220404&partnerID=8YFLogxK
U2 - 10.1109/AIxVR59861.2024.00029
DO - 10.1109/AIxVR59861.2024.00029
M3 - Conference contribution
AN - SCOPUS:85187220404
T3 - Proceedings - 2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality, AIxVR 2024
SP - 166
EP - 175
BT - Proceedings - 2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality, AIxVR 2024
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 17 January 2024 through 19 January 2024
ER -