Exploring Visuo-Haptic augmented reality user interfaces for Stereo-Tactic neurosurgery planning

Eck, U., Stefan, P., Laga, H.ORCID: 0000-0002-4758-7510, Sandor, C., Fallavollita, P. and Navab, N. (2016) Exploring Visuo-Haptic augmented reality user interfaces for Stereo-Tactic neurosurgery planning. In: Zheng, G., Liao, H., Jannin, P., Cattin, P. and Lee, S-L, (eds.) Medical Imaging and Augmented Reality. Springer International Publishing, pp. 208-220.

Abstract

Stereo-tactic neurosurgery planning is a time-consuming and complex task that requires detailed understanding of the patient anatomy and the affected regions in the brain to precisely deliver the treatment and to avoid proximity to any known risk structures. Traditional user interfaces for neurosurgery planning use keyboard and mouse for interaction and visualize the medical data on a screen. Previous research, however, has shown that 3D user interfaces are more intuitive for navigating volumetric data and enable users to understand spatial relations more quickly. Furthermore, new imaging modalities and automated segmentation of relevant structures provide important information to medical experts. However, displaying such information requires frequent context switches or occludes otherwise important information.

In collaboration with medical experts, we analyzed the planning workflow for stereo-tactic neurosurgery interventions and identified two tasks in the process that can be improved: volume exploration and trajectory refinement. In this paper, we present a novel 3D user interface for neurosurgery planning that is implemented using a head-mounted display and a haptic device. The proposed system improves volume exploration with bi-manual interaction to control oblique slicing of volumetric data and reduces visual clutter with the help of haptic guides that enable users to precisely target regions of interest and to avoid proximity to known risk structures.

Item Type:	Book Chapter
Murdoch Affiliation(s):	School of Engineering and Information Technology
Publisher:	Springer International Publishing
Copyright:	2016 Springer International Publishing Switzerland
Other Information:	Proceedings: 7th International Conference, MIAR 2016, Bern, Switzerland, August 24-26, 2016 Volume 9805 of the series Lecture Notes in Computer Science
URI:	http://researchrepository.murdoch.edu.au/id/eprint/33372

Item Control Page