Digital Pens as Smart Objects in Multimodal Medical Application Frameworks

Digital Pens as Smart Objects in Multimodal Medical Application Frameworks
Markus Weber, Christian Husodo Schulz, Daniel Sonntag, Takumi Toyama
Proceedings of the Second Workshop on Interacting with Smart Objects, in conjunction with IUI’13 International Conference on Intelligent User Interfaces (IUI-13), March 19-22, Santa Monica, CA, USA

Abstract:

In this paper, we present a novel mobile interaction system which combines a pen-based interface with a head-mounted display (HMD) for clinical radiology reports in the field of mammography. We consider a digital pen as an anthropocentric smart object, one that allows for a physical, tangible and embodied interaction to enhance data input in a mobile onbody HMD environment. Our system provides an intuitive way for a radiologist to write a structured report with a special pen on normal paper and receive real-time feedback using HMD technology. We will focus on the combination of new interaction possibilities with smart digital pens in this multimodal scenario due to a new real-time visualisation possibility.