Tangible reality – skilful interaction of user hands and fingers with real tools in mixed reality worlds
The goal of the GreifbAR project is to make mixed reality (MR) worlds, including virtual (VR) and augmented reality (“AR”), tangible and graspable by allowing users to interact with real and virtual objects with their bare hands. Hand accuracy and dexterity is paramount for performing precise tasks in many fields, but the capture of hand-object interaction in current MR systems is woefully inadequate. Current systems rely on hand-held controllers or capture devices that are limited to hand gestures without contact with real objects. GreifbAR solves this limitation by introducing a sensing system that detects both the full hand grip including hand surface and object pose when users interact with real objects or tools. This sensing system will be integrated into a mixed reality training simulator that will be demonstrated in two relevant use cases: industrial assembly and surgical skills training. The usability and applicability as well as the added value for training situations will be thoroughly analysed through user studies.
Partners
NMY – Mixed Reality Communication GmbH Hanauer Landstraße 188, 60314 Frankfurt am Main
Charité – Universitätsmedizin Berlin Charitéplatz 1, 10117 Berlin
Universität Passau vertreten durch den Präsidenten, Prof. Dr. Ulrich Bartosch Innstraße 40, 94032 Passau Wissenschaftliche Leitung: Prof. Dr. Susanne Mayr Lehrstuhl für Psychologie mit Schwerpunkt Mensch – Maschine – Interaktion
Contact
Dr.-Ing. Jason Raphael Rambach
- Jason_Raphael.Rambach@dfki.de
- Phone +49 631 20575 3740
- Yongzhi.Su@dfki.de
- Phone +49 631 20575 3416