An Interactive Pedestrian Environment Simulator for Cognitive Monitoring and Evaluation

An Interactive Pedestrian Environment Simulator for Cognitive Monitoring and Evaluation
Jason Orlosky, Markus Weber, Yecheng Gu, Daniel Sonntag, Sergey Sosnovsky
Proceedings of the 20th International Conference on Intelligent User Interfaces Companion International Conference on Intelligent User Interfaces (IUI), 20th, March 29 - April 1, Atlanta, GA, USA

Abstract:

Recent advances in virtual and augmented reality have led to the development of a number of simulations for different applications. In particular, simulations for monitoring, evaluation, training, and education have started to emerge for the consumer market due to the availability and affordability of immersive display technology. In this work, we introduce a virtual reality environment that provides an immersive traffic simulation designed to observe behavior and monitor relevant skills and abilities of pedestrians who may be at risk, such as elderly persons with cognitive impairments. The system provides basic reactive functionality, such as display of navigation instructions and notifications of dangerous obstacles during navigation tasks. Methods for interaction using hand and arm gestures are also implemented to allow users explore the environment in a more natural manner.