Eyes of Thing’s demonstrator “AudioGuide3.0” highlighted as “Creation Innovation” by the EU innovation radar

The Augmented Museum Guide developed in the EU project Eyes of Things has been selected by the EU innovation radar as a “Creation Innovation” and is presented on the innovation radar website. The Innovation Radar platform builds on the information and data gathered by independent experts involved in reviewing ongoing projects funded by H2020, FP7 or CIP. The aim is to make information about EU-funded innovations from high-quality projects visible and accessible to the public in one place (the EU’s new Innovation Radar platform).

The Museum Audio Guide 3.0 is a new type of Audio Guide for museums, where the headset used for audio information is equipped with a miniature camera and a image processing chip. The chip runs an image analysis software that has been trained for a specific exhibit and is able to recognize artworks such as paintings while the user is simply passing by. The painting recognition module is running constantly, but does not consume much power thanks to the dedicated hardware module and the efficient implementation. Thus, the camera-equipped headset can be used for an entire day without the need to change the batteries. From the visitor perspective, this new type of audio guide seems completely natural, as audio information is provided only in the right context, and without the need to care about the technology. An artificial-intelligence-based algorithm is able to detect when the visitor might be interested in audio information and delivers a soft sound notification, informing the user that audio information is available. The visitor can then decide to play the recorded audio by pressing a single button.  This technology has already been developed as an output of a former European project (“Eyes of things”), and several prototypes could be successfully tested at the Albertina Museum in Vienna.

The main developers of this demonstrator were the Austrian company Fluxguide and the department Augmented Vision at DFKI.

Contact person: Dr. Alain Pagani

 

The Museum Audio Guide 3.0

Best Paper Award at EuroVR
We proudly congratulate Jameel Malik and Ahmed Elhayek for the best paper award at EuroVR 2018!!!

 

Jameel Malik (second from left) at the award ceremony at Euro VR 2018 in London

 

Check also this video showing the result of our deep-learning-based method for tacking the pose of a moving hand in real time.

Dr. Alain Pagani on Augmented Reality for Education in Riga, Latvia

On November 27th 2018, Dr. Alain Pagani was invited by the State Fire and Rescue Service of the Republic of Latvia to give a talk on the use of Augmented Reality for education and awareness raising in the International Conference “Societal Security in the Baltic Sea Region: Challenges and Solutions“.

The main focus of the conference, organized jointly by the State Fire and Rescue Service of Latvia (VUGD) and Riga Stradins Universtiy, in cooperation with the Permanent Secretariat of the Council of the Baltic Sea States, the Swedish Institute and the Swedish Civil Contingencies Agency, was on introducing civil safety in education and the promotion of community awareness of safety in the Baltic Sea region. Dr. Alain Pagani introduced several aspects of Augmented Reality, including recent works from the Department Augmented Vision, and presented advantages of Augmented Reality for education, training and awareness raising.

He could share his views on the use of novel technologies in education during the panel discussion on the subject “education as a core element of societal security culture”, together with Mr Martins Baltmanis, Deputy Chief of the State Fire and Rescue Service of Latvia, Ms Ruta Silina, Head of Division of Communication and International Cooperation at Riga Stradins University, and Ms Elisabeth Braw, Associate Fellow at the Royal United Services Institute for Defence and Security Studies, United Kingdom.

 

Dr. Alain Pagani at the International Conference “Societal Security in the Baltic Sea Region: Challenges and Solutions” in Riga, Republic of Latvi