Two papers at ISMAR 2019

Our team is presenting two papers at the ISMAR 2019 conference in Beijing, China. ISMAR (International Symposium on Mixed and Augmented Reality) is the leading international conference in AR/VR/MR technologies. The two papers on the topics of Object Pose Estimation and SLAM are:

A Shape Completion Component for Monocular Non-Rigid SLAM
Yongzhi Su, Vladislav Golyanik, Nareg Minaskan Karabid, Sk Aziz Ali, Didier Stricker

Deep Multi-State Object Pose Estimation for Augmented Reality Assembly Yongzhi Su, Jason Raphael Rambach, Nareg Minaskan Karabid, Paul Lesur, Alain Pagani, Didier Stricker

Kick-Off meeting of the EU project HyperCOG

Dr. Alain Pagani, and Mohamed Selim (Augmented Vision department) and Ludgar Van Elst (Smart Data and Services department) participated in the Kick-off meeting of the EU project HyperCOG on September 24th, 2019, that was held at IK4-LORTEK in Spain.

HyperCOG project “HYPERCONNECTED ARCHITECTURE FOR HIGH COGNITIVE PRODUCTION PLANTS” addresses the full digital transformation of the process industry and cognitive process production plants through an innovative Industrial Cyber-Physical System (ICPS). It is based on commercially available advanced technologies that will enable the development of a hyper-connected network of digital nodes. The nodes can catch outstanding streams of data in real-time, which together with the high computing capabilities available nowadays, provide sensing, knowledge and cognitive reasoning to the industrial business. The project will strive to demonstrate how data technologies embedded in a CPS platform applied in the process industry can streamline processes, achieve a step gain in efficiency, sustainability and resource utilization and act as a basis for the provision of new services.

In HyperCOG, 14 international partners have joined forces, bringing together the necessary competence in terms of expertise and resources to ensure the achievement of the project goals. In DFKI, the departments “Augmented Vision” and the department “Smart Data and Services” at DFKI Kaiserslautern are involved.

The Augmented Vision department is responsible for developing smart sensing technologies based on visual perception and visual interpretation for different use cases in active industrial plants. Moreover, in industrial plants, with a growing amount of sensors and data, the information load might increase and hinder the monitoring task. Augmented Vision department will carry out the work on AR to present contextualized information in a simple and direct way.

Project partners:
1. SmartFactory Kaiserslautern (GERMANY)
3. Tecnalia Reseach and Innovation (SPAIN)
4. Estia – École Supérieure des Technologies Industrielles Avancées (FRANCE)
5. SIDENOR Aceros Especiales SL (SPAIN)
6. Çimsa Çimento Sanayi Ve Ticaret A.Ş. (TURKEY)
8. MSI – Mondragon Sistemas de Información (SPAIN)
9. U-PEC – Université Paris-Est Créteil (FRANCE)
10. CBS – Cybers Services Zrt (HUNGARY)
11. Ekodenge (TURKEY)
12. 2.0 LCA consultants (DENMARK)
13. Insights Publishers (UNITED KINGDOM).

Contact person: Dr. Alain Pagani, Mohamed Selim

Picture: The HyperCOG partners at the kick-off meeting.

Talk of Dr. Alain Pagani at the HE2Net Symposium 2019

Sylvain Hourlier (THALES) and Alain Pagani (DFKI)

On September 12th, 2019, Dr. Alain Pagani was invited to give a talk on the subject “User monitoring, Human-machine collaboration and Artificial Intelligence” at the 10th HE2Net Symposium.

The HE2Net Symposium, jointly organized by THALES and the Ecole Nationale Supérieure de Cognitique (ENSC) is the annual conference of the Human Engineering and Expertise Network, an association of institutions and companies addressing the topic of human factors in engineering.

The 10th HE2Net Symposium took place in Arcachon, France and was devoted to the topic of Human Factor of Artificial Intelligence. Experts of the Human Factors field and the Artificial Intelligence field could exchange views on questions related to the inclusion of AI methods in human-machine collaboration.

Dr. Alain Pagani presented recent advances on Artificial Intelligence at DFKI, including work on non-invasive human monitoring techniques developed at the Department Augmented Vision.

Photo: Sylvain Hourlier (THALES), co-organizer of the HE2Net Symposium and Alain Pagani (DFKI GmbH).

Papers at IEEE Intelligent Vehicles Conference 2019

The following papers have been presented at the Intelligent Vehicles Symposium (IV) 2019 from 9th to 12th of June in Paris, France:

PWOC-3D: Deep Occlusion-Aware End-to-End Scene Flow Estimation Rohan Saxena, René Schuster, Oliver Wasenmüller, Didier Stricker

DeLiO: Decoupled LiDAR Odometry
Queens Maria Thomas, Oliver Wasenmüller, Didier Stricker

The 2019 IEEE Intelligent Vehicles Symposium (IV’19) is a premier annual technical forum sponsored by the IEEE Intelligent Transportation Systems Society (ITSS). It brings together researchers and practitioners from universities, industry, and government agencies worldwide to share and discuss the latest advances in theory and technology related to intelligent vehicles. Papers concerning all aspects of intelligent vehicles as well as proposals for workshops and specials sessions are invited for IV’19. For more Information click here.

Oral Paper at CVPR 2019!

Our team members have presented the following paper at the Computer Vision and Pattern Recognition Conference 2019 which took place from 16th to 20th of June 2019 in Long Beach, California, USA and is the “premier” conference in this field (Computer Vision).

SDC – Stacked Dilated Convolution: A Unified Descriptor Network for Dense Matching Tasks
René Schuster, Oliver Wasenmüller, Christian Unger, Didier Stricker

Content: To introduce a new design element for Deep Neural Networks (SDC – Stacked Dilated Convolutions) and beyond that to apply this element in a network for Dense Feature Description. With the new descriptor, we were able to improve matching for stereo disparity, optical flow, and scene flow on different data sets by up to 50%.

Our paper was accepted from 5160 submissions as one of 1294 (acceptance rate: 25.1 %) and was also one of the 288 oral papers (oral presentation in addition to the poster session), oral rate: 5.6 % of submissions, 22.3 % of accepted papers. The presentation can be seen here.

New European Project “BIONIC”

BIONIC is a European research project aiming to develop an unobtrusive, autonomous and privacy preserving platform for real-time risk alerting and continuous persuasive coaching, enabling the design of workplace interventions adapted to the needs and fitness levels of specific ageing workforce. Gamification strategies adapted to the needs and wishes of the elderly workers will ensure optimal engagement for prevention and self-management of musculoskeletal health in any working/living environment.

For more Information visit

Official project Kick-Off Meeting at DFKI’s Headquarters in Kaiserslautern, Germany.
Article in “Nature” – The AlterEgo Project

The results of our European project AlterEgo ( have been published in the prestigious journal “Nature”. Please follow this link to read the complete article:

European project Co2Team takes off!

During flights, pilots have to manage difficult situations while facing an increasing system complexity due to the amount and the nature of available information. The idea of Co2Team, Cognitive Collaboration for Teaming, is that a system based on artificial intelligence can provide efficient support to the pilot with the use of cognitive computing. The main objective of the project is to propose a technological and methodological transition to a more autonomous flight transport based on a progressive crew reduction. Co2Team will develop the roadmap of cognitive computing to assist the pilot for future air transport. This transition will be based on an innovative bidirectional communication paradigm and an optimized shared authority (human-machine) using the potential of the cognitive computing (pilot monitoring, environment and situation understanding, enhanced assistance, adaptive automation).

The project partners are the department Augmented Vision at DFKI, Deutsche Lufthansa AG and the Institut Polytechnique de Bordeaux (INP Bordeaux).

The first meeting of the project took place on January 8th, 2019, in the premises of the INP Bordeaux. During the meeting, the participants could test an existing flight simulator and discuss possible developments of simulators for the project.

Contact person: Dr. Alain Pagani

Picture: The Co2Team partners at the kick-off event.

Start of the European Erasmus+ project ARinfuse

ARinfuse is an European project funded under Erasmus+, the EU’s programme to support education, training, youth and sport in Europe. The objective or ARinfuse is to support individuals in acquiring and developing basic skills and key competences within the field of geoinformatics and utility infrastructure, in order to foster employability. This objective is addressed through the development of new learning modules where Augmented Reality technologies are merged with geoinformatics and applied within the utility infrastructure sector. The developed digital learning content and tools will be implemented in university programs as well as in vocational training programs, and will be made available as Open Educational Resources, open textbooks and Open Source Educational Software.

The Augmented Vision department will contribute to the ARinfuse project by sharing its knowledge and expertise in Augmented Reality technologies for the energy and utilities sector, gained mainly during the European project LARA. Besides DFKI, following partners are collaborating in the project: GeoImaging Ltd (Cyprus), Novogit AB (Sweden), the Cyprus University of Technology (Cyprus), the GISIG association (Italy), the Sewerage Board of Nicosia (Cyprus), and the Flanders Environment Agency (VMM, Belgium).

On December 19th, 2018, the project was officially launched during a kick-off meeting in Nicosia, Cyprus, where the partners started to work on educational and training material and on the specification of the software modules.

Contact person: Dr. Alain Pagani

Picture: The ARinfuse partners at the kick-off event. From left to right: Alain Pagani (DFKI), Elena Valari (GeoImaging), Diofantos Hadjimitsis (CUT), Kiki Charalambus (Sewage Board Nicosia), Konstantinos Smagas (GeoImaging), Katleen Miserez (VMM), Mario Tzouvaras (CUT), Andreas Christofe (CUT), Anders Ostman (Novogit), Aristodemos Anastasiades (GeoImaging), Giorgio Saio (GISIG).

Talk of Dr. Alain Pagani on Augmented Reality for Education in Riga, Latvia

On November 27th 2018, Dr. Alain Pagani was invited by the State Fire and Rescue Service of the Republic of Latvia to give a talk on the use of Augmented Reality for education and awareness raising in the International Conference “Societal Security in the Baltic Sea Region: Challenges and Solutions”.

The main focus of the conference, organized jointly by the State Fire and Rescue Service of Latvia (VUGD) and Riga Stradins Universtiy, in cooperation with the Permanent Secretariat of the Council of the Baltic Sea States, the Swedish Institute and the Swedish Civil Contingencies Agency, was on introducing civil safety in education and the promotion of community awareness of safety in the Baltic Sea region. Dr. Alain Pagani introduced several aspects of Augmented Reality, including recent works from the Department Augmented Vision, and presented advantages of Augmented Reality for education, training and awareness raising.

He could share his views on the use of novel technologies in education during the panel discussion on the subject “education as a core element of societal security culture”, together with Mr Martins Baltmanis, Deputy Chief of the State Fire and Rescue Service of Latvia, Ms Ruta Silina, Head of Division of Communication and International Cooperation at Riga Stradins University, and Ms Elisabeth Braw, Associate Fellow at the Royal United Services Institute for Defence and Security Studies, United Kingdom.