Towards Non-Rigid Reconstruction – How to adapt rigid RGB-D reconstruction to non-rigid movements?

Towards Non-Rigid Reconstruction – How to adapt rigid RGB-D reconstruction to non-rigid movements?
Oliver Wasenmüller, Benjamin Schenkenberger, Didier Stricker
International Conference on Computer Vision Theory and Applications International Conference on Computer Vision Theory and Applications (VISAPP-17), February 27 - March 1, Porto, Portugal

Abstract:

Human body reconstruction is a very active field in recent Computer Vision research. The challenge is the moving human body while capturing, even when trying to avoid that. Thus, algorithms which explicitly cope with non-rigid movements are indispensable. In this paper, we propose a novel algorithm to extend existing rigid RGB-D reconstruction pipelines to handle non-rigid transformations. The idea is to store in addition to the model also the non-rigid transformation nrt of the current frame as a sparse warp field in the image space. We propose an algorithm to incrementally update this transformation nrt. In the evaluation we show that the novel algorithm provides accurate reconstructions and can cope with non-rigid movements of up to 5cm.

Keywords:

RGB-D reconstruction, non-rigid, human body capture, sparse warp field