Polar-Ano: Surface Anomaly Detection via Deep Polarization Imaging and Data Synthesis with Physic-based Rendering

Polar-Ano: Surface Anomaly Detection via Deep Polarization Imaging and Data Synthesis with Physic-based Rendering
Yaxu Xie, Alain Pagani, Didier Stricker
In: 2023 17th International Conference on Signal-Image Technology & Internet-Based Systems. International Conference on Signal-Image Technology & Internet-Based Systems (SITIS-2023), November 8-10, Bangkok, Thailand, IEEE, 2023.

Abstract:

In this paper, we propose a complete pipeline from generating polarization images via physics-based rendering to train and deploy an image anomaly detection and localization model for polarimetric industrial inspection. The method consists of two stages. We first compute the Polarimetric Priors with both determined and learning-based method. Then, the Polarimetric Priors are given to a self-supervised surface anomaly detection network to predict the anomalies score and anomalies masks. To train the network, we adapt and modify a physic-based rendering pipeline to generate photo-realistic data samples of polarized images on a large scale. Our experiments show the effectiveness of our proposed pipeline.