Multi-view damage inspection using single-view damage projection

R. E. van Ruitenbeek*, S. Bhulai

*Corresponding author for this work

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

Single-view computer vision models for vehicle damage inspection often suffer from strong light reflections. To resolve this, multiple images under various viewpoints can be used. However, multiple views increase the complexity as multi-view training data, specialized models, and damage re-identification over different views are required. In addition, traditional point cloud applications require large computational power, being impractical for edge computing. Therefore, multi-view damage inspection has not yet found its way into practical applications. We present a novel approach that projects the results from widely available single-view computer vision models onto 3D representations, to combine the detections from various viewpoints. With this, we leverage all advantages of multi-view damage inspection, without the need for multi-view training data and specialized models or hardware. We conduct a practical evaluation using a drive-through camera setup, to show the applicability of the methods in practice. We show that our proposed method successfully combines similar damages across viewpoints, reducing the number of duplicate damages by almost 99%. In addition, we show that our approach reduces the number of false positives by 96%. The proposed method leverages the existing single-view training data and single-view deep learning models to make multi-view inspection more accessible for practical implementations.

Original languageEnglish
Article number46
Pages (from-to)1-11
Number of pages11
JournalMachine Vision and Applications
Volume33
Issue number3
Early online date11 Apr 2022
DOIs
Publication statusPublished - May 2022

Bibliographical note

Funding Information:
We would like to thank Pon Holdings B.V. for contributing to this research by providing a test location, hardware, and test vehicles.

Publisher Copyright:
© 2022, The Author(s).

Funding

We would like to thank Pon Holdings B.V. for contributing to this research by providing a test location, hardware, and test vehicles.

Keywords

  • 3D models
  • Damage detection
  • Inspection
  • Multi-view
  • Ray tracing
  • Vehicles

Fingerprint

Dive into the research topics of 'Multi-view damage inspection using single-view damage projection'. Together they form a unique fingerprint.

Cite this