Towards a Multispectral RGB-IR-UV-D Vision System - Seeing the Invisible in 3D

Tanhao Zhang, Luyin Hu, Lu Li, David Navarro-Alarcon

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

Abstract

In this paper, we present the development of a sensing system with the capability to compute multispectral point clouds in real-time. The proposed multi-eye sensor system effectively registers information from the visible, (long-wave) infrared, and ultraviolet spectrum to its depth sensing frame, thus enabling to measure a wider range of surface features that are otherwise hidden to the naked eye. For that, we designed a new cross-calibration apparatus that produces consistent features which can be sensed by each of the cameras, therefore, acting as a multispectral "chessboard". The performance of the sensor is evaluated with two different cases of studies, where we show that the proposed system can detect "hidden"features of a 3D environment.

Original languageEnglish
Title of host publication2021 IEEE International Conference on Robotics and Biomimetics, ROBIO 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1723-1728
Number of pages6
ISBN (Electronic)9781665405355
DOIs
Publication statusPublished - Dec 2021
Event2021 IEEE International Conference on Robotics and Biomimetics, ROBIO 2021 - Sanya, China
Duration: 27 Dec 202131 Dec 2021

Publication series

Name2021 IEEE International Conference on Robotics and Biomimetics, ROBIO 2021

Conference

Conference2021 IEEE International Conference on Robotics and Biomimetics, ROBIO 2021
Country/TerritoryChina
CitySanya
Period27/12/2131/12/21

ASJC Scopus subject areas

  • Artificial Intelligence
  • Mechanical Engineering
  • Control and Optimization

Cite this