Superimposing Thermal-Infrared Data on 3D Structure Reconstructed by RGB Visual Odometry

Masahiro Yamaguchi 1 Trong Phuc Truong 2 Shohei Mori 2 Vincent Nozick 2 Hideo Saito 2 Shoji Yachida Hideaki Sato
1 Faculty of Science and Technology, Keio University
2 Faculty of Science and Technology (Keio University)
Abstract : In this paper, we propose a method to generate a three-dimensional (3D) thermal map and RGB + thermal (RGB-T) images of a scene from thermal-infrared and RGB images. The scene images are acquired by moving both a RGB camera and an thermal-infrared camera mounted on a stereo rig. Before capturing the scene with those cameras, we estimate their respective intrinsic parameters and their relative pose. Then, we reconstruct the 3D structures of the scene by using Direct Sparse Odometry (DSO) using the RGB images. In order to superimpose thermal information onto each point generated from DSO, we propose a method for estimating the scale of the point cloud corresponding to the ex-trinsic parameters between both cameras by matching depth images recovered from the RGB camera and the thermal-infrared camera based on mutual information. We also generate RGB-T images using the 3D structure of the scene and Delaunay triangulation. We do not rely on depth cameras and, therefore, our technique is not limited to scenes within the measurement range of the depth cameras. To demonstrate this technique, we generate 3D thermal maps and RGB-T images for both indoor and outdoor scenes.
Document type :
Journal articles
Complete list of metadatas

Cited literature [33 references]  Display  Hide  Download
https://hal-upec-upem.archives-ouvertes.fr/hal-01873577
Contributor : Vincent Nozick <>
Submitted on : Monday, November 5, 2018 - 5:29:52 PM
Last modification on : Wednesday, November 14, 2018 - 1:13:04 AM
Long-term archiving on: Wednesday, February 6, 2019 - 3:52:23 PM

File

main.pdf
Files produced by the author(s)

Identifiers

Collections

UPEC-UPEM

Citation

Masahiro Yamaguchi, Trong Phuc Truong, Shohei Mori, Vincent Nozick, Hideo Saito, et al.. Superimposing Thermal-Infrared Data on 3D Structure Reconstructed by RGB Visual Odometry. IEICE Transactions on Information and Systems, Institute of Electronics, Information and Communication Engineers, 2018, E101.D (5), pp.1296 - 1307. ⟨10.1587/transinf.2017MVP0023⟩. ⟨hal-01873577⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

62

Files downloads

174

Contact

Informations

CCSD