FusionMLS: Highly dynamic 3D reconstruction with consumer-grade RGB-D cameras

Abstract : Multi-view dynamic three-dimensional reconstruction has typically required the use of custom shutter-synchronized camera rigs in order to capture scenes containing rapid movements or complex topology changes. In this paper, we demonstrate that multiple unsynchronized low-cost RGB-D cameras can be used for the same purpose. To alleviate issues caused by unsynchronized shutters, we propose a novel depth frame interpolation technique that allows synchronized data capture from highly dynamic 3D scenes. To manage the resulting huge number of input depth images, we also introduce an efficient moving least squares-based volumetric reconstruction method that generates triangle meshes of the scene. Our approach does not store the reconstruction volume in memory, making it memory-efficient and scalable to large scenes. Our implementation is completely GPU based and works in real time. The results shown herein, obtained with real data, demonstrate the effectiveness of our proposed method and its advantages compared to state-of-the-art approaches.
Complete list of metadatas

Cited literature [33 references]  Display  Hide  Download

https://hal-upec-upem.archives-ouvertes.fr/hal-01912786
Contributor : Vincent Nozick <>
Submitted on : Monday, November 5, 2018 - 5:27:42 PM
Last modification on : Friday, May 24, 2019 - 4:12:31 PM
Long-term archiving on : Wednesday, February 6, 2019 - 3:56:23 PM

File

CVM0121_proof.pdf
Publisher files allowed on an open archive

Identifiers

Citation

Siim Meerits, Diego Thomas, Vincent Nozick, Hideo Saito. FusionMLS: Highly dynamic 3D reconstruction with consumer-grade RGB-D cameras. Computational Visual Media, 2018, ⟨10.1007/s41095-018-0121-0⟩. ⟨hal-01912786⟩

Share

Metrics

Record views

62

Files downloads

97