Real-Time Free Viewpoint Video from Uncalibrated Cameras Using Plan e-Sweep Algorithm

Songkran Jarusirisawad (1) , Hideo Saito (1) , Vincent Nozick (2)

1 hvrl - hyper vision research lab
2 LIGM - Laboratoire d'Informatique Gaspard-Monge

In this paper, we present a new online video-based rendering (VBR) method that creates new views of a scene from uncalibrated cameras. Our method does not require information about the cameras intrinsic parameters. For obtaining a geometrical relation among the cameras, we use projective grid space (PGS) which is 3D space defined by epipolar geometry between two basis cameras. The other cameras are registered to the same 3D space by trifocal tensors between these basis cameras. We simultaneously reconstruct and render novel view using our proposed planesweep algorithm in PGS. To achieve real-time performance, we implemented the proposed algorithm in graphics processing unit (GPU). We succeed to create novel view images in real-time from uncalibrated cameras and the results show the efficiency of our proposed method.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Synthèse d'image et réalité virtuelle [cs.GR]

Songkran Jarusirisawad, Hideo Saito, Vincent Nozick. Real-Time Free Viewpoint Video from Uncalibrated Cameras Using Plan e-Sweep Algorithm. 3DIM, 2009 IEEE 12th International Conference on Computer Vision Workshops, Oct 2009, Japan. pp.1740-1747. ⟨hal-00733381⟩