Real-time Free Viewpoint from Multiple moving Cameras

Vincent Nozick (1) , Hideo Saito (2)

1 LIGM - Laboratoire d'Informatique Gaspard-Monge
2 hvrl - hyper vision research lab

In recent years, some Video-Based Rendering methods have advanced from off-line rendering to on-line rendering. However very few of them can handle moving cameras while recording. Moving cameras enable to follow an actor in a scene, come closer to get more details or just adjust the framing of the cameras. In this paper, we propose a new Video-Based Rendering method that creates new views of the scene in live from four moving webcams. These cameras are calibrated in realtime using multiple markers. Our method fully uses both CPU and GPU and hence requires only one consumer grade computer.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Vincent Nozick, Hideo Saito. Real-time Free Viewpoint from Multiple moving Cameras. Advanced Concepts for Intelligent Vision Systems (ACIVS), Aug 2007, Netherlands. pp.72-83. ⟨hal-00733823⟩