Video-based, real-time multi-view stereo

George Vogiatzis*, Carlos Hernández

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

We investigate the problem of obtaining a dense reconstruction in real-time, from a live video stream. In recent years, multi-view stereo (MVS) has received considerable attention and a number of methods have been proposed. However, most methods operate under the assumption of a relatively sparse set of still images as input and unlimited computation time. Video based MVS has received less attention despite the fact that video sequences offer significant benefits in terms of usability of MVS systems. In this paper we propose a novel video based MVS algorithm that is suitable for real-time, interactive 3d modeling with a hand-held camera. The key idea is a per-pixel, probabilistic depth estimation scheme that updates posterior depth distributions with every new frame. The current implementation is capable of updating 15 million distributions/s. We evaluate the proposed method against the state-of-the-art real-time MVS method and show improvement in terms of accuracy.

Original languageEnglish
Pages (from-to)434-441
Number of pages8
JournalImage and Vision Computing
Volume29
Issue number7
DOIs
Publication statusPublished - Jun 2011

Bibliographical note

© 2011, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/

Keywords

  • 3d reconstruction
  • multi-view stereo
  • real-time
  • shape-from-X

Fingerprint

Dive into the research topics of 'Video-based, real-time multi-view stereo'. Together they form a unique fingerprint.

Cite this