3-d time-varying scene capture technologies: A survey

Elena Stoykova, A. Aydin Alatan, Philip William Benzie, Nikos Grammalidis, Sotiris Malassiotis, Joern Ostermann, Sergej Piekh, Ventseslav Sainov, Christian Theobalt, Thangavel Thevar, Xenophon Zabulis

Research output: Contribution to journalLiterature review

74 Citations (Scopus)

Abstract

Advances in image sensors and evolution of digital computation is a strong stimulus for development and implementation of sophisticated methods for capturing, processing and analysis of 3-D data from dynamic scenes. Research on perspective time-varying 3-D scene capture technologies is important for the upcoming 3DTV displays. Methods such as shape-from-texture, shape-from-shading, shape-from-focus, and shape-from-motion extraction can restore 3-D shape information from a single camera data. The existing techniques for 3-D extraction from single-camera video sequences are especially useful for conversion of the already available vast mono-view content to the 3DTV systems. Scene-oriented single-camera methods such as human face reconstruction and facial motion,analysis,,body modeling and body motion tracking, and motion recognition solve efficiently a variety of tasks. 3-D multicamera dynamic acquisition and reconstruction, their hardware specifics including calibration and synchronization and software demands form another area of intensive research. Different classes of multiview stereo algorithms such as those based on cost function computing and optimization, fusing of multiple views, and feature-point reconstruction are possible candidates for dynamic 3-D reconstruction. High-resolution digital holography and pattern projection techniques such as coded light or fringe projection for real-time extraction of 3-D object positions and color information could manifest themselves as an alternative to traditional camera-based methods. Apart from all of these approaches, there also are some active imaging devices capable of 3-D extraction such, as the 3-D time-of-flight camera, which provides 3-D image data of its environment by means of a modulated infrared light source.

Original languageEnglish
Pages (from-to)1568-1586
Number of pages19
JournalIEEE transactions on circuits and systems for video technology
Volume17
Issue number11
DOIs
Publication statusPublished - Nov 2007

Keywords

  • coded light
  • digital holography
  • pattern projection
  • shape
  • three-dimensional (3-D) displays
  • 3-D/stereo scene analysis
  • 3DTV
  • time-of-flight
  • video analysis
  • phase-shifting interferometry
  • structure-from-motion
  • human face detection
  • fourier-transform profilometry
  • 2-dimensional fringe patterns
  • continuous wavelet transform
  • structured light
  • factorization method
  • high-resolution
  • quadrature transform

Cite this

Stoykova, E., Alatan, A. A., Benzie, P. W., Grammalidis, N., Malassiotis, S., Ostermann, J., Piekh, S., Sainov, V., Theobalt, C., Thevar, T., & Zabulis, X. (2007). 3-d time-varying scene capture technologies: A survey. IEEE transactions on circuits and systems for video technology, 17(11), 1568-1586. https://doi.org/10.1109/TCSVT.2007.909975