3-d time-varying scene capture technologies: A survey

Elena Stoykova, A. Aydin Alatan, Philip William Benzie, Nikos Grammalidis, Sotiris Malassiotis, Joern Ostermann, Sergej Piekh, Ventseslav Sainov, Christian Theobalt, Thangavel Thevar, Xenophon Zabulis

Research output: Contribution to journalLiterature review

72 Citations (Scopus)

Abstract

Advances in image sensors and evolution of digital computation is a strong stimulus for development and implementation of sophisticated methods for capturing, processing and analysis of 3-D data from dynamic scenes. Research on perspective time-varying 3-D scene capture technologies is important for the upcoming 3DTV displays. Methods such as shape-from-texture, shape-from-shading, shape-from-focus, and shape-from-motion extraction can restore 3-D shape information from a single camera data. The existing techniques for 3-D extraction from single-camera video sequences are especially useful for conversion of the already available vast mono-view content to the 3DTV systems. Scene-oriented single-camera methods such as human face reconstruction and facial motion,analysis,,body modeling and body motion tracking, and motion recognition solve efficiently a variety of tasks. 3-D multicamera dynamic acquisition and reconstruction, their hardware specifics including calibration and synchronization and software demands form another area of intensive research. Different classes of multiview stereo algorithms such as those based on cost function computing and optimization, fusing of multiple views, and feature-point reconstruction are possible candidates for dynamic 3-D reconstruction. High-resolution digital holography and pattern projection techniques such as coded light or fringe projection for real-time extraction of 3-D object positions and color information could manifest themselves as an alternative to traditional camera-based methods. Apart from all of these approaches, there also are some active imaging devices capable of 3-D extraction such, as the 3-D time-of-flight camera, which provides 3-D image data of its environment by means of a modulated infrared light source.

Original languageEnglish
Pages (from-to)1568-1586
Number of pages19
JournalIEEE transactions on circuits and systems for video technology
Volume17
Issue number11
DOIs
Publication statusPublished - Nov 2007

Keywords

  • coded light
  • digital holography
  • pattern projection
  • shape
  • three-dimensional (3-D) displays
  • 3-D/stereo scene analysis
  • 3DTV
  • time-of-flight
  • video analysis
  • phase-shifting interferometry
  • structure-from-motion
  • human face detection
  • fourier-transform profilometry
  • 2-dimensional fringe patterns
  • continuous wavelet transform
  • structured light
  • factorization method
  • high-resolution
  • quadrature transform

Cite this

Stoykova, E., Alatan, A. A., Benzie, P. W., Grammalidis, N., Malassiotis, S., Ostermann, J., ... Zabulis, X. (2007). 3-d time-varying scene capture technologies: A survey. IEEE transactions on circuits and systems for video technology, 17(11), 1568-1586. https://doi.org/10.1109/TCSVT.2007.909975

3-d time-varying scene capture technologies : A survey. / Stoykova, Elena; Alatan, A. Aydin; Benzie, Philip William; Grammalidis, Nikos; Malassiotis, Sotiris; Ostermann, Joern; Piekh, Sergej; Sainov, Ventseslav; Theobalt, Christian; Thevar, Thangavel; Zabulis, Xenophon.

In: IEEE transactions on circuits and systems for video technology, Vol. 17, No. 11, 11.2007, p. 1568-1586.

Research output: Contribution to journalLiterature review

Stoykova, E, Alatan, AA, Benzie, PW, Grammalidis, N, Malassiotis, S, Ostermann, J, Piekh, S, Sainov, V, Theobalt, C, Thevar, T & Zabulis, X 2007, '3-d time-varying scene capture technologies: A survey' IEEE transactions on circuits and systems for video technology, vol. 17, no. 11, pp. 1568-1586. https://doi.org/10.1109/TCSVT.2007.909975
Stoykova E, Alatan AA, Benzie PW, Grammalidis N, Malassiotis S, Ostermann J et al. 3-d time-varying scene capture technologies: A survey. IEEE transactions on circuits and systems for video technology. 2007 Nov;17(11):1568-1586. https://doi.org/10.1109/TCSVT.2007.909975
Stoykova, Elena ; Alatan, A. Aydin ; Benzie, Philip William ; Grammalidis, Nikos ; Malassiotis, Sotiris ; Ostermann, Joern ; Piekh, Sergej ; Sainov, Ventseslav ; Theobalt, Christian ; Thevar, Thangavel ; Zabulis, Xenophon. / 3-d time-varying scene capture technologies : A survey. In: IEEE transactions on circuits and systems for video technology. 2007 ; Vol. 17, No. 11. pp. 1568-1586.
@article{3960f4c187d44686b70dcece472bb859,
title = "3-d time-varying scene capture technologies: A survey",
abstract = "Advances in image sensors and evolution of digital computation is a strong stimulus for development and implementation of sophisticated methods for capturing, processing and analysis of 3-D data from dynamic scenes. Research on perspective time-varying 3-D scene capture technologies is important for the upcoming 3DTV displays. Methods such as shape-from-texture, shape-from-shading, shape-from-focus, and shape-from-motion extraction can restore 3-D shape information from a single camera data. The existing techniques for 3-D extraction from single-camera video sequences are especially useful for conversion of the already available vast mono-view content to the 3DTV systems. Scene-oriented single-camera methods such as human face reconstruction and facial motion,analysis,,body modeling and body motion tracking, and motion recognition solve efficiently a variety of tasks. 3-D multicamera dynamic acquisition and reconstruction, their hardware specifics including calibration and synchronization and software demands form another area of intensive research. Different classes of multiview stereo algorithms such as those based on cost function computing and optimization, fusing of multiple views, and feature-point reconstruction are possible candidates for dynamic 3-D reconstruction. High-resolution digital holography and pattern projection techniques such as coded light or fringe projection for real-time extraction of 3-D object positions and color information could manifest themselves as an alternative to traditional camera-based methods. Apart from all of these approaches, there also are some active imaging devices capable of 3-D extraction such, as the 3-D time-of-flight camera, which provides 3-D image data of its environment by means of a modulated infrared light source.",
keywords = "coded light, digital holography, pattern projection, shape, three-dimensional (3-D) displays, 3-D/stereo scene analysis, 3DTV, time-of-flight, video analysis, phase-shifting interferometry, structure-from-motion, human face detection, fourier-transform profilometry, 2-dimensional fringe patterns, continuous wavelet transform, structured light, factorization method, high-resolution, quadrature transform",
author = "Elena Stoykova and Alatan, {A. Aydin} and Benzie, {Philip William} and Nikos Grammalidis and Sotiris Malassiotis and Joern Ostermann and Sergej Piekh and Ventseslav Sainov and Christian Theobalt and Thangavel Thevar and Xenophon Zabulis",
year = "2007",
month = "11",
doi = "10.1109/TCSVT.2007.909975",
language = "English",
volume = "17",
pages = "1568--1586",
journal = "IEEE transactions on circuits and systems for video technology",
issn = "1051-8215",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "11",

}

TY - JOUR

T1 - 3-d time-varying scene capture technologies

T2 - A survey

AU - Stoykova, Elena

AU - Alatan, A. Aydin

AU - Benzie, Philip William

AU - Grammalidis, Nikos

AU - Malassiotis, Sotiris

AU - Ostermann, Joern

AU - Piekh, Sergej

AU - Sainov, Ventseslav

AU - Theobalt, Christian

AU - Thevar, Thangavel

AU - Zabulis, Xenophon

PY - 2007/11

Y1 - 2007/11

N2 - Advances in image sensors and evolution of digital computation is a strong stimulus for development and implementation of sophisticated methods for capturing, processing and analysis of 3-D data from dynamic scenes. Research on perspective time-varying 3-D scene capture technologies is important for the upcoming 3DTV displays. Methods such as shape-from-texture, shape-from-shading, shape-from-focus, and shape-from-motion extraction can restore 3-D shape information from a single camera data. The existing techniques for 3-D extraction from single-camera video sequences are especially useful for conversion of the already available vast mono-view content to the 3DTV systems. Scene-oriented single-camera methods such as human face reconstruction and facial motion,analysis,,body modeling and body motion tracking, and motion recognition solve efficiently a variety of tasks. 3-D multicamera dynamic acquisition and reconstruction, their hardware specifics including calibration and synchronization and software demands form another area of intensive research. Different classes of multiview stereo algorithms such as those based on cost function computing and optimization, fusing of multiple views, and feature-point reconstruction are possible candidates for dynamic 3-D reconstruction. High-resolution digital holography and pattern projection techniques such as coded light or fringe projection for real-time extraction of 3-D object positions and color information could manifest themselves as an alternative to traditional camera-based methods. Apart from all of these approaches, there also are some active imaging devices capable of 3-D extraction such, as the 3-D time-of-flight camera, which provides 3-D image data of its environment by means of a modulated infrared light source.

AB - Advances in image sensors and evolution of digital computation is a strong stimulus for development and implementation of sophisticated methods for capturing, processing and analysis of 3-D data from dynamic scenes. Research on perspective time-varying 3-D scene capture technologies is important for the upcoming 3DTV displays. Methods such as shape-from-texture, shape-from-shading, shape-from-focus, and shape-from-motion extraction can restore 3-D shape information from a single camera data. The existing techniques for 3-D extraction from single-camera video sequences are especially useful for conversion of the already available vast mono-view content to the 3DTV systems. Scene-oriented single-camera methods such as human face reconstruction and facial motion,analysis,,body modeling and body motion tracking, and motion recognition solve efficiently a variety of tasks. 3-D multicamera dynamic acquisition and reconstruction, their hardware specifics including calibration and synchronization and software demands form another area of intensive research. Different classes of multiview stereo algorithms such as those based on cost function computing and optimization, fusing of multiple views, and feature-point reconstruction are possible candidates for dynamic 3-D reconstruction. High-resolution digital holography and pattern projection techniques such as coded light or fringe projection for real-time extraction of 3-D object positions and color information could manifest themselves as an alternative to traditional camera-based methods. Apart from all of these approaches, there also are some active imaging devices capable of 3-D extraction such, as the 3-D time-of-flight camera, which provides 3-D image data of its environment by means of a modulated infrared light source.

KW - coded light

KW - digital holography

KW - pattern projection

KW - shape

KW - three-dimensional (3-D) displays

KW - 3-D/stereo scene analysis

KW - 3DTV

KW - time-of-flight

KW - video analysis

KW - phase-shifting interferometry

KW - structure-from-motion

KW - human face detection

KW - fourier-transform profilometry

KW - 2-dimensional fringe patterns

KW - continuous wavelet transform

KW - structured light

KW - factorization method

KW - high-resolution

KW - quadrature transform

U2 - 10.1109/TCSVT.2007.909975

DO - 10.1109/TCSVT.2007.909975

M3 - Literature review

VL - 17

SP - 1568

EP - 1586

JO - IEEE transactions on circuits and systems for video technology

JF - IEEE transactions on circuits and systems for video technology

SN - 1051-8215

IS - 11

ER -