Motion and texture rate-allocation for prediction-based scalable motion-vector coding

Joeri Barbarien, Adrian Munteanu, Fabio Verdicchio, Yiannis Andreopoulos, Jan Cornelis, Peter Schelkens

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

Modern video coding applications require data transmission over variable-bandwidth wired and wireless network channels to a variety of terminals, possibly having different screen resolutions and available computing power. Scalable video coding technology is needed to optimally support these applications. Recently proposed wavelet-based video codecs employing spatial-domain motion-compensated temporal filtering (SDMCTF) provide quality, resolution and frame-rate scalability while delivering compression performance comparable to that of H.264, the state-of-the-art in single-layer video coding. These codecs require quality-scalable coding of the motion vectors to support a large range of bit-rates with optimal compression efficiency. In this paper, the practical use of prediction-based scalable motion-vector coding in the context of scalable SDMCTF-based video coding is investigated. Extensive experimental results demonstrate that, irrespective of the employed motion model, our prediction-based scalable motion-vector codec (MVC) systematically outperforms state-of-the-art wavelet-based solutions for both lossy and lossless compression. A new rate-distortion optimized rate-allocation strategy is proposed, capable of optimally distributing the available bit-budget between the different frames and between the texture and motion information, making the integration of the scalable MVC into a scalable video codec possible. This rate-allocation scheme systematically outperforms heuristic approaches previously employed in the literature. Experiments confirm that by using a scalable MVC, lower bit-rates can be attained without sacrificing motion-estimation efficiency and that the overall coding performance at low rates is significantly improved by a better distribution of the available rate between texture and motion information. The only downside of scalable motion-vector coding is a slight performance loss incurred at high bit-rates. (c) 2005 Elsevier B.V. All rights reserved.
Original languageEnglish
Pages (from-to)315-342
JournalSignal Processing: Image Communication
Volume20
Issue number4
DOIs
Publication statusPublished - Apr 2005

Fingerprint

Textures
Image coding
Scalable video coding
Motion estimation
Data communication systems
Scalability
Wireless networks
Compaction
Bandwidth
Experiments

Keywords

  • scalable wavelet-based video coding
  • spatial domain motion-compensated temporal filtering
  • multi-hypothesis block-based motion estimation
  • scalable motion-vector coding
  • rate allocation

Cite this

Motion and texture rate-allocation for prediction-based scalable motion-vector coding. / Barbarien, Joeri; Munteanu, Adrian; Verdicchio, Fabio; Andreopoulos, Yiannis; Cornelis, Jan; Schelkens, Peter.

In: Signal Processing: Image Communication, Vol. 20, No. 4, 04.2005, p. 315-342.

Research output: Contribution to journalArticle

Barbarien, Joeri ; Munteanu, Adrian ; Verdicchio, Fabio ; Andreopoulos, Yiannis ; Cornelis, Jan ; Schelkens, Peter. / Motion and texture rate-allocation for prediction-based scalable motion-vector coding. In: Signal Processing: Image Communication. 2005 ; Vol. 20, No. 4. pp. 315-342.
@article{1981345747b6463daf186fb7dc767041,
title = "Motion and texture rate-allocation for prediction-based scalable motion-vector coding",
abstract = "Modern video coding applications require data transmission over variable-bandwidth wired and wireless network channels to a variety of terminals, possibly having different screen resolutions and available computing power. Scalable video coding technology is needed to optimally support these applications. Recently proposed wavelet-based video codecs employing spatial-domain motion-compensated temporal filtering (SDMCTF) provide quality, resolution and frame-rate scalability while delivering compression performance comparable to that of H.264, the state-of-the-art in single-layer video coding. These codecs require quality-scalable coding of the motion vectors to support a large range of bit-rates with optimal compression efficiency. In this paper, the practical use of prediction-based scalable motion-vector coding in the context of scalable SDMCTF-based video coding is investigated. Extensive experimental results demonstrate that, irrespective of the employed motion model, our prediction-based scalable motion-vector codec (MVC) systematically outperforms state-of-the-art wavelet-based solutions for both lossy and lossless compression. A new rate-distortion optimized rate-allocation strategy is proposed, capable of optimally distributing the available bit-budget between the different frames and between the texture and motion information, making the integration of the scalable MVC into a scalable video codec possible. This rate-allocation scheme systematically outperforms heuristic approaches previously employed in the literature. Experiments confirm that by using a scalable MVC, lower bit-rates can be attained without sacrificing motion-estimation efficiency and that the overall coding performance at low rates is significantly improved by a better distribution of the available rate between texture and motion information. The only downside of scalable motion-vector coding is a slight performance loss incurred at high bit-rates. (c) 2005 Elsevier B.V. All rights reserved.",
keywords = "scalable wavelet-based video coding, spatial domain motion-compensated temporal filtering, multi-hypothesis block-based motion estimation, scalable motion-vector coding, rate allocation",
author = "Joeri Barbarien and Adrian Munteanu and Fabio Verdicchio and Yiannis Andreopoulos and Jan Cornelis and Peter Schelkens",
year = "2005",
month = "4",
doi = "10.1016/j.image.2004.12.006",
language = "English",
volume = "20",
pages = "315--342",
journal = "Signal Processing: Image Communication",
issn = "0923-5965",
publisher = "Elsevier",
number = "4",

}

TY - JOUR

T1 - Motion and texture rate-allocation for prediction-based scalable motion-vector coding

AU - Barbarien, Joeri

AU - Munteanu, Adrian

AU - Verdicchio, Fabio

AU - Andreopoulos, Yiannis

AU - Cornelis, Jan

AU - Schelkens, Peter

PY - 2005/4

Y1 - 2005/4

N2 - Modern video coding applications require data transmission over variable-bandwidth wired and wireless network channels to a variety of terminals, possibly having different screen resolutions and available computing power. Scalable video coding technology is needed to optimally support these applications. Recently proposed wavelet-based video codecs employing spatial-domain motion-compensated temporal filtering (SDMCTF) provide quality, resolution and frame-rate scalability while delivering compression performance comparable to that of H.264, the state-of-the-art in single-layer video coding. These codecs require quality-scalable coding of the motion vectors to support a large range of bit-rates with optimal compression efficiency. In this paper, the practical use of prediction-based scalable motion-vector coding in the context of scalable SDMCTF-based video coding is investigated. Extensive experimental results demonstrate that, irrespective of the employed motion model, our prediction-based scalable motion-vector codec (MVC) systematically outperforms state-of-the-art wavelet-based solutions for both lossy and lossless compression. A new rate-distortion optimized rate-allocation strategy is proposed, capable of optimally distributing the available bit-budget between the different frames and between the texture and motion information, making the integration of the scalable MVC into a scalable video codec possible. This rate-allocation scheme systematically outperforms heuristic approaches previously employed in the literature. Experiments confirm that by using a scalable MVC, lower bit-rates can be attained without sacrificing motion-estimation efficiency and that the overall coding performance at low rates is significantly improved by a better distribution of the available rate between texture and motion information. The only downside of scalable motion-vector coding is a slight performance loss incurred at high bit-rates. (c) 2005 Elsevier B.V. All rights reserved.

AB - Modern video coding applications require data transmission over variable-bandwidth wired and wireless network channels to a variety of terminals, possibly having different screen resolutions and available computing power. Scalable video coding technology is needed to optimally support these applications. Recently proposed wavelet-based video codecs employing spatial-domain motion-compensated temporal filtering (SDMCTF) provide quality, resolution and frame-rate scalability while delivering compression performance comparable to that of H.264, the state-of-the-art in single-layer video coding. These codecs require quality-scalable coding of the motion vectors to support a large range of bit-rates with optimal compression efficiency. In this paper, the practical use of prediction-based scalable motion-vector coding in the context of scalable SDMCTF-based video coding is investigated. Extensive experimental results demonstrate that, irrespective of the employed motion model, our prediction-based scalable motion-vector codec (MVC) systematically outperforms state-of-the-art wavelet-based solutions for both lossy and lossless compression. A new rate-distortion optimized rate-allocation strategy is proposed, capable of optimally distributing the available bit-budget between the different frames and between the texture and motion information, making the integration of the scalable MVC into a scalable video codec possible. This rate-allocation scheme systematically outperforms heuristic approaches previously employed in the literature. Experiments confirm that by using a scalable MVC, lower bit-rates can be attained without sacrificing motion-estimation efficiency and that the overall coding performance at low rates is significantly improved by a better distribution of the available rate between texture and motion information. The only downside of scalable motion-vector coding is a slight performance loss incurred at high bit-rates. (c) 2005 Elsevier B.V. All rights reserved.

KW - scalable wavelet-based video coding

KW - spatial domain motion-compensated temporal filtering

KW - multi-hypothesis block-based motion estimation

KW - scalable motion-vector coding

KW - rate allocation

U2 - 10.1016/j.image.2004.12.006

DO - 10.1016/j.image.2004.12.006

M3 - Article

VL - 20

SP - 315

EP - 342

JO - Signal Processing: Image Communication

JF - Signal Processing: Image Communication

SN - 0923-5965

IS - 4

ER -