Reducing Internet Latency: A Survey of Techniques and their Merit

Bob Briscoe, Anna Brunstrom, Andreas Petlund, David Hayes, David Ross, Ing-Jyh Tsan, Stein Gjessing, Gorry Fairhurst, Carsten Griwodz, Michael Welzl

Research output: Contribution to journalArticle

63 Citations (Scopus)
356 Downloads (Pure)

Abstract

Latency is increasingly becoming a performance bottleneck for Internet Protocol (IP) networks, but historically networks have been designed with aims of maximizing throughput and utilization. This article offers a broad survey of techniques aimed at tackling latency in the literature up to March 2014 and their merits. A goal of this work is to be able to quantify and compare the merits of the different Internet latency reducing techniques, contrasting their gains in delay reduction versus the pain required to implement and deploy them. We found that classifying techniques according to the sources of delay they alleviate provided the best insight into the following issues: 1) the structural arrangement of a network, such as placement of servers and suboptimal routes, can contribute significantly to latency; 2) each interaction between communicating endpoints adds a Round Trip Time (RTT) to latency, especially significant for short flows; 3) in addition to base propagation delay, several sources of delay accumulate along transmission paths, today intermittently dominated by queuing delays; 4) it takes time to sense and use available capacity, with overuse inflicting latency on other flows sharing the capacity; and 5) within end systems delay sources include operating system buffering, head-of-line blocking, and hardware interaction. No single source of delay dominates in all cases, and many of these sources are spasmodic and highly variable. Solutions addressing these sources often both reduce the overall latency and make it more predictable.
Original languageEnglish
Pages (from-to)2149 - 2196
Number of pages49
Journal IEEE Communications Surveys & Tutorials
Volume18
Issue number3
Early online date26 Nov 2014
DOIs
Publication statusPublished - 2014

    Fingerprint

Cite this

Briscoe, B., Brunstrom, A., Petlund, A., Hayes, D., Ross, D., Tsan, I-J., Gjessing, S., Fairhurst, G., Griwodz, C., & Welzl, M. (2014). Reducing Internet Latency: A Survey of Techniques and their Merit. IEEE Communications Surveys & Tutorials, 18(3), 2149 - 2196. https://doi.org/10.1109/COMST.2014.2375213