skip to main content
10.1145/1282380.1282394acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
Article
Free access

Accurate and efficient SLA compliance monitoring

Published: 27 August 2007 Publication History

Abstract

Service level agreements (SLAs) define performance guarantees made by service providers, e.g, in terms of packet loss, delay, delay variation, and network availability. In this paper, we describe a new active measurement methodology to accurately monitor whether measured network path characteristics are in compliance with performance targets specified in SLAs. Specifically, (1) we describe a new methodology for estimating packet loss rate that significantly improves accuracy over existing approaches; (2) we introduce a new methodology for measuring mean delay along a path that improves accuracy over existing methodologies, and propose a method for obtaining confidence intervals on quantiles of the empirical delay distribution without making any assumption about the true distribution of delay; (3) we introduce a new methodology for measuring delay variation that is more robust than prior techniques; and (4) we extend existing work in network performance tomography to infer lower bounds on the quantiles of a distribution of performance measures along an unmeasured path given measurements from a subset of paths. We unify active measurements for these metrics in a discrete time-based tool called SLAM. The unified probe stream from SLAM consumes lower overall bandwidth than if individual streams are used to measure path properties. We demonstrate the accuracy and convergence properties of SLAM in a controlled laboratory environment using a range of background traffic scenarios and in one- and two-hop settings, and examine its accuracy improvements over existing standard techniques.

References

[1]
ITU-T Recommendation G.107, The E-model, a computational model for use in transmission planning, March 2005.
[2]
AT&T Managed Internet Service (MIS). http://new.serviceguide.att.com/mis.htm, 2007.
[3]
NTT Communications Global IP Network Service Level Agreement (SLA). http://www.us.ntt.net/support/sla/network/, 2007.
[4]
Sprint NEXTEL service level agreements. http://www.sprint.com/business/support/serviceLevelAgreements.jsp, 2007.
[5]
S. Agarwal, J. Sommers, and P. Barford. Scalable network path emulation. In Proceedings of IEEE MASCOTS '05, September 2005.
[6]
M. Aida, N. Miyoshi, and K. Ishibashi. A scalable and lightweight QoS monitoring technique combining passive and active approaches. In Proceedings of IEEE INFOCOM '03, March 2003.
[7]
G. Almes, S. Kalidindi, and M. Zekauskas. A one-way delay metric for IPPM. IETF RFC 2679, September 1999.
[8]
G. Almes, S. Kalidindi, and M. Zekauskas. A one way packet loss metric for IPPM. IETF RFC 2680, September 1999.
[9]
D. Arifler, G. de Veciana, and B. L. Evans. 'network tomography based on flow level measurements. In IEEE Int. Conf. on Acoustics, Speech, and Signal Proc., Montreal, Canada, May 17-21 2004.
[10]
P. Barford and J. Sommers. Comparing probe- and router-based packet loss measurements. IEEE Internet Computing, September/October 2004.
[11]
J. Bolot.End-to-end packet delay and loss behavior in the Internet. In Proceedings of ACM SIGCOMM '93, September 1993.
[12]
R. Cáceres, N. Duffield, J. Horowitz, and D. Towsley. Multicast-based inference of network internal loss characteristics. IEEE Trans. on Information Theory, 45(7):2462--2480, 1999.
[13]
M. C. Chan, Y. J. Lin, and X. Wang. A scalable monitoring approach for service level agreements validation. In IEEE International Conference on Network Protocols (ICNP), pages 37--48, 2000.
[14]
Y. Chen, D. Bindel, and R. Katz. Tomography-based overlay network monitoring. In Proceedings of ACM SIGCOMM Internet Measurement Conference '03, October 2003.
[15]
Y. Chen, D. Bindel, H. Song, and R. H. Katz. An algebraic approach to practical and scalable overlay network monitoring. In Proceedings of ACM SIGCOMM '04, 2004.
[16]
B. Y. Choi, S. Moon, R. Cruz, Z.-L. Zhang, and C. Diot. Practical delay monitoring for ISPs. In Proceedings of ACM CoNEXT '05, 2005.
[17]
D. B. Chua, E. D. Kolaczyk, and M. Crovella. Efficient estimation of end-to-end network properties. In Proceedings of IEEE INFOCOM '05, 2005.
[18]
L. Ciavattone, A. Morton, and G. Ramachandran. Standardized active measurements on a tier 1 IP backbone. IEEE Communications, 41(6):90--97, June 2003.
[19]
R. Cole and J. Rosenbluth. Voice over IP Performance Monitoring. ACM SIGCOMM Computer Communcation Review, April 2001.
[20]
E. Corell, P. Saxholm, and D. Veitch. A user friendly TSC clock. In Proceedings of Passive and Active Measurement Conference, March 2006.
[21]
C. Demichelis and P. Chimento. IP packet delay variation metric for IP performance metrics (IPPM). IETF RFC 3393, November 2002.
[22]
N. Duffield. Network Tomography of Binary Network Performance Characteristics. IEEE Transactions on Information Theory, 52, 2006.
[23]
N. Duffield, F. Lo Presti, V. Paxson, and D. Towsley. Inferring link loss using striped unicast probes. In Proceedings of IEEE INFOCOM '01, April 2001.
[24]
Y. Liang, N. Farber, and B. Girod. Adaptive playout scheduling and loss concealment for voice communication over IP networks. IEEE Transactions on Multimedia, 5(4), December 2003.
[25]
F. Lo Presti, N. G. Duffield, J. Horowitz, and D. Towsley. Multicast-based inference of network-internal delay distributions. IEEE/ACM Transactions on Networking, 10(6):761--775, 2002.
[26]
J. Mahdavi and V. Paxson. IPPM metrics for measuring connectivity. IETF RFC 2678, September 1999.
[27]
J. Martin and A. Nilsson. On service level agreements for IP networks. In IEEE INFOCOM '02, 2002.
[28]
A. Pasztor and D. Veitch. A precision infrastructure for active probing. In Passive and Active Measurement Workshop, 2001.
[29]
V. Paxson. Measurements and Analysis of End-to-End Internet Dynamics. PhD thesis, University of California Berkeley, 1997.
[30]
V. Paxson, G. Almes, J. Mahdavi, and M. Mathis. Framework for IP performance metrics. IETF RFC 2330, 1998.
[31]
M. Roughan. Fundamental bounds on the accuracy of network performance measurements. In ACM SIGMETRICS, June 2005.
[32]
H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson. RTP: A transport protocol for real-time applications. IETF RFC 3550, July 2003.
[33]
A. Shaikh and A. Greenberg. Operations and Management of IP Networks: What Researchers Should Know. Tutorial Session, ACM SIGCOMM '05. August, 2005.
[34]
J. Sommers and P. Barford. Self-configuring network traffic generation. In Proceedings of ACM SIGCOMM Internet Measurement Conference '04, 2004.
[35]
J. Sommers, P. Barford, N. Duffield, and A. Ron. Improving accuracy in end-to-end packet loss measurement. In Proceedings of ACM SIGCOMM '05, 2005.
[36]
J. Sommers, P. Barford, N. Duffield, and A. Ron. A Framework for Multi-objective SLA Compliance Monitoring. In Proceedings of IEEE INFOCOM (minisymposium), May 2007.
[37]
J. Sommers, P. Barford, N. Duffield, and A. Ron. A geometric approach to improving active packet loss measurement. To appear, IEEE/ACM Transactions on Networking, 2008.
[38]
A. Tirumala, F. Qin, J. Dugan, J. Ferguson, and K. Gibbs. Iperf 1.7.0 - the TCP/UDP bandwidth measurement tool. http://dast.nlanr.net/Projects/Iperf. 2007.
[39]
Yolanda Tsang, Mark Coates, and Robert Nowak. Passive unicast network tomography using em algorithms. In IEEE International Conference on Acoustics, Speech, and Signal Processing, pages 1469--1472, Salt Lake City, Utah, May 2001.
[40]
M. Yajnik, S. Moon, J. Kurose, and D. Towsley. Measurement and modeling of temporal dependence in packet loss. In Proceedings of IEEE INFOCOM '99, March 1999.
[41]
Y. Zhang, N. Duffield, V. Paxson, and S. Shenker. On the constancy of Internet path properties. In Proceedings of ACM SIGCOMM Internet Measurement Workshop '01, November 2001.
[42]
T. Zseby. Deployment of sampling methods for SLA validation with non-intrusive measurements. In Proceedings of Passive and Active Measurement Workshop, 2001.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGCOMM '07: Proceedings of the 2007 conference on Applications, technologies, architectures, and protocols for computer communications
August 2007
432 pages
ISBN:9781595937131
DOI:10.1145/1282380
  • cover image ACM SIGCOMM Computer Communication Review
    ACM SIGCOMM Computer Communication Review  Volume 37, Issue 4
    October 2007
    420 pages
    ISSN:0146-4833
    DOI:10.1145/1282427
    Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 August 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. SLAm
  2. active measurement
  3. network congestion
  4. network delay
  5. network jitter
  6. packet loss
  7. service-level agreements

Qualifiers

  • Article

Conference

SIGCOMM07
Sponsor:
SIGCOMM07: ACM SIGCOMM 2007 Conference
August 27 - 31, 2007
Kyoto, Japan

Acceptance Rates

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)118
  • Downloads (Last 6 weeks)10
Reflects downloads up to 27 Dec 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media