skip to main content
article

Multiobjective monitoring for SLA compliance

Published: 01 April 2010 Publication History

Abstract

Service level agreements (SLAs) define performance guarantees made by service providers, e.g., in terms of packet loss, delay, delay variation, and network availability. In this paper, we describe a new active measurement methodology to accurately monitor whether measured network path characteristics are in compliance with performance targets specified in SLAs. Specifically, we: 1) introduce a new methodology for measuring mean delay along a path that improves accuracy over existing methodologies, and a method for obtaining confidence intervals on quantiles of the empirical delay distribution without making any assumption about the true distribution of delay; 2) introduce a new methodology for measuring delay variation that is more robust than prior techniques; 3) describe a new methodology for estimating packet loss rate that significantly improves accuracy over existing approaches; and 4) extend existing work in network performance tomography to infer lower bounds on the quantiles of a distribution of performance measures along an unmeasured path given measurements from a subset of paths. Active measurements for these metrics are unified in a discrete time-based tool called SLAM. The unified probe stream from SLAM consumes lower overall bandwidth than if individual streams are used to measure path properties. We demonstrate the accuracy and convergence properties of SLAM in a controlled laboratory environment using a range of background traffic scenarios and in one- and two-hop settings, and examine its accuracy improvements over existing standard techniques.

References

[1]
AT&T Managed Internet Service (MIS), 2007 {Online}. Available: http://new.serviceguide.att.com/mis.htm
[2]
"NTT communications global IP network service level agreement (SLA)," 2007 {Online}. Available: http://www.us.ntt.net/support/ sla/network/
[3]
"Sprint NEXTEL service level agreements," 2007 {Online}. Available: http://www.sprint.com/business/support/serviceLevelAgreements.jsp
[4]
S. Agarwal, J. Sommers, and P. Barford, "Scalable network path emulation," in Proc. IEEE MASCOTS, Sep. 2005, pp. 219-228.
[5]
M. Aida, N. Miyoshi, and K. Ishibashi, "A scalable and lightweight QoS monitoring technique combining passive and active approaches," in Proc. IEEE INFOCOM, Mar. 2003, vol. 1, pp. 125-133.
[6]
G. Almes, S. Kalidindi, and M. Zekauskas, "A one-way delay metric for IPPM," IETF, RFC 2679, Sep. 1999.
[7]
G. Almes, S. Kalidindi, and M. Zekauskas, "A one way packet loss metric for IPPM," IETF, RFC 2680, Sep. 1999.
[8]
D. Arifler,G. deVeciana, and B. L. Evans, "Network tomography based on flow level measurements," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., May 17-21, 2004, vol. 2, pp. 437-440.
[9]
P. Barford and J. Sommers, "Comparing probe- and router-based packet loss measurements," IEEE Internet Comput., vol. 8, no. 5, pp. 50-56, Sep./Oct. 2004.
[10]
J. Bolot, "End-to-end packet delay and loss behavior in the Internet," in Proc. ACM SIGCOMM, Sep. 1993, pp. 289-298.
[11]
R. L. Burden and J. D. Faires, Numerical Analysis, 8th ed. New York: Brooks-Cole, 2004.
[12]
R. Cáceres, N. Duffield, J. Horowitz, and D. Towsley, "Multicast-based inference of network internal loss characteristics," IEEE Trans. Inf. Theory, vol. 45, no. 7, pp. 2462-2480, Nov. 1999.
[13]
M. C. Chan, Y. J. Lin, and X. Wang, "A scalable monitoring approach for service level agreements validation," in Proc. IEEE ICNP, 2000, pp. 37-48.
[14]
Y. Chen, D. Bindel, and R. Katz, "Tomography-based overlay network monitoring," in Proc. ACMSIGCOMM Internet Meas. Conf., Oct. 2003, pp. 216-231.
[15]
Y. Chen, D. Bindel, H. Song, and R. H. Katz, "An algebraic approach to practical and scalable overlay network monitoring," in Proc. ACM SIGCOMM, 2004, pp. 55-66.
[16]
B. Y. Choi, S. Moon, R. Cruz, Z.-L. Zhang, and C. Diot, "Practical delay monitoring for ISPs," in Proc. ACM CoNEXT, 2005, pp. 83-92.
[17]
D. B. Chua, E. D. Kolaczyk, and M. Crovella, "Efficient monitoring of end-to-end network properties," in Proc. IEEE INFOCOM, 2005, pp. 1701-1711.
[18]
L. Ciavattone, A. Morton, and G. Ramachandran, "Standardized active measurements on a tier 1 IP backbone," IEEE Commun., vol. 41, no. 6, pp. 90-97, Jun. 2003.
[19]
R. Cole and J. Rosenbluth, "Voice over IP performance monitoring," ACM SIGCOMM Comput. Commun. Rev., vol. 31, no. 2, pp. 9-24, Apr. 2001.
[20]
E. Corell, P. Saxholm, and D. Veitch, "A user friendly TSC clock," in Proc. Passive Active Meas. Conf., Mar. 2006, pp. 141-150.
[21]
C. Demichelis and P. Chimento, "IP packet delay variation metric for IP performance metrics (IPPM)," IETF, RFC 3393, Nov. 2002.
[22]
N. Duffield, "Network tomography of binary network performance characteristics," IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5373-5388, Dec. 2006.
[23]
N. Duffield, F. Lo Presti, V. Paxson, and D. Towsley, "Inferring link loss using striped unicast probes," in Proc. IEEE INFOCOM, Apr. 2001, vol. 2, pp. 915-923.
[24]
J. Sommers, P. Barford, N. Duffield, and A. Ron, "Accurate and efficient SLA compliance monitoring," in Proc. ACM SIGCOMM, Aug. 2007, pp. 109-120.
[25]
Y. Liang, N. Farber, and B. Girod, "Adaptive playout scheduling and loss concealment for voice communication over IP networks," IEEE Trans. Multimedia, vol. 5, no. 4, pp. 532-543, Dec. 2003.
[26]
F. Lo Presti, N. G. Duffield, J. Horowitz, and D. Towsley, "Multicast-based inference of network-internal delay distributions," IEEE/ACM Trans. Netw., vol. 10, no. 6, pp. 761-775, Dec. 2002.
[27]
J. Mahdavi and V. Paxson, "IPPM metrics for measuring connectivity," IETF, RFC 2678, Sep. 1999.
[28]
J. Martin and A. Nilsson, "On service level agreements for IP networks," in Proc. IEEE INFOCOM, 2002, vol. 2, pp. 855-863.
[29]
A. Pasztor and D. Veitch, "A precision infrastructure for active probing," in Proc. Passive Active Meas. Workshop, 2001, pp. 33-44.
[30]
V. Paxson, "Measurements and analysis of end-to-end internet dynamics," Ph.D. dissertation, Univ. Calif., Berkeley, CA, 1997.
[31]
V. Paxson, G. Almes, J. Mahdavi, and M. Mathis, "Framework for IP performance metrics," IETF, RFC 2330, 1998.
[32]
M. Roughan, "Fundamental bounds on the accuracy of network performance measurements," in Proc. ACM SIGMETRICS, Jun. 2005, pp. 253-264.
[33]
H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson, "RTP: A transport protocol for real-time applications," IETF, RFC 3550, Jul. 2003.
[34]
A. Shaikh and A. Greenberg, "Operations and management of IP networks: What researchers should know," presented at the ACM SIGCOMM Tutorial Session, Aug. 2005.
[35]
J. Sommers and P. Barford, "Self-configuring network traffic generation," in Proc. ACM SIGCOMM Internet Meas. Conf., 2004, pp. 68-81.
[36]
J. Sommers and P. Barford, "An active measurement system for shared environments," in Proc. ACM SIGCOMM Internet Meas. Conf., Oct. 2007, pp. 303-314.
[37]
J. Sommers, P. Barford, N. Duffield, and A. Ron, "Improving accuracy in end-to-end packet loss measurement," in Proc. ACM SIGCOMM, 2005, pp. 157-168.
[38]
J. Sommers, P. Barford, N. Duffield, and A. Ron, "A geometric approach to improving active packet loss measurement," IEEE/ACM Trans. Netw., vol. 16, no. 2, pp. 307-320, Apr. 2008.
[39]
J. Sommers, P. Barford, N. Duffield, and A. Ron, "Multi-objective monitoring for SLA compliance," Colgate Univ., Hamilton, NY, Tech. Rep., 2008.
[40]
A. Tirumala, F. Qin, J. Dugan, J. Ferguson, and K. Gibbs, "Iperf 1.7.0--The TCP/UDP bandwidth measurement tool," 2007 {Online}. Available: http://dast.nlanr.net/Projects/Iperf
[41]
Y. Tsang, M. Coates, and R. Nowak, "Passive unicast network tomography using em algorithms," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., May 2001, pp. 1469-1472.
[42]
M. Yajnik, S. Moon, J. Kurose, and D. Towsley, "Measurement and modeling of temporal dependence in packet loss," in Proc. IEEE INFOCOM, Mar. 1999.
[43]
Y. Zhang, N. Duffield, V. Paxson, and S. Shenker, "On the constancy of Internet path properties," in Proc. ACM SIGCOMM Internet Meas. Workshop, Nov. 2001, pp. 197-211.
[44]
T. Zseby, "Deployment of sampling methods for SLA validation with non-intrusive measurements," in Proc. Passive Active Meas.Workshop, 2001, pp. 25-26.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image IEEE/ACM Transactions on Networking
IEEE/ACM Transactions on Networking  Volume 18, Issue 2
April 2010
339 pages

Publisher

IEEE Press

Publication History

Published: 01 April 2010
Revised: 24 December 2008
Received: 06 March 2008
Published in TON Volume 18, Issue 2

Author Tags

  1. SLAM
  2. active measurement
  3. network congestion
  4. network delay
  5. network jitter
  6. packet loss
  7. service level agreements (SLAs)

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 27 Dec 2024

Other Metrics

Citations

Cited By

View all

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media