Article

Free access

Enabling Network Measurement Portability Through a Hierarchy of Characteristics

Authors:

Bruce B. Lowekamp,

Richard Hughes-Jones,

Thilo Kielmann,

Martin SwanyAuthors Info & Claims

GRID '03: Proceedings of the 4th International Workshop on Grid Computing

Page 68

Published: 17 November 2003 Publication History

Abstract

Measurement and prediction of network resources arecrucial so that adaptive applications can make use of Gridenvironments. Although a large number of systems andtools have been developed to provide such measurementservices, the diversity of Grid resources and lack of central control prevent the development of a single monitoringsystem that can be deployed to answer every application'sresource queries for connections between any pair of machines it can use. We propose a standard for representingnetwork entities and measurements of their properties. Ourstandard enables the exchange of measurements and willallow applications to function even in environments without the particular measurement system for which they weredeveloped. We present an overview of our measurementrepresentation and evaluate its usefulness. We have usedthe characteristics hierarchy to store and exchange measurement data between several systems, and we discuss itsusefulness in comparing the output of several measurementtools.

References

[1]

G. Allen, K. Davis, K. N. Dolkas, N. D. Doulamis, T. Goodale, T. Kielmann, A. Merzky, J. Nabrzyski, J. Pukacki, T. Radke, M. Russell, E. Seidel, J. Shalf, and I. Taylor. Enabling Applications on the Grid: A GridLab Overview. International Journal of High Performance Computing Applications, 2003.

Digital Library

[2]

Y. Breitbart, M. Garofalakis, C. Martin, R. Rastogi, S. Seshadri, and A. Silberschatz. Topology discovery in heterogeneous IP networks. In INFOCOM 2000, March 2000.

[3]

M. Coates, A. O. H. III, R. Nowak, and B. Yu. Internet tomography. IEEE Signal Processing Magazine, 19(3):47- 65, May 2002.

[4]

R. L. Cottrell and C. Logg. A new high performance network and application monitoring infrastructure. Technical Report SLAC-PUB-9202, SLAC, 2002.

[5]

R. L. Cottrell and C. Logg. Experiences and results from a new high performance network and application monitoring toolkit. In PAM2003, 2003. SLAC-PUB-9560.

[6]

R. L. Cottrell and M. Shah. Measuring rtt by using syn/acks instead of pings. http://www-iepm.slac.stanford.edu/monitoring/limit/limiting.html#synack, December 1999.

[7]

M. den Burger, T. Kielmann, and H. E. Bal. TopoMon: A monitoring tool for grid network topology. In International Conference on Computational Science (2), pages 558-567, 2002.

Digital Library

[8]

R. Govindan and H. Tangmunarunkit. Heuristics for internet map discovery. In IEEE INFOCOM 2000, Tel Aviv, Israel, March 2000.

[9]

R. Hughes-Jones, S. Dallison, G. Fairey, P. Clarke, and I. Bridge. Performance Measurements on Gigabit Ethernet NICs and Server Quality Motherboards. In PFLDnet 2003, 2003. http://datatag.web.cern.ch/datatag/pfldnet2003/.

[10]

Internet2 end-to-end performance initiative. http://www.internet2.edu/e2eperf/.

[11]

S. Jamin, C. Jin, Y. Jin, D. Raz, Y. Shavitt, and L. Zhang. On the placement of internet instrumentation. In IEEE INFOCOM 2000, Tel Aviv, Israel, March 2000.

[12]

J. Lee, D. Gunter, M. Stoufer, and B. Tierney. Monitoring data archives for grid environments. In IEEE Supercomputing 2002 Conference, 2002.

Digital Library

[13]

B. B. Lowekamp, N. Miller, R. Karrer, T. Gross, and P. Steenkiste. Design, implementation, and evaluation of the remos network monitoring system. Journal of Grid Computing , 1(1), 2003.

[14]

B. B. Lowekamp, D. R. O'Hallaron, and T. Gross. Topology discovery for large ethernet networks. In SIGCOMM 2001. ACM, August 2001.

Digital Library

[15]

B. B. Lowekamp, B. Tierney, R. L. Cottrell, R. Hughes-Jones, T. Kielmann, and M. Swany. A hierarchy of network measurements for grid applications and services. Draft-GGF-NMWG-Hierarchy, 2003. http://forge.gridforum.org/projects/nm-wg/.

[16]

W. Matthews and R. L. Cottrell. The pinger project: Active internet performance monitoring. IEEE Communications Magazine, pages 130-137, May 2000.

Digital Library

[17]

Network Measurements Working Group. Schema/profile for network performance measurements for grids. http:// www-didc.lbl.gov/NMWG/NMWG-profile.html.

[18]

V. N. Padmanabhan and L. Subramanian. An investigation of geographic mapping techniques for internet hosts. In ACM SIGCOMM 2001, pages 173-185, 2001.

Digital Library

[19]

V. Paxson, G. Almes, J. Mahdavi, and M. Mathis. Framework for IP performance metrics. RFC2330, May 1998.

Digital Library

[20]

R. Schoonderwoerd. Network Performance Measurement Tools - a Comprehensive Comparison. M.Sc. Thesis, Vrije Universiteit, Amsterdam, November 2002. available from http://www.cs.vu.nl/albatross, summary results available at: http://www-didc.lbl. gov/NMWG/NM-WG-tools.html.

[21]

G. Shao, F. Berman, and R. Wolski. Using effective network views to promote distributed application performance. In International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'99), 1999.

[22]

M. Swany and R. Wolski. Multivariate resource performance forecasting in the network weather service. In SC02, Baltimore, MD, November 2002.

Digital Library

[23]

M. Swany and R. Wolski. Representing dynamic performance information in grid environments with the network weather service. 2nd IEEE International Symposium on Cluster Computing and the Grid, May 2002.

Digital Library

[24]

W. Theilmann and K. Rothermel. Dynamic distance maps of the internet. In IEEE INFOCOM 2000, Tel Aviv, Israel, March 2000.

[25]

B. Tierney, W. Johnston, B. Crowley, G. Hoo, C. Brooks, and D. Gunter. The netlogger methodology for high performance distributed systems performance analysis. In Seventh IEEE International Symposium on High Performance Distributed Computing (HPDC 7), pages 260-267, 1998.

Digital Library

[26]

R. Wolski. Dynamically forecasting network performance using the network weather service. Cluster Computing, 1:119-132, January 1998.

Digital Library

Cited By

Taesombut NChien AVerastegui B(2007)Evaluating network information models on resource efficiency and application performance in lambda-gridsProceedings of the 2007 ACM/IEEE conference on Supercomputing10.1145/1362622.1362632(1-12)Online publication date: 16-Nov-2007
https://dl.acm.org/doi/10.1145/1362622.1362632
Shirai TSaito HTaura KKesselman CDongarra JWalker D(2007)A fast topology inferenceProceedings of the 16th international symposium on High performance distributed computing10.1145/1272366.1272369(11-22)Online publication date: 25-Jun-2007
https://dl.acm.org/doi/10.1145/1272366.1272369
Lacour SPerez CPriol T(2004)A Network Topology Description Model for Grid Application DeploymentProceedings of the 5th IEEE/ACM International Workshop on Grid Computing10.1109/GRID.2004.2(61-68)Online publication date: 8-Nov-2004
https://dl.acm.org/doi/10.1109/GRID.2004.2

Index Terms

Enabling Network Measurement Portability Through a Hierarchy of Characteristics
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Process management
        Multiprocessing / multiprogramming / multitasking
        Scheduling
    2. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

Controlling the cost and increasing the utility of network measurement infrastructures
Unified architecture for network measurement: The case of available bandwidth

In the field of network monitoring and measurement, the efficiency and accuracy of the adopted tools is strongly dependent on (i) structural and dynamic characteristics of the network scenario under measurement and (ii) on manual fine tuning of the ...
Railway sleeper vibration measurement by train‐borne laser Doppler vibrometer and its speed‐dependent characteristics
Abstract
A train‐borne laser Doppler vibrometer (LDV) directly measures the dynamic response of railway track components from a moving train, which has the potential to complement existing train‐borne technologies for railway track monitoring. This paper ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

GRID '03: Proceedings of the 4th International Workshop on Grid Computing

November 2003

205 pages

ISBN:076952026X

Copyright © Copyright (c) 2003 Institute of Electrical and Electronics Engineers, Inc. All rights reserved.

Publisher

IEEE Computer Society

United States

Publication History

Published: 17 November 2003

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
85
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)3

Reflects downloads up to 04 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Taesombut NChien AVerastegui B(2007)Evaluating network information models on resource efficiency and application performance in lambda-gridsProceedings of the 2007 ACM/IEEE conference on Supercomputing10.1145/1362622.1362632(1-12)Online publication date: 16-Nov-2007
https://dl.acm.org/doi/10.1145/1362622.1362632
Shirai TSaito HTaura KKesselman CDongarra JWalker D(2007)A fast topology inferenceProceedings of the 16th international symposium on High performance distributed computing10.1145/1272366.1272369(11-22)Online publication date: 25-Jun-2007
https://dl.acm.org/doi/10.1145/1272366.1272369
Lacour SPerez CPriol T(2004)A Network Topology Description Model for Grid Application DeploymentProceedings of the 5th IEEE/ACM International Workshop on Grid Computing10.1109/GRID.2004.2(61-68)Online publication date: 8-Nov-2004
https://dl.acm.org/doi/10.1109/GRID.2004.2

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents