skip to main content
research-article

Memory Management for User-Level Network Interfaces

Published: 01 March 1998 Publication History

Abstract

With user-level network interfaces applications can access the network directly without operating system intervention on every send and receive. Messages are transferred to and from user-space by the network interface while observing the traditional protection boundaries between processes. First generation user-level network interfaces limit this message transfer to a per-process region of permanently-pinned physical memory to allow safe DMA. This approach is inflexible and does not scale to a large number of processes. A new memory management extension to the U-Net user-level network architecture allows messages to be transferred directly to and from any part of an application's address space. This is achieved by integrating a translation look-aside buffer into the network interface and coordinating its operation with the operating system's virtual memory subsystem. Two implementations demonstrate that existing commodity hardware and commercial operating systems can efficiently support the architecture.

References

[1]
B.S. Ang, et al., "Message Passing Support on StarT-Voyager," CSG Memo 387, MIT Laboratory for Computer Science, Cambridge, Mass., July 1996.
[2]
J. Beecroft M. Homewood and M. McLaren, "Meiko CS-2 Interconnect Elan-Elite Design," Parallel Computing, Vol. 20, No. 10-11, Elsevier Science, Amsterdam, 1994, pp. 1627-1638.
[3]
M. Blumrich, et al., "Virtual Memory Mapped Network Interfaces," IEEE Micro, Vol. 15, No. 1, Feb. 1995, pp. 21-28.
[4]
W.J. Dally, et al., "The Message-Driven Processor: A Multicomputer Processing Node with Efficient Mechanisms," IEEE Micro, Vol. 12, No. 2, Apr. 1993, pp. 23-39.
[5]
C. Dubnicki, et al., "Shrimp Project Update: Myrinet Communication," IEEE Micro, Vol. 18, No. 1, Jan.-Feb. 1998, pp. 50-52.
[6]
J. Kuskin, et al., "The Stanford FLASH Multiprocessor," Proc. 21st Ann. Int'l Symp. Computer Architecture, IEEE CS Press, Apr. 1994, pp. 302-313.
[7]
B.N. Chun A.M. Mainwaring and D.E. Culler, "Virtual Network Transport Protocols for Myrinet," IEEE Micro, Vol. 18, No. 1, Jan.-Feb. 1998, pp. 53-63.
[8]
S. Pakin M. Lauria and A. Chien, "High Performance Messaging on Workstations: Illinois Fast Messages (FM) for Myrinet," Proc. Supercomputing 95, IEEE CS Press, 1995.
[9]
T. von Eicken, et al., "U-Net: A User-level Network Interface for Parallel and Distributed Computing," Proc. 15th ACM Symp. Operating Systems Principles, Operating System Review, Vol. 29, No. 5, ACM Press, N.Y., 1995, pp. 40-53.
[10]
T. von Eicken, et al., "Active Messages: A Mechanism for Integrated Communication and Computation," Proc. 19th Ann. Int'l Symp. Computer Architecture, IEEE CS Press, May 1992, pp. 256-266.
[11]
Compaq Computer Corp., Intel Corporation, and Microsoft Corporation, "Virtual Interface Architecture Specification, Version 1.0," Dec. 16, 1997, http://www.viarch.org/.
[12]
S.K. Reinhardt J.R. Larus and D.A. Wood, "Typhoon and Tempest: User-Level Shared Memory," Proc. 21st Ann. Int'l Symp. Computer Architecture, IEEE CS Press, Apr. 1994, pp. 325-336.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image IEEE Micro
IEEE Micro  Volume 18, Issue 2
March 1998
79 pages

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 01 March 1998

Author Tags

  1. Network architecutre
  2. U-Net
  3. memory management
  4. network interfaces

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 21 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media