panel

What is a Lightweight Kernel?

Authors:

Arthur Barney Maccabe,

David N. Lombard,

John Jack Lange,

Kevin Pedretti,

Robert W. Wisniewski,

Ron Brightwell,

Yutaka IshikawaAuthors Info & Claims

ROSS '15: Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers

Article No.: 9, Pages 1 - 8

https://doi.org/10.1145/2768405.2768414

Published: 16 June 2015 Publication History

Abstract

Lightweight kernels (LWK) have been in use on the compute nodes of supercomputers for decades. Although many high-end systems now run Linux, interest in options and alternatives has increased in the last couple of years. Future extreme-scale systems require rethinking of the operating system, and modern LWKs may well play a role in the final solution.

In the course of our research, it has become clear that no single definition for a lightweight kernel exists. This paper describes what we mean by the term and what makes LWKs different from other operating system kernels.

References

[1]

ZeptoOS: The small Linux for big computers. http://www.mcs.anl.gov/research/projects/zeptoos/.

[2]

Cray Linux Environment™ (CLE) 5.2 software release overview. http://docs.cray.com/books/S-2425-52xx/S-2425-52xx.pdf, Apr. 2014.

[3]

Abernathy, D. H., Mancino, J. S., Pearson, C. R., and Swiger, D. C. Survey of design goals for operating systems. SIGOPS Oper. Syst. Rev. 7, 2 (Apr. 1973), 29--48.

Digital Library

[4]

Akkan, H., Ionkov, L., and Lang, M. Transparently consistent asynchronous shared memory. In Proceedings of the 3rd International Workshop on Runtime and Operating Systems for Supercomputers (New York, NY, USA, 2013), ROSS '13, ACM.

Digital Library

[5]

Ali, N., Carns, P., Iskra, K., Kimpe, D., Lang, S., Latham, R., Ross, R., Ward, L., and Sadayappan, P. Scalable i/o forwarding framework for high-performance computing systems. In Cluster Computing and Workshops, 2009. CLUSTER '09. IEEE International Conference on (Aug 2009), pp. 1--10.

[6]

Ammons, G., Appavoo, J., Butrico, M., Da Silva, D., Grove, D., Kawachiya, K., Krieger, O., Rosenburg, B., Van Hensbergen, E., and Wisniewski, R. W. Libra: A library operating system for a JVM in a virtualized execution environment. In Proceedings of the 3rd International Conference on Virtual Execution Environments (New York, NY, USA, 2007), VEE '07, ACM, pp. 44--54.

Digital Library

[7]

Ferreira, K. B., Pedretti, K., Brightwell, R., Bridges, P. G., Fiala, D., and Mueller, F. Evaluating operating system vulnerability to memory errors. In Proceedings of the 2nd International Workshop on Runtime and Operating Systems for Supercomputers (New York, NY, USA, 2012), ROSS '12, ACM.

Digital Library

[8]

Gerofi, B., Shimada, A., Hori, A., and Ishikawa, Y. Partially separated page tables for efficient operating system assisted hierarchical memory management on heterogeneous architectures. In Cluster, Cloud and Grid Computing (CCGrid), 2013 13th IEEE/ACM International Symposium on (May 2013), pp. 360--368.

Digital Library

[9]

Gerofi, B., Shimada, A., Hori, A., Masamichi, T., and Ishikawa, Y. CMCP: A Novel Page Replacement Policy for System Level Hierarchical Memory Management on Many-cores. In Proceedings of the 23rd International Symposium on High-performance Parallel and Distributed Computing (New York, NY, USA, 2014), HPDC '14, ACM, pp. 73--84.

Digital Library

[10]

Gerofi, B., Takagi, M., Ishikawa, Y., Riesen, R., Powers, E., and Wisniewski, R. W. Exploring the design space of combining linux with lightweight kernels for extreme scale computing. In Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers (June 2015).

Digital Library

[11]

Giampapa, M., Gooding, T., Inglett, T., and Wisniewski, R. Experiences with a lightweight supercomputer kernel: Lessons learned from Blue Gene's CNK. In High Performance Computing, Networking, Storage and Analysis (SC), 2010 International Conference for (2010).

Digital Library

[12]

Greenberg, D. S., Maccabe, B., Riesen, R., Wheat, S., and Womble, D. Achieving high performance on the Intel Paragon. In Proceedings of the Intel Supercomputer Users' Group. 1993 Annual North America Users' Conference (Oct. 1993), pp. 203--208.

[13]

Kaplan, L. Cray CNL. FastOS PI Meeting and Workshop, June 2007.

[14]

Kelly, S., and Brightwell, R. Software architecture of the lightweight kernel, Catamount. In Cray Users' Group Annual Technical Conference (Albuquerque, New Mexico, June 2005).

[15]

Kocoloski, B., and Lange, J. HPMMAP: Lightweight memory management for commodity operating systems. In Proceedings of the 2014 IEEE 28th International Parallel and Distributed Processing Symposium (Washington, DC, USA, 2014), IPDPS '14, IEEE Computer Society, pp. 649--658.

Digital Library

[16]

Liedtke, J. On micro-kernel construction. SIGOPS Oper. Syst. Rev. 29, 5 (Dec. 1995), 237--250.

Digital Library

[17]

Maccabe, A. B., McCurley, K. S., Riesen, R., and Wheat, S. R. SUNMOS for the Intel Paragon: A brief user's guide. In Proceedings of the Intel Supercomputer Users' Group. 1994 Annual North America Users' Conference (June 1994), pp. 245--251.

[18]

Meuer, H., Strohmaier, E., Dongarra, J., and Simon, H. Top500: The list. http://www.top500.org, Nov. 2014.

[19]

Minnich, R. G., Sottile, M. J., Choi, S.-E., Hendriks, E., and McKie, J. Right-weight kernels: An off-the-shelf alternative to custom light-weight kernels. SIGOPS Oper. Syst. Rev. 40, 2 (Apr. 2006), 22--28.

Digital Library

[20]

Otstott, D., Evans, N., Ionkov, L., Zhao, M., and Lang, M. Enabling composite applications through an asynchronous shared memory interface. In 2014 IEEE International Conference on Big Data, Big Data 2014, Washington, DC, USA, October 27--30, 2014 (2014), pp. 219--224.

[21]

Ouyang, J., Kocoloski, B., Lange, J., and Pedretti, K. Achieving performance isolation with lighweight co-kernels. In Proceeding of the 24th International ACM Symposium on High Performance Distributed Computing (HPDC) (June 2015).

Digital Library

[22]

Park, Y., Van Hensbergen, E., Hillenbrand, M., Inglett, T., Rosenburg, B., Ryu, K. D., and Wisniewski, R. FusedOS: Fusing LWK Performance with FWK Functionality in a Heterogeneous Environment. In Computer Architecture and High Performance Computing (SBAC-PAD), 2012 IEEE 24th International Symposium on (Oct 2012), pp. 211--218.

Digital Library

[23]

Riesen, R., Brightwell, R., Bridges, P. G., Hudson, T., Maccabe, A. B., Widener, P. M., and Ferreira, K. Designing and implementing lightweight kernels for capability computing. Concurrency and Computation: Practice and Experience 21, 6 (Apr. 2009), 793--817.

Digital Library

[24]

Shimosawa, T., Gerofi, B., Takagi, M., Nakamura, G., Shirasawa, T., Saeki, Y., Shimizu, M., Hori, A., and Ishikawa, Y. Interface for heterogeneous kernels: A framework to enable hybrid OS designs targeting high performance computing on manycore architectures. In High Performance Computing (HiPC), 2014 21th International Conference on (Dec 2014), HiPC '14.

[25]

Shuler, L., Jong, C., Riesen, R., van Dresser, D., Maccabe, A. B., Fisk, L. A., and Stallcup, T. M. The Puma Operating System for Massively Parallel Computers. In Proceeding of the 1995 Intel Supercomputer User's Group Conference (1995), Intel Supercomputer User's Group.

[26]

Soma, Y., Gerofi, B., and Ishikawa, Y. Revisiting Virtual Memory for High Performance Computing on Manycore Architectures: A Hybrid Segmentation Kernel Approach. In Proceedings of the 4th International Workshop on Runtime and Operating Systems for Supercomputers (New York, NY, USA, 2014), ROSS '14, ACM.

Digital Library

[27]

Wheat, S. R., Maccabe, A. B., Riesen, R., van Dresser, D. W., and Stallcup, T. M. PUMA: An operating system for massively parallel systems. Scientific Programming 3 (1994), 275--288.

Digital Library

[28]

Wikipedia. Lightweight kernel operating system. http://en.wikipedia.org/wiki/Lightweight_Kernel_Operating_System, Feb. 2015.

[29]

Wisniewski, R. W., Inglett, T., Keppel, P., Murty, R., and Riesen, R. mOS: An architecture for extreme-scale operating systems. In Proceedings of the 4th International Workshop on Runtime and Operating Systems for Supercomputers (New York, NY, USA, 2014), ROSS '14, ACM, pp. 2:1--2:8.

Digital Library

Cited By

An ZLi DGuo YGao GRen YJia NHu X(2023)Towards OS Heterogeneity Aware Cluster Management for HPCProceedings of the 14th ACM SIGOPS Asia-Pacific Workshop on Systems10.1145/3609510.3609819(16-23)Online publication date: 24-Aug-2023
https://dl.acm.org/doi/10.1145/3609510.3609819
Gordon NPedretti KLange J(2022)Porting the Kitten Lightweight Kernel Operating System to RISC-V2022 IEEE/ACM International Workshop on Runtime and Operating Systems for Supercomputers (ROSS)10.1109/ROSS56639.2022.00008(1-7)Online publication date: Nov-2022
https://doi.org/10.1109/ROSS56639.2022.00008
Gerofi BTarumizu KZhang LOkamoto TTakagi MSumimoto SIshikawa Yde Supinski BHall MGamblin T(2021)Linux vs. lightweight multi-kernels for high performance computingProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3458817.3476162(1-13)Online publication date: 14-Nov-2021
https://dl.acm.org/doi/10.1145/3458817.3476162
Show More Cited By

Index Terms

What is a Lightweight Kernel?
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

Linux vs. lightweight multi-kernels for high performance computing: experiences at pre-exascale
SC '21: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis

The long standing consensus in the High-Performance Computing (HPC) Operating Systems (OS) community is that lightweight kernel (LWK) based OSes have the potential to outperform Linux at extreme scale. To explore if LWKs live up to their expectation we ...
Exploring the Design Space of Combining Linux with Lightweight Kernels for Extreme Scale Computing
ROSS '15: Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers

As systems sizes increase to exascale and beyond, there is a need to enhance the system software to meet the needs and challenges of applications. The evolutionary versus revolutionary debate can be set aside by providing system software that ...
A Multi-Kernel Survey for High-Performance Computing
ROSS '16: Proceedings of the 6th International Workshop on Runtime and Operating Systems for Supercomputers

In HPC, two trends have led to the emergence and popularity of an operating-system approach in which multiple kernels are run simultaneously on each compute node. The first trend has been the increase in complexity of the HPC software environment, which ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ROSS '15: Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers

June 2015

70 pages

ISBN:9781450336062

DOI:10.1145/2768405

Conference Chairs:
Torsten Hoefler
ETH Zurich, Switzerland
,
Kamil Iskra
Argonne National Laboratory

Copyright © 2015 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

SIGHPC: ACM Special Interest Group on High Performance Computing, Special Interest Group on High Performance Computing
ETH Zurich
SPCL: Scalable Parallel Computing Laboratory

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 June 2015

Check for updates

Author Tags

Qualifiers

Panel
Research
Refereed limited

Conference

ROSS '15

ROSS '15: International Workshop on Runtime and Operating Systems for Supercomputers

June 16, 2015

OR, Portland, USA

Acceptance Rates

ROSS '15 Paper Acceptance Rate 7 of 12 submissions, 58%;

Overall Acceptance Rate 58 of 169 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
350
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

An ZLi DGuo YGao GRen YJia NHu X(2023)Towards OS Heterogeneity Aware Cluster Management for HPCProceedings of the 14th ACM SIGOPS Asia-Pacific Workshop on Systems10.1145/3609510.3609819(16-23)Online publication date: 24-Aug-2023
https://dl.acm.org/doi/10.1145/3609510.3609819
Gordon NPedretti KLange J(2022)Porting the Kitten Lightweight Kernel Operating System to RISC-V2022 IEEE/ACM International Workshop on Runtime and Operating Systems for Supercomputers (ROSS)10.1109/ROSS56639.2022.00008(1-7)Online publication date: Nov-2022
https://doi.org/10.1109/ROSS56639.2022.00008
Gerofi BTarumizu KZhang LOkamoto TTakagi MSumimoto SIshikawa Yde Supinski BHall MGamblin T(2021)Linux vs. lightweight multi-kernels for high performance computingProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3458817.3476162(1-13)Online publication date: 14-Nov-2021
https://dl.acm.org/doi/10.1145/3458817.3476162
Song JAhn MLee GSeo EJeong J(2021)A Performance-Stable NUMA Management Scheme for Linux-Based HPC SystemsIEEE Access10.1109/ACCESS.2021.30699919(52987-53002)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3069991
Weinhold CLackorzynski ABierbaum JKüttler MPlaneta MWeisbach HHille MHärtig HMargolin ASharf DLevy EGak PBarak AGholami MSchintke FSchütt TReinefeld ALieber MNagel W(2020)FFMK: A Fast and Fault-Tolerant Microkernel-Based System for Exascale ComputingSoftware for Exascale Computing - SPPEXA 2016-201910.1007/978-3-030-47956-5_16(483-516)Online publication date: 31-Jul-2020
https://doi.org/10.1007/978-3-030-47956-5_16
Gerofi BSantogidis AMartinet DIshikawa YZhao MChandra ARamakrishnan L(2018)PicoDriverProceedings of the 27th International Symposium on High-Performance Parallel and Distributed Computing10.1145/3208040.3208060(2-13)Online publication date: 11-Jun-2018
https://dl.acm.org/doi/10.1145/3208040.3208060
Gerofi BRiesen RTakagi MBoku TNakajima KIshikawa YWisniewski R(2018)Performance and Scalability of Lightweight Multi-kernel Based Operating Systems2018 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS.2018.00022(116-125)Online publication date: May-2018
https://doi.org/10.1109/IPDPS.2018.00022
Weisbach HGerofi BKocoloski BHärtig HIshikawa Y(2018)Hardware Performance Variation: A Comparative Study Using Lightweight KernelsHigh Performance Computing10.1007/978-3-319-92040-5_13(246-265)Online publication date: 29-May-2018
https://doi.org/10.1007/978-3-319-92040-5_13
Yu JLiu GDong WLi XLiu YXu BLi YMa Q(2017)Further Exploit the Potential of I/O Forwarding by Employing File Striping2017 IEEE International Symposium on Parallel and Distributed Processing with Applications and 2017 IEEE International Conference on Ubiquitous Computing and Communications (ISPA/IUCC)10.1109/ISPA/IUCC.2017.00053(322-330)Online publication date: Dec-2017
https://doi.org/10.1109/ISPA/IUCC.2017.00053
Giceva JZellweger GAlonso GRosco T(2016)Customized OS support for data-processingProceedings of the 12th International Workshop on Data Management on New Hardware10.1145/2933349.2933351(1-6)Online publication date: 26-Jun-2016
https://dl.acm.org/doi/10.1145/2933349.2933351

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents