research-article

Exploiting idle CPU cores to improve file access performance

Authors:

Takanori Ueda,

Yu Hirate,

Hayato YamanaAuthors Info & Claims

ICUIMC '09: Proceedings of the 3rd International Conference on Ubiquitous Information Management and Communication

Pages 529 - 535

https://doi.org/10.1145/1516241.1516334

Published: 15 February 2009 Publication History

Get Access

Abstract

Many-core CPUs require many parallel computation tasks to reach their full potential because CPU cores become idle if they do not have enough computation tasks. How best to utilize a number of cores in many-core CPUs should be examined. In this paper, we propose exploitation of idle cores for improving file access performance. Idle cores are used to extract file access patterns from access logs and the extracted patterns are used to improve file cache efficiency by reordering the LRU (Least Recently Used) list based on the extracted patterns. Data mining techniques are used to extract access patterns to reduce computation overhead. Our method was evaluated by simulation and also implemented on Linux kernel 2.6.26 as a prototype system. In the simulation experiment, our method improved the cache-hit ratio up to 1.09% on DBT-2 (TPC-C) trace logs. Our prototype implementation on Linux improves DBT-2 performance up to 5.24% on a real machine.

References

[1]

D. P. Bovet and M. Cesati, Understanding the Linux Kernel, Third Edition, O'Reilly, Nov. 2005.

Digital Library

Google Scholar

[2]

G. A. S. Whittle, J. F. Pâris, A. Amer, D. D. E. Long and R. Burns, "Using Multiple Predictors to Improve the Accuracy of File Access Predictions," In Proc. of the 20th IEEE/11th NASA Goddard Conf. on Mass Storage Systems and Technologies (MSS), pp.230--240, San Diego, US-CA, Apr. 2003.

Digital Library

Google Scholar

[3]

J. Griffioen and R. Appleton, "Reducing File System Latency using a Predictive Approach," In Proc. of the USENIX Summer 1994 Tech. Conf., Boston, US-MA, Jun. 1994.

Digital Library

Google Scholar

[4]

J. Matthews, S. Trika, D. Hensgen, R. Coulson and K. Grimsrud, "Intel Turbo Memory: Nonvolatile Disk Caches in the Storage Hierarchy of Mainstream Computer Systems," ACM Trans. on Storage, vol.4, no.2, article 4, May. 2008.

Digital Library

Google Scholar

[5]

L. Yu, G. Chen and J. Dong, "Mining Infrequently-Accessed File Correlations in Distributed File System," In Proc. of the Joint Conf. of the 9th Asia-Pacific Web Conf. and the 8th Int'l Conf. on Web-Age Information Management (APWeb/WAIM), pp.630--641, Huang Shan, China, Jun. 2007.

Digital Library

Google Scholar

[6]

S. W. Schlosser, J. Schindler, S. Papadomanolakis, M. Shao, A. Ailamaki, C. Faloutsos and G. R. Ganger, "On multidimensional data and modern disks," In Proc. of the 4th USENIX Conf. on File and Storage Technologies (FAST'05).

Digital Library

Google Scholar

[7]

T. Johnson and D. Shasha, "2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm," In Proc. of the 20th Int'l Conf. on Very Large Data Bases (VLDB), pp.439--450, Santiago, Chile, Sep. 1994.

Digital Library

Google Scholar

[8]

V. Vellanki and A. L. Chervenak, "A Cost-Benefit Scheme for High Performance Predictive Prefetching," In Proc. of the 1999 ACM/IEEE Conf. on Supercomputing (SC), Portland, US-OR, Nov. 1999.

Digital Library

Google Scholar

[9]

X. Ding, S. Jiang and F. Chen, "A Buffer Cache Management Scheme Exploiting Both Temporal and Spatial Localities," ACM Trans. on Storage, vol.3, no.2, article 5, Jun. 2007.

Digital Library

Google Scholar

[10]

X. Yan, J. Han and R. Afshar, "CloSpan: Mining closed sequential patterns in large datasets," In Proc. of the 2003 SIAM Int'l Conf. Data Mining (SDM'03), San Francisco, US-CA, May 2003.

Google Scholar

[11]

Y. Won, H. Chang, J. RYU, Y. Kim and J. Shim, "Intelligent Storage: Cross-Layer Optimization for Soft Real-Time Workload," ACM Trans. on Storage, vol.2, no.3, pp.255--282, Aug. 2006.

Digital Library

Google Scholar

[12]

Z. LI, Z. Chen and Y. Zhou, "Mining Block Correlations to Improve Storage Performance," ACM Trans. on Storage, vol.1, no.2, pp.213--245, May 2005.

Digital Library

Google Scholar

[13]

Database Test Suite, http://osdldbt.sourceforge.net/.

Google Scholar

[14]

Transaction Processing Performance Council, http://www.tpc.org/.

Google Scholar

Cited By

View all

Saad MGançarski S(2012)Archiving the web using page changes patternsInternational Journal on Digital Libraries10.1007/s00799-012-0094-z13:1(33-49)Online publication date: 1-Dec-2012
https://dl.acm.org/doi/10.1007/s00799-012-0094-z
Ben Saad MGançarski SNewton GWright MCassel L(2011)Archiving the web using page changes patternsProceedings of the 11th annual international ACM/IEEE joint conference on Digital libraries10.1145/1998076.1998098(113-122)Online publication date: 13-Jun-2011
https://dl.acm.org/doi/10.1145/1998076.1998098
Ueda THirate YYamana H(2009)The Challenge of Eliminating Storage Bottlenecks in Distributed SystemsProceedings of the 2009 Software Technologies for Future Dependable Distributed Systems10.1109/STFSSD.2009.46(49-53)Online publication date: 17-Mar-2009
https://dl.acm.org/doi/10.1109/STFSSD.2009.46
Show More Cited By

Index Terms

Exploiting idle CPU cores to improve file access performance
1. Information systems
  1. Information storage systems
    1. Storage management
      1. Hierarchical storage management
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Memory management
        Secondary storage

Recommendations

The Challenge of Eliminating Storage Bottlenecks in Distributed Systems
STFSSD '09: Proceedings of the 2009 Software Technologies for Future Dependable Distributed Systems

One of the most difficult problems in distributed systems is load-balancing. Even if we take care of load-balancing, heavily-loaded nodes often occur while there are still lightly-loaded nodes that have idle memory and idle CPU power. Our idea is to ...
Improving Networked File System Performance Using a Locality-Aware Cooperative Cache Protocol

In a distributed environment, the utilization of file buffer caches in different clients may greatly vary. Cooperative caching has been proposed to increase cache utilization by coordinating the shared usage of distributed caches. It allows clients that ...
The performance impact of kernel prefetching on buffer cache replacement algorithms
Performance evaluation review

A fundamental challenge in improving the file system performance is to design effective block replacement algorithms to minimize buffer cache misses. Despite the well-known interactions between prefetching and caching, almost all buffer cache ...

Comments

Information & Contributors

Information

Published In

ICUIMC '09: Proceedings of the 3rd International Conference on Ubiquitous Information Management and Communication

February 2009

704 pages

ISBN:9781605584058

DOI:10.1145/1516241

General Chairs:
Won Kim
Sungkyunkwan University, Korea
,
Hyung Jin Choi
Sungkyunkwan University, Korea
,
Dongho Won
SungKyunkwan University, Korea

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 February 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Waseda University

Conference

ICUIMC '09

Sponsor:

SIGKDD

ICUIMC '09: The 3rd International Conference on Ubiquitous Information Management and Communication

January 15 - 16, 2009

Suwon, Korea

Acceptance Rates

Overall Acceptance Rate 251 of 941 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
192
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Saad MGançarski S(2012)Archiving the web using page changes patternsInternational Journal on Digital Libraries10.1007/s00799-012-0094-z13:1(33-49)Online publication date: 1-Dec-2012
https://dl.acm.org/doi/10.1007/s00799-012-0094-z
Ben Saad MGançarski SNewton GWright MCassel L(2011)Archiving the web using page changes patternsProceedings of the 11th annual international ACM/IEEE joint conference on Digital libraries10.1145/1998076.1998098(113-122)Online publication date: 13-Jun-2011
https://dl.acm.org/doi/10.1145/1998076.1998098
Ueda THirate YYamana H(2009)The Challenge of Eliminating Storage Bottlenecks in Distributed SystemsProceedings of the 2009 Software Technologies for Future Dependable Distributed Systems10.1109/STFSSD.2009.46(49-53)Online publication date: 17-Mar-2009
https://dl.acm.org/doi/10.1109/STFSSD.2009.46
Akioka SIkeda JUeda TOhno YSugaya MHirate YKatto JGoto SMuraoka YYamana HNakajima T(2009)A Scalable Monitoring System for Distributed EnvironmentsProceedings of the 2009 Software Technologies for Future Dependable Distributed Systems10.1109/STFSSD.2009.43(32-37)Online publication date: 17-Mar-2009
https://dl.acm.org/doi/10.1109/STFSSD.2009.43

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

The Challenge of Eliminating Storage Bottlenecks in Distributed Systems

Improving Networked File System Performance Using a Locality-Aware Cooperative Cache Protocol

The performance impact of kernel prefetching on buffer cache replacement algorithms

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

The Challenge of Eliminating Storage Bottlenecks in Distributed Systems

Improving Networked File System Performance Using a Locality-Aware Cooperative Cache Protocol

The performance impact of kernel prefetching on buffer cache replacement algorithms

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations