research-article

Workload Characterization and Performance Implications of Large-Scale Blog Servers

Authors:

Myeongjae Jeon,

Euiseong SeoAuthors Info & Claims

ACM Transactions on the Web (TWEB), Volume 6, Issue 4

Article No.: 16, Pages 1 - 26

https://doi.org/10.1145/2382616.2382619

Published: 01 November 2012 Publication History

Abstract

With the ever-increasing popularity of Social Network Services (SNSs), an understanding of the characteristics of these services and their effects on the behavior of their host servers is critical. However, there has been a lack of research on the workload characterization of servers running SNS applications such as blog services. To fill this void, we empirically characterized real-world Web server logs collected from one of the largest South Korean blog hosting sites for 12 consecutive days. The logs consist of more than 96 million HTTP requests and 4.7TB of network traffic. Our analysis reveals the following: (i) The transfer size of nonmultimedia files and blog articles can be modeled using a truncated Pareto distribution and a log-normal distribution, respectively; (ii) user access for blog articles does not show temporal locality, but is strongly biased towards those posted with image or audio files. We additionally discuss the potential performance improvement through clustering of small files on a blog page into contiguous disk blocks, which benefits from the observed file access patterns. Trace-driven simulations show that, on average, the suggested approach achieves 60.6% better system throughput and reduces the processing time for file access by 30.8% compared to the best performance of the Ext4 filesystem.

References

[1]

Aban, I. B., Meerschaert, M. M., and Panorska, A. K. 2006. Parameter estimation for the truncated pareto distribution. J. Amer. Statist. Assoc. 101, 473, 270--277.

[2]

Arlitt, M. F. and Jin, T. 2000. A workload characterization study of the 1998 world cup web site. IEEE Netw. 14, 3, 33--37.

Digital Library

[3]

Arlitt, M. F. and Williamson, C. L. 1997. Internet web servers: Workload characterization and performance implications. IEEE/ACM Trans. Netw. 5, 5, 631--645.

Digital Library

[4]

Barford, P. and Crovella, M. 1999. A performance evaluation of hyper text transfer protocols. SIGMETRICS Perform. Eval. Rev. 27, 1, 188--197.

Digital Library

[5]

Bent, L., Rabinovich, M., Voelker, G. M., and Xiao, Z. 2004. Characterization of a large web site population with implications for content delivery. In Proceedings of the 13th International World Wide Web Conference.

Digital Library

[6]

Borghol, Y., Mitra, S., Ardon, S., Carlsson, N., Eager, D., and Mahanti, A. 2011. Characterizing and modeling popularity of user-generated videos. Perform. Eval. 68, 11, 1037--1055.

Digital Library

[7]

Bucy, J. S., Schindler, J., Schlosser, S. W., and Ganger, G. R. 2008. The disksim simulation environment version 4.0 reference manual. Tech. rep. CMU-PDL-08-101, Carnegie Mellon University.

[8]

Burke, M., Marlow, C., and Lento, T. 2009. Feed me: Motivating newcomer contribution in social network sites. In Proceedings of the 27th ACM CHI Conference on Human Factors in Computing Systems.

Digital Library

[9]

Cha, M., Mislove, A., and Gummadi, K. P. 2009. A measurement-driven analysis of information propagation in the flickr social network. In Proceedings of the 18th International Conference on World Wide Web.

Digital Library

[10]

Challenger, J. 1996. A distributed web server and its performance analysis on multiple platforms. In Proceedings of the 16th International Conference on Distributed Computing Systems.

Digital Library

[11]

Crovella, M. E. and Bestavros, A. 1997. Self-similarity in world wide web traffic: Evidence and possible causes. IEEE/ACM Trans. Netw. 5, 6, 835--846.

Digital Library

[12]

Crovella, M. E. and Taqqu, M. S. 1999. Estimating the heavy tail index from scaling properties. Meth. Comput. Appl. Probab. 1, 1, 55--79.

Digital Library

[13]

Dingle, A., MacNair, E., and Nguyen, T. 1999. An analysis of web server performance. In Proceedings of the Global Telecommunication Conference.

[14]

Duarte, F., Mattos, B., Bestavros, A., Almeida, V., and Almeida, J. 2007. Traffic characteristics and communication patterns in blogosphere. In Proceedings of the International Conference on Weblogs and Social Media.

[15]

Faber, A. M., Gupta, M., and Viecco, C. H. 2006. Revisiting web server workload invariants in the context of scientific web sites. In Proceedings of the ACM/IEEE Conference on Supercomputing.

Digital Library

[16]

Gill, P., Arlitt, M., Li, Z., and Mahanti, A. 2007. Youtube traffic characterization: A view from the edge. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement.

Digital Library

[17]

Gill, P., Arlitt, M., Carlsson, N., Mahanti, A., and Williamson, C. 2011. Characterizing organizational use of web-based services: Methodology, challenges, observations, and insights. ACM Trans. Web 5, 4, 19:1--19:23.

Digital Library

[18]

Guo, L., Tan, E., Chen, S., Zhang, X., and Zhao, Y. E. 2009. Analyzing patterns of user content generation in online social networks. In Proceedings of the 15th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.

Digital Library

[19]

Holmedahl, V., Smith, B., and Yang, T. 1998. Cooperative caching of dynamic content on a distributed web server. In Proceedings of the 7th International Symposium on High Performance Distributed Computing.

Digital Library

[20]

Iyengar, A. and Challenger, J. 1997. Improving web server performance by caching dynamic data. In Proceedings of the USENIX Symposium on Internet Technologies and Systems.

Digital Library

[21]

Kant, K. and Won, Y. 1999. Performance impact of uncached file accesses in specweb99. In Proceedings of the 2nd IEEE Workshop on Workload Characterization.

[22]

Krishnamurthy, B. 2009. A measure of online social networks. In Proceedings of the 1st International Conference on Communication Systems and Networks.

Digital Library

[23]

Leskovec, J., Mcglohon, M., Faloutsos, C., Glance, N., and Hurst, M. 2007. Cascading behavior in large blog graphs. In Proceedings of the 7th SIAM International Conference on Data Mining.

[24]

Li, Z., Chen, Z., Srinivasan, S. M., and Zhou, Y. 2004. C-miner: Mining block correlations in storage systems. In Proceedings of the 3rd USENIX Conference on File and Storage Technologies.

Digital Library

[25]

Limpert, E., Stahel, W. A., and Abbt, M. 2001. Log-Normal Distributions across the Sciences: Keys and Clues. BioScience.

[26]

Nagpurkar, P., Horn, W., Gopalakrishnan, U., Dubey, N., Jann, J., and Pattnaik, P. 2008. Workload characterization of selected JEE-based web 2.0 applications. In Proceedings of the IEEE International Symposium on Workload Characterization.

Digital Library

[27]

Ohara, M., Nagpurkar, P., Ueda, Y., and Ishizaki, K. 2009. The data-centricity of web 2.0 workloads and its impact on server performance. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software.

[28]

Oke, A. and Bunt, R. B. 2002. Hierarchical workload characterization for a busy web server. In Proceedings of the 12th International Conference on Modelling Tools and Techniques for Computer and Communication System Performance Evaluation.

Digital Library

[29]

Patterson, R. H., Gibson, G. A., Ginting, E., Stodolsky, D., and Zelenka, J. 1995. Informed prefetching and caching. In Proceedings of the 15th ACM Symposium on Operating System Principles.

Digital Library

[30]

Paxson, V. and Floyd, S. 1994. Wide-area traffic: the failure of poisson modeling. In Proceedings of the Conference on Communications Architectures, Protocols and Applications.

Digital Library

[31]

Rodriguez, P. 2009. Web infrastructure for the 21st century. In Proceedings of the 18th International World Wide Web Conference.

[32]

Shriver, E., Gabber, E., Huang, L., and Stein, C. A. 2001. Proceedings of the USENIX Annual Technical Conference.

[33]

Stewart, C., Leventi, M., and Shen, K. 2008. Empirical examination of a collaborative web application. In Proceedings of the IEEE International Symposium on Workload Characterization.

[34]

Tomkins, A., Patterson, R. H., and Gibson, G. 1997. Informed multi-process prefetching and caching. In Proceedings of the ACM SIGMETRICS Conference.

Digital Library

[35]

Veres, S. and Ionescu, D. 2009. Measurement-Based traffic characterization for web 2.0 applications. In Proceedings of the International Instrumentation and Measurement Technology Conference.

[36]

Wachs, M., Abd-El-Malek, M., Thereska, E., and Ganger, G. R. 2007. Argon: Performance insulation for shared storage servers. In Proceedings of the 6th USENIX Conference on File and Storage Technologies.

Digital Library

[37]

Wang, J. and Li, D. 2003.A light-weight, temporary file system for large-scale web servers. In Proceedings of the 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[38]

Williams, A., Arlitt, M., Williamson, C., and Barker, K. 2005. Web Workload Characterization: Ten Years Later. Springer.

[39]

Zipf, G. K. 1949. Human Behavior and the Principle of Least-Effort. Addison-Wesley.

Cited By

Song YMahanti ARavichandran S(2019)Understanding Evolution and Adoption of Top Level Domains and DNSSEC2019 IEEE International Symposium on Measurements & Networking (M&N)10.1109/IWMN.2019.8805011(1-6)Online publication date: Jul-2019
https://doi.org/10.1109/IWMN.2019.8805011
Song YMahanti A(2019)Comparison of Mobile and Fixed Device Workloads in an Academic Web Server2019 IEEE International Symposium on Measurements & Networking (M&N)10.1109/IWMN.2019.8804983(1-6)Online publication date: Jul-2019
https://doi.org/10.1109/IWMN.2019.8804983
Curiel MPont A(2018)Workload Generators for Web-Based Systems: Characteristics, Current Status, and ChallengesIEEE Communications Surveys & Tutorials10.1109/COMST.2018.279864120:2(1526-1546)Online publication date: Oct-2019
https://doi.org/10.1109/COMST.2018.2798641
Show More Cited By

Index Terms

Workload Characterization and Performance Implications of Large-Scale Blog Servers
1. General and reference
  1. Cross-computing tools and techniques
    1. Performance
2. Software and its engineering
  1. Software organization and properties
    1. Extra-functional properties
      1. Software performance

Recommendations

SSD-based Workload Characteristics and Their Performance Implications
Special Section on Usenix Fast 2020

Storage systems are designed and optimized relying on wisdom derived from analysis studies of file-system and block-level workloads. However, while SSDs are becoming a dominant building block in many storage systems, their design continues to build on ...
A comprehensive study of energy efficiency and performance of flash-based SSD

Use of flash memory as a storage medium is becoming popular in diverse computing environments. However, because of differences in interface, flash memory requires a hard-disk-emulation layer, called FTL (flash translation layer). Although the FTL enables ...
Blog Trust Model for Blog Readers
ITC '10: Proceedings of the 2010 International Conference on Recent Trends in Information, Telecommunication and Computing

Social network plays a major role in today’s internet technology. FOAF, community, Blogs etc are the few top level social network today. Weblogs (blogs) are today’s prominent social media on the internet which allows blogger and the user to interact ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on the Web

ACM Transactions on the Web Volume 6, Issue 4

November 2012

138 pages

ISSN:1559-1131

EISSN:1559-114X

DOI:10.1145/2382616

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2012

Accepted: 01 August 2012

Revised: 01 May 2012

Received: 01 September 2011

Published in TWEB Volume 6, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
504
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Song YMahanti ARavichandran S(2019)Understanding Evolution and Adoption of Top Level Domains and DNSSEC2019 IEEE International Symposium on Measurements & Networking (M&N)10.1109/IWMN.2019.8805011(1-6)Online publication date: Jul-2019
https://doi.org/10.1109/IWMN.2019.8805011
Song YMahanti A(2019)Comparison of Mobile and Fixed Device Workloads in an Academic Web Server2019 IEEE International Symposium on Measurements & Networking (M&N)10.1109/IWMN.2019.8804983(1-6)Online publication date: Jul-2019
https://doi.org/10.1109/IWMN.2019.8804983
Curiel MPont A(2018)Workload Generators for Web-Based Systems: Characteristics, Current Status, and ChallengesIEEE Communications Surveys & Tutorials10.1109/COMST.2018.279864120:2(1526-1546)Online publication date: Oct-2019
https://doi.org/10.1109/COMST.2018.2798641
Kim YGunasekaran R(2018)Understanding I/O workload characteristics of a Peta-scale storage systemThe Journal of Supercomputing10.1007/s11227-014-1321-871:3(761-780)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1007/s11227-014-1321-8
Li CShilane PDouglis FWallace G(2017)PannierACM Transactions on Storage10.1145/309478513:3(1-34)Online publication date: 18-Sep-2017
https://dl.acm.org/doi/10.1145/3094785
Marszałkowski JMizgajski JMokwa DDrozdowski M(2015)Analysis and Solution of CSS-Sprite Packing ProblemACM Transactions on the Web10.1145/281837710:1(1-34)Online publication date: 29-Dec-2015
https://dl.acm.org/doi/10.1145/2818377
Li CShilane PDouglis FWallace GLea RGopalakrishnan STilevich EMurphy ABlackstock M(2015)PannierProceedings of the 16th Annual Middleware Conference10.1145/2814576.2814734(50-62)Online publication date: 24-Nov-2015
https://dl.acm.org/doi/10.1145/2814576.2814734
Oh KRaghavan AChandra AWeissman JGannon DLi CParashar MLi XWang KWolski R(2015)Redefining Data Locality for Cross-Data Center StorageProceedings of the 2nd International Workshop on Software-Defined Ecosystems10.1145/2756594.2756596(15-22)Online publication date: 16-Jun-2015
https://dl.acm.org/doi/10.1145/2756594.2756596
Ali-Eldin AKihl MTordsson JElmroth EOoi WFeng WLiu F(2015)Analysis and characterization of a video-on-demand service workloadProceedings of the 6th ACM Multimedia Systems Conference10.1145/2713168.2713183(189-200)Online publication date: 18-Mar-2015
https://dl.acm.org/doi/10.1145/2713168.2713183
Eldin ARezaie AMehta ARazroev SLuna SSeleznjev OTordsson JElmroth E(2014)How will Your Workload Look Like in 6 Years? Analyzing Wikimedia's WorkloadProceedings of the 2014 IEEE International Conference on Cloud Engineering10.1109/IC2E.2014.50(349-354)Online publication date: 11-Mar-2014
https://dl.acm.org/doi/10.1109/IC2E.2014.50

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents