short-paper

Distributed QoS-aware scheduling in storm

Authors:

Valeria Cardellini,

Vincenzo Grassi,

Francesco Lo Presti,

Matteo NardelliAuthors Info & Claims

DEBS '15: Proceedings of the 9th ACM International Conference on Distributed Event-Based Systems

Pages 344 - 347

https://doi.org/10.1145/2675743.2776766

Published: 24 June 2015 Publication History

Get Access

Abstract

Storm is a distributed stream processing system that has recently gained increasing interest. We extend Storm to make it suitable to operate in a geographically distributed and highly variable environment such as that envisioned by the convergence of Fog computing, Cloud computing, and Internet of Things.

References

[1]

L. Aniello, R. Baldoni, and L. Querzoni. Adaptive online scheduling in Storm. In Proc. of ACM DEBS '13, pages 207--218, 2013.

Digital Library

Google Scholar

[2]

V. Cardellini, V. Grassi, F. Lo Presti, and M. Nardelli. Distributed QoS-aware scheduling in Storm. Technical Report DICII RR-15.7, Univ. Roma Tor Vergata, 2015. www.ce.uniroma2.it/publications/RR-15.7.pdf.

Digital Library

Google Scholar

[3]

F. Dabek, R. Cox, F. Kaashoek, and R. Morris. Vivaldi: A decentralized network coordinate system. SIGCOMM Comput. Commun. Rev., 34(4), 2004.

Digital Library

Google Scholar

[4]

T. Heinze, L. Aniello, L. Querzoni, and Z. Jerzak. Cloud-based data stream processing. In Proc. of ACM DEBS '14, pages 238--245, 2014.

Digital Library

Google Scholar

[5]

J. Kephart and D. Chess. The vision of autonomic computing. IEEE Computer, 36(1):41--50, Jan. 2003.

Digital Library

Google Scholar

[6]

P. Pietzuch et al. Network-aware operator placement for stream-processing systems. In Proc. of IEEE ICDE '06, 2006.

Digital Library

Google Scholar

[7]

J. Xu, Z. Chen, J. Tang, and S. Su. T-Storm: Traffic-aware online scheduling in Storm. In Proc. of IEEE ICDCS '14, pages 535--544, June 2014.

Digital Library

Google Scholar

Cited By

View all

Pan XJin YXi MLi Y(2024)Deployment perspective of service pattern: Solve dynamic services with heterogeneous carrier description2024 IEEE International Conference on Web Services (ICWS)10.1109/ICWS62655.2024.00045(234-243)Online publication date: 7-Jul-2024
https://doi.org/10.1109/ICWS62655.2024.00045
Ecker RKaragiannis VSober MEbrahimi ESchulte S(2024)Latency-Aware Placement of Stream Processing OperatorsEuro-Par 2023: Parallel Processing Workshops10.1007/978-3-031-50684-0_3(30-41)Online publication date: 16-Apr-2024
https://doi.org/10.1007/978-3-031-50684-0_3
Nguyen HChien A(2023)Storm-RTS: Stream Processing with Stable Performance for Multi-Cloud and Cloud-edge2023 IEEE 16th International Conference on Cloud Computing (CLOUD)10.1109/CLOUD60044.2023.00015(45-57)Online publication date: Jul-2023
https://doi.org/10.1109/CLOUD60044.2023.00015
Show More Cited By

Index Terms

Distributed QoS-aware scheduling in storm
1. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

Adaptive online scheduling in storm
DEBS '13: Proceedings of the 7th ACM international conference on Distributed event-based systems

Today we are witnessing a dramatic shift toward a data-driven economy, where the ability to efficiently and timely analyze huge amounts of data marks the difference between industrial success stories and catastrophic failures. In this scenario Storm, an ...
R-Storm: Resource-Aware Scheduling in Storm
Middleware '15: Proceedings of the 16th Annual Middleware Conference

The era of big data has led to the emergence of new systems for real-time distributed stream processing, e.g., Apache Storm is one of the most popular stream processing systems in industry today. However, Storm, like many other stream processing systems ...
Meteorological data layout and task scheduling in a multi-cloud environment
Abstract
The meteorological cloud mainly provides computing ability and meteorological datasets for meteorological model tasks. If the location of the required dataset and the execution location of the task are different, this will consume a large amount ...

Comments

Information & Contributors

Information

Published In

DEBS '15: Proceedings of the 9th ACM International Conference on Distributed Event-Based Systems

June 2015

385 pages

ISBN:9781450332866

DOI:10.1145/2675743

General Chairs:
Frank Eliassen
University of Oslo, Norway
,
Roman Vitenberg
University of Oslo, Norway

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 June 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Poster

Author Tags

Qualifiers

Short-paper

Conference

DEBS '15

Sponsor:

DEBS '15: The 9th ACM International Conference on Distributed Event-Based Systems

June 29 - July 3, 2015

Oslo, Norway

Acceptance Rates

Overall Acceptance Rate 145 of 583 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

61
Total Citations
View Citations
936
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Pan XJin YXi MLi Y(2024)Deployment perspective of service pattern: Solve dynamic services with heterogeneous carrier description2024 IEEE International Conference on Web Services (ICWS)10.1109/ICWS62655.2024.00045(234-243)Online publication date: 7-Jul-2024
https://doi.org/10.1109/ICWS62655.2024.00045
Ecker RKaragiannis VSober MEbrahimi ESchulte S(2024)Latency-Aware Placement of Stream Processing OperatorsEuro-Par 2023: Parallel Processing Workshops10.1007/978-3-031-50684-0_3(30-41)Online publication date: 16-Apr-2024
https://doi.org/10.1007/978-3-031-50684-0_3
Nguyen HChien A(2023)Storm-RTS: Stream Processing with Stable Performance for Multi-Cloud and Cloud-edge2023 IEEE 16th International Conference on Cloud Computing (CLOUD)10.1109/CLOUD60044.2023.00015(45-57)Online publication date: Jul-2023
https://doi.org/10.1109/CLOUD60044.2023.00015
Sun DWu MYang ZSajjanhar ABuyya R(2023)A two-tier coordinated load balancing strategy over skewed data streamsThe Journal of Supercomputing10.1007/s11227-023-05473-z79:18(21028-21056)Online publication date: 18-Jun-2023
https://doi.org/10.1007/s11227-023-05473-z
Huang XShao ZYang Y(2022)POTUS: Predictive Online Tuple Scheduling for Data Stream Processing SystemsIEEE Transactions on Cloud Computing10.1109/TCC.2020.303257710:4(2863-2875)Online publication date: 1-Oct-2022
https://doi.org/10.1109/TCC.2020.3032577
Smolka SMann Z(2022)Evaluation of fog application placement algorithms: a surveyComputing10.1007/s00607-021-01031-8104:6(1397-1423)Online publication date: 11-Feb-2022
https://doi.org/10.1007/s00607-021-01031-8
Qi TRodriguez M(2021)A Traffic and Resource Aware Online Storm SchedulerProceedings of the 2021 Australasian Computer Science Week Multiconference10.1145/3437378.3444365(1-10)Online publication date: 1-Feb-2021
https://dl.acm.org/doi/10.1145/3437378.3444365
Li HDai HLiu ZFu HZou Y(2021)Dynamic energy-efficient scheduling for streaming applications in stormComputing10.1007/s00607-021-00961-7Online publication date: 8-Jun-2021
https://doi.org/10.1007/s00607-021-00961-7
Liu FJin ZMu WZhu WZhang YWang W(2021)DROAllocator: A Dynamic Resource-Aware Operator Allocation Framework in Distributed Streaming ProcessingNetwork and Parallel Computing10.1007/978-3-030-79478-1_30(349-360)Online publication date: 23-Jun-2021
https://doi.org/10.1007/978-3-030-79478-1_30
Battulga DMiorandi DTedeschi C(2021)SpecK: Composition of Stream Processing Applications over Fog EnvironmentsDistributed Applications and Interoperable Systems10.1007/978-3-030-78198-9_3(38-54)Online publication date: 9-Jun-2021
https://doi.org/10.1007/978-3-030-78198-9_3
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Adaptive online scheduling in storm

R-Storm: Resource-Aware Scheduling in Storm

Meteorological data layout and task scheduling in a multi-cloud environment