skip to main content
10.1145/3573900.3591115acmconferencesArticle/Chapter ViewAbstractPublication PagespadsConference Proceedingsconference-collections
research-article

Zero Lookahead? Zero Problem. The Window Racer Algorithm

Published: 21 June 2023 Publication History

Abstract

Synchronization algorithms for parallel simulation struggle to attain speedup if the simulation entities are tightly coupled and their interactions are difficult to predict. Window Racer is a novel parallel synchronization algorithm for shared-memory architectures specifically targeted toward attaining speedup in these challenging cases. The key idea is to speculatively process sequences of dependent events even across partition boundaries through fine-grained locking and low-overhead rollbacks, while negotiating a global synchronization window that rules out transitive rollbacks. In performance measurements using a variant of the PHold benchmark model, Window Racer outperforms an established implementation of the Time Warp algorithm in model configurations where events are often scheduled with near-zero delay. In an ablation study, we pinpoint the performance impact of our algorithm’s individual features by reducing Window Racer to two existing algorithms. We further study the algorithm’s ability to attain speedup in simulations of bio-chemical reaction networks, a particularly challenging class of simulations with tightly coupled state transitions.

References

[1]
John H. Abel, Brian Drawert, Andreas Hellander, and Linda R. Petzold. 2016. GillesPy: A Python Package for Stochastic Model Building and Simulation. IEEE Life Sciences Letters 2, 3 (Sept. 2016), 35–38. Conference Name: IEEE Life Sciences Letters.
[2]
Philipp Andelfinger and Adelinde Uhrmacher. 2021. Optimistic parallel simulation of tightly coupled agents in continuous time. In 2021 IEEE/ACM 25th International Symposium on Distributed Simulation and Real Time Applications (DS-RT). IEEE, 1–9.
[3]
Philipp Andelfinger and Adelinde M Uhrmacher. 2023. Synchronous speculative simulation of tightly coupled agents in continuous time on CPUs and GPUs. SIMULATION (2023), 00375497231158930.
[4]
Pavol Bauer, Jonatan Lindén, Stefan Engblom, and Bengt Jonsson. 2015. Efficient inter-process synchronization for parallel discrete event simulation on multicores. In Proceedings of the 3rd ACM SIGSIM Conference on Principles of Advanced Discrete Simulation. 183–194.
[5]
David Blackman and Sebastiano Vigna. 2021. Scrambled linear pseudorandom number generators. ACM Transactions on Mathematical Software (TOMS) 47, 4 (2021), 1–32.
[6]
Christopher D Carothers, David Bauer, and Shawn Pearce. 2002. ROSS: A high-performance, low-memory, modular Time Warp system. J. Parallel and Distrib. Comput. 62, 11 (2002), 1648–1669.
[7]
K Mani Chandy and Jay Misra. 2006. Conditional Knowledge as a basis for Distributed Simulation. Technical Report. California Institute of Technology, Pasadena. Department of Computer Science.
[8]
Li-li Chen, Ya-shuai Lu, Yi-ping Yao, Shao-liang Peng, 2011. A well-balanced Time Warp system on multi-core environments. In 2011 IEEE Workshop on Principles of Advanced and Distributed Simulation. IEEE, 1–9.
[9]
Howard David, Eugene Gorbatov, Ulf R Hanebutte, Rahul Khanna, and Christian Le. 2010. RAPL: Memory power estimation and capping. In ACM/IEEE International Symposium on Low power Electronics and Design. 189–194.
[10]
Cristian Dittamo and Davide Cangelosi. 2009. Optimized parallel implementation of gillespie’s first reaction method on graphics processing units. In 2009 International Conference on Computer Modeling and Simulation. IEEE, 156–161.
[11]
Johan Elf and Måns Ehrenberg. 2004. Spontaneous separation of bi-stable biochemical systems into spatial domains of opposite phases. Systems biology 1, 2 (2004), 230–236.
[12]
James R. Faeder, Michael L. Blinov, and William S. Hlavacek. 2009. Rule-Based Modeling of Biochemical Systems with BioNetGen. In Systems Biology, Ivan V. Maly (Ed.). Vol. 500. Humana Press, Totowa, NJ, 113–167. Series Title: Methods in Molecular Biology.
[13]
Alois Ferscha. 1995. Probabilistic adaptive direct optimism control in Time Warp. In Proceedings of the Workshop on Parallel and Distributed Simulation. 120–129.
[14]
Richard Fujimoto and Aradhya Biswas. 2015. An empirical study of energy consumption in distributed simulations. In International Symposium on Distributed Simulation and Real Time Applications (DS-RT). IEEE, 163–170.
[15]
Richard M Fujimoto. 1989. Time Warp on a shared memory multiprocessor. Technical Report. Utah University, Salt Lake City. School of Computing.
[16]
Richard M Fujimoto. 1990. Performance of Time Warp under synthetic workloads. In Proceedings of the SCS Multiconference on Distributed Simulations, 1990, Vol. 22. 23–28.
[17]
Richard M Fujimoto. 2001. Parallel and distributed simulation systems. In Proceeding of the 2001 Winter Simulation Conference, Vol. 1. IEEE, 147–157.
[18]
Kaushik Ghosh and Richard M Fujimoto. 1994. Parallel discrete event simulation using space-time memory. Technical Report. Georgia Institute of Technology.
[19]
Michael A Gibson and Jehoshua Bruck. 2000. Efficient exact stochastic simulation of chemical systems with many species and many channels. The Journal of Physical Chemistry A 104, 9 (2000), 1876–1889.
[20]
Daniel T Gillespie. 1976. A general method for numerically simulating the stochastic time evolution of coupled chemical reactions. Journal of computational physics 22, 4 (1976), 403–434.
[21]
Daniel T Gillespie. 2007. Stochastic simulation of chemical kinetics. Annu. Rev. Phys. Chem. 58 (2007), 35–55.
[22]
Arthur P. Goldberg, David R. Jefferson, John A. P. Sekar, and Jonathan R. Karr. 2020. Exact Parallelization of the Stochastic Simulation Algorithm for Scalable Simulation of Large Biochemical Networks.
[23]
Stefan Hoops, Sven Sahle, Ralph Gauges, Christine Lee, Jürgen Pahle, Natalia Simus, Mudita Singhal, Liang Xu, Pedro Mendes, and Ursula Kummer. 2006. COPASI—a COmplex PAthway SImulator. Bioinformatics 22, 24 (Dec. 2006), 3067–3074.
[24]
Mauro Ianni, Romolo Marotta, Davide Cingolani, Alessandro Pellegrini, and Francesco Quaglia. 2018. The ultimate share-everything PDES system. In ACM SIGSIM Conference on Principles of Advanced Discrete Simulation. 73–84.
[25]
David Jefferson and Henry Sowizral. 1982. Fast concurrent simulation using the Time Warp mechanism. Part I. Local control. Technical Report. Rand Corporation, Santa Monica, CA.
[26]
Matthias Jeschke, Roland Ewald, Alfred Park, Richard Fujimoto, and Adelinde M Uhrmacher. 2008. A parallel and distributed discrete event approach for spatial cell-biological simulations. ACM SIGMETRICS Performance Evaluation Review 35, 4 (2008), 22–31.
[27]
Margaret E Johnson, Athena Chen, James R Faeder, Philipp Henning, Ion I Moraru, Martin Meier-Schellersheim, Robert F Murphy, Thorsten Prüstel, Julie A Theriot, and Adelinde M Uhrmacher. 2021. Quantifying the roles of space and stochasticity in computer simulations for cell biology and cellular biochemistry. Molecular Biology of the Cell 32, 2 (2021), 186–210.
[28]
Hong Li and Linda Petzold. 2006. Logarithmic direct method for discrete stochastic simulation of chemically reacting systems. Journal of Chemical Physics 16 (2006), 1–11.
[29]
Jonatan Linden, Pavol Bauer, Stefan Engblom, and Bengt Jonsson. 2019. Exposing inter-process information for efficient pdes of spatial stochastic systems on multicores. ACM Transactions on Modeling and Computer Simulation (TOMACS) 29, 2 (2019), 1–25.
[30]
Nazzareno Marziale, Francesco Nobilia, Alessandro Pellegrini, and Francesco Quaglia. 2016. Granular Time Warp objects. In Proceedings of the 2016 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation. 57–68.
[31]
Carsten Maus, Stefan Rybacki, and Adelinde M. Uhrmacher. 2011. Rule-based multi-level modeling of cell biological systems. BMC Systems Biology 5, 1 (Oct. 2011), 166.
[32]
Horst Mehl and Stefan Hammes. 1995. How to integrate shared variables in distributed simulation. ACM SIGSIM Simulation Digest 25, 2 (1995), 14–41.
[33]
James Nutaro. 2020. Toward a theory of superdense time in simulation models. ACM Transactions on Modeling and Computer Simulation (TOMACS) 30, 3 (2020), 1–13.
[34]
Oleksandr Ostrenko, Pietro Incardona, Rajesh Ramaswamy, Lutz Brusch, and Ivo F. Sbalzarini. 2017. pSSAlib: The partial-propensity stochastic chemical network simulator. PLOS Computational Biology 13, 12 (April 2017), e1005865. Publisher: Public Library of Science.
[35]
Avinash C Palaniswamy and Philip A Wilsey. 1994. Scheduling Time Warp processes using adaptive control techniques. In Proceedings of Winter Simulation Conference. IEEE, 731–738.
[36]
Alessandro Pellegrini, Sebastiano Peluso, Francesco Quaglia, and Roberto Vitali. 2016. Transparent speculative parallelization of discrete event simulation applications using global variables. International journal of parallel programming 44 (2016), 1200–1247.
[37]
Alessandro Pellegrini and Francesco Quaglia. 2019. Cross-state events: A new approach to parallel discrete event simulation and its speculative runtime support. Journal of parallel and distributed computing 132 (2019), 48–68.
[38]
Alessandro Pellegrini, Roberto Vitali, and Francesco Quaglia. 2012. The rome optimistic simulator: Core internals and programming model. In 4th International ICST Conference on Simulation Tools and Techniques.
[39]
Andrea Piccione, Philipp Andelfinger, and Alessandro Pellegrini. 2023. Hybrid Speculative Synchronisation for Parallel Discrete Event Simulation. In Proceedings of the 2023 SIGSIM Conference on Principles of Advanced Discrete Simulation(SIGSIM-PADS ’23). ACM, New York, NY, USA, 12 pages.
[40]
Paul F Reynolds Jr. 1988. A spectrum of options for parallel simulation. In Proceedings of the 20th conference on Winter simulation. 325–332.
[41]
Bilal Shaikh, Lucian P Smith, Dan Vasilescu, Gnaneswara Marupilla, Michael Wilson, Eran Agmon, Henry Agnew, Steven S Andrews, Azraf Anwar, Moritz E Beber, 2022. BioSimulators: a central registry of simulation engines and services for recommending specific tools. Nucleic acids research 50, W1 (2022), W108–W114.
[42]
L Sokol. 1988. MTW: A strategy for scheduling discrete simulation events for concurrent execution. Distributed Simulation’88 (1988), 34–42.
[43]
E. T. Somogyi, M. T. Karlsson, M. Swat, M. Galdzicki, and H. M. Sauro. 2013. libRoadRunner: A High Performance SBML Compliant Simulator. Pages: 001230 Section: New Results.
[44]
Jeff S Steinman. 1992. SPEEDES-A multiple-synchronization environment for parallel discrete-event simulation. International Journal in Computer Simulation;(United States) 2 (1992).
[45]
Jeff S Steinman. 1993. Breathing Time Warp. In Proceedings of the seventh workshop on Parallel and distributed simulation. 109–118.
[46]
Jeff S Steinman. 1994. Discrete-event simulation and the event horizon. ACM SIGSIM Simulation Digest 24, 1 (1994), 39–49.
[47]
Vo Hong Thanh and Roberto Zunino. 2011. Parallel stochastic simulation of biochemical reaction systems on multi-core processors. Proceedings of CSSIM (2011), 162–170.
[48]
Stephen J Turner and Ming Q Xu. 1990. Performance evaluation of the bounded Time Warp algorithm. University of Exeter, Department of Computer Science.
[49]
Bing Wang, Bonan Hou, Fei Xing, and Yiping Yao. 2011. Abstract next subvolume method: A logical process-based approach for spatial stochastic simulation of chemical reactions. Computational Biology and Chemistry 35, 3 (2011), 193–198.
[50]
Bing Wang, Yiping Yao, Yuliang Zhao, Bonan Hou, and Shaoliang Peng. 2009. Experimental analysis of optimistic synchronization algorithms for parallel simulation of reaction-diffusion systems. In 2009 International Workshop on High Performance Computational Systems Biology. IEEE, 91–100.
[51]
Jun Wang and Carl Tropper. 2007. Optimizing Time Warp simulation with reinforcement learning techniques. In Winter Simulation Conference. IEEE, 577–584.
[52]
Xuehui Wang and Lei Zhang. 2017. Design and Analysis of a Minimum Time Buckets Synchronization Algorithm for Parallel and Distributed Simulation. In International Symposium on Autonomous Decentralized System (ISADS). IEEE, 96–103.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGSIM-PADS '23: Proceedings of the 2023 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation
June 2023
173 pages
ISBN:9798400700309
DOI:10.1145/3573900
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 June 2023

Permissions

Request permissions for this article.

Check for updates

Badges

Author Tags

  1. Optimistic Synchronization
  2. PDES
  3. Time Warp

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

SIGSIM-PADS '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 398 of 779 submissions, 51%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)61
  • Downloads (Last 6 weeks)2
Reflects downloads up to 28 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media