research-article

Open access

Simulative Investigations of Crowd Evacuation by Incorporating Reinforcement Learning Scheme

Authors:

Nitinun Sinpan,

Pruk Sasithong,

Sushank Chaudhary,

Suvit Poomrittigul,

Lunchakorn WuttisittikulkijAuthors Info & Claims

ICACS '22: Proceedings of the 6th International Conference on Algorithms, Computing and Systems

Article No.: 1, Pages 1 - 5

https://doi.org/10.1145/3564982.3564983

Published: 30 January 2023 Publication History

All formats PDF

Abstract

Safe and effective evacuation is very essential to decrease casualties in an emergency event. The social force model is used to simulate the movement of evacuee and leader crowd evacuation with leader in an experimental area. The a-star algorithm is used to find the evacuation routes of each evacuee from the initial location to the exit. In this paper, we proposed the application of reinforcement learning to train the agent to become an evacuation leader via the Unity ML-Agents Toolkit. This model is tested in three scenarios: an evacuation without a leader, an evacuation with a leader, and an evacuation with randomly located agent. They are considered for comparison purposes to show the impact of an agent that tries to tell an exit to all evacuees in the experimental area. The experimental results show that the proposed crowd evacuation agent could effectively evacuate all evacuees in the experimental area.

References

[1]

Helbing, D., Farkas, I., & Vicsek, T. (2000). Simulating dynamical features of escape panic. Nature, 407(6803), 487-490.

[2]

Helbing, D., & Molnar, P. (1995). Social force model for pedestrian dynamics. Physical review E, 51(5), 4282.

[3]

Ming, R., & Peng, X. (2017). Study on the social force model of personnel evacuation in large stadiums. 2017 International Conference on Service Systems and Service Management.

[4]

Yang, X., Dong, H., Wang, Q., Chen, Y., & Hu, X. (2014). Guided crowd dynamics via modified social force model. International Conference on Service Systems and Service Management. 2017. Physica A: Statistical Mechanics and its Applications, 411, 63-73.

[5]

Yang, X., Dong, H., Yao, X., Sun, X., Wang, Q., & Zhou, M. (2016). Necessity of guides in pedestrian emergency evacuation. Physica A: Statistical Mechanics and its Applications, 442, 397-408.

[6]

Zhou, M., Dong, H., Zhao, Y., Ioannou, P. A., & Wang, F.-Y. (2019). Optimization of crowd evacuation with leaders in urban rail transit stations. IEEE transactions on intelligent transportation systems, 20(12), 4476-4487.

Digital Library

[7]

Zhou, M., Dong, H., Wang, X., Hu, X., & Ge, S. (2020). Modeling and simulation of crowd evacuation with signs at subway platform: A case study of beijing subway stations. IEEE transactions on intelligent transportation systems.

[8]

Qiang, W., & Zhongli, Z. (2011). Reinforcement learning model, algorithms and its application. 2011 International Conference on Mechatronic Science, Electric Engineering and Computer (MEC).

[9]

Majumder, A. (2021). Deep Reinforcement Learning in Unity With Unity ML Toolkit.

[10]

Borromeo, N. A. (July 2020). Hads-On Unity 2020 Game Development. Packt Publishing Ltd.

[11]

Zhang, Z., Lu, D., Li, J., Liu, P., & Zhang, G. (2021). Crowd evacuation simulation using hierarchical deep reinforcement learning. 2021 IEEE 24th International Conference on Computer Supported Cooperative Work in Design (CSCWD),

[12]

Wang, Q., Liu, H., Gao, K., & Zhang, L. (2019). Improved multi-agent reinforcement learning for path planning-based crowd simulation. IEEE Access, 7, 73841-73855.

[13]

Zheng, S., & Liu, H. (2019). Improved multi-agent deep deterministic policy gradient for path planning-based crowd simulation. IEEE Access, 7, 147755-147770.

[14]

Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017). Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347.

[15]

Dutt, V. (2011). Explaining human behavior in dynamic tasks through reinforcement learning. Journal of Advances in Information Technology, 2(3), 177-188.

[16]

Muslim, N., Islam, S., & Grégoire, J.-C. (2022). Reinforcement Learning Based Offloading Framework for Computation Service in the Edge Cloud and Core Cloud. Journal of Advances in Information Technology Vol, 13(2).

[17]

Leelawat, N., Suppasri, A., Latcharote, P., Abe, Y., Sugiyasu, K., & Imamura, F. (2018). Tsunami evacuation experiment using a mobile application: A design science approach. International journal of disaster risk reduction, 29, 63-72.

Cited By

Chaudhary SSinpan NSasithong PKhichar Sla-Aiddee PLeelawat NParnianifard APoomrittigul SWuttisittikulkij L(2024)Proximal Policy Optimization for Crowd Evacuation in Complex Environments—A Metaverse Approach at Krung Thep Aphiwat Central Terminal, ThailandIEEE Access10.1109/ACCESS.2024.351515312(196969-196983)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3515153

Index Terms

Simulative Investigations of Crowd Evacuation by Incorporating Reinforcement Learning Scheme
1. Computing methodologies

Index terms have been assigned to the content through auto-classification.

Recommendations

Emergence of cooperation during an emergency evacuation

We propose a game-theoretical model on cooperation among evacuees.We examine the relationship between escape aspiration and cooperation.High escape aspiration promotes cooperation in emergency conditions.High escape aspiration inhibits cooperation in ...
An agent-based simulation system for concert venue crowd evacuation modeling in the presence of a fire disaster

A key activity in emergency management is planning and preparation for disaster. If the right safety measures are implemented beforehand, harmful effects can be significantly mitigated. However, evaluation and selection of effective measures is ...
Emergency crowd evacuation modeling and simulation framework with cellular discrete event systems

First responders and security personnel face many challenges to safely evacuate crowded environments. Conducting frequent physical and table-top exercises are neither feasible nor economical. This is where modeling and simulation comes into play in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICACS '22: Proceedings of the 6th International Conference on Algorithms, Computing and Systems

September 2022

132 pages

ISBN:9781450397407

DOI:10.1145/3564982

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 January 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICACS 2022

ICACS 2022: 2022 The 6th International Conference on Algorithms, Computing and Systems

September 16 - 18, 2022

Larissa, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
299
Total Downloads

Downloads (Last 12 months)230
Downloads (Last 6 weeks)36

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chaudhary SSinpan NSasithong PKhichar Sla-Aiddee PLeelawat NParnianifard APoomrittigul SWuttisittikulkij L(2024)Proximal Policy Optimization for Crowd Evacuation in Complex Environments—A Metaverse Approach at Krung Thep Aphiwat Central Terminal, ThailandIEEE Access10.1109/ACCESS.2024.351515312(196969-196983)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3515153

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents