skip to main content
research-article

STExplorer: A Hierarchical Autonomous Exploration Strategy with Spatio-temporal Awareness for Aerial Robots

Published: 14 November 2023 Publication History

Abstract

The autonomous exploration task we consider requires Unmanned Aerial Vehicles (UAVs) to actively navigate through unknown environments with the goal of fully perceiving and mapping the environments. Some existing exploration strategies suffer from rough cost budgets, ambiguous Information Gain (IG), and unnecessary backtracking exploration caused by Fragmented Regions (FRs). In our work, a hierarchical spatio-temporal-aware exploration framework is proposed to alleviate these problems. At the local exploration level, the Asymmetrical Traveling Salesman Problem (ATSP) is solved by comprehensively considering exploration time, IG, and heading consistency to avoid blindly exploring. Specifically, the exploration time is reasonably budgeted by fast marching in an artificial potential field. Meanwhile, a transformer-based map occupancy predictor is designed to assist in IG calculation by imagining spatial clues out of the Field of View (FoV), facilitating the prescient exploration. We verify that our local exploration is effective in alleviating the unnecessary back-and-forth movements caused by FRs and the interference of potential obstacle occlusion on the IG calculation. At the global exploration level, the classical Next Best View Points (NBVP) are generalized to Next Best Sub-Regions (NBSR) to choose informative sub-regions for further forward-looking exploration based on a well-designed utility function. Safe flight paths and dynamically feasible trajectories are reasonably generated throughout the exploration process by fast marching and B-spline curve optimization. Comparative simulations and benchmark tests demonstrate that our proposed exploration strategy is quite competitive in terms of exploration path length, total exploration time, and exploration ratio.

References

[1]
Alper Aydemir, Patric Jensfelt, and John Folkesson. 2012. What can we learn from 38,000 rooms? Reasoning about unexplored space in indoor environments. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 4675–4682.
[2]
Héctor Azpúrua, Maíra Saboia, Gustavo M. Freitas, Lillian Clark, Ali-akbar Agha-mohammadi, Gustavo Pessin, Mario F. M. Campos, and Douglas G. Macharet. 2023. A survey on the autonomous exploration of confined subterranean spaces: Perspectives from real-word and industrial robotic deployments. Robotics and Autonomous Systems 160 (2023), 104304.
[3]
Ana Batinovic, Antun Ivanovic, Tamara Petrovic, and Stjepan Bogdan. 2022. A shadowcasting-based next-best-view planner for autonomous 3D exploration. IEEE Robotics and Automation Letters 7, 2 (2022), 2969–2976.
[4]
Ana Batinovic, Tamara Petrovic, Antun Ivanovic, Frano Petric, and Stjepan Bogdan. 2021. A multi-resolution frontier-based planner for autonomous 3D exploration. IEEE Robotics and Automation Letters 6, 3 (2021), 4528–4535.
[5]
Andreas Bircher, Mina Kamel, Kostas Alexis, Helen Oleynikova, and Roland Siegwart. 2016. Receding horizon “next-best-view” planner for 3d exploration. In 2016 IEEE International Conference on Robotics and Automation (ICRA’16). IEEE, 1462–1468.
[6]
Anthony Brunel, Amine Bourki, Cédric Demonceaux, and Olivier Strauss. 2021. Splatplanner: Efficient autonomous exploration via permutohedral frontier filtering. In 2021 IEEE International Conference on Robotics and Automation (ICRA’21). IEEE, 608–615.
[7]
Chao Cao, Hongbiao Zhu, Howie Choset, and Ji Zhang. 2021. TARE: A hierarchical framework for efficiently exploring complex 3D environments. In Robotics: Science and Systems, Vol. 5.
[8]
Angel Chang, Angela Dai, Thomas Funkhouser, Maciej Halber, Matthias Niessner, Manolis Savva, Shuran Song, Andy Zeng, and Yinda Zhang. 2017. Matterport3d: Learning from RGB-D data in indoor environments. arXiv preprint arXiv:1709.06158 (2017).
[9]
Fanfei Chen, John D. Martin, Yewei Huang, Jinkun Wang, and Brendan Englot. 2020. Autonomous exploration under uncertainty via deep reinforcement learning on graphs. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’20). IEEE, 6140–6147.
[10]
Fanfei Chen, Paul Szenher, Yewei Huang, Jinkun Wang, Tixiao Shan, Shi Bai, and Brendan Englot. 2021. Zero-shot reinforcement learning on graphs for autonomous exploration under uncertainty. In 2021 IEEE International Conference on Robotics and Automation (ICRA’21). IEEE, 5193–5199.
[11]
Titus Cieslewski, Elia Kaufmann, and Davide Scaramuzza. 2017. Rapid exploration with multi-rotors: A frontier selection method for high speed flight. In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’17). IEEE, 2135–2142.
[12]
Reinis Cimurs, Il Hong Suh, and Jin Han Lee. 2021. Goal-driven autonomous exploration through deep reinforcement learning. IEEE Robotics and Automation Letters 7, 2 (2021), 730–737.
[13]
Angela Dai, Christian Diller, and Matthias Nießner. 2020. SG-NN: Sparse generative neural networks for self-supervised scene completion of RGB-D scans. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 849–858.
[14]
Anna Dai, Sotiris Papatheodorou, Nils Funk, Dimos Tzoumanikas, and Stefan Leutenegger. 2020. Fast frontier-based information-driven autonomous exploration with an MAV. In 2020 IEEE International Conference on Robotics and Automation (ICRA’20). IEEE, 9570–9576.
[15]
Wenchao Ding, Wenliang Gao, Kaixuan Wang, and Shaojie Shen. 2019. An efficient b-spline-based kinodynamic replanning framework for quadrotors. IEEE Transactions on Robotics 35, 6 (2019), 1287–1306.
[16]
Amine Elhafsi, Boris Ivanovic, Lucas Janson, and Marco Pavone. 2020. Map-predictive motion planning in unknown environments. In 2020 IEEE International Conference on Robotics and Automation (ICRA’20). IEEE, 8552–8558.
[17]
Fadri Furrer, Michael Burri, Markus Achtelik, and Roland Siegwart. 2016. Rotors-a modular gazebo MAV simulator framework. Robot Operating System (ROS): The Complete Reference (Volume 1), 595–625.
[18]
Jonathan D. Gammell, Siddhartha S. Srinivasa, and Timothy D. Barfoot. 2015. Batch informed trees (BIT): Sampling-based optimal planning via the heuristically guided search of implicit random geometric graphs. In 2015 IEEE International Conference on Robotics and Automation (ICRA’15). IEEE, 3067–3074.
[19]
Luiza Caetano Garaffa, Maik Basso, Andréa Aparecida Konzen, and Edison Pignaton de Freitas. 2021. Reinforcement learning for mobile robotics exploration: A survey. IEEE Transactions on Neural Networks and Learning Systems 8 (2021), 1–15.
[20]
Armin Hornung, Kai M. Wurm, Maren Bennewitz, Cyrill Stachniss, and Wolfram Burgard. 2013. OctoMap: An efficient probabilistic 3D mapping framework based on octrees. Autonomous Robots 34 (2013), 189–206.
[21]
Zitian Huang, Yikuan Yu, Jiawen Xu, Feng Ni, and Xinyi Le. 2020. Pf-net: Point fractal network for 3d point cloud completion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7662–7670.
[22]
Intel. (n.d.). Ascending Technologies GmbH. http://www.asctec.de/.
[23]
Kapil D. Katyal, Adam Polevoy, Joseph Moore, Craig Knuth, and Katie M. Popek. 2021. High-speed robot navigation using predicted occupancy maps. In 2021 IEEE International Conference on Robotics and Automation (ICRA’21). IEEE, 5476–5482.
[24]
Sung-Kyun Kim, Amanda Bouman, Gautam Salhotra, David D. Fan, Kyohei Otsu, Joel Burdick, and Ali-akbar Agha-mohammadi. 2021. PLGRIM: Hierarchical value learning for large-scale exploration in unknown environments. In Proceedings of the International Conference on Automated Planning and Scheduling, Vol. 31. 652–662.
[25]
Haoran Li, Qichao Zhang, and Dongbin Zhao. 2019. Deep reinforcement learning-based automatic exploration for navigation in unknown environment. IEEE Transactions on Neural Networks and Learning Systems 31, 6 (2019), 2064–2076.
[26]
Daniel Mellinger and Vijay Kumar. 2011. Minimum snap trajectory generation and control for quadrotors. In 2011 IEEE International Conference on Robotics and Automation. IEEE, 2520–2525.
[27]
Sergi Molina, Grzegorz Cielniak, and Tom Duckett. 2021. Robotic exploration for learning human motion patterns. IEEE Transactions on Robotics 38, 2 (2021), 1304–1318.
[28]
Christos Papachristos, Shehryar Khattak, and Kostas Alexis. 2017. Uncertainty-aware receding horizon exploration and mapping using aerial robots. In 2017 IEEE International Conference on Robotics and Automation (ICRA’17). IEEE, 4568–4575.
[29]
Victor Massagué Respall, Dmitry Devitt, Roman Fedorenko, and Alexandr Klimchik. 2021. Fast sampling-based next-best-view exploration algorithm for a MAV. In 2021 IEEE International Conference on Robotics and Automation (ICRA’21). IEEE, 89–95.
[30]
Lukas Schmid, Michael Pantic, Raghav Khanna, Lionel Ott, Roland Siegwart, and Juan Nieto. 2020. An efficient sampling-based method for online informative path planning in unknown environments. IEEE Robotics and Automation Letters 5, 2 (2020), 1500–1507.
[31]
James A. Sethian. 1999. Fast marching methods. SIAM Review 41, 2 (1999), 199–235.
[32]
Rakesh Shrestha, Fei-Peng Tian, Wei Feng, Ping Tan, and Richard Vaughan. 2019. Learned map prediction for enhanced mobile robot exploration. In 2019 International Conference on Robotics and Automation (ICRA’19). IEEE, 1197–1204.
[33]
Wennie Tabib, Kshitij Goel, John Yao, Curtis Boirum, and Nathan Michael. 2021. Autonomous cave surveying with an aerial robot. IEEE Transactions on Robotics 38, 2 (2021), 1016–1032.
[34]
Lyne P. Tchapmi, Vineet Kosaraju, Hamid Rezatofighi, Ian Reid, and Silvio Savarese. 2019. Topnet: Structural point cloud decoder. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 383–392.
[35]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 (2017), 5998–6008.
[36]
Lizi Wang, Hongkai Ye, Qianhao Wang, Yuman Gao, Chao Xu, and Fei Gao. 2021. Learning-based 3D occupancy prediction for autonomous navigation in occluded environments. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’21). IEEE, 4509–4516.
[37]
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, and Justin M. Solomon. 2019. Dynamic graph CNN for learning on point clouds. ACM Transactions on Graphics (TOG) 38, 5 (2019), 1–12.
[38]
Christian Witting, Marius Fehr, Rik Bähnemann, Helen Oleynikova, and Roland Siegwart. 2018. History-aware autonomous exploration in confined environments using MAVs. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’18). IEEE, 1–9.
[39]
Haozhe Xie, Hongxun Yao, Shangchen Zhou, Jiageng Mao, Shengping Zhang, and Wenxiu Sun. 2020. Grnet: Gridding residual network for dense point cloud completion. In Proceedings of the 16th European Conference on Computer Vision (ECCV’20), Part IX. Springer, 365–381.
[40]
Yuanfan Xu, Jincheng Yu, Jiahao Tang, Jiantao Qiu, Jian Wang, Yuan Shen, Yu Wang, and Huazhong Yang. 2022. Explore-bench: Data sets, metrics and evaluations for frontier-based and deep-reinforcement-learning-based autonomous exploration. In 2022 International Conference on Robotics and Automation (ICRA’22). IEEE, 6225–6231.
[41]
Zhefan Xu, Di Deng, and Kenji Shimada. 2021. Autonomous UAV exploration of dynamic environments via incremental sampling and probabilistic roadmap. IEEE Robotics and Automation Letters 6, 2 (2021), 2729–2736.
[42]
Brian Yamauchi. 1997. A frontier-based approach for autonomous exploration. In Proceedings of the 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA’97). Towards New Computational Principles for Robotics and Automation. IEEE, 146–151.
[43]
Yaoqing Yang, Chen Feng, Yiru Shen, and Dong Tian. 2017. Foldingnet: Interpretable unsupervised learning on 3D point clouds. arXiv preprint arXiv:1712.07262 2, 3 (2017), 5.
[44]
Xumin Yu, Yongming Rao, Ziyi Wang, Zuyan Liu, Jiwen Lu, and Jie Zhou. 2021. Pointr: Diverse point cloud completion with geometry-aware transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 12498–12507.
[45]
Leonardo Zacchini, Matteo Franchi, and Alessandro Ridolfi. 2022. Sensor-driven autonomous underwater inspections: A receding-horizon RRT-based view planning solution for AUVs. Journal of Field Robotics 39, 5 (2022), 499–527.
[46]
Xuetao Zhang, Yubin Chu, Yisha Liu, Xuebo Zhang, and Yan Zhuang. 2021. A novel informative autonomous exploration strategy with uniform sampling for quadrotors. IEEE Transactions on Industrial Electronics 69, 12 (2021), 13131–13140.
[47]
Yichen Zhang, Boyu Zhou, Luqi Wang, and Shaojie Shen. 2022. Exploration with global consistency using real-time re-integration and active loop closure. In 2022 International Conference on Robotics and Automation (ICRA’22). IEEE, 9682–9688.
[48]
Yinghao Zhao, Li Yan, Yu Chen, Hong Xie, and Bo Xu. 2022. FAEP: Fast autonomous exploration planner for UAV equipped with limited FOV sensor. arXiv preprint arXiv:2202.12507 (2022).
[49]
Ping Zhong, Bolei Chen, Yongzheng Cui, Hanchen Song, and Yu Sheng. 2022. Space-heuristic navigation and occupancy map prediction for robot autonomous exploration. In Proceedings of Algorithms and Architectures for Parallel Processing: 21st International Conference (ICA3PP’21), Part I. Springer, 578–594.
[50]
Ping Zhong, Bolei Chen, Siyi Lu, Xiaoxi Meng, and Yixiong Liang. 2021. Information-driven fast marching autonomous exploration with aerial robots. IEEE Robotics and Automation Letters 7, 2 (2021), 810–817.
[51]
Boyu Zhou, Fei Gao, Luqi Wang, Chuhao Liu, and Shaojie Shen. 2019. Robust and efficient quadrotor trajectory generation for fast autonomous flight. IEEE Robotics and Automation Letters 4, 4 (2019), 3529–3536.
[52]
Boyu Zhou, Jie Pan, Fei Gao, and Shaojie Shen. 2021. Raptor: Robust and perception-aware trajectory replanning for quadrotor fast flight. IEEE Transactions on Robotics 37, 6 (2021), 1992–2009.
[53]
Boyu Zhou, Yichen Zhang, Xinyi Chen, and Shaojie Shen. 2021. Fuel: Fast UAV exploration using incremental frontier structure and hierarchical planning. IEEE Robotics and Automation Letters 6, 2 (2021), 779–786.
[54]
Xin Zhou, Zhepei Wang, Hongkai Ye, Chao Xu, and Fei Gao. 2020. Ego-planner: An ESDF-free gradient-based local planner for quadrotors. IEEE Robotics and Automation Letters 6, 2 (2020), 478–485.
[55]
Delong Zhu, Tingguang Li, Danny Ho, Chaoqun Wang, and Max Q.-H. Meng. 2018. Deep reinforcement learning supervised autonomous exploration in office environments. In 2018 IEEE International Conference on Robotics and Automation (ICRA’18). IEEE, 7548–7555.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 14, Issue 6
December 2023
493 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3632517
  • Editor:
  • Huan Liu
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2023
Online AM: 02 May 2023
Accepted: 24 April 2023
Revised: 27 March 2023
Received: 13 April 2022
Published in TIST Volume 14, Issue 6

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Spatio-temporal autonomous exploration
  2. unmanned aerial vehicles
  3. spatial occupancy prediction
  4. fast marching
  5. information gain

Qualifiers

  • Research-article

Funding Sources

  • National Natural Science Foundation of China
  • Natural Science Foundation of Hunan Province
  • Natural Science Foundation of Changsha

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)449
  • Downloads (Last 6 weeks)81
Reflects downloads up to 30 Dec 2024

Other Metrics

Citations

Cited By

View all

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media