SPEAR-board: cross-platform interactive spatio-temporal big data analytics
Article No.: 105, Pages 1 - 4
Abstract
With the widespread use of mobile and sensing devices, there has been an explosion of high velocity, transient data having spatial and temporal characteristics. Interactive analysis at such scale and speed require support for highly efficient query processing backend frameworks coupled with lightweight yet powerful frontend interfaces. While existing in-memory distributed stream processing frameworks are perfect candidates for scalable big data processing, spatio-temporal systems in this domain are mostly dominated by specify-once-apply-continuously query model. Any modification in query state requires query restart limiting system responsiveness and producing outdated or in the worst case erroneous results. Furthermore, most of the contemporary spatio-temporal big data systems are designed to operate in a single execution environment limiting their applicability to users accustomed to other similar frameworks with different APIs. In this paper, we demon-strate SPEAR-Board; an interactive web-based interface integrated with cross-platform stream processing engine; SPEAR, capable of seamlessly handling spatio-temporal query state changes in real-time. We demonstrate working of SPEAR-Board with respect to spatio-temporal Range and Nearest Neighbor queries backed by Apache Spark and Apache Flink deployed over cloud resources.
References
[1]
Ablimit Aji, Fusheng Wang, Hoang Vo, Rubao Lee, Qiaoling Liu, Xiaodong Zhang, and Joel Saltz. 2013. Hadoop GIS: A High Performance Spatial Data Warehousing System over Mapreduce. Proc. VLDB Endow. 6, 11 (Aug. 2013), 1009--1020.
[2]
Louai Alarabi, Mohamed F Mokbel, and Mashaal Musleh. 2018. St-hadoop: A mapreduce framework for spatio-temporal data. GeoInformatica 22, 4 (2018), 785--813.
[3]
Furqan Baig, Dejun Teng, Jun Kong, and Fusheng Wang. 2021. SPEAR: Dynamic Spatio-Temporal Query Processing over High Velocity Data Streams. In 2021 IEEE 37th International Conference on Data Engineering (ICDE). 2279--2284.
[4]
Furqan Baig, Hoang Vo, Tahsin Kurc, Joel Saltz, and Fusheng Wang. 2017. Sparkgis: Resource aware efficient in-memory spatial query processing. In Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 28.
[5]
Paris Carbone, Asterios Katsifodimos, Stephan Ewen, Volker Markl, Seif Haridi, and Kostas Tzoumas. 2015. Apache flink: Stream and batch processing in a single engine. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering 36, 4 (2015).
[6]
Ahmed Eldawy. 2014. SpatialHadoop: Towards Flexible and Scalable Spatial Processing Using Mapreduce. In Proceedings of the 2014 SIGMOD PhD Symposium (Snowbird, Utah, USA) (SIGMOD'14 PhD Symposium). ACM, New York, NY, USA, 46--50.
[7]
Zdravko Galić. 2016. Spatio-temporal data streams. Springer.
[8]
Zdravko Galić, Emir Mešković, and Dario Osmanović. 2017. Distributed processing of big mobility data as spatio-temporal data streams. Geoinformatica 21, 2 (2017), 263--291.
[9]
Stefan Hagedorn, Philipp Gotze, and Kai-Uwe Sattler. 2017. The STARK frame-work for spatio-temporal data analytics on spark. Datenbanksysteme für Business, Technologie und Web (BTW 2017) (2017).
[10]
Jinxuan Wu Jia Yu, Mohamed Sarwat. 2015. GeoSpark: A Cluster Computing Framework for Processing Large-Scale Spatial Data. In Proceedings of the 2015 International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL 2015).
[11]
Argonne National Laboratory. 2019. Array of Things. https://arrayofthings.github.io/.
[12]
Ruiyuan Li, Huajun He, Rubin Wang, Yuchuan Huang, Junwen Liu, Sijie Ruan, Tianfu He, Jie Bao, and Yu Zheng. 2020. Just: Jd urban spatio-temporal data engine. In 2020 IEEE 36th International Conference on Data Engineering (ICDE). IEEE, 1558--1569.
[13]
Jiajun Liu, Haoran Li, Yong Gao, Hao Yu, and Dan Jiang. 2014. A geohash-based index for spatial data management in distributed memory. In 2014 22nd International Conference on Geoinformatics. IEEE, 1--4.
[14]
Loic Salmon and Cyril Ray. 2017. Design principles of a stream-based framework for mobility analysis. GeoInformatica 21, 2 (2017), 237--261.
[15]
Mingjie Tang, Yongyang Yu, QutaibahMMalluhi, Mourad Ouzzani, and Walid G Aref. 2016. Locationspark: a distributed in-memory data management system for big spatial data. Proceedings of the VLDB Endowment 9, 13 (2016), 1565--1568.
[16]
Dong Xie, Feifei Li, Bin Yao, Gefei Li, Liang Zhou, and Minyi Guo. 2016. Simba: Efficient In-Memory Spatial Analytics. In (To Appear) In Proceedings of 35th ACM SIGMOD International Conference on Management of Data (SIGMOD'16).
[17]
Simin You and Jianting Zhang. 2015. Large-Scale Spatial Join Query Processing in Cloud. Technical Report. City University of New York.
[18]
Matei Zaharia, Mosharaf Chowdhury, Michael J. Franklin, Scott Shenker, and Ion Stoica. 2010. Spark: Cluster Computing with Working Sets. In Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing (Boston, MA) (HotCloud'10). USENIX Association, Berkeley, CA, USA, 10--10. http://dl.acm.org/citation.cfm?id=1863103.1863113
Index Terms
- SPEAR-board: cross-platform interactive spatio-temporal big data analytics
Recommendations
A Survey on Spatio-temporal Data Analytics Systems
Due to the surge of spatio-temporal data volume, the popularity of location-based services and applications, and the importance of extracted knowledge from spatio-temporal data to solve a wide range of real-world problems, a plethora of research and ...
DISTIL: a distributed in-memory data processing system for location-based services
SIGSPATIAL '18: Proceedings of the 26th ACM SIGSPATIAL International Conference on Advances in Geographic Information SystemsLocation-based services (LBS) have become an ubiquitous technology and spatio-temporal data generated by LBS is characterized by high volume and velocity. In recent times several projects, such as GeoSpark, SpatialSpark and LocationSpark, have focused ...
TrajParquet: A Trajectory-Oriented Column File Format for Mobility Data Lakes
SIGSPATIAL '23: Proceedings of the 31st ACM International Conference on Advances in Geographic Information SystemsColumnar data formats, such as Apache Parquet, are increasingly popular nowadays for scalable data storage and querying data lakes, due to compressed storage and efficient data access via data skipping. However, when applied to spatial or spatio-temporal ...
Comments
Information & Contributors
Information
Published In
November 2022
806 pages
Copyright © 2022 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 November 2022
Check for updates
Author Tags
Qualifiers
- Demonstration
Funding Sources
- National Institutes of Health
Conference
SIGSPATIAL '22
Sponsor:
SIGSPATIAL '22: The 30th International Conference on Advances in Geographic Information Systems
November 1 - 4, 2022
Washington, Seattle
Acceptance Rates
Overall Acceptance Rate 257 of 1,238 submissions, 21%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 91Total Downloads
- Downloads (Last 12 months)22
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in