skip to main content
10.1145/3594315.3594385acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccaiConference Proceedingsconference-collections
research-article

Dynamic Graph Convolutional Transformer for Short-term Wind Speed Forecasting

Published: 02 August 2023 Publication History

Abstract

Wind speed forecasting is still a challenging problem, especially considering the correlations of spatial and temporal domains. However, the changing properties of spatial dependencies over time are ignored in most existing algorithms. In this paper, we propose a novel spatio-temporal machine learning algorithm, named Dynamic Graph Convolutional Transformer (DGCT), for wind speed forecasting. The key contribution of the proposed method is that graph convolutional networks are embedded into self-attention layers of Transformer to capture spatio-temporal correlations to improve the accuracy of forecasting. For the changing properties of spatial dependencies, we model the spatial dependencies as a mixture of global and localized patterns, which are represented by static and dynamic matrices respectively. Moreover, an auxiliary network is designed to generate the dynamic matrix, which further improve the forecasting accuracy. Experiments on two real-world datasets demonstrate that the proposed method outperformed other existing methods consistently.

References

[1]
Shoaib, Muhammad, "Assessment of wind energy potential using wind energy conversion system." Journal of cleaner production 216 (2019): 346-360.
[2]
Zhang S, Wei J, Chen X, China in global wind power development: Role, status and impact[J]. Renewable and Sustainable Energy Reviews, 2020, 127: 109881.
[3]
Barra P H A, de Carvalho W C, Menezes T S, A review on wind power smoothing using high-power energy storage systems[J]. Renewable and Sustainable Energy Reviews, 2021, 137: 110455.
[4]
Wang, Long, "Wind turbine gearbox failure identification with deep neural networks." IEEE Transactions on Industrial Informatics 13.3 (2016): 1360-1368.
[5]
Sapankevych, Nicholas I., and Ravi Sankar. "Time series prediction using support vector machines: a survey." IEEE computational intelligence magazine 4.2 (2009): 24-38.
[6]
Sun, Xiaolei, Mingxi Liu, and Zeqian Sima. "A novel cryptocurrency price trend forecasting model based on LightGBM." Finance Research Letters 32 (2020): 101084.
[7]
Bali, Vikram, Ajay Kumar, and Satyam Gangwar. "Deep learning based wind speed forecasting-A review." 2019 9th International Conference on Cloud Computing, Data Science & Engineering (Confluence). IEEE, 2019.
[8]
Bai, Shaojie, J. Zico Kolter, and Vladlen Koltun. "An empirical evaluation of generic convolutional and recurrent networks for sequence modeling." arXiv preprint arXiv:1803.01271 (2018).
[9]
Fu, Rui, Zuo Zhang, and Li Li. "Using LSTM and GRU neural network methods for traffic flow prediction." 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC). IEEE, 2016.
[10]
Petneházi, Gábor. "Recurrent neural networks for time series forecasting." arXiv preprint arXiv:1901.00069 (2019).
[11]
Wen, Qingsong, "Transformers in time series: A survey." arXiv preprint arXiv:2202.07125 (2022).
[12]
Zhu, Qiaomu, "Learning temporal and spatial correlations jointly: A unified framework for wind speed prediction." IEEE Transactions on Sustainable Energy 11.1 (2019): 509-523.
[13]
Stańczyk, Tomasz, and Siamak Mehrkanoon. "Deep graph convolutional networks for wind speed prediction." arXiv preprint arXiv:2101.10041 (2021).
[14]
Wu, Zonghan, "Graph wavenet for deep spatial-temporal graph modeling." arXiv preprint arXiv:1906.00121 (2019).
[15]
Vaswani, Ashish, "Attention is all you need." Advances in neural information processing systems 30 (2017).
[16]
Abbasi, Ali Reza, Mohammad Reza Mahmoudi, and Mohammad Mehdi Arefi. "Transformer winding faults detection based on time series analysis." IEEE Transactions on Instrumentation and Measurement 70 (2021): 1-10.
[17]
Li, Shiyang, "Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting." Advances in neural information processing systems 32 (2019).
[18]
Zhou, Jingbo, "SDWPF: A dataset for spatial dynamic wind power forecasting challenge at KDD cup 2022." arXiv preprint arXiv:2208.04360 (2022).

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICCAI '23: Proceedings of the 2023 9th International Conference on Computing and Artificial Intelligence
March 2023
824 pages
ISBN:9781450399029
DOI:10.1145/3594315
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 August 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Dynamic graph convolutional networks
  2. Spatio-temporal series
  3. Transforme
  4. Wind speed forecasting

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICCAI 2023

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 46
    Total Downloads
  • Downloads (Last 12 months)25
  • Downloads (Last 6 weeks)0
Reflects downloads up to 06 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media