skip to main content
10.1145/3576842.3582384acmconferencesArticle/Chapter ViewAbstractPublication PagesiotdiConference Proceedingsconference-collections
research-article
Open access

SolarDetector: Automatic Solar PV Array Identification using Big Satellite Imagery Data

Published: 09 May 2023 Publication History

Abstract

Due to the intermittent nature of solar energy, it has been increasingly challenging for the utilities, third-parties, and government agencies to integrate distributed energy resources generated by rooftop solar photovoltaic (PV) arrays into smart grids. Recently, there is a rising interest in automatically collecting solar installation information in a geospatial region that are necessary to manage this stochastic green energy, including the quantity and locations of solar PV deployments, and their profiling information. Most recent work focuses on using big aerial or satellite imagery data to train machine learning or deep learning models to automatically detect solar PV arrays. Unfortunately, these approaches are suffering low detection accuracy due to the insufficient sample and feature learning when building their models, and the separation of rooftop object segmentation and identification during their detection process. In addition, most recent approaches cannot report accurate multi-panel detection results.
To address these problems, we design a new approach—SolarDetector that can automatically detect and profile distributed solar photovoltaic arrays in a given geospatial region without any extra cost. SolarDetector first leverages data augmentation techniques and Generative adversarial networks (GANs) to automatically learn accurate features for rooftop objects. Then, SolarDetector employs Mask R-CNN algorithm to accurately identify rooftop solar arrays and also learn the detailed installation information for each solar array simultaneously. In addition, SolarDetector could also integrate with large-scale data processing engine—Apache Spark and graphics processing units (GPUs) to further improve its training cost. We evaluate SolarDetector using 263,430 public satellite images from 11 geospatial regions in the U.S. We find that pre-trained SolarDetector yields an average MCC of 0.76 to detect solar PV arrays over two big datasets, which is ∼ 50% better than the most notable approach—SolarFinder. In addition, unlike prior work, we show that SolarDetector can also accurately report the profiling information for the detected rooftop objects.

References

[1]
Josephine Akosa. [n. d.]. Predictive accuracy: a misleading performance measure for highly imbalanced data.
[2]
Fadi Al-Turjman and Mohammad Abujubbeh. 2019. IoT-enabled smart grid via SM: An overview. Future Generation Computer Systems 96 (2019), 579–590.
[3]
Noman Bashir, Dong Chen, David Irwin, and Prashant Shenoy. 2019. Solar-TK: A Data-driven Toolkit for Solar PV Performance Modeling and Forecasting. In 2019 IEEE 16th International Conference on Mobile Ad Hoc and Sensor Systems (MASS). IEEE, 456–466.
[4]
Yoshua Bengio, Patrice Simard, Paolo Frasconi, 1994. Learning long-term dependencies with gradient descent is difficult. IEEE transactions on neural networks 5, 2 (1994), 157–166.
[5]
Dong Chen, Joseph Breda, and David Irwin. 2018. Staring at the sun: a physical black-box solar performance model. In Proceedings of the 5th Conference on Systems for Built Environments. ACM, 53–62.
[6]
Abderrahim Derdar, Nadia Bensiali, Mohamed Adjabi, Nadir Boutasseta, Mohammed Salah Bouakkaz, Issam Attoui, Nadir Fergani, and Ahmed Bouraiou. 2022. Photovoltaic energy generation systems monitoring and performance optimization using wireless sensors network and metaheuristics. Sustainable Computing: Informatics and Systems 35 (2022), 100684.
[7]
Vladimir Golovko, Sergei Bezobrazov, Alexander Kroshchanka, Anatoliy Sachenko, Myroslav Komar, and Andriy Karachka. 2017. Convolutional neural network based solar photovoltaic panel detection in satellite photos. In 2017 9th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS), Vol. 1. IEEE, 14–19.
[8]
Vladimir Golovko, Alexander Kroshchanka, Sergei Bezobrazov, Anatoliy Sachenko, Myroslav Komar, and Oleksandr Novosad. 2018. Development of Solar Panels Detector. In 2018 International Scientific-Practical Conference Problems of Infocommunications. Science and Technology (PIC S&T). IEEE, 761–764.
[9]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems, Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K.Q. Weinberger (Eds.). Vol. 27. Curran Associates, Inc.https://proceedings.neurips.cc/paper/2014/file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf
[10]
googlemaps [n. d.]. googlemaps. https://developers.google.com/maps/documentation/maps-static/intro.
[11]
Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. 2017. Mask R-CNN. In 2017 IEEE International Conference on Computer Vision (ICCV). 2980–2988. https://doi.org/10.1109/ICCV.2017.322
[12]
Yuji HIGUCHI and Tadatoshi BABASAKI. 2018. Failure detection of solar panels using thermographic images captured by drone. In 2018 7th International Conference on Renewable Energy Research and Applications (ICRERA). IEEE, 391–396.
[13]
Srinivasan Iyengar, Stephen Lee, Daniel Sheldon, and Prashant Shenoy. 2018. Solarclique: Detecting anomalies in residential solar arrays. In Proceedings of the 1st ACM SIGCAS Conference on Computing and Sustainable Societies. 1–10.
[14]
Stephen Lee, Srinivasan Iyengar, Menghong Feng, Prashant Shenoy, and Subhransu Maji. 2019. DeepRoof: A Data-driven Approach For Solar Potential Estimation Using Rooftop Imagery. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (Anchorage, AK, USA) (KDD ’19). ACM, New York, NY, USA, 2105–2113. https://doi.org/10.1145/3292500.3330741
[15]
Qi Li, Yuzhou Feng, Yuyang Leng, and Dong Chen. 2020. SolarFinder: Automatic Detection of Solar Photovoltaic Arrays. In 2020 19th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 193–204. https://doi.org/10.1109/IPSN48710.2020.00024
[16]
Qi Li, Keyang Yu, and Dong Chen. 2021. SolarDiagnostics: Automatic damage detection on rooftop solar photovoltaic arrays. Sustainable Computing: Informatics and Systems 32 (2021), 100595.
[17]
Andreas Livera, Marios Theristis, George Makrides, and George E Georghiou. 2019. Recent advances in failure diagnosis techniques based on performance data analysis for grid-connected photovoltaic systems. Renewable energy 133 (2019), 126–143.
[18]
Jordan M Malof, Kyle Bradbury, Leslie M Collins, Richard G Newell, Alexander Serrano, Hetian Wu, and Sam Keene. 2016. Image features for pixel-wise detection of solar photovoltaic arrays in aerial imagery using a random forest classifier. In 2016 IEEE International Conference on Renewable Energy Research and Applications (ICRERA). IEEE, 799–803.
[19]
Jordan M Malof, Leslie M Collins, and Kyle Bradbury. 2017. A deep convolutional neural network, with pre-training, for solar photovoltaic array detection in aerial imagery. In 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). IEEE, 874–877.
[20]
Jordan M Malof, Leslie M Collins, Kyle Bradbury, and Richard G Newell. 2016. A deep convolutional neural network and a random forest classifier for solar photovoltaic array detection in aerial imagery. In 2016 IEEE International Conference on Renewable Energy Research and Applications (ICRERA). IEEE, 650–654.
[21]
Jordan M Malof, Rui Hou, Leslie M Collins, Kyle Bradbury, and Richard Newell. 2015. Automatic solar photovoltaic panel detection in satellite imagery. In 2015 International Conference on Renewable Energy Research and Applications (ICRERA). IEEE, 1428–1431.
[22]
OpenStreetMap [n. d.]. OpenStreetMap. https://www.openstreetmap.org/.
[23]
Stjepan Picek, Annelie Heuser, Alan Jovic, Shivam Bhasin, and Francesco Regazzoni. 2018. The curse of class imbalance and conflicting metrics with machine learning for side-channel evaluations. (2018).
[24]
Alec Radford, Luke Metz, and Soumith Chintala. 2015. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015).
[25]
Sunil Rao, Sameeksha Katoch, Pavan Turaga, Andreas Spanias, Cihan Tepedelenlioglu, Raja Ayyanar, Henry Braun, Jongmin Lee, U Shanthamallu, M Banavar, 2017. A cyber-physical system approach for photovoltaic array monitoring and control. In 2017 8th International Conference on Information, Intelligence, Systems & Applications (IISA). IEEE, 1–6.
[26]
Salima Sarikh, Mustapha Raoufi, Amin Bennouna, Ahmed Benlarabi, and Badr Ikken. 2019. Photovoltaic system fault identification methodology based on IV characteristics analysis. In AIP Conference Proceedings, Vol. 2123. AIP Publishing LLC, 020037.
[27]
Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
[28]
Brenda So, Cory Nezin, Vishnu Kaimal, Sam Keene, Leslie Collins, Kyle Bradbury, and Jordan M Malof. 2017. Estimating the electricity generation capacity of solar photovoltaic arrays using only color aerial imagery. In 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). IEEE, 1603–1606.
[29]
SolarDetector [n. d.]. SolarDetector. https://github.com/cyber-physical-systems/solardetector.
[30]
SolarFinder Dataset [n. d.]. SolarFinder. https://www.kaggle.com/datasets/qli027/solar-finder/.
[31]
Rui Wang, Joseph Camilo, Leslie M Collins, Kyle Bradbury, and Jordan M Malof. 2017. The poor generalization of deep convolutional networks to aerial imagery from new geographic locations: an empirical study with solar array detection. In 2017 IEEE Applied Imagery Pattern Recognition Workshop (AIPR). IEEE, 1–8.
[32]
Yaxing Wang, Chenshen Wu, Luis Herranz, Joost van de Weijer, Abel Gonzalez-Garcia, and Bogdan Raducanu. 2018. Transferring GANs: generating images from limited data. In Proceedings of the European Conference on Computer Vision (ECCV). 218–234.
[33]
Yaosuo Xue, Michael Starke, Jin Dong, Mohammed Olama, Teja Kuruganti, Jeffrey Taft, and Mallikarjun Shankar. 2018. On a future for smart inverters with integrated system functions. In 2018 9th IEEE International Symposium on Power Electronics for Distributed Generation Systems (PEDG). IEEE, 1–8.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IoTDI '23: Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation
May 2023
514 pages
ISBN:9798400700378
DOI:10.1145/3576842
This work is licensed under a Creative Commons Attribution-NoDerivatives International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 May 2023

Check for updates

Author Tags

  1. Big Data
  2. Data Analytics
  3. Deep Learning
  4. Image Processing
  5. Solar Detection
  6. Solar Segmentation

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

IoTDI '23
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)427
  • Downloads (Last 6 weeks)79
Reflects downloads up to 05 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media