skip to main content
research-article

A Binary Grey Wolf Optimization based Hybrid Convolutional Neural Network (BGWOHCNN) framework for hyperspectral image classification

Published: 20 June 2023 Publication History

Abstract

In recent years deep learning (DL) models have obtained great success in hyperspectral image classification (HSIC) with commendable performance and especially convolutional neural networks (CNNs) have attracted huge attention due to the exceptional performance demonstrated in this area. However, most of the CNN-based models have to suffer with low classification performance due to non-availability of abundant training samples. Recently, hybrid-CNN models, utilizing both spectral and spatial features unitedly, have exhibited remarkable classification accuracy. Yet, the hybrid-CNN models have been adopted in very limited research works due to a very high computational complexity. Furthermore, huge dimensional HSIs contain highly correlated but irrelevant bands. The selection of most relevant spectral bands affects the performance and computational complexity of HSIC models very profoundly. To address these issues, the authors have proposed a binary grey wolf optimization-based hybrid CNN (BGWOHCNN) framework for HSIC, in this paper. In the hybrid framework, a 3-D CNN has been employed to exploit spatial and spectral features jointly along with a 2-D CNN utilizing the spatial features and reducing the computational complexity of the overall design. In addition, binary grey wolf optimization (BGWO) technique has been adapted to select the most relevant spectral bands for HSIC. As per the best of authors’ knowledge and belief, the BGWO technique has been investigated for the first time with hybrid CNN for HSIC in the current work. Further, the experiments are conducted to investigate the performance and superiority of the proposed framework over three very popular datasets viz. Salinas, Indian Pines and Pavia University. The obtained results are compared with the six state-of-art DL models, in terms of average accuracy, overall accuracy and Cohen’s kappa coefficient, to show that the proposed framework provides very promising results to HSIC tasks.

References

[1]
Chen Y, Lin Z, Zhao X, Wang G, and Gu Y Deep learning-based classification of hyperspectral data IEEE Journal of Selected topics in Applied Earth Observations and Remote Sensing 2014 7 6 2094-2107
[2]
Chen Y, Jiang H, Li C, Jia X, and Ghamisi P Deep feature extraction and classification of hyperspectral images based on convolutional neural networks IEEE Trans Geosci Remote Sens 2016 54 10 6232-6251
[3]
Chen C, Jiang F, Yang C, Rho S, Shen W, Liu S, and Liu Z Hyperspectral classification based on spectral–spatial convolutional neural networks Eng Appl Artif Intell 2018 68 165-171
[4]
Chen Y, Zhu K, Zhu L, He X, Ghamisi P, and Benediktsson JA Automatic design of convolutional neural network for hyperspectral image classification IEEE Trans Geosci Remote Sens 2019 57 9 7048-7066
[5]
Cheng J, Wang P, Li G, Hu Q, Lu H (2018) Recent advances in efficient computation of deep convolutional neural networks. arXiv:1802.00939
[6]
Dunne R A, Campbell N A (1997) On the pairing of the softmax activation and cross-entropy penalty functions and the derivation of the softmax activation function. In: Proc. 8th Aust. conf. on the neural networks, Melbourne, vol 181, p 185
[7]
Emary E, Zawbaa HM, and Hassanien AE Binary grey wolf optimization approaches for feature selection Neurocomputing 2016 172 371-381
[8]
Fukushima K, Miyake S (1982) Neocognitron: a self-organizing neural network model for a mechanism of visual pattern recognition. In: Competition and cooperation in neural nets. Springer, Japan, pp 267–285
[9]
Ghaderizadeh S, Abbasi-Moghadam D, Sharifi A, Zhao N, and Tariq A Hyperspectral image classification using a hybrid 3d-2d convolutional neural networks IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 2021 14 7570-7588
[10]
Ghamisi P, Yokoya N, Li J, Liao W, Liu S, Plaza J, Rasti B, and Plaza A Advances in hyperspectral image and signal processing: a comprehensive overview of the state of the art IEEE Geosci Rem Sens Mag 2017 5 4 37-78
[11]
Guo B, Damper RI, Gunn SR, and Nelson JDB Improving hyperspectral band selection by constructing an estimated reference map J Appl Remote Sens 2014 8 1 083692
[12]
Habbema JDF and Hermans J Selection of variables in discriminant analysis by f-statistic and error rate Technometrics 1977 19 4 487-493
[13]
Hatta NM, Zain AM, Sallehuddin R, Shayfull Z, and Yusoff Y Recent studies on optimisation method of grey wolf optimiser (gwo): a review (2014–2017) Artif Intell Rev 2019 52 4 2651-2683
[14]
He M, Li B, Chen H (2017) Multi-scale 3d deep convolutional neural network for hyperspectral image classification. In: 2017 IEEE International Conference on Image Processing (ICIP). IEEE, pp 3904–3908
[15]
Hu W-S, Li H-C, Pan L, Li W, Tao R, Du Q (2019) Feature extraction and classification based on spatial-spectral convlstm neural network for hyperspectral images. arXiv:1905.03577
[16]
Hu W-S, Li H-C, Pan L, Li W, Tao R, and Du Q Spatial–spectral feature extraction via deep convlstm neural networks for hyperspectral image classification IEEE Trans Geosci Remote Sens 2020 58 6 4237-4250
[17]
Jensen JR Remote sensing of the environment: an earth resource perspective 2/e 2009 India Pearson Education India
[18]
Jia S, Zhu Z, Shen L, and Li Q A two-stage feature selection framework for hyperspectral image classification using few labeled samples IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 2013 7 4 1023-1035
[19]
Jia S, Tang G, Zhu J, and Li Q A novel ranking-based clustering approach for hyperspectral band selection IEEE Trans Geosci Remote Sens 2015 54 1 88-102
[20]
Krizhevsky A, Sutskever I, and Hinton GE Imagenet classification with deep convolutional neural networks Commun ACM 2017 60 6 84-90
[21]
Kumar D, Kumar D (2021) Hyperspectral image classification using deep learning models: a review. In: Journal of Physics: Conference Series, vol 1950. IOP Publishing, p 012087
[22]
Lee H and Kwon H Going deeper with contextual cnn for hyperspectral image classification IEEE Trans Image Process 2017 26 10 4843-4855
[23]
Li Y, Zhang H, and Shen Q Spectral–spatial classification of hyperspectral imagery with 3d convolutional neural network Rem Sens 2017 9 1 67
[24]
Li J, Xi B, Li Y, Du Q, and Wang K Hyperspectral classification based on texture feature enhancement and deep belief networks Rem Sens 2018 10 3 396
[25]
Liu Q, Zhou F, Hang R, and Yuan X Bidirectional-convolutional lstm based spectral-spatial feature learning for hyperspectral image classification Rem Sens 2017 9 12 1330
[26]
Lu G and Fei B Medical hyperspectral imaging: a review J Biomed Opt 2014 19 1 010901
[27]
Luo H (2018) Shorten spatial-spectral rnn with parallel-gru for hyperspectral image classification. arXiv:1810.12563
[28]
Luo F, Huang Y, Tu W, and Liu J Local manifold sparse model for image classification Neurocomputing 2020 382 162-173
[29]
Ma X, Geng J, and Wang H Hyperspectral image classification via contextual deep learning EURASIP J Image Video Process 2015 2015 1 1-12
[30]
Manley PV, Sagan V, Fritschi FB, and Burken JG Remote sensing of explosives-induced stress in plants: Hyperspectral imaging analysis for remote detection of unexploded threats Rem Sens 2019 11 15 1827
[31]
Medjahed SA, Saadi TA, Benyettou A, and Ouali M Binary cuckoo search algorithm for band selection in hyperspectral image classification IAENG Int J Comput Sci 2015 42 3 183-191
[32]
Medjahed SA, Saadi TA, Benyettou A, and Ouali M Gray wolf optimizer for hyperspectral band selection Appl Soft Comput 2016 40 178-186
[33]
Melgani F and Bruzzone L Classification of hyperspectral remote sensing images with support vector machines IEEE Trans Geosci Rem Sens 2004 42 8 1778-1790
[34]
Mou L, Ghamisi P, and Zhu XX Deep recurrent neural networks for hyperspectral image classification IEEE Trans Geosci Remote Sens 2017 55 7 3639-3655
[35]
Moughal TA (2013) Hyperspectral image classification using support vector machine. In: J Phys: Conf Series, vol 439. IOP Publishing, p 012042
[36]
Mughees A and Tao L Multiple deep-belief-network-based spectral-spatial classification of hyperspectral images Tsinghua Sci Technol 2018 24 2 183-194
[37]
Pal K K, Sudeep KS (2016) Preprocessing for image classification by convolutional neural networks. In: 2016 IEEE International conference on recent trends in electronics, information & communication technology (RTEICT). IEEE, pp 1778–1781
[38]
Pan B, Shi Z, and Xu X Mugnet: deep learning for hyperspectral image classification using limited samples ISPRS J Photogramm Remote Sens 2018 145 108-119
[39]
Pan E, Mei X, Wang Q, Ma Y, and Ma J Spectral-spatial classification for hyperspectral image based on a single gru Neurocomputing 2020 387 150-160
[40]
Paoletti ME, Haut JM, Plaza J, and Plaza A A new deep convolutional neural network for fast hyperspectral image classification ISPRS J Photogramm Remote Sens 2018 145 120-147
[41]
Pathak Y, Arya KV, and Tiwari S Feature selection for image steganalysis using levy flight-based grey wolf optimization Multimed Tools Applic 2019 78 2 1473-1494
[42]
Qi C, Zhou Z, Sun Y, Song H, Hu L, and Wang Q Feature selection and multiple kernel boosting framework based on pso with mutation mechanism for hyperspectral classification Neurocomputing 2017 220 181-190
[43]
Roy SK, Krishna G, Dubey SR, and Chaudhuri BB Hybridsn: exploring 3-d–2-d cnn feature hierarchy for hyperspectral image classification IEEE Geosci Remote Sens Lett 2019 17 2 277-281
[44]
Sawant SS and Manoharan P New framework for hyperspectral band selection using modified wind-driven optimization algorithm Int J Remote Sens 2019 40 20 7852-7873
[45]
Sellami A, Farah M, Farah IR, and Solaiman B Hyperspectral imagery classification based on semi-supervised 3-d deep neural network and adaptive band selection Expert Syst Appl 2019 129 246-259
[46]
Shahshahani BM and Landgrebe DA The effect of unlabeled samples in reducing the small sample size problem and mitigating the hughes phenomenon IEEE Trans Geosci Rem Sens 1994 32 5 1087-1095
[47]
Sharma A, Liu X, and Yang X Land cover classification from multi-temporal, multi-spectral remotely sensed imagery using patch-based recurrent neural networks Neural Netw 2018 105 346-355
[48]
Shi C and Pun C-M Superpixel-based 3d deep neural networks for hyperspectral image classification Pattern Recogn 2018 74 600-616
[49]
Singh S and Kasana SS Efficient classification of the hyperspectral images using deep learning Multimed Tools Applic 2018 77 20 27061-27074
[50]
Srinivasu PN and Balas VE Self-learning network-based segmentation for real-time brain mr images through haris PeerJ Comput Sci 2021 7 e654
[51]
Srinivasu PN, SivaSai JG, Ijaz MF, Bhoi AK, Kim W, and Kang JJ Classification of skin disease using deep learning neural networks with mobilenet v2 and lstm Sensors 2021 21 8 2852
[52]
Wang C, Ma N, Ming Y, Wang Q, and Xia J Classification of hyperspectral imagery with a 3d convolutional neural network and jm distance Adv Space Res 2019 64 4 886-899
[53]
Xie F, Li F, Lei C, Yang J, and Zhang Y Unsupervised band selection based on artificial bee colony algorithm for hyperspectral image classification Appl Soft Comput 2019 75 428-440
[54]
Xu Y, Zhang L, Du B, and Zhang F Spectral–spatial unified networks for hyperspectral image classification IEEE Trans Geosci Remote Sens 2018 56 10 5893-5909
[55]
Yang H, Du Q, Su H, and Sheng Y An efficient method for supervised hyperspectral band selection IEEE Geosci Remote Sens Lett 2010 8 1 138-142
[56]
Yang R, Su L, Zhao X, Wan H, and Sun J Representative band selection for hyperspectral image classification J Vis Commun Image Represent 2017 48 396-403
[57]
Yin J, Wang Y, and Hu J A new dimensionality reduction algorithm for hyperspectral image using evolutionary strategy IEEE Trans Industr Inf 2012 8 4 935-943
[58]
Yu S, Jia S, and Xu C Convolutional neural networks for hyperspectral image classification Neurocomputing 2017 219 88-98
[59]
Yu C, Han R, Song M, Liu C, and Chang C-I A simplified 2d-3d cnn architecture for hyperspectral image classification based on spatial–spectral fusion IEEE J Selected Topics Appl Earth Observ Rem Sens 2020 13 2485-2501
[60]
Yuan Y, Lin J, and Wang Q Dual-clustering-based hyperspectral band selection by contextual analysis IEEE Trans Geosci Remote Sens 2015 54 3 1431-1445
[61]
Zhai H, Zhang H, Zhang L, and Li P Laplacian-regularized low-rank subspace clustering for hyperspectral image band selection IEEE Trans Geosci Remote Sens 2018 57 3 1723-1740
[62]
Zhao W and Du S Spectral–spatial feature extraction for hyperspectral image classification: a dimension reduction and deep learning approach IEEE Trans Geosci Remote Sens 2016 54 8 4544-4554
[63]
Zhao Y-Q, Zhang L, and Kong SG Band-subset-based clustering and fusion for hyperspectral imagery classification IEEE Trans Geosci Remote Sens 2010 49 2 747-756
[64]
Zhong Z, Li J, Luo Z, and Chapman M Spectral–spatial residual network for hyperspectral image classification: a 3-d deep learning framework IEEE Trans Geosci Remote Sens 2017 56 2 847-858
[65]
Zhou F, Hang R, Liu Q, and Yuan X Hyperspectral image classification using spectral-spatial lstms Neurocomputing 2019 328 39-47
[66]
Zhu J, Hu J, Jia S, Jia X, and Li Q Multiple 3-d feature fusion framework for hyperspectral image classification IEEE Trans Geosci Remote Sens 2018 56 4 1873-1886

Index Terms

  1. A Binary Grey Wolf Optimization based Hybrid Convolutional Neural Network (BGWOHCNN) framework for hyperspectral image classification
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image Multimedia Tools and Applications
        Multimedia Tools and Applications  Volume 83, Issue 4
        Jan 2024
        2884 pages

        Publisher

        Kluwer Academic Publishers

        United States

        Publication History

        Published: 20 June 2023
        Accepted: 19 April 2023
        Revision received: 04 May 2022
        Received: 19 October 2021

        Author Tags

        1. Deep learning
        2. Machine learning
        3. Hyperspectral image classification
        4. Hybrid design

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 0
          Total Downloads
        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 06 Jan 2025

        Other Metrics

        Citations

        View Options

        View options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media