Stacked-CNN-BiLSTM-COVID: an effective stacked ensemble deep learning framework for sentiment analysis of Arabic COVID-19 tweets
Abstract
Social networks are popular for advertising, idea sharing, and opinion formation. Due to COVID-19, coronavirus information disseminated on social media affects people’s lives directly. Individuals sometimes managed it well, but it often hampered daily activities. As a result, analyzing people’s feelings is important. Sentiment analysis identifies opinions or sentiments from text. In this paper, we present an effective model that leverages the benefits of Convolutional Neural Network (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) to categorize Arabic tweets using a stacked ensemble learning model. First, the tweets are represented as vectors using a word embedding model, then the text feature is extracted by CNN, and finally the context information of the text is acquired by BiLSTM. Aravec, FastText, and ArWordVec are employed separately to assess the impact of the word embedding on the our model. We also compare the proposed method to various deep learning models: CNN, LSTM, and BiLSTM. Experiments are performed on three different Arabic datasets related to COVID-19 and vaccines. Empirical findings show that the proposed model outperformed the other models’ results by achieving F-measures of 76.76%, 87.%, and 80.5% on the SenWave, AraCOVID19-SSD, and ArCovidVac datasets, respectively.
References
[1]
Liu B Sentiment analysis and opinion mining Synth Lect Hum Lang Technol 2012 5 1 1-167
[2]
Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, and Kuksa P Natural language processing (almost) from scratch J Mach Learn Res 2011 12 ARTICLE 2493-2537
[3]
Luo S, Gu Y, Yao X, and Fan W Research on text sentiment analysis based on neural network and ensemble learning Rev d’Intelligence Artif 2021 35 1 63-70
[4]
Heikal M, Torki M, and El-Makky N Sentiment analysis of arabic tweets using deep learning Procedia Comput Sci 2018 142 114-122
[5]
Al-Azani S, El-Alfy ESM (2017) Hybrid deep learning for sentiment polarity determination of arabic microblogs. In: International Conference on Neural Information Processing. Springer, pp 491–500
[6]
Alwehaibi A, Bikdash M, Albogmi M, Roy K (2021) A study of the performance of embedding methods for arabic short-text sentiment analysis using deep learning approaches. J King Saud Univ-Comput Inf Sci
[7]
Tam S, Said RB, and Tanriöver ÖÖ A convbilstm deep learning model-based approach for twitter sentiment classification IEEE Access 2021 9 41283-41293
[8]
Liu G and Guo J Bidirectional lstm with attention mechanism and convolutional layer for text classification Neurocomputing 2019 337 325-338
[9]
Lulu L and Elnagar A Automatic arabic dialect classification using deep learning models Procedia Comput Sci 2018 142 262-269
[10]
Abdelhade N, Soliman THA, Ibrahim HM (2017) Detecting twitter users’ opinions of arabic comments during various time episodes via deep neural network. In: International Conference on Advanced Intelligent Systems and Informatics. Springer, pp 232–246
[11]
Abu Kwaik K, Saad M, Chatzikyriakidis S, Dobnik S (2019) Lstm-cnn deep learning model for sentiment analysis of dialectal arabic. In: International Conference on Arabic Language Processing. Springer, pp 108–121
[12]
Baly R, El-Khoury G, Moukalled R, Aoun R, Hajj H, Shaban KB, and El-Hajj W Comparative evaluation of sentiment analysis methods across arabic dialects Procedia Comput Sci 2017 117 266-273
[13]
Soumeur A, Mokdadi M, Guessoum A, and Daoud A Sentiment analysis of users on social networks: Overcoming the challenge of the loose usages of the algerian dialect Procedia Comput Sci 2018 142 26-37
[14]
Alwehaibi A, Roy K (2018) Comparison of pre-trained word vectors for arabic text classification using deep learning approach. In: 2018 17th IEEE international conference on machine learning and applications (ICMLA). IEEE, pp 1471–1474
[15]
Mohammed A and Kora R Deep learning approaches for arabic sentiment analysis Soc Netw Anal Min 2019 9 1 1-12
[16]
Al-Azani S and El-Alfy ESM Using word embedding and ensemble learning for highly imbalanced data sentiment analysis in short Arabic text Procedia Comput Sci 2017 109 359-366
[17]
Abdou M, Kulmizev A, i Ametllé JG (2018) Affecthor at semeval-2018 task 1: A cross-linguistic approach to sentiment intensity quantification in tweets. In: Proceedings of The 12th International Workshop on Semantic Evaluation. pp 210–217
[18]
Zaidan O, Callison-Burch C (2011) The arabic online commentary dataset: an annotated dataset of informal arabic with high dialectal content. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. pp 37–41
[19]
Nabil M, Aly M, Atiya A (2015) Astd: Arabic sentiment tweets dataset. In: Proceedings of the 2015 conference on empirical methods in natural language processing. pp 2515–2519
[20]
Abdulla NA, Ahmed NA, Shehab MA, Al-Ayyoub M (2013) Arabic sentiment analysis: Lexicon-based and corpus-based. In: 2013 IEEE Jordan conference on applied electrical engineering and computing technologies (AEECT). IEEE, pp 1–6
[21]
Aly M, Atiya A (2013) Labr: A large scale arabic book reviews dataset. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). pp 494–498
[22]
Soufan A (2019) Deep learning for sentiment analysis of arabic text. In: Proceedings of the ArabWIC 6th Annual International Conference Research Track. pp 1–8
[23]
Al-Twairesh N, Al-Khalifa H, Al-Salman A, and Al-Ohali Y Arasenti-tweet: A corpus for arabic sentiment analysis of saudi tweets Procedia Comput Sci 2017 117 63-72
[24]
Kora R, Mohammed A (2019) Corpus on arabic egyptian tweets. Harv Dataverse
[25]
Al-Azani S, El-Alfy ES (2018) Emojis-based sentiment classification of arabic microblogs using deep recurrent neural networks. In: 2018 international conference on computing sciences and engineering (ICCSE). IEEE, pp 1–6
[26]
Mourad A, Darwish K (2013) Subjectivity and sentiment analysis of modern standard arabic and arabic microblogs. In: Proceedings of the 4th workshop on computational approaches to subjectivity, sentiment and social media analysis. pp 55–64
[27]
Rosenthal S, Farra N, Nakov P (2019) Semeval-2017 task 4: Sentiment analysis in twitter. arXiv preprint arXiv:191200741
[28]
Khalil EAH, Houby EME, and Mohamed HK Deep learning for emotion analysis in arabic tweets J Big Data 2021 8 1-15
[29]
Abdullah M, Shaikh S (2018) Teamuncc at semeval-2018 task 1: Emotion detection in english and arabic tweets using deep learning. In: Proceedings of the 12th international workshop on semantic evaluation. pp 350–357
[30]
Mohammad SM, Salameh M, and Kiritchenko S How translation alters sentiment J Artif Intell Res 2016 55 95-130
[31]
Alharbi A, Kalkatawi M, and Taileb M Arabic sentiment analysis using deep learning and ensemble methods Arab J Sci Eng 2021 46 9 8913-8923
[32]
ElSahar H, El-Beltagy SR (2015) Building large arabic multi-domain resources for sentiment analysis. In: International conference on intelligent text processing and computational linguistics. Springer, pp 23–34
[33]
Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:13013781
[34]
Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: International conference on machine learning. PMLR, pp 1188–1196
[35]
Pennington J, Socher R, Manning CD (2014) Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). pp 1532–1543
[36]
Altowayan AA, Tao L (2016) Word embeddings for arabic sentiment analysis. In: 2016 IEEE International Conference on Big Data (Big Data). IEEE, pp 3820–3825
[37]
Bojanowski P, Grave E, Joulin A, and Mikolov T Enriching word vectors with subword information Trans Assoc Comput Linguist 2017 5 135-146
[38]
Soliman AB, Eissa K, and El-Beltagy SR Aravec: A set of arabic word embedding models for use in arabic nlp Procedia Comput Sci 2017 117 256-265
[39]
Fouad MM, Mahany A, Aljohani N, Abbasi RA, and Hassan SU Arwordvec: efficient word embedding models for arabic tweets Soft Comput 2020 24 11 8061-8068
[40]
LeCun Y, Boser B, Denker JS, Henderson D, Howard RE, Hubbard W, and Jackel LD Backpropagation applied to handwritten zip code recognition Neural Comput 1989 1 4 541-551
[41]
Hochreiter S and Schmidhuber J Long short-term memory Neural Comput 1997 9 8 1735-1780
[42]
Rehman AU, Malik AK, Raza B, and Ali W A hybrid cnn-lstm model for improving accuracy of movie reviews sentiment analysis Multimedia Tools Appl 2019 78 18 26597-26613
[43]
Yang Q, Alamro H, Albaradei S, Salhi A, Lv X, Ma C, Alshehri M, Jaber I, Tifratene F, Wang W, et al (2020) Senwave: monitoring the global sentiments under the covid-19 pandemic. arXiv preprint arXiv:200610842
[44]
Ameur MSH, Aliane H (2021) Aracovid19-ssd: Arabic covid-19 sentiment and sarcasm detection dataset. arXiv preprint arXiv:211001948
[45]
Mubarak H, Hassan S, Chowdhury SA, Alam F (2022) Arcovidvac: Analyzing arabic tweets about covid-19 vaccination. arXiv preprint arXiv:220106496
[46]
Khanna VV, Chadaga K, Sampathila N, Prabhu S, Chadaga R, and Umakanth S Diagnosing covid-19 using artificial intelligence: A comprehensive review Netw Model Anal Health Inform Bioinforma 2022 11 1 25
Recommendations
Sentiment Analysis of Arabic Tweets using Deep Learning
AbstractSentiment analysis is the computational study of people’s opinions, attitudes and emotions toward entities, individuals, issues, events or topics. A lot of research has been done to improve the accuracy of sentiment analysis, varying from simple ...
A deep learning-based sentiment analysis approach (MF-CNN-BILSTM) and topic modeling of tweets related to the Ukraine–Russia conflict
AbstractTwitter, one of the most significant social media platforms, can be used as data sources to research public opinion on various topics, including political conflicts. People worldwide have expressed their opinions about the war between Russia and ...
Highlights- Sentiment analysis is an effective way to get people's thoughts on the Ukraine–Russia conflict.
- The Ukraine–Russia conflict will result in long-term economic, political, and psychological problems in a given society. All over the world,...
Multitask Aspect_Based Sentiment Analysis with Integrated Bidirectional LSTM & CNN Model.
ICFNDS '20: Proceedings of the 4th International Conference on Future Networks and Distributed SystemsSentiment analysis involves building the opinion collection and classification system. Aspect-based sentiment analysis focuses on the ability to extract and summarize opinions on specific aspects of entities within sentiment document. In this paper, we ...
Comments
Information & Contributors
Information
Published In
© The Author(s) 2024.
Publisher
Hindawi Limited
London, United Kingdom
Publication History
Published: 09 April 2024
Accepted: 22 March 2024
Received: 26 October 2022
Author Tags
Qualifiers
- Research-article
Funding Sources
- Assiut University
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 06 Nov 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in