skip to main content
10.1145/3673971.3673984acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicmhiConference Proceedingsconference-collections
research-article

Detection of Opioid Users from Reddit Posts via an Attention-based Bidirectional Recurrent Neural Network

Published: 09 September 2024 Publication History

Abstract

The opioid epidemic, referring to the growing hospitalizations and deaths because of overdose of opioid usage and addiction, has become a severe health problem in the United States. Many strategies have been developed by the federal and local governments and health communities to combat this crisis. Among them, improving our understanding of the epidemic through better health surveillance is one of the top priorities. In addition to direct testing, machine learning approaches may also allow us to detect opioid users by analyzing data from social media because many opioid users may choose not to do the tests but may share their experiences on social media anonymously. In this paper, we take advantage of recent advances in machine learning, collect and analyze user posts from a popular social network Reddit with the goal to identify opioid users. Posts from more than 1,000 users who have posted on three sub-reddits over a period of one month have been collected. In addition to the ones that contain keywords such as opioid, opiate, or heroin, we have also collected posts that contain slang words of opioid such as black or chocolate. We apply an attention-based bidirectional long short memory model to identify opioid users. Experimental results show that the approaches significantly outperform competitive algorithms in terms of F1-score. Furthermore, the model allows us to extract most informative words, such as opiate, opioid, and black, from posts via the attention layer, which provides more insights on how the machine learning algorithm works in distinguishing drug users from non-drug users.

References

[1]
Jianpeng Cheng, Li Dong, and Mirella Lapata. 2016. Long short-term memory-networks for machine reading. arXiv preprint arXiv:1601.06733 (2016).
[2]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. CoRR abs/1810.04805 (2018). arXiv:1810.04805http://arxiv.org/abs/1810.04805
[3]
Yujie Fan, Yiming Zhang, Yanfang Ye, and Xin Li. 2018. Automatic opioid user detection from twitter: Transductive ensemble built on different meta-graph based similarities over heterogeneous information network. In IJCAI. 3357–3363.
[4]
Yujie Fan, Yiming Zhang, Yanfang Ye, Xin Li, and Wanhong Zheng. 2017. Social media for opioid addiction epidemiology: Automatic detection of opioid addicts from twitter and case studies. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 1259–1267.
[5]
R Matt Gladden, Julie O’Donnell, Christine L Mattson, and Puja Seth. 2019. Changes in opioid-involved overdose deaths by opioid type and presence of benzodiazepines, cocaine, and methamphetamine—25 states, July–December 2017 to January–June 2018. Morbidity and Mortality Weekly Report 68, 34 (2019), 737.
[6]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.
[7]
Gerard Arnoldus Kalkman, Cornelis Kramers, Robert T van Dongen, Wim van den Brink, and Arnt Schellekens. 2019. Trends in use and misuse of opioids in the Netherlands: a retrospective, multi-source database study. The Lancet Public Health 4, 10 (2019), e498–e505.
[8]
Chao Li, Zhongtian Bao, Linhao Li, and Ziping Zhao. 2020. Exploring temporal representations by leveraging attention-based bidirectional LSTM-RNNs for multi-modal emotion recognition. Information Processing & Management 57, 3 (2020), 102185. https://doi.org/10.1016/j.ipm.2019.102185
[9]
Jing Liu, Songzheng Zhao, and Xiaodi Zhang. 2016. An ensemble method for extracting adverse drug events from social media. Artificial intelligence in medicine 70 (2016), 62–76.
[10]
Fenglong Ma, Radha Chitta, Jing Zhou, Quanzeng You, Tong Sun, and Jing Gao. 2017. Dipole: Diagnosis Prediction in Healthcare via Attention-Based Bidirectional Recurrent Neural Networks. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Halifax, NS, Canada) (KDD ’17). Association for Computing Machinery, New York, NY, USA, 1903–1911. https://doi.org/10.1145/3097983.3098088
[11]
Tim K Mackey, Janani Kalyanam, Takeo Katsuki, and Gert Lanckriet. 2017. Twitter-based detection of illegal online sale of prescription opioid. American journal of public health 107, 12 (2017), 1910–1915.
[12]
OpenAI. 2023. GPT-4 Technical Report. arxiv:2303.08774 [cs.CL]
[13]
Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532–1543.
[14]
Mike Schuster and Kuldip K Paliwal. 1997. Bidirectional recurrent neural networks. IEEE transactions on Signal Processing 45, 11 (1997), 2673–2681.
[15]
Paul Hongsuck Seo, Zhe Lin, Scott Cohen, Xiaohui Shen, and Bohyung Han. 2016. Progressive attention networks for visual attribute prediction. arXiv preprint arXiv:1606.02393 (2016).
[16]
United States Drug Enforcement Administration Houston Division. 2017. Drug Slang Code Words.
[17]
Yequan Wang, Minlie Huang, Xiaoyan Zhu, and Li Zhao. 2016. Attention-based LSTM for aspect-level sentiment classification. In Proceedings of the 2016 conference on empirical methods in natural language processing. 606–615.
[18]
Zhou Yang, Long Nguyen, and Fang Jin. 2018. Predicting opioid relapse using social media data. arXiv preprint arXiv:1811.12169 (2018).
[19]
Hannah Yao, Sina Rashidian, Xinyu Dong, Hongyi Duanmu, Richard N. Rosenthal, and Fusheng Wang. 2020. Detection of suicidality among opioid users on reddit: Machine learning-based approach. Journal of Medical Internet Research (2020). https://doi.org/10.2196/15293
[20]
Andrew Yates and Nazli Goharian. 2013. ADRTrace: detecting expected and unexpected adverse drug reactions from user reviews on social media sites. In European Conference on Information Retrieval. Springer, 816–819.
[21]
Yiming Zhang, Yujie Fan, Yanfang Ye, Xin Li, and Erin L Winstanley. 2018. Utilizing social media to combat opioid addiction epidemic: automatic detection of opioid users from twitter. In AAAI Workshops.
[22]
Peng Zhou, Wei Shi, Jun Tian, Zhenyu Qi, Bingchen Li, Hongwei Hao, and Bo Xu. 2016. Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Katrin Erk and Noah A. Smith (Eds.). Association for Computational Linguistics, Berlin, Germany, 207–212. https://doi.org/10.18653/v1/P16-2034

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICMHI '24: Proceedings of the 2024 8th International Conference on Medical and Health Informatics
May 2024
349 pages
ISBN:9798400716874
DOI:10.1145/3673971
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 September 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Attention-based bidirectional long short memory model
  2. Opioid user detection
  3. Social network mining

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • NSF

Conference

ICMHI 2024

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 38
    Total Downloads
  • Downloads (Last 12 months)38
  • Downloads (Last 6 weeks)3
Reflects downloads up to 26 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media