skip to main content
10.1145/3583780.3615033acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article
Open access

REST: Drug-Drug Interaction Prediction via Reinforced Student-Teacher Curriculum Learning

Published: 21 October 2023 Publication History

Abstract

Accurate prediction of drug-drug interaction (DDI) is crucial to achieving effective decision-making in medical treatment for both doctors and patients. Recently, many deep learning based methods have been proposed to learn from drug-related features and conduct DDI prediction. These works have achieved promising results. However, the extreme imbalance of medical data poses a serious problem to DDI prediction, where a small fraction of DDI types occupy the majority training data. A straightforward way is to develop an appropriate policy to sample the data. Due to the high complexity and speciality of medical science, a dynamic learnable policy is required instead of a heuristic, uniform or static one. Therefore, we propose a REinforced Student-Teacher curriculum learning model (REST) for effective sampling to tackle this imbalance problem. Specifically, REST consists of two interactive parts, which are a heterogeneous graph neural network as the student and a reinforced sampler as the teacher. In each interaction, the teacher model takes action to sample an appropriate batch to train the student model according to the student model state while the cumulated improvement in performance of the student model is treated as the reward for policy gradient of the teacher model. The experimental results on two benchmarking datasets have demonstrated the significant effectiveness of our proposed model in DDI prediction, especially for the DDI types with low frequency.

References

[1]
Yoshua Bengio, Jé rô me Louradour, Ronan Collobert, and Jason Weston. 2009. Curriculum learning. In ICML, Vol. 382. 41--48.
[2]
Elizabeth M. Benson. 2001. Bupropion?induced hypersensitivity reactions. Medical Journal of Australia, Vol. 174 (2001).
[3]
Yujie Chen, Tengfei Ma, Xixi Yang, Jianmin Wang, Bosheng Song, and Xiangxiang Zeng. 2021. MUFFIN: multi-scale feature fusion for drug-drug interaction prediction. Bioinform., Vol. 37, 17 (2021), 2651--2658.
[4]
Yin Cui, Menglin Jia, Tsung-Yi Lin, Yang Song, and Serge J. Belongie. 2019. Class-Balanced Loss Based on Effective Number of Samples. In CVPR. 9268--9277.
[5]
Yifan Deng, Xinran Xu, Yang Qiu, Jingbo Xia, Wen Zhang, and Shichao Liu. 2020. A multimodal deep learning framework for predicting drug-drug interaction events. Bioinform., Vol. 36, 15 (2020), 4316--4322.
[6]
Rasheed el-Bouri, David W. Eyre, Peter J. Watkinson, Tingting Zhu, and David A. Clifton. 2020. Student-Teacher Curriculum Learning via Reinforcement Learning: Predicting Hospital Inpatient Admission Location. In ICML, Vol. 119. 2848--2857.
[7]
Jingtong Gao, Xiangyu Zhao, Bo Chen, Fan Yan, Huifeng Guo, and Ruiming Tang. 2023. AutoTransfer: Instance Transfer for Cross-Domain Recommendations. In SIGIR. 1478--1487.
[8]
Kathleen M. Giacomini, Ronald M. Krauss, Dan M. Roden, Michel F Eichelbaum, Michael R. Hayden, and Yusuke Nakamura. 2007. When good drugs go bad. Nature, Vol. 446 (2007), 975--977.
[9]
Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable Feature Learning for Networks. In KDD. 855--864.
[10]
Changxiang He, Yuru Liu, Hao Li, Hui Zhang, Yaping Mao, Xiaofei Qin, Lele Liu, and Xuedian Zhang. 2022. Multi-type feature fusion based on graph neural network for drug-drug interaction prediction. BMC Bioinform., Vol. 23, 1 (2022), 224.
[11]
Daniel S. Himmelstein and Sergio E. Baranzini. 2015. Heterogeneous Network Edge Prediction: A Data Integration Approach to Prioritize Disease-Associated Genes. PLoS Comput. Biol., Vol. 11, 7 (2015).
[12]
Kexin Huang, Cao Xiao, Trong Nghia Hoang, Lucas Glass, and Jimeng Sun. 2020. CASTER: Predicting Drug Interactions with Chemical Substructure Representation. In AAAI. 702--709.
[13]
Vassilis N. Ioannidis, Xiang Song, Saurav Manchanda, Mufei Li, Xiaoqin Pan, Da Zheng, Xia Ning, Xiangxiang Zeng, and George Karypis. 2020. DRKG - Drug Repurposing Knowledge Graph for Covid-19.
[14]
Lu Jiang, Deyu Meng, Qian Zhao, Shiguang Shan, and Alexander G. Hauptmann. 2015. Self-Paced Curriculum Learning. In AAAI. 2694--2700.
[15]
Lu Jiang, Zhengyuan Zhou, Thomas Leung, Li-Jia Li, and Li Fei-Fei. 2018. MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels. In ICML, Vol. 80. 2309--2318.
[16]
Md. Rezaul Karim, Michael Cochez, Joao Bosco Jares, Mamtaz Uddin, Oya Deniz Beyan, and S. Decker. 2019. Drug-Drug Interaction Prediction Based on Knowledge Graph Embeddings and Convolutional-LSTM Network. Bioinform. (2019).
[17]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR.
[18]
Weilin Lin, Xiangyu Zhao, Yejing Wang, Tong Xu, and Xian Wu. 2022. AdaFS: Adaptive Feature Selection in Deep Recommender System. In KDD. 3309--3317.
[19]
Weilin Lin, Xiangyu Zhao, Yejing Wang, Yuanshao Zhu, and Wanyu Wang. 2023. AutoDenoise: Automatic Data Instance Denoising for Recommendations. In WWW. 1003--1011.
[20]
Xuan Lin, Zhe Quan, Zhi-Jie Wang, Tengfei Ma, and Xiangxiang Zeng. 2020. KGNN: Knowledge Graph Neural Network for Drug-Drug Interaction Prediction. In IJCAI. 2739--2745.
[21]
Tengfei Lyu, Jianliang Gao, Ling Tian, Zhao Li, Peng Zhang, and Ji Zhang. 2021. MDNN: A Multimodal Deep Neural Network for Predicting Drug-Drug Interaction Events. In IJCAI. 3536--3542.
[22]
Tambet Matiisen, Avital Oliver, Taco Cohen, and John Schulman. 2020. Teacher-Student Curriculum Learning. TNNLS, Vol. 31, 9 (2020), 3732--3740.
[23]
Robert A McCollom, Dean H T Elbe, and Alec H Ritchie. 2000. Bupropion-Induced Serum Sickness--Like Reaction. In The Annals of pharmacotherapy.
[24]
Anna Ofrydopoulou, Eleni Evgenidou, Christina Nannou, Marlen I. Vasquez, and Dimitra A. Lambropoulou. 2020. Exploring the phototransformation and assessing the in vitro and in silico toxicity of a mixture of pharmaceuticals susceptible to photolysis. The Science of the total environment (2020), 144079.
[25]
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: online learning of social representations. In KDD. 701--710.
[26]
Catrin O. Plumpton, Daniel Roberts, Munir Pirmohamed, and Dyfrig A. Hughes. 2016. A Systematic Review of Economic Evaluations of Pharmacogenetic Testing for Prevention of Adverse Drug Reactions. PharmacoEcon., Vol. 34 (2016), 771--793.
[27]
David Rogers and Mathew Hahn. 2010. Extended-Connectivity Fingerprints. J. Chem. Inf. Model., Vol. 50, 5 (2010), 742--754.
[28]
Jae Yong Ryu, Hyun Uk Kim, and Sang Yup Lee. 2018. Deep learning improves prediction of drug--drug and drug--food interactions. National Academy of Sciences, Vol. 115 (2018), E4304 -- E4311.
[29]
Takako Takeda, Ming Hao, Tiejun Cheng, Stephen H. Bryant, and Yanli Wang. 2017. Predicting drug-drug interactions through drug structural similarities and interaction networks incorporating pharmacokinetics and pharmacodynamics knowledge. J. Cheminformatics, Vol. 9, 1 (2017), 16:1--16:9.
[30]
Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. LINE: Large-scale Information Network Embedding. In WWW. 1067--1077.
[31]
Nicholas P. Tatonetti, Guy Haskin Fernald, and Russ B. Altman. 2012. A novel signal detection algorithm for identifying hidden drug-drug interactions in adverse event reports. J. Am. Medical Informatics Assoc., Vol. 19, 1 (2012), 79--85.
[32]
Madhukar H. Trivedi, Robrina Walker, Walter Ling, Adriane M. dela Cruz, Gaurav Sharma, Thomas J. Carmody, Udi E. Ghitza, Aimee Wahle, Mora Kim, Kathy Shores?Wilson, Steven Sparenborg, Phillip Oliver Coffin, Joy M Schmitz, Katharina L. Wiest, Gavin B. Bart, Susan C. Sonne, Sidarth Wakhlu, Augustus John Rush, Edward V Nunes, and Steven Shoptaw. 2021. Bupropion and Naltrexone in Methamphetamine Use Disorder. The New England journal of medicine, Vol. 384 2 (2021), 140--153.
[33]
Thé o Trouillon, Johannes Welbl, Sebastian Riedel, É ric Gaussier, and Guillaume Bouchard. 2016. Complex Embeddings for Simple Link Prediction. In ICML, Vol. 48. 2071--2080.
[34]
Amanda Velazquez and Caroline M. Apovian. 2018. Pharmacological management of obesity. Minerva endocrinologica, Vol. 43 3 (2018), 356--366.
[35]
Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018. Graph Attention Networks. In ICLR.
[36]
Santiago Vilar, Rave Harpaz, Eugenio Uriarte, Lourdes Santana, Raul Rabadan, and Carol Friedman. 2012. Drug-drug interaction through molecular structure similarity analysis. J. Am. Medical Informatics Assoc., Vol. 19, 6 (2012), 1066--1074.
[37]
Santiago Vilar, Eugenio Uriarte, Lourdes Santana, Tal Lorberbaum, George Hripcsak, Carol Friedman, and Nicholas P. Tatonetti. 2014. Similarity-based modeling in large-scale prediction of drug-drug interactions. Nature Protocols, Vol. 9 (2014), 2147--2163.
[38]
Xiao Wang, Houye Ji, Chuan Shi, Bai Wang, Yanfang Ye, Peng Cui, and Philip S. Yu. 2019. Heterogeneous Graph Attention Network. In WWW. 2022--2032.
[39]
Yejing Wang, Zhaocheng Du, Xiangyu Zhao, Bo Chen, Huifeng Guo, Ruiming Tang, and Zhenhua Dong. 2023 a. Single-shot Feature Selection for Multi-task Recommendations. In SIGIR. 341--351.
[40]
Yejing Wang, Shen Ge, Xiangyu Zhao, Xian Wu, Tong Xu, Chen Ma, and Zhi Zheng. 2023 b. Doctor Specific Tag Recommendation for Online Medical Record Management. In KDD.
[41]
Yingheng Wang, Yaosen Min, Xin Chen, and Ji Wu. 2021. Multi-view Graph Contrastive Representation Learning for Drug-Drug Interaction Prediction. In WWW. 2921--2933.
[42]
Yejing Wang, Xiangyu Zhao, Tong Xu, and Xian Wu. 2022. AutoField: Automating Feature Selection in Deep Recommender Systems. In WWW. 1977--1986.
[43]
Steven Whitebread, Jacques Hamon, Dejan Bojanic, and Laszlo Urban. 2005. Keynote review: in vitro safety pharmacology profiling: an essential tool for successful drug development. Drug discovery today, Vol. 10 21 (2005), 1421--33.
[44]
David S. Wishart, Yannick D. Feunang, An Chi Guo, Elvis J. Lo, Ana Marcu, Jason R. Grant, Tanvir Sajed, Daniel Johnson, Carin Li, Zinat Sayeeda, Nazanin Assempour, Ithayavani Iynkkaran, Yifeng Liu, Adam Maciejewski, Nicola Gale, Alex Wilson, Lucy Chin, Ryan Cummings, Diana Le, Allison Pon, Craig Knox, and Michael Wilson. 2018. DrugBank 5.0: a major update to the DrugBank database for 2018. Nucleic Acids Res., Vol. 46, Database-Issue (2018), D1074--D1082.
[45]
Rui Wu, Zhaopeng Qiu, Jiacheng Jiang, Guilin Qi, and Xian Wu. 2022. Conditional Generation Net for Medication Recommendation. In WWW. ACM, 935--945.
[46]
Yue Yu, Kexin Huang, Chao Zhang, Lucas M. Glass, Jimeng Sun, and Cao Xiao. 2021. SumGNN: multi-typed drug interaction prediction via efficient knowledge graph summarization. Bioinform., Vol. 37, 18 (2021), 2988--2995.
[47]
Chuxu Zhang, Dongjin Song, Chao Huang, Ananthram Swami, and Nitesh V. Chawla. 2019. Heterogeneous Graph Neural Network. In KDD. 793--803.
[48]
Yin Zhang, Derek Zhiyuan Cheng, Tiansheng Yao, Xinyang Yi, Lichan Hong, and Ed H. Chi. 2021. A Model of Two Tales: Dual Transfer Learning Framework for Improved Long-tail Item Recommendation. In WWW. 2220--2231.
[49]
Tianyu Zhao, Cheng Yang, Yibo Li, Quan Gan, Zhenyi Wang, Fengqi Liang, Huan Zhao, Yingxia Shao, Xiao Wang, and Chuan Shi. 2022. Space4HGNN: A Novel, Modularized and Reproducible Platform to Evaluate Heterogeneous Graph Neural Network. In SIGIR. 2776--2789.
[50]
Zhi Zheng, Zhaopeng Qiu, Hui Xiong, Xian Wu, Tong Xu, Enhong Chen, and Xiangyu Zhao. 2022. DDR: Dialogue Based Doctor Recommendation for Online Medical Service. In KDD. 4592--4600.
[51]
Zhi Zheng, Chao Wang, Tong Xu, Dazhong Shen, Penggang Qin, Baoxing Huai, Tongzhu Liu, and Enhong Chen. 2021. Drug Package Recommendation via Interaction-aware Graph Induction. In WWW. 1284--1295.
[52]
Zhi Zheng, Chao Wang, Tong Xu, Dazhong Shen, Penggang Qin, Xiangyu Zhao, Baoxing Huai, Xian Wu, and Enhong Chen. 2023. Interaction-aware Drug Package Recommendation via Policy Gradient. TOIS, Vol. 41, 1 (2023), 3:1--3:32.
[53]
Yadi Zhou, Fei Wang, Jian Tang, Ruth Nussinov, and Feixiong Cheng. 2020. Artificial intelligence in COVID-19 drug repurposing. The Lancet. Digital Health, Vol. 2 (2020), e667 -- e676.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management
October 2023
5508 pages
ISBN:9798400701245
DOI:10.1145/3583780
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2023

Check for updates

Author Tags

  1. curriculum learning
  2. drug-drug interaction
  3. heterogeneous graph neural network
  4. reinforcement learning

Qualifiers

  • Research-article

Funding Sources

  • SIRG - CityU Strategic Interdisciplinary Research Grant
  • National Natural Science Foundation of China
  • Diversified Investment Foundation of Tianjin
  • CCF-Ant Research Fund
  • CityU - HKIDS Early Career Research Grant
  • CCF-Tencent Open Fund
  • Tencent Rhino-Bird Focused Research Fund
  • APRC - CityU New Research Initiatives
  • Hong Kong ITC Innovation and Technology Fund Midstream Research Programme for Universities Project
  • Ant Group Research Fund
  • Huawei Innovation Research Program
  • Tencent Rhino-Bird Research Elite Training Program

Conference

CIKM '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 807
    Total Downloads
  • Downloads (Last 12 months)560
  • Downloads (Last 6 weeks)47
Reflects downloads up to 21 Dec 2024

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media