skip to main content
10.1145/3627673.3679836acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article
Open access

Contrastive Learning on Medical Intents for Sequential Prescription Recommendation

Published: 21 October 2024 Publication History

Abstract

Recent advancements in sequential modeling applied to Electronic Health Records (EHR) have greatly influenced prescription recommender systems. While the recent literature on drug recommendation has shown promising performance, the study of discovering a diversity of coexisting temporal relationships at the level of medical codes over consecutive visits remains less explored. The goal of this study can be motivated from two perspectives. First, there is a need to develop a sophisticated sequential model capable of disentangling the complex relationships across sequential visits. Second, it is crucial to establish multiple and diverse health profiles for the same patient to ensure a comprehensive consideration of different medical intents in drug recommendation. To achieve this goal, we introduce Attentive Recommendation with Contrasted Intents (ARCI), a multi-level transformer-based method designed to capture the different but coexisting temporal paths across a shared sequence of visits. Specifically, we propose a novel intent-aware method with contrastive learning, that links specialized medical intents of the patients to the transformer heads for extracting distinct temporal paths associated with different health profiles. We conducted experiments on two real-world datasets for the prescription recommendation task using both ranking and classification metrics. Our results demonstrate that ARCI has outperformed the state-of-the-art prescription recommendation methods and is capable of providing interpretable insights for healthcare practitioners.

References

[1]
Hanieh Ajami, Mahsa Kargar Nigjeh, and Scott E Umbaugh. 2023. Unsupervised white matter lesion identification in multiple sclerosis (MS) using MRI segmentation and pattern classification: a novel approach with CVIPtools. In Applications of Digital Image Processing XLVI, Vol. 12674. SPIE, 282--287.
[2]
James J Ashton, Aneurin Young, Mark J Johnson, and R Mark Beattie. 2023. Using machine learning to impact on long-term clinical care: principles, challenges, and practicalities. Pediatric Research, Vol. 93, 2 (2023), 324--333.
[3]
Akshay Athavale, Tegan Athavale, and Darren M Roberts. 2020. Antiemetic drugs: what to prescribe and when. Australian Prescriber, Vol. 43, 2 (2020), 49.
[4]
Michael Auerbach, Dan Coyne, and Harold Ballard. 2008. Intravenous iron: from anathema to standard of care. American journal of hematology, Vol. 83, 7 (2008), 580--588.
[5]
Suman Bhoi, Mong Li Lee, Wynne Hsu, and Ngiap Chuan Tan. 2024. REFINE: A Fine-Grained Medication Recommendation System Using Deep Learning and Personalized Drug Interaction Modeling. Advances in Neural Information Processing Systems, Vol. 36 (2024).
[6]
Dennis S Charney, S John Mihic, and R Adron Harris. 2006. Hypnotics and sedatives. The Pharmacologic Basis of Therapeutics. 11th ed. Brunton LL, Lazo JS, Parker KL (Eds). New York, McGraw-Hill (2006), 401--427.
[7]
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. In International conference on machine learning. PMLR, 1597--1607.
[8]
Yongjun Chen, Zhiwei Liu, Jia Li, Julian McAuley, and Caiming Xiong. 2022. Intent contrastive learning for sequential recommendation. In Proceedings of the ACM Web Conference 2022. 2172--2182.
[9]
Edward Choi, Mohammad Taha Bahadori, Jimeng Sun, Joshua Kulas, Andy Schuetz, and Walter Stewart. 2016. Retain: An interpretable predictive model for healthcare using reverse time attention mechanism. Advances in neural information processing systems, Vol. 29 (2016).
[10]
Edward Choi, Zhen Xu, Yujia Li, Michael Dusenberry, Gerardo Flores, Emily Xue, and Andrew Dai. 2020. Learning the graphical structure of electronic health records with graph convolutional transformer. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 606--613.
[11]
Junyi Gao, Cao Xiao, Lucas M Glass, and Jimeng Sun. 2020. Dr. Agent: Clinical predictive model via mimicked second opinions. Journal of the American Medical Informatics Association, Vol. 27, 7 (2020), 1084--1091.
[12]
Stephanie G Harshman and M Kyla Shea. 2016. The role of vitamin K in chronic aging diseases: inflammation, cardiovascular disease, and osteoarthritis. Current nutrition reports, Vol. 5 (2016), 90--98.
[13]
Alistair EW Johnson, Tom J Pollard, Lu Shen, Li-wei H Lehman, Mengling Feng, Mohammad Ghassemi, Benjamin Moody, Peter Szolovits, Leo Anthony Celi, and Roger G Mark. 2016. MIMIC-III, a freely accessible critical care database. Scientific data, Vol. 3, 1 (2016), 1--9.
[14]
Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive sequential recommendation. In 2018 IEEE international conference on data mining (ICDM). IEEE, 197--206.
[15]
Prannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna, Yonglong Tian, Phillip Isola, Aaron Maschinot, Ce Liu, and Dilip Krishnan. 2020. Supervised contrastive learning. Advances in neural information processing systems, Vol. 33 (2020), 18661--18673.
[16]
Marek Koniew. 2020. Classification of the User's Intent Detection in Ecommerce systems-Survey and Recommendations. International Journal of Information Engineering & Electronic Business, Vol. 12, 6 (2020).
[17]
Kang Liu, Xiangzhou Zhang, Weiqi Chen, SL Alan, John A Kellum, Michael E Matheny, Steven Q Simpson, Yong Hu, and Mei Liu. 2022. Development and validation of a personalized model with transfer learning for acute kidney injury risk estimation using electronic health records. JAMA Network Open, Vol. 5, 7 (2022), e2219776--e2219776.
[18]
Zhiwei Liu, Ziwei Fan, Yu Wang, and Philip S Yu. 2021. Augmenting sequential recommendation with pseudo-prior items via reversely pre-training transformer. In Proceedings of the 44th international ACM SIGIR conference on Research and development in information retrieval. 1608--1612.
[19]
Zhiwei Liu, Xiaohan Li, Ziwei Fan, Stephen Guo, Kannan Achan, and S Yu Philip. 2020. Basket recommendation with multi-intent translation graph neural network. In 2020 IEEE International Conference on Big Data (Big Data). IEEE, 728--737.
[20]
Paul Michel, Omer Levy, and Graham Neubig. 2019. Are sixteen heads really better than one? Advances in neural information processing systems, Vol. 32 (2019).
[21]
Arya Hadizadeh Moghaddam, Mohsen Nayebi Kerdabadi, Cuncong Zhong, and Zijun Yao. 2024. Meta-Learning on Augmented Gene Expression Profiles for Enhanced Lung Cancer Detection. arXiv preprint arXiv:2408.09635 (2024).
[22]
Mohsen Nayebi Kerdabadi, Arya Hadizadeh Moghaddam, Bin Liu, Mei Liu, and Zijun Yao. 2023. Contrastive learning of temporal distinctiveness for survival analysis in electronic health records. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 1897--1906.
[23]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, Vol. 32 (2019).
[24]
Naime Ranjbar Kermany, Jian Yang, Jia Wu, and Luiz Pizzato. 2022. Fair-srs: a fair session-based recommendation system. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1601--1604.
[25]
Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2010. Factorizing personalized Markov chains for next-basket recommendation. In Proceedings of the 19th International Conference on World Wide Web (Raleigh, North Carolina, USA) (WWW '10). Association for Computing Machinery, New York, NY, USA, 811--820. https://doi.org/10.1145/1772690.1772773
[26]
Junyuan Shang, Cao Xiao, Tengfei Ma, Hongyan Li, and Jimeng Sun. 2019. Gamenet: Graph augmented memory networks for recommending medication combination. In proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 1126--1133.
[27]
Shahnaz Sultana, Andleeb Khan, Mohammed M Safhi, and Hassan A Alhazmi. 2016. Cough suppressant herbal drugs: A review. Int. J. Pharm. Sci. Invent, Vol. 5, 5 (2016), 15--28.
[28]
Hongda Sun, Shufang Xie, Shuqi Li, Yuhan Chen, Ji-Rong Wen, and Rui Yan. 2022. Debiased, Longitudinal and Coordinated Drug Recommendation through Multi-Visit Clinic Records. Advances in Neural Information Processing Systems, Vol. 35 (2022), 27837--27849.
[29]
Md Mehrab Tanjim, Congzhe Su, Ethan Benjamin, Diane Hu, Liangjie Hong, and Julian McAuley. 2020. Attentive sequential models of latent intent for next item recommendation. In Proceedings of The Web Conference 2020. 2528--2534.
[30]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems, Vol. 30 (2017).
[31]
Chenyang Wang, Weizhi Ma, Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2023. Sequential recommendation with multiple contrast signals. ACM Transactions on Information Systems, Vol. 41, 1 (2023), 1--27.
[32]
Yuling Wang, Xiao Wang, Xiangzhou Huang, Yanhua Yu, Haoyang Li, Mengdi Zhang, Zirui Guo, and Wei Wu. 2023. Intent-aware recommendation via disentangled graph contrastive learning. In Proceedings of the 32th international joint conference on artificial intelligence. 2343--2351.
[33]
Yinwei Wei, Xiang Wang, Xiangnan He, Liqiang Nie, Yong Rui, and Tat-Seng Chua. 2021. Hierarchical user intent graph network for multimedia recommendation. IEEE Transactions on Multimedia, Vol. 24 (2021), 2701--2712.
[34]
Rui Wu, Zhaopeng Qiu, Jiacheng Jiang, Guilin Qi, and Xian Wu. 2022. Conditional generation net for medication recommendation. In Proceedings of the ACM Web Conference 2022. 935--945.
[35]
Shu Wu, Yuyuan Tang, Yanqiao Zhu, Liang Wang, Xing Xie, and Tieniu Tan. 2019. Session-based recommendation with graph neural networks. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 346--353.
[36]
Chaoqi Yang, Zhenbang Wu, Patrick Jiang, Zhen Lin, Junyi Gao, Benjamin Danek, and Jimeng Sun. 2023. PyHealth: A Deep Learning Toolkit for Healthcare Predictive Modeling. In Proceedings of the 27th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) 2023. https://github.com/sunlabuiuc/PyHealth
[37]
Chaoqi Yang, Cao Xiao, Lucas Glass, and Jimeng Sun. 2021. Change matters: Medication change prediction with recurrent residual networks. arXiv preprint arXiv:2105.01876 (2021).
[38]
Chaoqi Yang, Cao Xiao, Lucas Glass, and Jimeng Sun. 2021. Change matters: Medication change prediction with recurrent residual networks. arXiv preprint arXiv:2105.01876 (2021).
[39]
Chaoqi Yang, Cao Xiao, Fenglong Ma, Lucas Glass, and Jimeng Sun. 2021. Safedrug: Dual molecular graph encoders for recommending effective and safe drug combinations. arXiv preprint arXiv:2105.02711 (2021).
[40]
Nianzu Yang, Kaipeng Zeng, Qitian Wu, and Junchi Yan. 2023. Molerec: Combinatorial drug recommendation with substructure-aware molecular representation learning. In Proceedings of the ACM Web Conference 2023. 4075--4085.
[41]
Zhichao Yang, Avijit Mitra, Weisong Liu, Dan Berlowitz, and Hong Yu. 2023. TransformEHR: transformer-based encoder-decoder generative model to enhance prediction of disease outcomes using electronic health records. Nature Communications, Vol. 14, 1 (2023), 7857.
[42]
Zijun Yao, Bin Liu, Fei Wang, Daby Sow, and Ying Li. 2023. Ontology-aware prescription recommendation in treatment pathways using multi-evidence healthcare data. ACM Transactions on Information Systems, Vol. 41, 4 (2023), 1--29.
[43]
Peiyan Zhang, Jiayan Guo, Chaozhuo Li, Yueqi Xie, Jae Boum Kim, Yan Zhang, Xing Xie, Haohan Wang, and Sunghun Kim. 2023. Efficiently leveraging multi-level user intent for session-based recommendation via atten-mixer network. In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining. 168--176.
[44]
Yipeng Zhang, Xin Wang, Hong Chen, and Wenwu Zhu. 2023. Adaptive disentangled transformer for sequential recommendation. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 3434--3445.
[45]
Yingying Zhang, Xian Wu, Quan Fang, Shengsheng Qian, and Changsheng Xu. 2023. Knowledge-enhanced attributed multi-task learning for medicine recommendation. ACM Transactions on Information Systems, Vol. 41, 1 (2023), 1--24.
[46]
Ding Zou, Wei Wei, Xian-Ling Mao, Ziyang Wang, Minghui Qiu, Feida Zhu, and Xin Cao. 2022. Multi-level cross-view contrastive learning for knowledge-aware recommender system. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1358--1368.

Cited By

View all
  • (2024)Discovering Time-aware Hidden Dependencies with Personalized Graphical Structure in Electronic Health RecordsACM Transactions on Knowledge Discovery from Data10.1145/370914319:2(1-21)Online publication date: 23-Dec-2024

Index Terms

  1. Contrastive Learning on Medical Intents for Sequential Prescription Recommendation

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management
      October 2024
      5705 pages
      ISBN:9798400704369
      DOI:10.1145/3627673
      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 21 October 2024

      Check for updates

      Author Tags

      1. contrastive learning
      2. electronic health records
      3. prescription recommendation

      Qualifiers

      • Research-article

      Conference

      CIKM '24
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

      Upcoming Conference

      CIKM '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)202
      • Downloads (Last 6 weeks)72
      Reflects downloads up to 06 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Discovering Time-aware Hidden Dependencies with Personalized Graphical Structure in Electronic Health RecordsACM Transactions on Knowledge Discovery from Data10.1145/370914319:2(1-21)Online publication date: 23-Dec-2024

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media