skip to main content
10.1145/3702879.3702892acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiotcctConference Proceedingsconference-collections
research-article

Doctor-Patient Compatibility in Online Healthcare Based on Dynamic Fusion of Multimodal Uncertainty Information

Published: 11 December 2024 Publication History

Abstract

With the reopening post-pandemic and the advancement of smart healthcare, online consultations have gradually become one of the primary means of health management due to their convenience and low cost. However, the uncertainty in different modalities between patients and doctors has further complicated the challenge of matching. How to achieve efficient patient-doctor matching has become a pressing issue. Therefore, this paper proposes a multimodal uncertainty dynamic fusion method. First, we design a method for measuring uncertainty based on the modality information of each doctor and patient. Then, considering the upper bound of the model's error, we introduce a regularization term between modality weights and loss to improve the loss function. Finally, we conduct model comparisons and uncertainty information fusion analysis using the data provided by the Haodaifu online medical platform. The results demonstrate the effectiveness of the proposed method.

References

[1]
Lu J., Bai J., Zhao H. and Zhang X. 2023. The effect of “offline-to-online” trust transfer on the utilization of online medical consultation among Chinese rural residents: experimental study. Journal of Medical Internet Research, vol. 25, pp. e43430.
[2]
Zhu W., He J. and Guo H. 2023. Doctor-patient bilateral matching considering diagnosis and treatment perception in the absence of public health resources. Frontiers in Public Health, vol. 10, pp. 1094523.
[3]
Liu J., Zhang W., Jiang X. and Zhou Y. 2020. Data mining of the reviews from online private doctors. Telemedicine and e-Health, vol. 26(9), pp. 1157-1166.
[4]
Huang Y., Du C., Xue Z., Chen X., Zhao H. and Huang L. 2021. What makes multi-modal learning better than single (provably). Advances in Neural Information Processing Systems, vol. 34, pp. 10944-10956.
[5]
Eitel A., Springenberg J. T., Spinello L., Riedmiller M. and Burgard W. 2015. Multimodal deep learning for robust RGB-D object recognition. in: RSJ International Conference on Intelligent Robots and Systems. IROS. vol. 28.
[6]
Wu N., Jastrzebski S., Cho K. and Geras, K. J. 2022. Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks. In: International Conference on Machine Learning. PMLR. pp. 24043-24055.
[7]
Zhang Q., Wu H., Zhang C., Hu Q., Fu H., Zhou J. T. and Peng, X. 2023. Provable dynamic fusion for low-quality multimodal data. In: International conference on machine learning. PMLR. pp. 41753-41769.
[8]
Gómez-Chova L., Tuia D., Moser G. and Camps-Valls, G. 2015. Multimodal classification of remote sensing images: A review and future directions. Proceedings of the IEEE, vol. 103(9), pp. 1560-1584.
[9]
Einbeck J. and Tutz G. 2006. Modelling beyond regression functions: an application of multimodal regression to speed–flow data. Journal of the Royal Statistical Society Series C: Applied Statistics, vol. 55(4), pp. 461-475.
[10]
Li B., Han Z., Li H., Fu H. and Zhang C. 2022. Trustworthy long-tailed classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6970-6979.
[11]
Graves A. and Graves, A. 2012. Long short-term memory. Supervised Sequence Labelling with Recurrent Neural Networks, vol. 37-45.
[12]
Zhou P., Shi W., Tian J., Qi Z., Li B., Hao H. and Xu, B. 2016. Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the 54th annual meeting of the association for computational linguistics, pp. 207-212.
[13]
Dey R. and Salem, F.M. 2017. Gate-variants of gated recurrent unit (GRU) neural networks. In: 2017 IEEE 60th international midwest symposium on circuits and systems. MWSCAS. pp. 1597-1600.
[14]
Song Y., Wang Y., Ye X., Wang D. Yin Y. and Wang, Y. 2020. Multi-view ensemble learning based on distance-to-model and adaptive clustering for imbalanced credit risk assessment in P2P lending. Information Sciences, vol. 525, pp. 182-204.

Index Terms

  1. Doctor-Patient Compatibility in Online Healthcare Based on Dynamic Fusion of Multimodal Uncertainty Information

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      IoTCCT '24: Proceedings of the 2024 2nd International Conference on Internet of Things and Cloud Computing Technology
      September 2024
      384 pages
      ISBN:9798400710148
      DOI:10.1145/3702879
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 11 December 2024

      Check for updates

      Author Tags

      1. Doctor-patient compatibility
      2. Multimodal fusion
      3. Smart health
      4. Uncertainty information

      Qualifiers

      • Research-article

      Conference

      IoTCCT 2024

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 9
        Total Downloads
      • Downloads (Last 12 months)9
      • Downloads (Last 6 weeks)5
      Reflects downloads up to 29 Jan 2025

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media