skip to main content
10.1145/3460569.3460581acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicmaiConference Proceedingsconference-collections
research-article

Knowledge Transfer across Diseases

Published: 31 August 2021 Publication History

Abstract

In the field of medical data mining, collecting sufficient expert labeled datasets especially with pixel-level annotations is extremely difficult. For diseases with scarce data, supervised learning has little effect even with synthetic images for data augmentation or cross-modality knowledge transfer. In response to the problem, we propose a novel solution - knowledge transfer across diseases. Existing transfer methods either focus on mapping one domain to another or focus on generating a subspace consisting of domain invariant features. However, these methods are negative in the transfer of knowledge across diseases because they lose the private characteristics of the target disease. Motivated by this limitation, we present a reweighting network (RW-net). It can be widely applied to a domain adaptation model based on adversarial, through reweighting dynamic balance subspace generation and segmenter optimization. We compare our method to two popular transfer learning methods and baseline on the open glioma dataset (BraTS) and ischemic stroke dataset (ATLAS). Our approach achieves excellent performance, even though the two diseases have completely different imaging traits.

References

[1]
Havaei M, Davy A, Warde-Farley D, Brain tumor segmentation with deep neural networks[J]. Medical image analysis (MIA), 35: 18-31(2017).
[2]
Milletari F, Navab N, Ahmadi S A. V-net: Fully convolutional neural networks for volumetric medical image segmentation[C]//2016 Fourth International Conference on 3D Vision (3DV). IEEE, 2016: 565-571. (2016)
[3]
Yu L, Yang X, Chen H, Volumetric convnets with mixed residual connections for automated prostate segmentation from 3d mr images. In AAAI (2017).
[4]
Frid-Adar M, Diamant I, Klang E, GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification[J]. Neurocomputing, 321: 321-331 (2018).
[5]
Nielsen C, Okoniewski M. GAN Data Augmentation Through Active Learning Inspired Sample Acquisition. In CVPR workshop (2019).
[6]
Pan S J, Yang Q. A survey on transfer learning[J]. IEEE Transactions on knowledge and data engineering (TKDE), 22(10): 1345-1359 (2009).
[7]
Shoag J, Bagci U, Jambawalikar S. Domain Adaptation and Representation Transfer and Medical Image Learning with Less Labels and Imperfect Data. In MICCAI Workshop (2019).
[8]
Dou Q, Ouyang C, Chen C, Unsupervised cross-modality domain adaptation of convnets for biomedical image segmentations with adversarial loss. In IJCAI (2018).
[9]
Srinivasan A, Goyal M, Azri F A, State-of-the-art imaging of acute stroke[J]. Radiographics, 26(suppl_1): S75-S95 (2006).
[10]
Allen L M, Hasso A N, Handwerker J, Sequence-specific MR imaging findings that are useful in dating ischemic stroke[J]. Radiographics, 32(5): 1285-1297 (2012).
[11]
Upadhyay N, Waldman A D. Conventional MRI evaluation of gliomas[J]. The British journal of radiology, 84(special_issue_2): S107-S111 (2011).
[12]
Liu, J., Shah, M., Kuipers, B., and Savarese, S. Cross-view action recognition via view knowledge transfer. In CVPR (2011).
[13]
Hu, D. H. and Yang, Q. Transfer learning for activity recognition via sensor mapping. In IJCAI (2011).
[14]
Long, M., Wang, J., Ding, G., Sun, J., and Yu, P. S. Transfer joint matching for unsupervised domain adaptation. In CVPR (2014).
[15]
Duan L, Tsang I W, Xu D. Domain transfer multiple kernel learning[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 34(3): 465-479 (2012).
[16]
Tan B, Zhang Y, Pan S J, Distant domain transfer learning. In AAAI (2017).
[17]
Wang Z, Dai Z, Póczos B, Characterizing and avoiding negative transfer. In CVPR (2019).
[18]
Bousmalis K, Trigeorgis G, Silberman N, Domain separation networks. In NIPS (2016).
[19]
Menze B H, Jakab A, Bauer S, The multimodal brain tumor image segmentation benchmark (BRATS)[J]. IEEE transactions on medical imaging, 34(10): 1993-2024 (2014).
[20]
Bakas S, Akbari H, Sotiras A, Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features[J]. Scientific data, 4: 170117 (2017).
[21]
 Bakas S, Reyes M, Jakab A, Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the BRATS challenge[J]. arXiv preprint arXiv:1811.02629 (2018).
[22]
Liew S L, Anglin J M, Banks N W, A large, open source dataset of stroke anatomical brain images and manual lesion segmentations[J]. Scientific data, 5: 180011 (2018).
[23]
Pan S J, Tsang I W, Kwok J T, Domain adaptation via transfer component analysis[J]. IEEE Transactions on Neural Networks, 22(2): 199-210 (2010).
[24]
Long M, Cao Y, Wang J, Learning transferable features with deep adaptation networks. In ICML (2015).
[25]
Long M, Zhu H, Wang J, Deep transfer learning with joint adaptation networks. In ICML (2017).
[26]
Ganin Y, Ustinova E, Ajakan H, Domain-adversarial training of neural networks[J]. The Journal of Machine Learning Research (JMLR), 17(1): 2096-2030 (2016).
[27]
Tzeng E, Hoffman J, Saenko K, Adversarial discriminative domain adaptation. In CVPR (2017).
[28]
Moon S, Carbonell J G. Completely Heterogeneous Transfer Learning with Attention-What And What Not To Transfer. In IJCAI (2017).
[29]
Zhang Z, Liu Q, Wang Y. Road extraction by deep residual u-net[J]. IEEE Geoscience and Remote Sensing Letters, 15(5): 749-753 (2018).
[30]
Duan L, Tsang I W, Xu D. Domain transfer multiple kernel learning[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 34(3): 465-479 (2012).
[31]
Chen L C, Papandreou G, Schroff F, Rethinking atrous convolution for semantic image segmentation[J]. arXiv preprint arXiv:1706.05587 (2017).
[32]
Kingma D P, Ba J. Adam: A method for stochastic optimization[J]. arXiv preprint arXiv:1412.6980 (2014).

Index Terms

  1. Knowledge Transfer across Diseases
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        ICMAI '21: Proceedings of the 2021 6th International Conference on Mathematics and Artificial Intelligence
        March 2021
        142 pages
        ISBN:9781450389464
        DOI:10.1145/3460569
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 31 August 2021

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Deep learning
        2. Generative Adversarial Network
        3. Lesion segmentation
        4. Negative transfer
        5. Transfer learning

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Funding Sources

        Conference

        ICMAI 2021

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 42
          Total Downloads
        • Downloads (Last 12 months)9
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 23 Dec 2024

        Other Metrics

        Citations

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media