skip to main content
10.1145/3633637.3633698acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccprConference Proceedingsconference-collections
research-article

A Method for Breast Mass Segmentation using Image Augmentation with SAM and Receptive Field Expansion

Published: 28 February 2024 Publication History

Abstract

With the development of deep learning methods and their wide application in medical image segmentation tasks, mammography, used for early breast cancer screening, can further assist clinicians in diagnosis to a certain extent. Due to the loss of fine-grained features in the downsampling process and the very few available mammograms, the main methods for extracting masses from the whole mammography are relatively ineffective. In this paper, we propose a novel mass segmentation model for mammograms based on two U-Net network models, and integrate the Receptive Field Block (RFB) module in-between to enhance the deep features captured by the model. We augmented the input image using Segment Anything Model (SAM) and evaluated the proposed architecture on two public datasets, namely the Curated Breast Imaging Subset of Digital Database for Screening Mammography (CBIS-DDSM) and INBreast, as well as on a private dataset. The results show that the proposed model for segmenting masses in ROI regions can achieve high Dice scores of 92.18% and 89.85%, and Intersection over Union (IoU) scores of 85.47% and 80.80% on both INBreast and the private dataset. In addition, our model for segmenting masses on whole mammographs in CBIS-DDSM dataset can achieve Dice scores of 58.10% and 41.96% IoU scores. Besides, our model performance improved to Dice score 61.78% and IoU score 43.00% on whole mammographs in private dataset using SAM-augmented input images.

References

[1]
[1] Siegel, R. L., Miller, K. D. & Jemal, A. Cancer statistics, 2020. CA Cancer J. Clin. 70,7–30 (2020).
[2]
[2] C. Xia et al. Cancer statistics in China and United States, 2022: profiles, trends, and determinants. Chin Med J (Engl). 2022 Feb 9;135(5):584-590.
[3]
[3] H. Qiu, S. Cao, R. Xu. Cancer incidence, mortality, and burden in China: a time-trend analysis and comparison with the United States and United Kingdom based on the global epidemiological data released in 2020. Cancer Commun. 2021; 41: 1037–1048.
[4]
[4] Ciria-Suarez, L. et al. Breast cancer patient experiences through a journey map: A qualitative study. PLoS One. 2021 Sep 22;16(9):e0257680.
[5]
[5] Lauby-Secretan B. et al. Breast-cancer screening—viewpoint of the IARC Working Group. N. Engl. J. Med. 372, 2353–2358 (2015).
[6]
[6] Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” nature, vol. 521, no. 7553,pp. 436–444, 2015.
[7]
[7] Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 234–241 (Springer, Cham, 2015).
[8]
[8] Baccouche A., Garcia-Zapirain B., Castillo Olea C., and Elmaghraby AS. Connected-UNets: a deep learning architecture for breast mass segmentation. NPJ Breast Cancer. 2021 Dec 2;7(1):151. 34857755; PMCID: PMC8640011.
[9]
[9] Q. Xu, Z. Ma, N. HE, W. Duan. DCSAU-Net: A deeper and more compact split-attention U-Net for medical image segmentation. Computers in Biology and Medicine, Volume 154, 2023.
[10]
[10] Heath M, Bowyer K, Kopans D, Moore R, Kegelmeyer WP. The digital database for screening mammography. In Proceedings of the 5th International Workshop on Digital Mammography;2000; Medical Physics Publishing, 2000.
[11]
[11] I. C. Moreira, I. Amaral, I. Domingues, A. Cardoso, M. J. Cardoso, and J. S.Cardoso, “Inbreast: toward a full-field digital mammographic database,” Academic radiology, vol. 19, no. 2, pp. 236–248, 2012.
[12]
[12] Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al.Segment anything. arXiv preprint arXiv:2304.02643, 2023.
[13]
[13] Lou A, Guan S, Loew M.DC-UNet: Rethinking the U-Net Architecture with Dual Channel Efficient CNN for Medical Images Segmentation[J]. 2020.
[14]
[14] Sun, H., Li, C., Liu, B., Zheng, H., Feng, D. D., & Wang, S. (2018). Aunet: attention-guided dense-upsampling networks for breast mass segmentation in whole mammograms.
[15]
[15] Li H, Chen D, Nailon B,et al. Improved Breast Mass Segmentation in Mammograms with Conditional Residual U-net[J]. 2018.
[16]
[16] Zhu, W., Xiang, X., Tran, T. D., Hager, G. D. & Xie, X. Adversarial deep structured nets for mass segmentation from mammograms. In 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), 847–850 (IEEE, 2018).
[17]
[17] Singh, V. K. et al. Breast tumor segmentation and shape classification in mammograms using generative adversarial and convolutional neural network. ExpertSyst. Appl. 139, 112855 (2020).
[18]
[18] Liu, S., Huang, D., Wang, Y. (2018). Receptive Field Block Net for Accurate and Fast Object Detection. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds) Computer Vision – ECCV 2018. ECCV 2018. Lecture Notes in Computer Science(), vol 11215. Springer, Cham. https://doi.org/10.1007/978-3-030-01252-6_24
[19]
[19] Jha, D., Riegler, M. A., Johansen, D., Halvorsen, P. & Johansen, H. D. Double U-net: a deep convolutional neural network for medical image segmentation. In 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems(CBMS), 558-564 (IEEE, 2020).
[20]
[20] Chen, L. C., Papandreou, G., Schroff, F. & Adam, H. Rethinking Atrous convolution for semantic image segmentation. Preprint at https://arxiv.org/abs/1706.05587(2017).
[21]
[21] Das, S. et al. Contour-aware residual W-Net for nuclei segmentation. Procedia Comput. Sci. 159, 1479–1488 (2019)
[22]
[22] Zhu, J. Y., Park, T., Isola, P. & Efros, A. A. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proc. IEEE International Conference on Computer Vision, 2223–2232 (IEEE, 2017).
[23]
[23] Yuhao Huang, Xin Yang, Lian Liu, Han Zhou, Ao Chang, Xinrui Zhou, Rusi Chen, Junxuan Yu, Jiongquan Chen, Chaoyu Chen, et al. Segment Anything Model for medical images? arXiv preprint arXiv:2304.14660, 2023.
[24]
[24] Jun Ma and Bo Wang. Segment anything in medical images. arXiv preprint arXiv:2304.12306, 2023.
[25]
[25] Junde Wu, Rao Fu, Huihui Fang, Yuanpei Liu, Zhaowei Wang, Yanwu Xu, Yueming Jin, and Tal Arbel. Medical SAM adapter: Adapting Segment Anything Model for medical image segmentation. arXiv preprint arXiv:2304.12620, 2023.
[26]
[26] Yizhe Zhang, Tao Zhou, Peixian Liang, and Danny Chen. (2023). Input Augmentation with SAM: Boosting Medical Image Segmentation with Segmentation Foundation Model.
[27]
[27] Yifan Gao, Wei Xia, Dingdu Hu, and Xin Gao. DeSAM: Decoupling Segment Anything Model for generalizable medical image segmentation. arXiv preprint arXiv:2306.00499, 2023
[28]
[28] Sanderson, E., Matuszewski, B.J. (2022). FCN-Transformer Feature Fusion for Polyp Segmentation. In: Yang, G., Aviles-Rivero, A., Roberts, M., Schönlieb, CB. (eds) Medical Image Understanding and Analysis. MIUA 2022. Lecture Notes in Computer Science, vol 13413. Springer, Cham. https://doi.org/10.1007/978-3-031-12053-4_65
[29]
[29] Zhu, W., Xie, X. (2016). Adversarial deep structural networks for mammographic mass segmentation. Biorxiv, 095786.
[30]
[30] Abdelhafiz, D., Nabavi, S., Ammar, R., Yang, C., & Bi, J. (2019). Residual Deep Learning System for Mass Segmentation and Classification in Mammography. Proceedings of the 10th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics.
[31]
[31] Zhao, X., Zhang, L., Lu, H. (2021). Automatic Polyp Segmentation via Multi-scale Subtraction Network. In: de Bruijne, M., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2021. MICCAI 2021. Lecture Notes in Computer Science, vol 12901. Springer, Cham.

Index Terms

  1. A Method for Breast Mass Segmentation using Image Augmentation with SAM and Receptive Field Expansion

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICCPR '23: Proceedings of the 2023 12th International Conference on Computing and Pattern Recognition
    October 2023
    589 pages
    ISBN:9798400707988
    DOI:10.1145/3633637
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 February 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Mammography
    2. RFB
    3. SAM
    4. U-Net
    5. semantic segmentation

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICCPR 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 22
      Total Downloads
    • Downloads (Last 12 months)22
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 14 Sep 2024

    Other Metrics

    Citations

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media