skip to main content
10.1145/3634875.3634876acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicbspConference Proceedingsconference-collections
research-article

Clustering-Based Cancer Diagnosis Model for Whole Slide Image

Published: 29 January 2024 Publication History

Abstract

Automated classification of Whole Slide Images (WSIs) is of great significance for early diagnosis of cancer. Existing approaches are trained on a specific level which affects the analysis performance due to weak supervision of patches and variants. Additionally, it is difficult to distinguish cancer subtype patches accurately from different magnification levels of WSIs. However, this can be improved by employing artificial intelligence models to address these problems, we propose a novel clustering-based cancer diagnosis (CBCD) method for WSI classification. The CBCD constructs three modules: first, we extracted patches from each magnification level of WSIs with respective cancer sub-types. Second, we employed two features (global and local) to learn discriminative and salient information of each patch. Then we find the meaningful cluster regions based on these features to quantify (select) the best patches of salient cancer subtypes by only relying on the collective characteristics of patches from different magnification levels. The clustering techniques used are k-means, gaussian mixture model, and agglomerative clustering. The quality of each clustering technique was determined using adjusted rand, and calinski harabasz scores. Later we used five state-of-the-art (SOTA) deep learning models to learn and classify cancer subtype regions of WSIs based on two types of features of patches. We also showed the results with no clustering techniques in an end-to-end supervised way by directly extracting patches from WSIs. Our method is evaluated on the public WSI dataset (KBSMC) for cancer sub-types classification and achieves better performance and great interpretability compared with the SOTA methods.

References

[1]
ATTALLAH, O., ANWAR, F., GHANEM, N. M., AND ISMAIL, M. A. Histo-cadx: duo cascaded fusion stages for breast cancer diagnosis from histopathological images. PeerJ Computer Science 7 (2021), e493.
[2]
BARKER, J., HOOGI, A., DEPEURSINGE, A., AND RUBIN, D. L. Automated classification of brain tumor type in whole-slide digital pathology images using local representative tiles. Medical image analysis 30 (2016), 60–71.
[3]
BENTAIEB, A., AND HAMARNEH, G. Predicting cancer with a recurrent visual attention model for histopathology images. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part II 11 (2018), Springer, pp. 129–137.
[4]
CAMPANELLA, G., HANNA, M. G., GENESLAW, L., MIRAFLOR, A., WERNECK KRAUSS SILVA, V., BUSAM, K. J., BROGI, E., REUTER, V. E., KLIMSTRA, D. S., AND FUCHS, T. J. Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nature medicine 25, 8 (2019), 1301–1309.
[5]
CHIKONTWE, P., KIM, M., NAM, S. J., GO, H., AND PARK, S. H. Multiple instance learning with center embeddings for histopathology classification. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part V 23 (2020), Springer, pp. 519–528.
[6]
GERTYCH, A., ING, N., MA, Z., FUCHS, T. J., SALMAN, S., MOHANTY, S., BHELE, S., VELASQUEZ-VACCA, A., AMIN, M. B., AND KNUDSEN, B. S. Machine learning approaches to analyze histological images of tissues from radical prostatectomies. Computerized Medical Imaging and Graphics 46 (2015), 197–208.
[7]
HOU, L., SAMARAS, D., KURC, T. M., GAO, Y., DAVIS, J. E., AND SALTZ, J. H. Patch-based convolutional neural network for whole slide tissue image classification. In Proceedings of the IEEE conference on computer vision and pattern recognition (2016), pp. 2424–2433.
[8]
ILSE, M., TOMCZAK, J., AND WELLING, M. Attention-based deep multiple instance learning. In International conference on machine learning (2018), PMLR, pp. 2127–2136.
[9]
LE VUONG, T. T., KIM, K., SONG, B., AND KWAK, J. T. Joint categorical and ordinal learning for cancer grading in pathology images. Medical image analysis 73 (2021), 102206.
[10]
LI, B., LI, Y., AND ELICEIRI, K. W. Dual-stream multiple instance learning network for whole slide image classification with self-supervised contrastive learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (2021), pp. 14318–14328.
[11]
LI, Y., WU, J., AND WU, Q. Classification of breast cancer histology images using multi-size and discriminative patches based on deep learning. Ieee Access 7 (2019), 21400–21408.
[12]
LIU, L., FENG, W., CHEN, C., LIU, M., QU, Y., AND YANG, J. Classification of breast cancer histology images using msmv-pfenet. Scientific Reports 12, 1 (2022), 17447.
[13]
LU, M. Y., CHEN, R. J., WANG, J., DILLON, D., AND MAHMOOD, F. Semi-supervised histology classification using deep multiple instance learning and contrastive predictive coding. arXiv preprint arXiv:1910.10825 (2019).
[14]
LU, M. Y., WILLIAMSON, D. F., CHEN, T. Y., CHEN, R. J., BARBIERI, M., AND MAHMOOD, F. Data-efficient and weakly supervised computational pathology on whole-slide images. Nature biomedical engineering 5, 6 (2021), 555–570.
[15]
MERCAN, C., AKSOY, S., MERCAN, E., SHAPIRO, L. G., WEAVER, D. L., AND ELMORE, J. G. Multi-instance multi-label learning for multi-class classification of whole slide breast histopathology images. IEEE transactions on medical imaging 37, 1 (2017), 316–325.
[16]
MERCAN, C., AKSOY, S., MERCAN, E., SHAPIRO, L. G., WEAVER, D. L., AND ELMORE, J. G. Multi-instance multi-label learning for multi-class classification of whole slide breast histopathology images. IEEE transactions on medical imaging 37, 1 (2017), 316–325.
[17]
RELAN, D., MACGILLIVRAY, T., BALLERINI, L., AND TRUCCO, E. Retinal vessel classification: sorting arteries and veins. In 2013 35th annual international conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (2013), IEEE, pp. 7396–7399.
[18]
REN, J., HACIHALILOGLU, I., SINGER, E. A., FORAN, D. J., AND QI, X. Adversarial domain adaptation for classification of prostate histopathology whole-slide images. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part II 11 (2018), Springer, pp. 201–209.
[19]
SHEIKH, T. S., LEE, Y., AND CHO, M. Histopathological classification of breast cancer images using a multi-scale input and multi-feature network. Cancers 12, 8 (2020), 2031.
[20]
SHRIVASTAVA, A., KANT, K., SENGUPTA, S., KANG, S.-J., KHAN, M., ALI, S. A., MOORE, S. R., AMADI, B. C., KELLY, P., BROWN, D. E., ET AL. Deep learning for visual recognition of environmental enteropathy and celiac disease. In 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI) (2019), IEEE, pp. 1–4.
[21]
TELLEZ, D., LITJENS, G., VAN DER LAAK, J., AND CIOMPI, F. Neural image compression for gigapixel histopathology image analysis. IEEE transactions on pattern analysis and machine intelligence 43, 2 (2019), 567–578.
[22]
THAWANI, R., MCLANE, M., BEIG, N., GHOSE, S., PRASANNA, P., VELCHETI, V., AND MADABHUSHI, A. Radiomics and radiogenomics in lung cancer: a review for the clinician. Lung cancer 115 (2018), 34–41.
[23]
TONG, L., HOFFMAN, R., DESHPANDE, S. R., AND WANG, M. D. Predicting heart rejection using histopathological whole-slide imaging and deep neural network with dropout. In 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI) (2017), IEEE, pp. 1–4.
[24]
WANG, D., KHOSLA, A., GARGEYA, R., IRSHAD, H., AND BECK, A. H. Deep learning for identifying metastatic breast cancer. arXiv preprint arXiv:1606.05718 (2016).
[25]
WANG, X., CHEN, H., GAN, C., LIN, H., DOU, Q., TSOUGENIS, E., HUANG, Q., CAI, M., AND HENG, P.-A. Weakly supervised deep learning for whole slide lung cancer image analysis. IEEE transactions on cybernetics 50, 9 (2019), 3950–3962.
[26]
WU, H., LYU, X., AND WEN, Z. Automatic texture exemplar extraction based on global and local textureness measures. Computational Visual Media 4 (2018), 173–184.
[27]
XIA, Y., NIE, L., ZHANG, L., YANG, Y., HONG, R., AND LI, X. Weakly supervised multilabel clustering and its applications in computer vision.IEEE transactions on cybernetics 46, 12 (2016), 3220–3232.
[28]
XIAO, Y., LIU, B., HAO, Z., AND CAO, L. A similarity-based classification framework for multiple-instance learning. IEEE transactions on cybernetics 44, 4 (2013), 500–515.
[29]
XIE, C., MUHAMMAD, H., VANDERBILT, C. M., CASO, R., YARLAGADDA, D. V. K., CAMPANELLA, G., AND FUCHS, T. J. Beyond classification: Whole slide tissue histopathology analysis by end-to-end part learning. In Medical Imaging with Deep Learning (2020), PMLR, pp. 843–856.
[30]
YAO, J., ZHU, X., JONNAGADDALA, J., HAWKINS, N., AND HUANG, J. Whole slide images based cancer survival prediction using attention guided deep multiple instance learning networks. Medical Image Analysis 65 (2020), 101789.
[31]
YOSHIDA, H., SHIMAZU, T., KIYUNA, T., MARUGAME, A., YAMASHITA, Y., COSATTO, E., TANIGUCHI, H., SEKINE, S., AND OCHIAI, A. Automated histological classification of whole-slide images of gastric biopsy specimens. Gastric Cancer 21, 2 (2018), 249–257.
[32]
ZHU, W., LOU, Q., VANG, Y. S., AND XIE, X. Deep multi-instance networks with sparse label assignment for whole mammogram classification. In International Conference on Medical Image Computing and Computer-Assisted Intervention (2017), Springer, pp. 603–611.
[33]
ZHU, X., YAO, J., ZHU, F., AND HUANG, J. Wsisa: Making survival prediction from whole slide histopathological images. In Proceedings of the IEEE conference on computer vision and pattern recognition (2017), pp. 7234–7242.

Index Terms

  1. Clustering-Based Cancer Diagnosis Model for Whole Slide Image

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICBSP '23: Proceedings of the 2023 8th International Conference on Biomedical Imaging, Signal Processing
    October 2023
    127 pages
    ISBN:9798400716584
    DOI:10.1145/3634875
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 January 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Additional Key Words and Phrases: Deep Learning
    2. Cancer Diagnosis
    3. Classification
    4. Clustering
    5. Whole Slide Images

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICBSP 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 23
      Total Downloads
    • Downloads (Last 12 months)23
    • Downloads (Last 6 weeks)6
    Reflects downloads up to 13 Jan 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media