skip to main content
research-article

An adaptive ensemble deep learning framework for reliable detection of pandemic patients

Published: 01 January 2024 Publication History

Abstract

Nurses, often considered the backbone of global health services, are disproportionately vulnerable to COVID-19 due to their front-line roles. They conduct essential patient tests, including blood pressure, temperature, and complete blood counts. The pandemic-induced loss of nursing staff has resulted in critical shortages. To address this, robotic solutions offer promising avenues. To solve this problem, we developed an ensemble deep learning (DL) model that uses seven different models to detect patients. Detected images are then used as input for the soft robot, which performs basic assessment tests. In this study, we introduce a deep learning-based approach for nursing soft robots, and propose a novel deep learning model named Deep Ensemble of Adaptive Architectures. Our method is twofold: firstly, an ensemble deep learning technique detects COVID-19 patients; secondly, a soft robot performs basic assessment tests on the identified patients. We evaluate the performance of various deep learning-based object detectors for patient detection, examining implementations of You Only Look Once (YOLO), Single Shot MultiBox Detector (SSD), Region-Based Convolutional Neural Network (RCNN), and Region-Based Fully Convolutional Network (R-FCN) on a proprietary dataset comprising 32,668 hospital surveillance images. Our results indicate that while YOLO and VGG facilitate rapid detection, Faster-RCNN (Inception ResNet-v2) and our proposed Ensemble-DL achieve the highest accuracy. Ensemble-DL offers accurate results in a reasonable timeframe, making it apt for patient detection on embedded platforms. Through real-world experiments, our method outperforms baseline approaches (including Faster-RCNN, R-FCN variants, CNN+LSTM, etc.) in terms of both precision and recall. Achieving an impressive accuracy of 98.32%, our deep learning-based model for nursing soft robots presents a significant advancement in the identification and assessment of COVID-19 patients, ultimately enhancing healthcare efficiency and patient care.

Highlights

Introducing Deep Ensemble of Adaptive Architectures for COVID-19 patient detection.
Utilizing an ensemble of seven models to enhance patient detection accuracy.
Integrating detected images with soft robots for essential patient assessments.
Addressing nursing staff shortage during the COVID-19 pandemic through robotics.
Enhancing healthcare efficiency using deep learning and soft robotics.

References

[1]
Suryawanshi C.M., Shah B., Khanna S., Ghodki P., Bhati K., Ashok K., Anaesthetic management of robot-assisted laparoscopic surgery, Indian J. Anaesth. 67 (1) (2023) 117.
[2]
Salkowski M., Checcucci E., Chow A.K., Rogers C.C., Adbollah F., Liatsikos E., Dasgupta P., Guimaraes G.C., Rassweiler J., Mottrie A., et al., New multiport robotic surgical systems: a comprehensive literature review of clinical outcomes in urology, Therapeutic Adv. Urol. 15 (2023).
[3]
Rivera-Cuadrado W., Healthcare practitioners’ construction of occupational risk during the COVID-19 pandemic, Soc. Sci. Med. (2023).
[4]
Kumar Maheshwari S., Trends in the management of aged population during the COVID-19 pandemic, in: Handbook on COVID-19 Pandemic and Older Persons: Narratives and Issues from India and beyond, Springer, 2023, pp. 55–80.
[5]
Fusi G., Del Giudice D., Skarsetz O., Di Stefano S., Walther A., Autonomous soft robots empowered by chemical reaction networks, Adv. Mater. 35 (7) (2023).
[6]
Della Santina C., Catalano M.G., Bicchi A., Ang M., Khatib O., Siciliano B., Soft robots, Encycl. Robotics 489 (2020).
[7]
Zhang Y., Li P., Quan J., Li L., Zhang G., Zhou D., Progress, challenges, and prospects of soft robotics for space applications, Adv. Intell. Syst. 5 (3) (2023).
[8]
Ambrose J.W., Chiang N.Z.R., Cheah D.S.Y., Yeow C.-H., Compact multilayer extension actuators for reconfigurable soft robots, Soft Robotics 10 (2) (2023) 301–313.
[9]
Aalto U.L., Pitkälä K.H., Andersen-Ranberg K., Bonin-Guillaume S., Cruz-Jentoft A.J., Eriksdotter M., Gordon A.L., Gosch M., Holmerova I., Kautiainen H., et al., COVID-19 pandemic and mortality in nursing homes across USA and europe up to october 2021, European Geriatric Med. 13 (3) (2022) 705–709.
[10]
Dean A., Venkataramani A., Kimmel S., Mortality rates from COVID-19 are lower in unionized nursing homes: study examines mortality rates in New York nursing homes, Health Affairs 39 (11) (2020) 1993–2001.
[11]
Sania A., Mahmud A.S., Alschuler D.M., Urmi T., Chowdhury S., Lee S., Mostari S., Shaikh F.Z., Sojib K.H., Khan T., et al., Risk factors for COVID-19 mortality among telehealth patients in Bangladesh: A prospective cohort study, PLoS Global Public Health 3 (6) (2023).
[12]
Loh C., How COVID-19 Took over the World: Lessons for the Future, Hong Kong University Press, 2023.
[13]
Seo M., Law-abiding citizens in the age of social distancing: religion and COVID-19 in South Korea, Religion Brain Behav. (2023) 1–15.
[14]
Salehiniya H., Hatamian S., Abbaszadeh H., Mental health status of dentists during COVID-19 pandemic: A systematic review and meta-analysis, Health Sci. Rep. 5 (3) (2022).
[15]
Hasan M., Islam A.R.M.T., Jion M.M.M.F., Rahman M.N., Peu S.D., Das A., Bari A.M., Islam M.S., Pal S.C., Islam A., et al., Personal protective equipment-derived pollution during Covid-19 era: A critical review of ecotoxicology impacts, intervention strategies, and future challenges, Sci. Total Environ. (2023).
[16]
Rejeski K., Perez A., Iacoboni G., Penack O., Bücklein V., Jentzsch L., Mougiakakos D., Johnson G., Arciola B., Carpio C., et al., The CAR-HEMATOTOX risk-stratifies patients for severe infections and disease progression after CD19 CAR-T in R/R LBCL, J. ImmunoTher. Cancer 10 (5) (2022).
[17]
Sunnetci K.M., Alkan A., Biphasic majority voting-based comparative COVID-19 diagnosis using chest X-Ray images, Expert Syst. Appl. (2022).
[18]
Kuo M.D., Chiu K.W., Wang D.S., Larici A.R., Poplavskiy D., Valentini A., Napoli A., Borghesi A., Ligabue G., Fang X.H.B., et al., Multi-center validation of an artificial intelligence system for detection of COVID-19 on chest radiographs in symptomatic patients, Eur. Radiol. 33 (1) (2023) 23–33.
[19]
Ulfa M., Azuma M., Steiner A., Burnout status of healthcare workers in the world during the peak period of the COVID-19 pandemic, Front. Psychol. 13 (2022).
[20]
Das D., Saikia H., Bora D., Bhattacharjee D., Das J., A survival analysis approach for identifying the risk factors in time to recovery of COVID-19 patients using Cox proportional hazard model, Decis. Anal. J. 5 (2022).
[21]
Lugli G., Ottaviani M.M., Botta A., Ascione G., Bruschi A., Cagnazzo F., Zammarchi L., Romagnani P., Portaluri T., The impact of the SARS-CoV-2 pandemic on healthcare provision in Italy to non-COVID patients: a systematic review, Mediterr. J. Hematol. Infect. Dis. 14 (1) (2022).
[22]
Yi J., Zhang H., Mao J., Chen Y., Zhong H., Wang Y., Review on the COVID-19 pandemic prevention and control system based on AI, Eng. Appl. Artif. Intell. (2022).
[23]
Gleeson T., Mackway-Jones K., et al., Major Incident Medical Management and Support: The Practical Approach At the Scene, John Wiley & Sons, 2022.
[24]
Tan M., Le Q., Efficientnet: Rethinking model scaling for convolutional neural networks, in: International Conference on Machine Learning, PMLR, 2019, pp. 6105–6114.
[25]
Yuan H.-S., Chen S.-B., Luo B., Huang H., Li Q., Multi-branch bounding box regression for object detection, Cogn. Comput. (2022) 1–8.
[26]
Tuncer S.A., Alkan A., A decision support system for detection of the renal cell cancer in the kidney, Measurement 123 (2018) 298–303.
[27]
Henderson P., Ferrari V., End-to-end training of object class detectors for mean average precision, in: Computer Vision–ACCV 2016: 13th Asian Conference on Computer Vision, Taipei, Taiwan, November 20-24, 2016, Revised Selected Papers, Part V 13, Springer, 2017, pp. 198–213.
[28]
Liu W., Anguelov D., Erhan D., Szegedy C., Reed S., Fu C.-Y., Berg A.C., Ssd: Single shot multibox detector, in: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, the Netherlands, October 11–14, 2016, Proceedings, Part I 14, Springer, 2016, pp. 21–37.
[29]
S. Gidaris, N. Komodakis, Locnet: Improving localization accuracy for object detection, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 789–798.
[30]
Fu C.-Y., Liu W., Ranga A., Tyagi A., Berg A.C., DSSD: Deconvolutional single shot detector, 2017, arXiv preprint arXiv:1701.06659.
[31]
J. Redmon, A. Farhadi, YOLO9000: better, faster, stronger, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 7263–7271.
[32]
Ren S., He K., Girshick R., Sun J., Faster r-CNN: Towards real-time object detection with region proposal networks, Adv. Neural Inf. Process. Syst. 28 (2015).
[33]
K. He, G. Gkioxari, P. Dollár, R. Girshick, Mask r-CNN, in: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2961–2969.
[34]
L. Tychsen-Smith, L. Petersson, DeNet: Scalable real-time object detection with directed sparse sampling, in: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 428–436.
[35]
Z. Cai, N. Vasconcelos, Cascade r-CNN: Delving into high quality object detection, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 6154–6162.
[36]
S. Robertson, A new interpretation of average precision, in: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008, pp. 689–690.
[37]
Redmon J., Farhadi A., Yolov3: An incremental improvement, 2018, arXiv preprint arXiv:1804.02767.
[38]
Zhang S., Wen L., Lei Z., Li S.Z., RefineDet++: Single-shot refinement neural network for object detection, IEEE Trans. Circuits Syst. Video Technol. 31 (2) (2020) 674–687.
[39]
T.-Y. Lin, P. Goyal, R. Girshick, K. He, P. Dollár, Focal loss for dense object detection, in: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2980–2988.
[40]
Bochkovskiy A., Wang C.-Y., Liao H.-Y.M., Yolov4: Optimal speed and accuracy of object detection, 2020, arXiv preprint arXiv:2004.10934.
[41]
C.-Y. Wang, H.-Y.M. Liao, Y.-H. Wu, P.-Y. Chen, J.-W. Hsieh, I.-H. Yeh, CSPNet: A new backbone that can enhance learning capability of CNN, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, pp. 390–391.
[42]
Y. Zhu, C. Zhao, J. Wang, X. Zhao, Y. Wu, H. Lu, Couplenet: Coupling global structure with local parts for object detection, in: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 4126–4134.
[43]
Z. Gao, L. Wang, G. Wu, Lip: Local importance-based pooling, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 3355–3364.
[44]
Kim J., Oh K., Oh B.-S., Lin Z., Toh K.-A., A line feature extraction method for finger-knuckle-print verification, Cogn. Comput. 11 (2019) 50–70.
[45]
Y. Li, Y. Chen, N. Wang, Z. Zhang, Scale-aware trident networks for object detection, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 6054–6063.
[46]
B. Cheng, Y. Wei, H. Shi, R. Feris, J. Xiong, T. Huang, Revisiting RCNN: On awakening the classification power of faster rcnn, in: Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 453–468.
[47]
S. Wang, J. Song, J. Lien, I. Poupyrev, O. Hilliges, Interacting with soli: Exploring fine-grained dynamic gesture recognition in the radio-frequency spectrum, in: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, 2016, pp. 851–860.
[48]
Devi S.K., Subalalitha C., Assisting the visually challenged people using faster RCNN with inception ResNet V2 based object detection model, in: Pervasive Computing and Social Networking: Proceedings of ICPCSN 2021, Springer, 2022, pp. 171–181.
[49]
Arcos-García Á., Álvarez-García J.A., Soria-Morillo L.M., Evaluation of deep neural networks for traffic sign detection systems, Neurocomputing 316 (2018) 332–344.
[50]
B. Singh, H. Li, A. Sharma, L.S. Davis, R-FCN-3000 at 30fps: Decoupling detection and classification, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 1081–1090.
[51]
Nielsen D.S., Hansen R.F., Beck S.H., Wensien J., Masud T., Ryg J., Older patients’ perspectives and experience of hospitalisation during the COVID-19 pandemic: a qualitative explorative study, Int. J. Older People Nurs. 16 (2) (2021).
[52]
S. Taube, R. Lipson, COVID-19 and the Changing Massachusetts Healthcare Workforce, in: Project on Workforce White Papers, 2021.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Computers in Biology and Medicine
Computers in Biology and Medicine  Volume 168, Issue C
Jan 2024
1551 pages

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 January 2024

Author Tags

  1. Nurses
  2. COVID-19
  3. Robotic solutions
  4. Deep learning
  5. Patient detection

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 23 Jan 2025

Other Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media