skip to main content
10.1145/3592686.3592696acmotherconferencesArticle/Chapter ViewAbstractPublication PagesbicConference Proceedingsconference-collections
research-article

Estimate Heart Rate from Recovered Facial Signal

Published: 31 May 2023 Publication History

Abstract

Heart rate is an important physiological indicator of the human body, reflecting a person's health and mental state. Remote photoplethysmography (rPPG) is a noncontact method for measuring cardiac signals from facial videos. This method uses facial video to analyze the subtle and instantaneous changes in skin color caused by the heartbeat that cannot be detected by the human eye and realizes the detection of physiological indicators such as heart rate, respiration rate, and heart rate variability. RPPG signals (also known as "blood volume pulse signals" or "BVP" signals) are the signals extracted by rPPG techniques. Heart rate can be obtained through BVP signals extracted by rPPG techniques. However, the quality of the signal is affected to varying degrees due to effects such as lighting and motion, so the accuracy of remotely measured heart rate is also affected. The existing methods rarely perform signal recovery processes for measuring heart rate, usually estimating heart rate by complex models. In this paper, we propose GBR-HR, a framework based on Gradient Boosting Regression (GBR) and Convolutional Neural Networks (CNN) for remote heart rate estimation from facial videos. The results show that the proposed method can effectively improve the quality of the BVP signal compared with the chrominance-based color space projection decomposition algorithm (CHROM), and the Pearson correlation coefficient is improved by an average of 24.5% on the UBFC-rPPG and UJN-rPPG datasets. For heart rate estimation, results demonstrate that GBR-HR outperforms most of the existing methods on the UBFC-rPPG dataset. This simple framework can quickly and accurately restore the BVP signal, which makes physiological indices such as heart rate estimation even more accurate.

References

[1]
Bailey, James J., 1990. "Recommendations for standardization and specifications in automated electrocardiography: bandwidth and digital signal processing. A report for health professionals by an ad hoc writing group of the Committee on Electrocardiography and Cardiac Electrophysiology of the Council on Clinical Cardiology, American Heart Association." Circulation 81.2 (1990): 730-739.
[2]
Shelley, Kirk H. 2007. "Photoplethysmography: beyond the calculation of arterial oxygen saturation and heart rate." Anesthesia & Analgesia 105.6 (2007): S31-S36.K. Elissa, “Title of paper if known,” unpublished.
[3]
E. J. Parra. 2007. Human pigmentation variation: evolution, genetic basis, and implications for public health. Yearbook of Physical Anthropology, 50:85-105, 2007
[4]
Tohma, Akito, 2021. "Evaluation of Remote Photoplethysmography Measurement Conditions toward Telemedicine Applications." Sensors 21.24 (2021): 8357.
[5]
De Haan, Gerard, and Vincent Jeanne. 2013. "Robust pulse rate from chrominance-based rPPG." IEEE Transactions on Biomedical Engineering 60.10 (2013): 2878-2886.
[6]
W. Verkruysse, L. O. Svaasand, and J. S. Nelson. 2008. “Remote plethysmographic imaging using ambient light,” Opt. Exp., vol. 16, no. 26, pp. 21 434–21 445, 2008.
[7]
Poh, M.Z.; McDuff, D.J.; Picard, R.W. 2010. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt. Express 2010, 18, 10762-10774.
[8]
Wang, W., den Brinker, A.C., Stuijk, S., de Haan, G. 2016. : Algorithmic principles of remote ppg. IEEE Transactions on Biomedical Engineering 64(7), 1479-1491 (2016)
[9]
E.Lee, E. Chen, and C.-Y. Lee. 2020. “Meta-RPPG: Remote heart rate estimation using a transductive meta-learner,” in Proc. Eur. Conf. Comput. Vis., 2020, pp. 392-409.
[10]
Bousefsaf, Fr´ed´eric, Alain Pruski, and Choubeila Maaoui. 2019. “3D convolutional neural networks for remote pulse rate measurement and mapping from facial video.” Applied Sciences 9.20 (2019): 4364.
[11]
Tsou, Yun-Yun, 2020. "Siamese-rPPG network: Remote photoplethysmography signal estimation from face videos." Proceedings of the 35th annual ACM symposium on applied computing. 2020.
[12]
K. He, X. Zhang, S. Ren, and J. Sun. 2016. “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
[13]
S. Bobbia, R. Macwan, Y. Benezeth, A. Mansouri, J. Dubois. 2017. "Unsupervised skin tissue segmentation for remote photoplethysmography", Pattern Recognition Letters, 2017.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
BIC '23: Proceedings of the 2023 3rd International Conference on Bioinformatics and Intelligent Computing
February 2023
398 pages
ISBN:9798400700200
DOI:10.1145/3592686
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 May 2023

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

BIC 2023

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 43
    Total Downloads
  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media