Weakly Supervised rPPG Estimation for Respiratory Rate Estimation

Jingda Du, Siqi Liu, Bochao Zhang, Pong Chi Yuen

Research output: Chapter in book/report/conference proceedingConference contributionpeer-review

Abstract

Recent studies demonstrate that respiratory rate can be estimated from skin videos through analyzing the frequency domain attributes of their remote photoplethysmography (rPPG). However, respiration is not always periodic so the frequency attributes of rPPG may not accurately estimate the respiratory rate. In this paper, we proposed an end-to-end network to estimate both rPPG signals and respiratory rates from facial videos. Since only breathing waves are available in the Remote Physiological Signal Sensing track2 competition, to preserve the respiratory pattern in rPPG estimation, rPPG signals pre-estimated by chrominace-based methods and modulated by breathing waves are used as weak labels for supervision. To adapt to the large differences between training and testing data, in terms of recording environment and subjects behavior, we also involved customized adversarial training on feature extractor to minimize the domain gap. In the competition, our model achieved 7.56 bpm MAE and ranked the second place.
Original languageEnglish
Title of host publication2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)
PublisherIEEE
Pages2391-2397
Number of pages7
ISBN (Electronic)9781665401913
ISBN (Print)9781665401920
DOIs
Publication statusPublished - Oct 2021
Event2021 IEEE/CVF International Conference on Computer Vision Workshops - Montreal, BC, Canada
Duration: 11 Oct 202117 Oct 2021
https://ieeexplore.ieee.org/xpl/conhome/9607382/proceeding

Publication series

NameIEEE/CVF International Conference on Computer Vision Workshops (ICCVW)
ISSN (Print)2473-9936
ISSN (Electronic)2473-9944

Conference

Conference2021 IEEE/CVF International Conference on Computer Vision Workshops
Abbreviated titleICCVW 2021
Country/TerritoryCanada
CityMontreal, BC
Period11/10/2117/10/21
Internet address

Fingerprint

Dive into the research topics of 'Weakly Supervised rPPG Estimation for Respiratory Rate Estimation'. Together they form a unique fingerprint.

Cite this