TY - JOUR
T1 - Camera-Based Bi-Modal PPG-SCG
T2 - Sleep Privacy-Protected Contactless Vital Signs Monitoring
AU - Zhu, Yingen
AU - Ge, Yao
AU - Wei, Qiang
AU - Huang, Yukai
AU - Huang, Dongmin
AU - Yuen, Pongchi
AU - Xiao, Fu
AU - Wang, Wenjin
N1 - Funding Information:
This work is supported by the National Natural Science Foundation of China (62350068, 62271241), National Key R&D Program of China (2022YFC2407800), Guangdong Basic and Applied Basic Research Foundation (2023A1515012983), Shenzhen Science and Technology Program (JSGGKQTD20221103174704003), Shenzhen Fundamental Research Program (JCYJ20220530112601003), and Shenzhen Medical Research Fund (D2402011).
PY - 2025/2/15
Y1 - 2025/2/15
N2 - The monitoring of respiratory rate (RR), heart rate (HR), heart rate variability (HRV), and blood pressure (BP) during sleep allows for a comprehensive evaluation of sleep quality, facilitating the understanding and improvement of a person's sleep health. Contactless physiological monitoring using cameras has gained popularity recently due to its convenient, infection-free, continuous, and versatile nature. However, the privacy concerns limit the application of camera-based solutions in sleep monitoring setups. This study proposes a novel hybrid setup that integrates camera-based seismocardiography (CamSCG) and photoplethysmography (CamPPG) for contactless measurement of RR, HR and HRV during sleep while simultaneously estimating BP. For the proximal SCG, we employed camera-based laser speckle vibrometry to measure cardiac motions from the chest, and benchmarked it with a millimeter-wave radar (RFSCG). For the distal PPG, a defocused camera was utilized to measure pulse signals from the facial skin while protecting privacy. In this setup, we analyzed the single-modality in measuring RR, HR and HRV, and established two bi-modalities (CamSCG-CamPPG and RFSCG-CamPPG) to measure Pulse Transit Time (PTT) features for BP calibration. The benchmark involving 19 subjects highlights the potential of camera-based bimodal SCG-PPG for privacy-protected vital signs monitoring during sleep.
AB - The monitoring of respiratory rate (RR), heart rate (HR), heart rate variability (HRV), and blood pressure (BP) during sleep allows for a comprehensive evaluation of sleep quality, facilitating the understanding and improvement of a person's sleep health. Contactless physiological monitoring using cameras has gained popularity recently due to its convenient, infection-free, continuous, and versatile nature. However, the privacy concerns limit the application of camera-based solutions in sleep monitoring setups. This study proposes a novel hybrid setup that integrates camera-based seismocardiography (CamSCG) and photoplethysmography (CamPPG) for contactless measurement of RR, HR and HRV during sleep while simultaneously estimating BP. For the proximal SCG, we employed camera-based laser speckle vibrometry to measure cardiac motions from the chest, and benchmarked it with a millimeter-wave radar (RFSCG). For the distal PPG, a defocused camera was utilized to measure pulse signals from the facial skin while protecting privacy. In this setup, we analyzed the single-modality in measuring RR, HR and HRV, and established two bi-modalities (CamSCG-CamPPG and RFSCG-CamPPG) to measure Pulse Transit Time (PTT) features for BP calibration. The benchmark involving 19 subjects highlights the potential of camera-based bimodal SCG-PPG for privacy-protected vital signs monitoring during sleep.
KW - Camera
KW - photoplethysmography
KW - seismocardiogram
KW - sleep monitoring
KW - vital signs monitoring
KW - millimeter-wave (mmWave) radar
UR - http://www.scopus.com/inward/record.url?scp=85207377607&partnerID=8YFLogxK
U2 - 10.1109/JIOT.2024.3484752
DO - 10.1109/JIOT.2024.3484752
M3 - Journal article
AN - SCOPUS:85207377607
SN - 2327-4662
VL - 12
SP - 4375
EP - 4389
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
IS - 4
ER -
