TY - JOUR
T1 - Camera-Based Bi-Modal PPG-SCG
T2 - Sleep Privacy-Protected Contactless Vital Signs Monitoring
AU - Zhu, Yingen
AU - Ge, Yao
AU - Wei, Qiang
AU - Huang, Yukai
AU - Huang, Dongmin
AU - Yuen, Pongchi
AU - Xiao, Fu
AU - Wang, Wenjin
N1 - Funding Information:
This work is supported by the National Natural Science Foundation of China (62350068, 62271241), National Key R&D Program of China (2022YFC2407800), Guangdong Basic and Applied Basic Research Foundation (2023A1515012983), Shenzhen Science and Technology Program (JSGGKQTD20221103174704003), Shenzhen Fundamental Research Program (JCYJ20220530112601003), and Shenzhen Medical Research Fund (D2402011).
Publisher Copyright:
© 2014 IEEE.
PY - 2024/10/23
Y1 - 2024/10/23
N2 - The monitoring of respiratory rate (RR), heart rate (HR), heart rate variability (HRV), and blood pressure (BP) during sleep allows for a comprehensive evaluation of sleep quality, facilitating the understanding and improvement of a person's sleep health. Contactless physiological monitoring using cameras has gained popularity recently due to its convenient, infection-free, continuous, and versatile nature. However, the privacy concerns limit the application of camera-based solutions in sleep monitoring setups. This study proposes a novel hybrid setup that integrates camera-based seismocardiography (CamSCG) and photoplethysmography (CamPPG) for contactless measurement of RR, HR and HRV during sleep while simultaneously estimating BP. For the proximal SCG, we employed camera-based laser speckle vibrometry to measure cardiac motions from the chest, and benchmarked it with a millimeter-wave radar (RFSCG). For the distal PPG, a defocused camera was utilized to measure pulse signals from the facial skin while protecting privacy. In this setup, we analyzed the single-modality in measuring RR, HR and HRV, and established two bi-modalities (CamSCG-CamPPG and RFSCG-CamPPG) to measure Pulse Transit Time (PTT) features for BP calibration. The benchmark involving 19 subjects highlights the potential of camera-based bimodal SCG-PPG for privacy-protected vital signs monitoring during sleep.
AB - The monitoring of respiratory rate (RR), heart rate (HR), heart rate variability (HRV), and blood pressure (BP) during sleep allows for a comprehensive evaluation of sleep quality, facilitating the understanding and improvement of a person's sleep health. Contactless physiological monitoring using cameras has gained popularity recently due to its convenient, infection-free, continuous, and versatile nature. However, the privacy concerns limit the application of camera-based solutions in sleep monitoring setups. This study proposes a novel hybrid setup that integrates camera-based seismocardiography (CamSCG) and photoplethysmography (CamPPG) for contactless measurement of RR, HR and HRV during sleep while simultaneously estimating BP. For the proximal SCG, we employed camera-based laser speckle vibrometry to measure cardiac motions from the chest, and benchmarked it with a millimeter-wave radar (RFSCG). For the distal PPG, a defocused camera was utilized to measure pulse signals from the facial skin while protecting privacy. In this setup, we analyzed the single-modality in measuring RR, HR and HRV, and established two bi-modalities (CamSCG-CamPPG and RFSCG-CamPPG) to measure Pulse Transit Time (PTT) features for BP calibration. The benchmark involving 19 subjects highlights the potential of camera-based bimodal SCG-PPG for privacy-protected vital signs monitoring during sleep.
KW - Camera
KW - mmWave radar
KW - photoplethysmography
KW - seismocardiogram
KW - sleep monitoring
KW - vital signs monitoring
UR - http://www.scopus.com/inward/record.url?scp=85207377607&partnerID=8YFLogxK
U2 - 10.1109/JIOT.2024.3484752
DO - 10.1109/JIOT.2024.3484752
M3 - Journal article
AN - SCOPUS:85207377607
SN - 2327-4662
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
ER -