A deep learning method for contactless emotion recognition from ballistocardiogram | |
Yu, Xianya1,2; Zou, Yonggang1,2; Mou, Xiuying1,2; Li, Siying1,2; Bai, Zhongrui4; Du, Lidong1,2; Li, Zhenfeng1; Wang, Peng1; Chen, Xianxiang1,2; Li, Xiaoran5; Li, Fenghua6; Li, Huaiyong7; Fang, Zhen1,2,3 | |
第一作者 | Yu, Xianya |
通讯作者邮箱 | [email protected] ; [email protected] ; [email protected] ; [email protected] ; [email protected] |
心理所单位排序 | 6 |
摘要 | Emotion recognition is a major research point in the field of affective computing. Existing research on the application of physiological signals to emotion recognition mainly focuses on the processing of contact signals. However, there are issues with contact signal acquisition equipment, such as limited portability and poor user compliance, which make it difficult to promote its use. To explore a new method for emotion recognition based on contactless ballistocardiogram (BCG), we proposed a SE-CNN model with a multi-class focal loss function. To construct the dataset, we used audio-visual stimuli to evoke the subjects' emotions and collected data on the subjects' three discrete emotions, positive, neutral, and negative, through our established BCG signal acquisition system based on a piezoelectric ceramics sensor. Root mean square filter and thresholding were used to detect and eliminate motion artifacts of BCG signals. We did two kinds of preprocessing on BCG signals: wavelet transform and bandpass filtering, to explore the effect of different components of BCG on emotion recognition. Subsequently, we verified the model's performance and cross-time working ability through traditional K-Fold and our proposed K-Session cross-validation methods. The results showed that the band-pass filtering method was more beneficial to the current classification task. Under K-Fold cross-validation, the model's accuracy, precision, and recall were 97.21%, 97.00%, and 97.11%. Under K-Session cross-validation, the model's accuracy, precision, and recall were 94.66%, 93.92%, and 94.86%, respectively, all of which were better than the classification effect of synchronous ECG. The reliability of BCG in contactless emotion recognition was proved. |
关键词 | Ballistocardiogram Emotion recognition Contactless technology |
2025 | |
语种 | 英语 |
DOI | 10.1016/j.bspc.2024.106891 |
发表期刊 | BIOMEDICAL SIGNAL PROCESSING AND CONTROL |
ISSN | 1746-8094 |
卷号 | 99页码:10 |
期刊论文类型 | 实证研究 |
收录类别 | SCI |
资助项目 | National Key Research and Development Project[2020YFC2003703] ; National Key Research and Development Project[2021YFC3002204] ; National Key Research and Development Project[2020YFC1512304] ; National Natural Science Foundation of China[62071451] ; CAMS Innovation Fund for Medical Sciences[2019-I2M-5-019] |
出版者 | ELSEVIER SCI LTD |
WOS研究方向 | Engineering |
WOS类目 | Engineering, Biomedical |
WOS记录号 | WOS:001316856800001 |
WOS分区 | Q1 |
资助机构 | National Key Research and Development Project ; National Natural Science Foundation of China ; CAMS Innovation Fund for Medical Sciences |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.psych.ac.cn/handle/311026/48985 |
专题 | 认知与发展心理学研究室 |
通讯作者 | Chen, Xianxiang; Li, Xiaoran; Li, Fenghua; Li, Huaiyong; Fang, Zhen |
作者单位 | 1.Chinese Acad Sci, Aerosp Informat Res Inst, Beijing, Peoples R China 2.Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing, Peoples R China 3.Chinese Acad Med Sci, Personalized Management Chron Resp Dis, Beijing, Peoples R China 4.Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai, Peoples R China 5.Capital Med Univ, Beijing Friendship Hosp, Beijing, Peoples R China 6.Chinese Acad Sci, Inst Psychol, Beijing, Peoples R China 7.Peoples Liberat Army Gen Hosp, Med Ctr 6, Beijing, Peoples R China |
通讯作者单位 | 中国科学院心理研究所 |
推荐引用方式 GB/T 7714 | Yu, Xianya,Zou, Yonggang,Mou, Xiuying,et al. A deep learning method for contactless emotion recognition from ballistocardiogram[J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL,2025,99:10. |
APA | Yu, Xianya.,Zou, Yonggang.,Mou, Xiuying.,Li, Siying.,Bai, Zhongrui.,...&Fang, Zhen.(2025).A deep learning method for contactless emotion recognition from ballistocardiogram.BIOMEDICAL SIGNAL PROCESSING AND CONTROL,99,10. |
MLA | Yu, Xianya,et al."A deep learning method for contactless emotion recognition from ballistocardiogram".BIOMEDICAL SIGNAL PROCESSING AND CONTROL 99(2025):10. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
A deep learning meth(2235KB) | 期刊论文 | 出版稿 | 限制开放 | CC BY-NC-SA | 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论