Institutional Repository, Institute of Psychology, Chinese Academy of Sciences
Recognition of Masked Facial Expressions Based on Transfer Learning and Data Augmentation | |
Liu, Yonggang; Zhao, Ke; Fu, Xiaolan | |
2023 | |
通讯作者邮箱 | zhao, ke |
会议名称 | 2023 International Annual Conference on Complex Systems and Intelligent Science, CSIS-IAC 2023 |
会议录名称 | 2023 International Annual Conference on Complex Systems and Intelligent Science |
页码 | 80-86 |
会议日期 | 2023 |
会议地点 | 不详 |
摘要 | Facial expression recognition is currently one of the research hotspots in the field of artificial intelligence. In addition to normal natural expressions, people sometimes intentionally change their facial expressions to mask their real emotions. Masked expressions are more complex than ordinary expressions, and the number of masked expression datasets that can be used for model training is limited. The automatic recognition of masked expressions will be a new challenge. Traditional machine learning requires the manual design of feature extraction algorithms, resulting in low expression recognition rates. Deep learning requires a large amount of labeled data and has poor model performance on small sample datasets. This paper proposes a method based on transfer learning, which transfers the pre-trained weights to the model, reconstructs the classifier to complete new tasks, and combines data augmentation and regularization to improve the robustness and generalization ability of the model. It has achieved good results on the Masked Facial Expression Database (MFED). Using leave-one-subject-out cross-validation, the recognition accuracy is 64.78% for required expressions (6R), 42.16% for experienced emotions evoked by video clips (6E), and 21.21% for 36 mixed expressions (6Ex6R), which is improved by 35.61%, 57.14%, and 88.52% compared to traditional methods, respectively. The experiment deepens the research on the recognition of masked expressions, providing a possible method for the recognition of deception and lies. |
DOI | 10.1109/CSIS-IAC60628.2023.10364081 |
收录类别 | EI |
语种 | 英语 |
引用统计 | |
文献类型 | 会议论文 |
条目标识符 | http://ir.psych.ac.cn/handle/311026/46802 |
专题 | 脑与认知科学国家重点实验室 |
作者单位 | University of Chinese Academy of Sciences, State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Department of Psychology, Beijing, China |
推荐引用方式 GB/T 7714 | Liu, Yonggang,Zhao, Ke,Fu, Xiaolan. Recognition of Masked Facial Expressions Based on Transfer Learning and Data Augmentation[C],2023:80-86. |
条目包含的文件 | 条目无相关文件。 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论