图卷积和关键点特征融合的D-GFK网络级联人脸表情识别
作者:
作者单位:

徐州医科大学医学信息与工程学院, 徐州 221004

作者简介:

通讯作者:

基金项目:

国家自然科学基金(62102345);江苏省卫生健康委员会医学科研项目(Z2020032);徐州市重点研发计划(KC22117);江苏摩尔声学技术研究院有限公司横向课题(MESX-202305001);安徽方舟生物课题(240729001)。


D-GFK Network Cascaded Facial Expression Recognition Based on Graph Convolution and Key Point Feature Fusion
Author:
Affiliation:

School of Medical Information and Engineering, Xuzhou Medical University, Xuzhou 221004, China

Fund Project:

National Natural Science Foundation of China (No.62102345); Medical Research Project of Jiangsu Provincial Health Commission (No.Z2020032); Key Research and Development Program of Xuzhou City (No.KC22117); Jiangsu Moore Acoustics Technology Research Institute Co., Ltd. Horizontal Project(No.MESX-202305001); Anhui Ark Biotechnology Project (No.240729001).

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    针对当前人脸表情在光照变化、存在遮挡等情况下难以识别,以及悲观情绪识别率较低的问题,本文提出一种基于改进稠密连接网络与人脸关键点特征融合的图卷积级联分类人脸表情识别算法。由于不同深度学习模型在人脸表情识别中各具优势,稠密连接网络在识别乐观和平静表情时准确率较高,而对悲观表情的识别效果较弱,因此本文首先采用小波变换、基于关键部位掩码注意力机制和二叉树分类器对稠密连接网络进行改进,构建了I-Densenet(Improved-DenseNet)模块,用于乐观、平静和悲观3类人脸表情的粗划分,提高粗划分识别率;其次使用基于人脸关键点特征融合的图卷积神经网络对人脸悲观表情细粒度划分,提高悲观表情的识别率。最后,通过将改进的稠密连接网络与基于关键点特征融合的图卷积神经网络进行级联,构建了D-GFK网络(DenseNet-GCN and face key point network),结合不同模型的优势,综合提高了对人脸表情识别的准确率。实验表明,本文提出的模型在人脸表情识别任务中取得了较好的识别效果。

    Abstract:

    In view of the current problems that facial expressions are difficult to recognize under conditions of lighting changes and occlusion, as well as the low recognition rate of pessimistic emotions, this paper proposes a facial expression recognition algorithm based on graph convolutional cascade classification based on improved dense connection network and fusion of facial key point features. Since different deep learning models have their own advantages in facial expression recognition, dense connection network has a high accuracy rate in recognizing optimistic and calm expressions, but has a weak recognition effect on pessimistic expressions. Therefore, this paper first uses wavelet transform, key part mask attention mechanism and binary tree classifier to improve the dense connection network, and constructs the I-Densenet (Improved-DenseNet) module for the rough division of optimistic, calm and pessimistic facial expressions to improve the recognition rate of rough division; Secondly, the graph convolutional neural network based on the fusion of facial key point features is used to fine-grainedly divide the pessimistic expression of the face to improve the recognition rate of pessimistic expression. Finally, this paper constructs the D-GFK network (DenseNet-GCN and face key point network) by cascading the improved dense connection network with the graph convolutional neural network based on key point feature fusion, combining the advantages of different models to comprehensively improve the accuracy of facial expression recognition. Experiments show that the model proposed in this paper has achieved good recognition results in facial expression recognition tasks.

    参考文献
    相似文献
    引证文献
引用本文

赵藤,曹亚茹,闫厚儒,陈荥,肖湘,范蕊,杨慕,朱红.图卷积和关键点特征融合的D-GFK网络级联人脸表情识别[J].数据采集与处理,2026,(3):841-853

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:2025-06-15
  • 最后修改日期:2025-07-03
  • 录用日期:
  • 在线发布日期: 2026-06-10