一种半监督金融事件多标签分类方法
作者:
作者单位:

1.山西大学计算机与信息技术学院,太原 030006;2.山西财经大学金融学院,太原 030006;3.计算智能与中文信息处理教育部重点实验室(山西大学),太原 030006

作者简介:

通讯作者:

基金项目:

国家自然科学基金(62106130, 62072294);山西省青年科学研究项目(20210302124084);山西省高等学校科技创新项目(2021L284)。


Semi-supervised Multi-label Classification Method for Financial Events
Author:
Affiliation:

1.School of Computer and Information Technology, Shanxi University, Taiyuan 030006, China;2.School of Finance, Shanxi University of Finance and Economics, Taiyuan 030006, China;3.Key Laboratory of Computational Intelligence and Chinese Information Processing(Shanxi University), Ministry of Education, Taiyuan 030006, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    随着数字金融服务业的不断发展,互联网和金融服务系统积累了海量文本数据,对金融文本中描述的金融事件自动分类是金融科技的现实需求,也是自然语言处理和机器学习领域广泛关注的方向。目前,深度学习方法已在文本分类中广泛应用,针对文本数据中的金融事件多标签分类中存在的已标注数据缺少、已有深度学习方法消耗资源大以及现有方法未利用金融事件文本的具体特点等问题,通过采用ALBERT和TextCNN等表示工具,引入主体词注意力机制,提出了一种半监督金融事件多标签分类方法。首先,通过无监督数据增强(Unsupervised data augmentation,UDA)方法缓解标注数据量不足的问题;其次,引入了主体词注意力机制,使用ALBERT动态词向量表征方法对文本中的词进行表示;然后,利用TextCNN对文本进行综合语义表示;最后,分别采用交叉熵和KL散度度量标记数据和无标记数据的损失来训练模型。在金融文本数据集上验证了本文所提方法的有效性。

    Abstract:

    With the continuous development of the digital financial service industry, the Internet and financial service systems have accumulated a large amount of text data. The automatic classification of financial events described in the financial text is a realistic demand of financial technology, and also a widespread concern in the field of natural language processing and machine learning. At present, the deep learning method has been widely used in text classification. Addressing the issues of lack of labeled data in multi label classification of financial events in text data, frequent resource consumption of existing deep learning methods, and failure to explore the specific characteristics of financial event texts, a semi-supervised multi-label classification method of financial events is proposed by using ALBERT, TextCNN and other presentation tools, introducing the subject word attention mechanism. Firstly, the problem of insufficient labeled data is alleviated through unsupervised data augmentation (UDA) methods; Secondly, the subject word attention mechanism is introduced, and the ALBERT dynamic word vector representation method is used to represent the words in the text; Then, TextCNN is used to represent the text comprehensively; Finally, cross entropy and KL divergence are used to measure the loss of labeled data and unlabeled data to train the model. The effectiveness of the proposed method is verified on the financial text dataset.

    参考文献
    相似文献
    引证文献
引用本文

杨卓峰,李旸,李德玉.一种半监督金融事件多标签分类方法[J].数据采集与处理,2024,(2):385-394

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:2023-06-28
  • 最后修改日期:2023-09-30
  • 录用日期:
  • 在线发布日期: 2024-03-25