基于策略梯度的黑盒模型显著性解释方法
作者:
作者单位:

北京理工大学计算机学院, 北京 100081

作者简介:

通讯作者:

基金项目:

国家重点研发计划项目 2022YFB2703100国家重点研发计划项目(2022YFB2703100)。


Policy Gradient-Based Saliency Explanation Method for Black-Box Models
Author:
Affiliation:

School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China

Fund Project:

National Key Research and Development Project 2022YFB2703100National Key Research and Development Project (No.2022YFB2703100).

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    作为可信人工智能的核心支撑技术,机器学习模型的可解释性在自动化决策系统中扮演重要角色,其中显著性解释能够以热力图的形式直观揭示模型决策依据,已成为可解释人工智能的关键研究方向。然而,现有方法存在根本性缺陷:基于扰动的方法受限于人工设计的分布假设,计算效率与泛化能力难以兼顾;基于梯度的方法需要预设模型结构,无法解释黑盒模型;基于线性近似的方法因局部过度简化引入模型偏差。本文提出一种基于策略梯度的黑盒模型显著性解释方法Polixplain,将Deletion Score作为核心奖励信号,通过可导松弛技术嵌入策略梯度优化流程,实现忠实性目标的端到端优化。采用图像分类任务作为验证载体,其高维特征空间与可视化直观性为解释方法的多维度评估提供了理想测试环境。Polixplain方法在解释忠实性以及热力图的人类可理解性方面均超越了多种现有解释方法。

    Abstract:

    As a core enabling technology for trustworthy artificial intelligence, research on the interpretability of machine learning models plays a vital role in automated decision-making systems. Among them, saliency-based explanations, which intuitively reveal the basis of model decisions in the form of heatmaps, have become a key research direction in explainable artificial intelligence. However, existing approaches suffer from fundamental limitations: Perturbation-based methods are constrained by manually designed distributional assumptions, making it difficult to balance computational efficiency and generalization ability; gradient-based methods require prior knowledge of the model’s internal structure and thus fail to explain black-box models; and linear-approximation-based methods introduce model bias due to excessive local simplification. To address these limitations, we propose Polixplain, a policy-gradient-based saliency explanation method for black-box models. By using the Deletion Score as the core reward signal and incorporating a differentiable relaxation technique into the policy gradient optimization process, Polixplain enables end-to-end optimization toward the faithfulness objective. Image classification tasks are adopted as the experimental testbed, where the high-dimensional feature space and intuitive visual representation provide an ideal environment for multidimensional evaluation of explanation methods. Polixplain outperforms a range of existing explanation methods in terms of both explanation faithfulness and the human interpretability of the generated heatmaps.

    参考文献
    相似文献
    引证文献
引用本文

果宇涵,丁立中,韦秋宁.基于策略梯度的黑盒模型显著性解释方法[J].数据采集与处理,2026,(5):1366-1377

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:2025-06-12
  • 最后修改日期:2025-08-25
  • 录用日期:
  • 在线发布日期: 2026-10-14