内容自适应量化参数决策的视频感知编码方法
作者:
作者单位:

宁波大学人工智能学院,宁波315211

作者简介:

通讯作者:

基金项目:

浙江省“尖兵领雁+X”科技计划项目 2025C01035 浙江省“尖兵领雁+X”科技计划项目(2025C01035)。


Content-Adaptive Quantization Parameter Decision Method for Perceptual Video Coding
Author:
Affiliation:

School of Artificial Intelligence, Ningbo University, Ningbo 315211, China

Fund Project:

The “Pioneer” and “Leading Goose” R & D Program of Zhejiang Province 2025C01035 The “Pioneer” and “Leading Goose” R & D Program of Zhejiang Province (No.2025C01035).

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    以第三代音视频编码标准(Audio video coding standard 3,AVS3)为代表的现代视频编码标准显著提升了压缩效率,但传统优化范式仍高度依赖均方误差(Mean squared error,MSE),而MSE与人眼视觉系统(Human visual system,HVS)的感知特性相关性较弱。近年来,基于知识蒸馏的方法通过生成感知引导的量化参数(Quantization parameter,QP)映射,有效改善了压缩视频的视觉质量。然而,现有方法大多局限于全帧内编码配置,难以直接推广至同时包含帧内与帧间预测的实际视频编码场景。针对上述问题,本文提出一种轻量级的内容自适应QP决策方法。在编码流程之前部署视频内容预分析模块,利用预训练卷积神经网络(Convolutional neural network,CNN)提取输入视频的显著时空特征;随后,决策模型依据这些特征动态确定不同视频片段所适用的编码策略。实验结果表明,所提方法能够针对不同类型的视频内容选择更有效的编码策略。与AVS3基准编码器相比,该方法在多尺度结构相似性(Multi-scale structural similarity,MS-SSIM)评价指标下平均降低7.11%的Bj?ntegaard Delta码率(Bj?ntegaard Delta rate,BD-rate)。进一步将其集成至高度优化的AVS3内容感知编码器后,在基本保持峰值信噪比(Peak signal-to-noise ratio,PSNR)性能的同时,MS-SSIM BD-rate相对于共同的AVS3高性能模型(High performance model,HPM)12.0基准进一步改善4.79个百分点。需要指出的是,当前方法采用片段级二值门控,尚不支持帧/块粒度精细调控。

    Abstract:

    Modern video coding standards such as the audio video coding standard 3 (AVS3) have substantially improved compression efficiency, but conventional rate-distortion optimization still relies heavily on signal-fidelity measures such as mean squared error (MSE) and peak signal-to-noise ratio (PSNR), which do not fully reflect the nonlinear characteristics of the human visual system (HVS). Knowledge-distillation-based perceptual coding methods can improve visual quality by transferring bit-allocation knowledge from perceptually optimized learned image compression models to block-level quantization parameter (QP) maps. However, most existing approaches are designed and evaluated under image or all-intra coding configurations. When directly extended to practical video coding with both intra- and inter-frame prediction, a fixed perceptual QP adjustment strategy may produce content-dependent performance fluctuations, especially for sequences with complex textures or strong temporal variation. To address this problem, this paper proposes a lightweight content-adaptive QP decision method for AVS3 video coding. Before actual encoding, a video content pre-analysis module processes the first ten frames of each segment using a pretrained VGG-16 network. Features from shallow, intermediate, and deep layers are pooled and fused to describe fine-grained texture, local structure, and high-level semantics. Temporal variation of the fused features is further summarized into four compact descriptors: Texture, motion, complexity, and motion consistency. A logistic-regression classifier then generates a binary gating signal to determine whether the downstream perceptual optimization module is enabled or bypassed. The classifier is trained on 292 non-overlapping 32-frame segments constructed from standard HEVC test sequences, where the ground-truth label of each segment is determined by the MS-SSIM BD-rate difference between perceptual optimization and the AVS3 anchor under identical coding configurations. Five-fold stratified cross-validation yields an accuracy of 92.3%, a precision of 82.0%, a recall of 93.3%, and an F 1 score of 87.3%. Experiments on representative 4K UHD sequences under random-access configuration show that, relative to the AVS3 HPM 12.0 anchor, the proposed method reduces the average BD-rate by 7.11% under multi-scale structural similarity (MS-SSIM) and by 3.39% under PSNR. When integrated into a highly optimized content-aware code (CAC), the average MS-SSIM BD-rate relative to the common HPM anchor improves from -21.45% to -26.24%, corresponding to an additional gain of 4.79 percentage points, while the average PSNR BD-rate improves from -3.60% to -7.01%. On a synthetic 64-frame sequence containing abrupt scene changes, the proposed adaptive scheme achieves an 11.82% MS-SSIM BD-rate reduction and a -0.53% PSNR BD-rate, whereas unconditional perceptual distillation yields a 6.79% MS-SSIM reduction but a 1.71% PSNR increase. These results indicate that the proposed segment-level gating mechanism can retain perceptual coding gains while reducing the risk of objective-quality degradation caused by unconditional perceptual adjustment. The method does not alter the standard bitstream structure and can be integrated as a low-overhead encoder-side decision module in conventional hybrid video coding frameworks.

    参考文献
    相似文献
    引证文献
引用本文

祁海洋,晏星宇,郑永康,徐龙.内容自适应量化参数决策的视频感知编码方法[J].数据采集与处理,2026,41(5):1306-1317

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:2026-07-03
  • 最后修改日期:2026-08-21
  • 录用日期:
  • 在线发布日期: 2026-10-14