Blind Face Restoration Algorithm Based on Feature Fusion and Embedding
CSTR:
Author:
Affiliation:

1.Department of Educational Science and Technology, Nanjing University of Posts and Telecommunications, Nanjing 210003, China;2.Department of Communication and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210003, China

Clc Number:

TP391.41

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Blind face restoration is to recover high quality face from unknown degradation, and the ill-posed problem often results in local texture missing or mismatched facial components for restored images, therefore a degraded blind face restoration algorithm based on feature fusion and embedding optimization is proposed. By extracting face prior features from degraded inputs, using multi-headed cross-attention for feature interaction fusion and global context modeling, embedding facial priors into the latent space of pre-trained generative networks, and carrying out optimization based on loss functions, local textures lost or damaged due to degradation are repaired to achieve a balance between realism and fidelity. Numerical experiments are conducted on three real degraded datasets, which outperform existing methods in terms of objective metrics and subjective quality, and the final ablation experiments validate the effectiveness of the degraded blind face restoration algorithm.

    Reference
    Related
    Cited by
Get Citation

HUO Zhiyong, HU Shanlin. Blind Face Restoration Algorithm Based on Feature Fusion and Embedding[J].,2024,39(3):609-616.

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:March 23,2023
  • Revised:June 09,2023
  • Adopted:
  • Online: May 25,2024
  • Published:
Article QR Code