Text-Guided Image Editing Method Based on Diffusion Model with Mapping-Fusion Embedding
CSTR:
Author:
Affiliation:

1.College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023, China;2.School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China;3.School of Computer Science, Wuhan University, Wuhan 430072, China

Clc Number:

TP391

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Text-guided editing of real images with only images and target text prompts as input is an extremely challenging problem. Previous approaches based on fine-tuning large pre-trained diffusion models often simply interpolate and combine source and target text features to guide the image generation process, which limits their editing capabilities, while fine-tuning large diffusion models is highly susceptible to overfitting and time-consuming problems. In this paper, we propose a text-guided image editing method based on diffusion model with mapping-fusion embedding(MFE-Diffusion). The method consists of the following two components: (1) A large pre-trained diffusion model and source text feature vectors joint learning framework, which enables the model to quickly learn to reconstruct the original image. (2) A feature mapping-fusion module, which deeply fuses the feature information of the target text and the original image to generate conditional embedding that is used to guide the image editing process. Experimental validation on the challenging text-guided image editing benchmark TEdBench shows that the proposed method has advantages in image editing performance.

    Reference
    Related
    Cited by
Get Citation

WU Fei, MA Yongheng, DENG Zheying, WANG Yinjie, JI Yimu, JING Xiaoyuan. Text-Guided Image Editing Method Based on Diffusion Model with Mapping-Fusion Embedding[J].,2025,40(4):1035-1045.

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:June 19,2024
  • Revised:October 29,2024
  • Adopted:
  • Online: August 15,2025
  • Published:
Article QR Code