Cooperative Cognitive Jamming in Low-Altitude Intelligent Network Based on Digital Twin and Reinforcement Learning
CSTR:
Author:
Affiliation:

1.Public Experimental Teaching Department, Nanjing University of Aeronautics & Astronautics, Nanjing 211106, China;2.College of Electronic and Information Engineering, Nanjing University of Aeronautics & Astronautics, Nanjing 211106, China

Clc Number:

TP391

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    To address the issue of resource allocation for multiple electronic jamming unmanned aerial vehicles (UAVs) against multiple multifunctional radars in the low-altitude intelligent network cooperative cognitive jamming decision-making process, a cognitive jamming decision-making approach based on digital twinning and deep reinforcement learning is proposed. Firstly, a cognitive jamming decision-making system model is established by treating the cooperative electronic jamming problem as a Markov decision process. Considering the constraints related to jamming target, jamming power, and jamming pattern selection comprehensively, the agents’ action space, state space, and reward function are constructed. Secondly, an adaptive learning rate proximal policy optimization (APPO) algorithm is proposed based on the proximal policy optimization (PPO) algorithm. Additionally, to enhance the training speed of the deep reinforcement learning algorithm in a high-fidelity manner, a digital twin-based cooperative electronic jamming decision-making model training method is presented. Simulation results demonstrate that compared with existing deep reinforcement learning algorithms, the interference efficiency of the APPO algorithm is improved by more than 30%, and the proposed training method increases the model training speed by more than 50%.

    Reference
    Related
    Cited by
Get Citation

SHEN Gaoqing, CAI Shengsuo, LEI Lei, BEN De. Cooperative Cognitive Jamming in Low-Altitude Intelligent Network Based on Digital Twin and Reinforcement Learning[J].,2024,39(1):15-30.

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:December 11,2023
  • Revised:January 15,2024
  • Adopted:
  • Online: January 25,2024
  • Published:
Article QR Code