EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning

Jin Tang, Yangang Liang, Kebo Li

Drones · 09.02.2024 · 8 (2) · 60

DOI: 10.3390/drones8020060 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 09.02.2024. Verfasst von Jin Tang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 66-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional unmanned aerial vehicle path planning methods focus on addressing planning issues in static scenes, struggle to balance optimality and real-time performance, and are prone to local optima. In this paper, we propose an improved deep reinforcement learning approach for UAV path planning in dynamic scenarios. Firstly, we establish a task scenario including an obstacle assessment model and model the UAV’s path planning problem using the Markov Decision Process. We translate the MDP model into the framework of reinforcement learning and design the state space, action space, and reward function while incorporating heuristic rules into the action exploration policy. Secondly, we utilize the Q function approximation of an enhanced D3QN with a prioritized experience replay mechanism and design the algorithm’s network structure based on the TensorFlow framework. Through extensive training, we obtain reinforcement learning path planning policies for both static and dynamic scenes and innovatively employ a visualized action field to analyze their planning effectiveness. Simulations demonstrate that the proposed algorithm can accomplish UAV dynamic scene path planning tasks and outperforms classical methods such as A*, RRT, and DQN in terms of planning effectiveness.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Tang, J., Liang, Y., & Li, K. (2024). Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning. Drones, 8(2), 60. https://doi.org/10.3390/drones8020060

Vancouver

Tang J, Liang Y, Li K. Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning. Drones. 2024;8(2):60. doi:10.3390/drones8020060

BibTeX
@article{Tang2024,
  author = {Tang, Jin and Liang, Yangang and Li, Kebo},
  title = {Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning},
  journal = {Drones},
  year = {2024},
  volume = {8},
  number = {2},
  pages = {60},
  doi = {10.3390/drones8020060}
}
Kostenlos starten →