Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning
Drones · 09.02.2024 · 8 (2) · 60
DOI: 10.3390/drones8020060 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 09.02.2024. Verfasst von Jin Tang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 66-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Traditional unmanned aerial vehicle path planning methods focus on addressing planning issues in static scenes, struggle to balance optimality and real-time performance, and are prone to local optima. In this paper, we propose an improved deep reinforcement learning approach for UAV path planning in dynamic scenarios. Firstly, we establish a task scenario including an obstacle assessment model and model the UAV’s path planning problem using the Markov Decision Process. We translate the MDP model into the framework of reinforcement learning and design the state space, action space, and reward function while incorporating heuristic rules into the action exploration policy. Secondly, we utilize the Q function approximation of an enhanced D3QN with a prioritized experience replay mechanism and design the algorithm’s network structure based on the TensorFlow framework. Through extensive training, we obtain reinforcement learning path planning policies for both static and dynamic scenes and innovatively employ a visualized action field to analyze their planning effectiveness. Simulations demonstrate that the proposed algorithm can accomplish UAV dynamic scene path planning tasks and outperforms classical methods such as A*, RRT, and DQN in terms of planning effectiveness.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Tang, J., Liang, Y., & Li, K. (2024). Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning. Drones, 8(2), 60. https://doi.org/10.3390/drones8020060
Vancouver
Tang J, Liang Y, Li K. Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning. Drones. 2024;8(2):60. doi:10.3390/drones8020060
BibTeX
@article{Tang2024,
author = {Tang, Jin and Liang, Yangang and Li, Kebo},
title = {Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning},
journal = {Drones},
year = {2024},
volume = {8},
number = {2},
pages = {60},
doi = {10.3390/drones8020060}
}
EUVIMED