EUVIMEDEUVIMED entdecken
Crossref

Model-based Reinforcement Learning: A Survey

Thomas M. Moerland, Joost Broekens, Aske Plaat, Catholijn M. Jonker

Foundations and Trends® in Machine Learning · 04.01.2023 · 16 (1) · 1-118

DOI: 10.1561/2200000086 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Foundations and Trends® in Machine Learning, online erschienen am 04.01.2023. Verfasst von Thomas M. Moerland und 3 weiteren Autor:innen. Die Arbeit wurde bisher 474-mal zitiert (Crossref) und nennt 327 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sequential decision making, commonly formalized as Markov Decision Process (MDP) optimization, is an important challenge in artificial intelligence. Two key approaches to this problem are reinforcement learning (RL) and planning. This survey is an integration of both fields, better known as model-based reinforcement learning. Model-based RL has two main steps. First, we systematically cover approaches to dynamics model learning, including challenges like dealing with stochasticity, uncertainty, partial observability, and temporal abstraction. Second, we present a systematic categorization of planning-learning integration, including aspects like: where to start planning, what budgets to allocate to planning and real data collection, how to plan, and how to integrate planning in the learning and acting loop. After these two sections, we also discuss implicit model-based RL as an end-to-end alternative for model learning and planning, and we cover the potential benefits of model-based RL. Along the way, the survey also draws connections to several related RL fields, like hierarchical RL and transfer learning. Altogether, the survey presents a broad conceptual overview of the combination of planning and learning for MDP optimization.

Zitieren

APA

Moerland, T. M., Broekens, J., Plaat, A., & Jonker, C. M. (2023). Model-based Reinforcement Learning: A Survey. Foundations and Trends® in Machine Learning, 16(1), 1-118. https://doi.org/10.1561/2200000086

Vancouver

Moerland TM, Broekens J, Plaat A, Jonker CM. Model-based Reinforcement Learning: A Survey. Foundations and Trends® in Machine Learning. 2023;16(1):1-118. doi:10.1561/2200000086

BibTeX
@article{Moerland2023,
  author = {Moerland, Thomas M. and Broekens, Joost and Plaat, Aske and Jonker, Catholijn M.},
  title = {Model-based Reinforcement Learning: A Survey},
  journal = {Foundations and Trends® in Machine Learning},
  year = {2023},
  volume = {16},
  number = {1},
  pages = {1--118},
  doi = {10.1561/2200000086}
}
Kostenlos starten →