A Tutorial on Meta-Reinforcement Learning
Foundations and Trends® in Machine Learning · 03.04.2025 · 18 (2-3) · 224-384
DOI: 10.1561/2200000080 ↗Kurz gefasst
Fachartikel in der Zeitschrift Foundations and Trends® in Machine Learning, online erschienen am 03.04.2025. Verfasst von Jacob Beck und 6 weiteren Autor:innen. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 358 Literaturangaben.
Abstract (Originalsprache)
While deep reinforcement learning (RL) has fueled multiple high-profile successes in machine learning, it is held back from more widespread adoption by its often poor data efficiency and the limited generality of the policies it produces. A promising approach for alleviating these limitations is to cast the development of better RL algorithms as a machine learning problem itself in a process called meta-RL. Meta-RL is most commonly studied in a problem setting where, given a distribution of tasks, the goal is to learn a policy that is capable of adapting to any new task from the task distribution with as little data as possible. In this survey, we describe the meta-RL problem setting in detail as well as its major variations. We discuss how, at a high level, meta-RL research can be clustered based on the presence of a task distribution and the learning budget available for each individual task. Using these clusters, we then survey meta-RL algorithms and applications. We conclude by presenting the open problems on the path to making meta-RL part of the standard toolbox for a deep RL practitioner.
Zitieren
APA
Beck, J., Vuorio, R., Liu, E. Z., Xiong, Z., Zintgraf, L., Finn, C., & Whiteson, S. (2025). A Tutorial on Meta-Reinforcement Learning. Foundations and Trends® in Machine Learning, 18(2-3), 224-384. https://doi.org/10.1561/2200000080
Vancouver
Beck J, Vuorio R, Liu EZ, Xiong Z, Zintgraf L, Finn C, et al. A Tutorial on Meta-Reinforcement Learning. Foundations and Trends® in Machine Learning. 2025;18(2-3):224-384. doi:10.1561/2200000080
BibTeX
@article{Beck2025,
author = {Beck, Jacob and Vuorio, Risto and Liu, Evan Zheran and Xiong, Zheng and Zintgraf, Luisa and Finn, Chelsea and Whiteson, Shimon},
title = {A Tutorial on Meta-Reinforcement Learning},
journal = {Foundations and Trends® in Machine Learning},
year = {2025},
volume = {18},
number = {2-3},
pages = {224--384},
doi = {10.1561/2200000080}
}
EUVIMED