EUVIMEDEUVIMED entdecken
Crossref

A Tutorial on Meta-Reinforcement Learning

Jacob Beck, Risto Vuorio, Evan Zheran Liu, Zheng Xiong, Luisa Zintgraf, Chelsea Finn, Shimon Whiteson

Foundations and Trends® in Machine Learning · 03.04.2025 · 18 (2-3) · 224-384

DOI: 10.1561/2200000080 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Foundations and Trends® in Machine Learning, online erschienen am 03.04.2025. Verfasst von Jacob Beck und 6 weiteren Autor:innen. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 358 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

While deep reinforcement learning (RL) has fueled multiple high-profile successes in machine learning, it is held back from more widespread adoption by its often poor data efficiency and the limited generality of the policies it produces. A promising approach for alleviating these limitations is to cast the development of better RL algorithms as a machine learning problem itself in a process called meta-RL. Meta-RL is most commonly studied in a problem setting where, given a distribution of tasks, the goal is to learn a policy that is capable of adapting to any new task from the task distribution with as little data as possible. In this survey, we describe the meta-RL problem setting in detail as well as its major variations. We discuss how, at a high level, meta-RL research can be clustered based on the presence of a task distribution and the learning budget available for each individual task. Using these clusters, we then survey meta-RL algorithms and applications. We conclude by presenting the open problems on the path to making meta-RL part of the standard toolbox for a deep RL practitioner.

Zitieren

APA

Beck, J., Vuorio, R., Liu, E. Z., Xiong, Z., Zintgraf, L., Finn, C., & Whiteson, S. (2025). A Tutorial on Meta-Reinforcement Learning. Foundations and Trends® in Machine Learning, 18(2-3), 224-384. https://doi.org/10.1561/2200000080

Vancouver

Beck J, Vuorio R, Liu EZ, Xiong Z, Zintgraf L, Finn C, et al. A Tutorial on Meta-Reinforcement Learning. Foundations and Trends® in Machine Learning. 2025;18(2-3):224-384. doi:10.1561/2200000080

BibTeX
@article{Beck2025,
  author = {Beck, Jacob and Vuorio, Risto and Liu, Evan Zheran and Xiong, Zheng and Zintgraf, Luisa and Finn, Chelsea and Whiteson, Shimon},
  title = {A Tutorial on Meta-Reinforcement Learning},
  journal = {Foundations and Trends® in Machine Learning},
  year = {2025},
  volume = {18},
  number = {2-3},
  pages = {224--384},
  doi = {10.1561/2200000080}
}
Kostenlos starten →