A Primer on Pretrained Multilingual Language Models
ACM Computing Surveys · 30.09.2025 · 57 (9) · 1-39
DOI: 10.1145/3727339 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 06.05.2025. Verfasst von Sumanth Doddapaneni und 4 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 184 Literaturangaben.
Abstract (Originalsprache)
Multilingual Language Models (MLLMs) such as mBERT, XLM, XLM-R, and the like, have emerged as a viable option for bringing the power of pretraining to a large number of languages. Given their success in zero-shot transfer learning, there has emerged a large body of work in (i) building bigger MLLMs covering a large number of languages, (ii) creating exhaustive benchmarks covering a wider variety of tasks and languages for evaluating MLLMs, (iii) analysing the performance of MLLMs on monolingual, zero-shot cross-lingual and bilingual tasks, (iv) understanding the universal language patterns (if any) learnt by MLLMs, and (v) augmenting the (often) limited capacity of MLLMs to improve their performance on seen or even unseen languages. In this survey, we review the existing literature covering the above broad areas of research pertaining to MLLMs. Based on our survey, we recommend some promising directions of future research.
Zitieren
APA
Doddapaneni, S., Ramesh, G., Khapra, M., Kunchukuttan, A., & Kumar, P. (2025). A Primer on Pretrained Multilingual Language Models. ACM Computing Surveys, 57(9), 1-39. https://doi.org/10.1145/3727339
Vancouver
Doddapaneni S, Ramesh G, Khapra M, Kunchukuttan A, Kumar P. A Primer on Pretrained Multilingual Language Models. ACM Computing Surveys. 2025;57(9):1-39. doi:10.1145/3727339
BibTeX
@article{Doddapaneni2025,
author = {Doddapaneni, Sumanth and Ramesh, Gowtham and Khapra, Mitesh and Kunchukuttan, Anoop and Kumar, Pratyush},
title = {A Primer on Pretrained Multilingual Language Models},
journal = {ACM Computing Surveys},
year = {2025},
volume = {57},
number = {9},
pages = {1--39},
doi = {10.1145/3727339}
}
EUVIMED