Adapting BLOOM to a new language: A case study for the Italian
Italian Journal of Computational Linguistics · 2024 · 10 (1)
DOI: 10.4000/125nl ↗Kurz gefasst
Fachartikel in der Zeitschrift Italian Journal of Computational Linguistics, 2024. Verfasst von Pierpaolo Basile und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
The BLOOM Large Language Model is a cuttingI think that the authors’ way of doing self-training is quite interesting. I suggest writing about self-training in the abstract and generally expose self-training as one of the paper’s contributions.-edge open linguistic model developed to provide computers with natural language understanding skills. Despite its remarkable capabilities in understanding natural language by capturing intricate contextual relationships, the BLOOM model exhibits a notable limitation concerning the number of included languages. In fact, Italian is not included among the languages supported by the model, making its use challenging in this context. Within this study, we explore the language adaptation strategy based on continuing training on language-specific data. Moreover, we fine-tune both the BLOOM and the adapted models on several instruction datasets and different downstream classification tasks over EVALITA datasets. It has been observed that language adaptation followed by instruction-based fine-tuning is shown to be effective in correctly addressing a task never seen by the model in a new language learned on language-specific data.
Zitieren
APA
Basile, P., Siciliani, L., Musacchio, E., Polignano, M., & Semeraro, G. (2024). Adapting BLOOM to a new language: A case study for the Italian. Italian Journal of Computational Linguistics, 10(1). https://doi.org/10.4000/125nl
Vancouver
Basile P, Siciliani L, Musacchio E, Polignano M, Semeraro G. Adapting BLOOM to a new language: A case study for the Italian. Italian Journal of Computational Linguistics. 2024;10(1). doi:10.4000/125nl
BibTeX
@article{Basile2024,
author = {Basile, Pierpaolo and Siciliani, Lucia and Musacchio, Elio and Polignano, Marco and Semeraro, Giovanni},
title = {Adapting BLOOM to a new language: A case study for the Italian},
journal = {Italian Journal of Computational Linguistics},
year = {2024},
volume = {10},
number = {1},
doi = {10.4000/125nl}
}
EUVIMED