A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition
Electronics · 09.09.2024 · 13 (17) · 3574
DOI: 10.3390/electronics13173574 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 09.09.2024. Verfasst von Mashael Al-Duwais und 2 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 79 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Multilingual large language models (MLLMs) have demonstrated remarkable performance across a wide range of cross-lingual Natural Language Processing (NLP) tasks. The emergence of MLLMs made it possible to achieve knowledge transfer from high-resource to low-resource languages. Several MLLMs have been released for cross-lingual transfer tasks. However, no systematic evaluation comparing all models for Arabic cross-lingual Named-Entity Recognition (NER) is available. This paper presents a benchmark evaluation to empirically investigate the performance of the state-of-the-art multilingual large language models for Arabic cross-lingual NER. Furthermore, we investigated the performance of different MLLMs adaptation methods to better model the Arabic language. An error analysis of the different adaptation methods is presented. Our experimental results indicate that GigaBERT outperforms other models for Arabic cross-lingual NER, while language-adaptive pre-training (LAPT) proves to be the most effective adaptation method across all datasets. Our findings highlight the importance of incorporating language-specific knowledge to enhance the performance in distant language pairs like English and Arabic.
Zitieren
APA
Al-Duwais, M., Al-Khalifa, H., & Al-Salman, A. (2024). A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition. Electronics, 13(17), 3574. https://doi.org/10.3390/electronics13173574
Vancouver
Al-Duwais M, Al-Khalifa H, Al-Salman A. A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition. Electronics. 2024;13(17):3574. doi:10.3390/electronics13173574
BibTeX
@article{AlDuwais2024,
author = {Al-Duwais, Mashael and Al-Khalifa, Hend and Al-Salman, Abdulmalik},
title = {A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition},
journal = {Electronics},
year = {2024},
volume = {13},
number = {17},
pages = {3574},
doi = {10.3390/electronics13173574}
}
EUVIMED