EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition

Mashael Al-Duwais, Hend Al-Khalifa, Abdulmalik Al-Salman

Electronics · 09.09.2024 · 13 (17) · 3574

DOI: 10.3390/electronics13173574 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 09.09.2024. Verfasst von Mashael Al-Duwais und 2 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 79 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multilingual large language models (MLLMs) have demonstrated remarkable performance across a wide range of cross-lingual Natural Language Processing (NLP) tasks. The emergence of MLLMs made it possible to achieve knowledge transfer from high-resource to low-resource languages. Several MLLMs have been released for cross-lingual transfer tasks. However, no systematic evaluation comparing all models for Arabic cross-lingual Named-Entity Recognition (NER) is available. This paper presents a benchmark evaluation to empirically investigate the performance of the state-of-the-art multilingual large language models for Arabic cross-lingual NER. Furthermore, we investigated the performance of different MLLMs adaptation methods to better model the Arabic language. An error analysis of the different adaptation methods is presented. Our experimental results indicate that GigaBERT outperforms other models for Arabic cross-lingual NER, while language-adaptive pre-training (LAPT) proves to be the most effective adaptation method across all datasets. Our findings highlight the importance of incorporating language-specific knowledge to enhance the performance in distant language pairs like English and Arabic.

Zitieren

APA

Al-Duwais, M., Al-Khalifa, H., & Al-Salman, A. (2024). A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition. Electronics, 13(17), 3574. https://doi.org/10.3390/electronics13173574

Vancouver

Al-Duwais M, Al-Khalifa H, Al-Salman A. A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition. Electronics. 2024;13(17):3574. doi:10.3390/electronics13173574

BibTeX
@article{AlDuwais2024,
  author = {Al-Duwais, Mashael and Al-Khalifa, Hend and Al-Salman, Abdulmalik},
  title = {A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {17},
  pages = {3574},
  doi = {10.3390/electronics13173574}
}
Kostenlos starten →