Construction of Legal Knowledge Graph Based on Knowledge-Enhanced Large Language Models
Information · 23.10.2024 · 15 (11) · 666
DOI: 10.3390/info15110666 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 23.10.2024. Verfasst von Jun Li und 3 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Zhongnan University of Economics and Law and Beijing Borui Tongyun Technology Co., Ltd..
Abstract (Originalsprache)
Legal knowledge involves multidimensional heterogeneous knowledge such as legal provisions, judicial interpretations, judicial cases, and defenses, which requires extremely high relevance and accuracy of knowledge. Meanwhile, the construction of a legal knowledge reasoning system also faces challenges in obtaining, processing, and sharing multisource heterogeneous knowledge. The knowledge graph technology, which is a knowledge organization form with triples as the basic unit, is able to efficiently transform multisource heterogeneous information into a knowledge representation form close to human cognition. Taking the automated construction of the Chinese legal knowledge graph (CLKG) as a case scenario, this paper presents a joint knowledge enhancement model (JKEM), where prior knowledge is embedded into a large language model (LLM), and the LLM is fine-tuned through the prefix of the prior knowledge data. Under the condition of freezing most parameters of the LLM, this fine-tuning scheme adds continuous deep prompts as prefix tokens to the input sequences of different layers, which can significantly improve the accuracy of knowledge extraction. The results show that the knowledge extraction accuracy of the JKEM in this paper reaches 90.92%. Based on the superior performance of this model, the CLKG is further constructed, which contains 3480 knowledge triples composed of 9 entities and 2 relationships, providing strong support for an in-depth understanding of the complex relationships in the legal field.
Förderung
- National Natural Science Foundation of China
- Zhongnan University of Economics and Law and Beijing Borui Tongyun Technology Co., Ltd.
Zitieren
APA
Li, J., Qian, L., Liu, P., & Liu, T. (2024). Construction of Legal Knowledge Graph Based on Knowledge-Enhanced Large Language Models. Information, 15(11), 666. https://doi.org/10.3390/info15110666
Vancouver
Li J, Qian L, Liu P, Liu T. Construction of Legal Knowledge Graph Based on Knowledge-Enhanced Large Language Models. Information. 2024;15(11):666. doi:10.3390/info15110666
BibTeX
@article{Li2024,
author = {Li, Jun and Qian, Lu and Liu, Peifeng and Liu, Taoxiong},
title = {Construction of Legal Knowledge Graph Based on Knowledge-Enhanced Large Language Models},
journal = {Information},
year = {2024},
volume = {15},
number = {11},
pages = {666},
doi = {10.3390/info15110666}
}
EUVIMED