EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Optimized Semantic Matching Method and RAG Testing Framework for Regulatory Texts

Bingjie Li, Haolin Wen, Songyi Wang, Tao Hu, Xin Liang, Xing Luo

Electronics · 17.07.2025 · 14 (14) · 2856

DOI: 10.3390/electronics14142856 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 17.07.2025. Verfasst von Bingjie Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Theoretical research independently initiated project, Advanced Interdisciplinary Project of PCL, Major Key Project of PCL.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To enhance the accuracy and reliability of large language models (LLMs) in regulatory question-answering tasks, this study addresses the complexity and domain-specificity of regulatory texts by designing a retrieval-augmented generation (RAG) testing framework. It proposes a dimensionality reduction-based semantic similarity measurement method and a retrieval optimization approach leveraging information reasoning. Through the construction of the technical route of the intelligent knowledge management system, the semantic understanding capabilities of multiple mainstream embedding models in the text matching of financial regulations are systematically evaluated. The workflow encompasses data processing, knowledge base construction, embedding model selection, vectorization, recall parameter analysis, and retrieval performance benchmarking. Furthermore, the study innovatively introduces a multidimensional scaling (MDS) based semantic similarity measurement method and a question-reasoning processing technique. Compared to traditional cosine similarity (CS) metrics, these methods significantly improved recall accuracy. Experimental results demonstrate that, under the RAG testing framework, the mxbai-embed-large embedding model combined with MDS similarity calculation, Top-k recall, and information reasoning effectively addresses core challenges such as the structuring of regulatory texts and the generalization of domain-specific terminology. This approach provides a reusable technical solution for optimizing semantic matching in vertical-domain RAG systems, particularly for MDSs such as law and finance.

Förderung

  • Theoretical research independently initiated project
  • Advanced Interdisciplinary Project of PCL
  • Major Key Project of PCL
  • Educational Commission of Guangdong Province
  • Southern Key Laboratory of Technology Finance (Guangdong)

Zitieren

APA

Li, B., Wen, H., Wang, S., Hu, T., Liang, X., & Luo, X. (2025). An Optimized Semantic Matching Method and RAG Testing Framework for Regulatory Texts. Electronics, 14(14), 2856. https://doi.org/10.3390/electronics14142856

Vancouver

Li B, Wen H, Wang S, Hu T, Liang X, Luo X. An Optimized Semantic Matching Method and RAG Testing Framework for Regulatory Texts. Electronics. 2025;14(14):2856. doi:10.3390/electronics14142856

BibTeX
@article{Li2025,
  author = {Li, Bingjie and Wen, Haolin and Wang, Songyi and Hu, Tao and Liang, Xin and Luo, Xing},
  title = {An Optimized Semantic Matching Method and RAG Testing Framework for Regulatory Texts},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {14},
  pages = {2856},
  doi = {10.3390/electronics14142856}
}
Kostenlos starten →