EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitSystematische ÜbersichtOpen Access

Applying Natural Language Processing to Textual Data From Clinical Data Warehouses: Systematic Review

Adrien Bazoge iD, Emmanuel Morin iD, Béatrice Daille iD, Pierre-Antoine Gourraud iD

JMIR Medical Informatics · 15.12.2023 · 11 · e42477

DOI: 10.2196/42477 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift JMIR Medical Informatics, online erschienen am 15.12.2023. Verfasst von Adrien Bazoge und 3 weiteren Autor:innen. Beteiligte Einrichtung: Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 210 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

In recent years, health data collected during the clinical care process have been often repurposed for secondary use through clinical data warehouses (CDWs), which interconnect disparate data from different sources. A large amount of information of high clinical value is stored in unstructured text format. Natural language processing (NLP), which implements algorithms that can operate on massive unstructured textual data, has the potential to structure the data and make clinical information more accessible.

Objective

The aim of this review was to provide an overview of studies applying NLP to textual data from CDWs. It focuses on identifying the (1) NLP tasks applied to data from CDWs and (2) NLP methods used to tackle these tasks.

Methods

This review was performed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. We searched for relevant articles in 3 bibliographic databases: PubMed, Google Scholar, and ACL Anthology. We reviewed the titles and abstracts and included articles according to the following inclusion criteria: (1) focus on NLP applied to textual data from CDWs, (2) articles published between 1995 and 2021, and (3) written in English.

Results

We identified 1353 articles, of which 194 (14.34%) met the inclusion criteria. Among all identified NLP tasks in the included papers, information extraction from clinical text (112/194, 57.7%) and the identification of patients (51/194, 26.3%) were the most frequent tasks. To address the various tasks, symbolic methods were the most common NLP methods (124/232, 53.4%), showing that some tasks can be partially achieved with classical NLP techniques, such as regular expressions or pattern matching that exploit specialized lexica, such as drug lists and terminologies. Machine learning (70/232, 30.2%) and deep learning (38/232, 16.4%) have been increasingly used in recent years, including the most recent approaches based on transformers. NLP methods were mostly applied to English language data (153/194, 78.9%).

Conclusions

CDWs are central to the secondary use of clinical texts for research purposes. Although the use of NLP on data from CDWs is growing, there remain challenges in this field, especially with regard to languages other than English. Clinical NLP is an effective strategy for accessing, extracting, and transforming data from CDWs. Information retrieved with NLP can assist in clinical research and have an impact on clinical practice.

Schlagwörter

Stichwörter der Autor:innen

AIartificial intelligenceclinical data warehousedata warehousingnatural language processing

Autor:innen und Institutionen

  • Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France.
  • Nantes Université, CHU de Nantes, Pôle Hospitalo-Universitaire 11: Santé Publique, Clinique des données, INSERM, CIC 1413, F-44000 Nantes, France.
  • Nantes Université, INSERM, CHU de Nantes, École Centrale Nantes, Centre de Recherche Translationnelle en Transplantation et Immunologie, CR2TI, F-44000 Nantes, France.

ORCID-Profile: Adrien Bazoge, Emmanuel Morin, Béatrice Daille, Pierre-Antoine Gourraud

Zitieren

APA

Bazoge, A., Morin, E., Daille, B., & Gourraud, P. A. (2023). Applying Natural Language Processing to Textual Data From Clinical Data Warehouses: Systematic Review. JMIR Medical Informatics, 11, e42477. https://doi.org/10.2196/42477

Vancouver

Bazoge A, Morin E, Daille B, Gourraud PA. Applying Natural Language Processing to Textual Data From Clinical Data Warehouses: Systematic Review. JMIR Medical Informatics. 2023;11:e42477. doi:10.2196/42477

BibTeX
@article{Bazoge2023,
  author = {Bazoge, Adrien and Morin, Emmanuel and Daille, Béatrice and Gourraud, Pierre-Antoine},
  title = {Applying Natural Language Processing to Textual Data From Clinical Data Warehouses: Systematic Review},
  journal = {JMIR Medical Informatics},
  year = {2023},
  volume = {11},
  pages = {e42477},
  doi = {10.2196/42477}
}
Kostenlos starten →