EUVIMEDEUVIMED entdecken
ValidierungsstudieOpen Access

ChatGPT for Univariate Statistics: Validation of AI-Assisted Data Analysis in Healthcare Research

Michael R Ruta iD, Tony Gaidici iD, Chase Irwin iD, Jonathan Lifshitz iD

Journal of Medical Internet Research · 07.02.2025 · 27 · e63550

DOI: 10.2196/63550 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift Journal of Medical Internet Research, online erschienen am 07.02.2025. Verfasst von Michael R Ruta und 3 weiteren Autor:innen. Beteiligte Einrichtung: University of Arizona College of Medicine - Phoenix, Phoenix, AZ, United States. Hauptthemen laut MEDLINE: Artificial Intelligence, Health Services Research, Data Analysis. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

ChatGPT, a conversational artificial intelligence developed by OpenAI, has rapidly become an invaluable tool for researchers. With the recent integration of Python code interpretation into the ChatGPT environment, there has been a significant increase in the potential utility of ChatGPT as a research tool, particularly in terms of data analysis applications.

Objective

This study aimed to assess ChatGPT as a data analysis tool and provide researchers with a framework for applying ChatGPT to data management tasks, descriptive statistics, and inferential statistics.

Methods

A subset of the National Inpatient Sample was extracted. Data analysis trials were divided into data processing, categorization, and tabulation, as well as descriptive and inferential statistics. For data processing, categorization, and tabulation assessments, ChatGPT was prompted to reclassify variables, subset variables, and present data, respectively. Descriptive statistics assessments included mean, SD, median, and IQR calculations. Inferential statistics assessments were conducted at varying levels of prompt specificity (“Basic,” “Intermediate,” and “Advanced”). Specific tests included chi-square, Pearson correlation, independent 2-sample t test, 1-way ANOVA, Fisher exact, Spearman correlation, Mann-Whitney U test, and Kruskal-Wallis H test. Outcomes from consecutive prompt-based trials were assessed against expected statistical values calculated in Python (Python Software Foundation), SAS (SAS Institute), and RStudio (Posit PBC).

Results

ChatGPT accurately performed data processing, categorization, and tabulation across all trials. For descriptive statistics, it provided accurate means, SDs, medians, and IQRs across all trials. Inferential statistics accuracy against expected statistical values varied with prompt specificity: 32.5% accuracy for “Basic” prompts, 81.3% for “Intermediate” prompts, and 92.5% for “Advanced” prompts.

Conclusions

ChatGPT shows promise as a tool for exploratory data analysis, particularly for researchers with some statistical knowledge and limited programming expertise. However, its application requires careful prompt construction and human oversight to ensure accuracy. As a supplementary tool, ChatGPT can enhance data analysis efficiency and broaden research accessibility.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceHealth Services ResearchData AnalysisHumansGenerative Artificial Intelligence

Stichwörter der Autor:innen

ChatGPTartificial intelligencebioinformaticsbiomedical researchchatbotdata analysisdata processingprogrammersstatistics

Autor:innen und Institutionen

  • University of Arizona College of Medicine - Phoenix, Phoenix, AZ, United States.

ORCID-Profile: Michael R Ruta, Tony Gaidici, Chase Irwin, Jonathan Lifshitz

Zitieren

APA

Ruta, M. R., Gaidici, T., Irwin, C., & Lifshitz, J. (2025). ChatGPT for Univariate Statistics: Validation of AI-Assisted Data Analysis in Healthcare Research. Journal of Medical Internet Research, 27, e63550. https://doi.org/10.2196/63550

Vancouver

Ruta MR, Gaidici T, Irwin C, Lifshitz J. ChatGPT for Univariate Statistics: Validation of AI-Assisted Data Analysis in Healthcare Research. Journal of Medical Internet Research. 2025;27:e63550. doi:10.2196/63550

BibTeX
@article{Ruta2025,
  author = {Ruta, Michael R and Gaidici, Tony and Irwin, Chase and Lifshitz, Jonathan},
  title = {ChatGPT for Univariate Statistics: Validation of AI-Assisted Data Analysis in Healthcare Research},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  volume = {27},
  pages = {e63550},
  doi = {10.2196/63550}
}
Kostenlos starten →