EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Co-design of Human-centered, Explainable AI for Clinical Decision Support

Cecilia Panigutti, Andrea Beretta, Daniele Fadda, Fosca Giannotti, Dino Pedreschi, Alan Perotti, Salvatore Rinzivillo

ACM Transactions on Interactive Intelligent Systems · 31.12.2023 · 13 (4) · 1-35

DOI: 10.1145/3587271 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Interactive Intelligent Systems, online erschienen am 08.12.2023. Verfasst von Cecilia Panigutti und 6 weiteren Autor:innen. Die Arbeit wurde bisher 136-mal zitiert (Crossref) und nennt 145 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union, HumanE AI Net, PNRR - M4C2 - Investimento 1.3, Partenariato Esteso.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

eXplainable AI (XAI) involves two intertwined but separate challenges: the development of techniques to extract explanations from black-box AI models and the way such explanations are presented to users, i.e., the explanation user interface. Despite its importance, the second aspect has received limited attention so far in the literature. Effective AI explanation interfaces are fundamental for allowing human decision-makers to take advantage and oversee high-risk AI systems effectively. Following an iterative design approach, we present the first cycle of prototyping-testing-redesigning of an explainable AI technique and its explanation user interface for clinical Decision Support Systems (DSS). We first present an XAI technique that meets the technical requirements of the healthcare domain: sequential, ontology-linked patient data, and multi-label classification tasks. We demonstrate its applicability to explain a clinical DSS, and we design a first prototype of an explanation user interface. Next, we test such a prototype with healthcare providers and collect their feedback with a two-fold outcome: First, we obtain evidence that explanations increase users’ trust in the XAI system, and second, we obtain useful insights on the perceived deficiencies of their interaction with the system, so we can re-design a better, more human-centered explanation interface.

Förderung

  • European Union
  • HumanE AI Net
  • PNRR - M4C2 - Investimento 1.3, Partenariato Esteso
  • UK government

Zitieren

APA

Panigutti, C., Beretta, A., Fadda, D., Giannotti, F., Pedreschi, D., Perotti, A., & Rinzivillo, S. (2023). Co-design of Human-centered, Explainable AI for Clinical Decision Support. ACM Transactions on Interactive Intelligent Systems, 13(4), 1-35. https://doi.org/10.1145/3587271

Vancouver

Panigutti C, Beretta A, Fadda D, Giannotti F, Pedreschi D, Perotti A, et al. Co-design of Human-centered, Explainable AI for Clinical Decision Support. ACM Transactions on Interactive Intelligent Systems. 2023;13(4):1-35. doi:10.1145/3587271

BibTeX
@article{Panigutti2023,
  author = {Panigutti, Cecilia and Beretta, Andrea and Fadda, Daniele and Giannotti, Fosca and Pedreschi, Dino and Perotti, Alan and Rinzivillo, Salvatore},
  title = {Co-design of Human-centered, Explainable AI for Clinical Decision Support},
  journal = {ACM Transactions on Interactive Intelligent Systems},
  year = {2023},
  volume = {13},
  number = {4},
  pages = {1--35},
  doi = {10.1145/3587271}
}
Kostenlos starten →