Explainable AI (XAI)
Also known as: XAI, Interpretable AI
AI systems designed to make their outputs and reasoning understandable to a human clinician.
Explainable AI (XAI) refers to AI systems, and the techniques used to build them, designed to make a model's outputs and reasoning understandable to a human user, such as showing a radiologist which region of an image drove a finding.
Many clinical AI models are "black box" deep learning systems by default; explainability techniques (such as highlighting the image region behind a finding) are added specifically to support clinician trust and review, not because the underlying model is inherently transparent.