Impact of a deep learning-based brain CT interpretation algorithm on clinical decision-making for intracranial hemorrhage in the emergency department

Abstract

Intracranial hemorrhage is a critical emergency that requires prompt and accurate diagnosis in the emergency department (ED). Deep learning technology can assist in interpreting non-enhanced brain CT scans, but its real-world impact on clinical decision-making is uncertain. This study assessed a deep learning-based intracranial hemorrhage detection algorithm (DLHD) in a simulated clinical environment with ten emergency medical professionals from a tertiary hospital’s ED. The participants reviewed CT scans with clinical information in two steps: without and with DLHD. Diagnostic performance was measured, including sensitivity, specificity, accuracy, and the area under the receiver operating characteristic curve. Consistency in clinical decision-making was evaluated using the kappa statistic. The results demonstrated that DLHD minimally affected experienced participants’ diagnostic performance and decision-making. In contrast, inexperienced participants exhibited significantly increased sensitivity (59.33–72.67%, p < 0.001) and decreased specificity (65.49–53.73%, p < 0.001) with the algorithm. Clinical decision-making consistency was moderate among inexperienced professionals (k = 0.425) and higher among experienced ones (k = 0.738). Inexperienced participants changed their decisions more frequently, mainly due to the algorithm’s false positives. The study highlights the need for thorough evaluation and careful integration of deep learning tools into clinical workflows, especially for less experienced professionals.