Real-world application of a 3D deep learning model for detecting and localizing cerebral microbleeds

Abstract

Background: Detection and localization of cerebral microbleeds (CMBs) is crucial for disease diagnosis and treatment planning. However, CMB detection is labor-intensive, time-consuming, and challenging owing to its visual similarity to mimics. This study aimed to validate the performance of a three-dimensional (3D) deep learning model that not only detects CMBs but also identifies their anatomic location in real-world settings.

Methods: A total of 21 patients with 116 CMBs and 12 without CMBs were visited in the neurosurgery outpatient department between January 2023 and October 2023. Three readers, including a board-certified neuroradiologist (reader 1), a resident in radiology (reader 2), and a neurosurgeon (reader 3) independently reviewed SWIs of 33 patients to detect CMBs and categorized their locations into lobar, deep, and infratentorial regions without any AI assistance. After a one-month washout period, the same datasets were redistributed randomly, and readers reviewed them again with the assistance of the 3D deep learning model. A comparison of the diagnostic performance between readers with and without AI assistance was performed.

Results: All readers with an AI assistant (reader 1:0.991 [0.930-0.999], reader 2:0.922 [0.881-0.905], and reader 3:0.966 [0.928-0.984]) tended to have higher sensitivity per lesion than readers only (reader 1:0.905 [0.849-0.942], reader 2:0.621 [0.541-0.694], and reader 3:0.871 [0.759-0.935], p = 0.132, 0.017, and 0.227, respectively). In particular, radiology residents (reader 2) showed a statistically significant increase in sensitivity per lesion when using AI. There was no statistically significant difference in the number of FPs per patient for all readers with AI assistant (reader 1: 0.394 [0.152-1.021], reader 2: 0.727 [0.334-1.582], reader 3: 0.182 [0.077-0.429]) and reader only (reader 1: 0.364 [0.159-0.831], reader 2: 0.576 [0.240-1.382], reader 3: 0.121 [0.038-0.383], p = 0.853, 0.251, and 0.157, respectively). Our model accurately categorized the anatomical location of all CMBs.

Conclusions: Our model demonstrated promising potential for the detection and anatomical localization of CMBs, although further research with a larger and more diverse population is necessary to establish clinical utility in real-world settings.