Development of Clinically Validated Artificial fi cial Intelligence Model for Detecting ST-segment Elevation Myocardial Infarction
Authors
Sang-Hyup Lee ; Kyu Lee Jeon ; Yong-Joon Lee ; Seng Chan You ; Seung-Jun Lee ; Sung-Jin Hong ; Chul-Min Ahn ; Jung-Sun Kim ; Byeong-Keuk Kim ; Young-Guk Ko ; Donghoon Choi ; Myeong-Ki Hong
Citation
ANNALS OF EMERGENCY MEDICINE, Vol.84(5) : 540-548, 2024-11
Aged ; Artificial Intelligence* ; Coronary Angiography ; Electrocardiography* ; Female ; Humans ; Male ; Middle Aged ; Neural Networks, Computer ; Percutaneous Coronary Intervention ; Prospective Studies ; Registries ; Republic of Korea ; ST Elevation Myocardial Infarction* / diagnosis ; ST Elevation Myocardial Infarction* / diagnostic imaging ; Sensitivity and Specificity
Abstract
Study objective: Although the importance of primary percutaneous coronary intervention has been emphasized for ST-segment elevation myocardial infarction (STEMI), the appropriateness of the cardiac catheterization laboratory activation remains suboptimal. This study aimed to develop a precise artificial intelligence (AI) model for the diagnosis of STEMI and accurate cardiac catheterization laboratory activation.
Methods: We used electrocardiography (ECG) waveform data from a prospective percutaneous coronary intervention registry in Korea in this study. Two independent board-certified cardiologists established a criterion standard (STEMI or Not STEMI) for each ECG based on corresponding coronary angiography data. We developed a deep ensemble model by combining 5 convolutional neural networks. In addition, we performed clinical validation based on a symptom-based ECG data set, comparisons with clinical physicians, and external validation.
Results: We used 18,697 ECGs for the model development data set, and 1,745 (9.3%) were STEMI. The AI model achieved an accuracy of 92.1%, sensitivity of 95.4%, and specificity of 91.8 %. The performances of the AI model were well balanced and outstanding in the clinical validation, comparison with clinical physicians, and the external validation.
Conclusion: The deep ensemble AI model showed a well-balanced and outstanding performance. As visualized with gradient-weighted class activation mapping, the AI model has a reasonable explainability. Further studies with prospective validation regarding clinical benefit in a real-world setting should be warranted.