Clinical support system for triage based on federated learning for the Korea triage and acuity scale

Abstract

Background and aims: This study developed a clinical support system based on federated learning to predict the need for a revised Korea Triage Acuity Scale (KTAS) to facilitate triage.Methods: This was a retrospective study that used data from 11,952,887 patients in the Korean National Emergency Department Information System (NEDIS) from 2016 to 2018 for model development. Separate cohorts were created based on the emergency medical center level in the NEDIS: regional emergency medical center (REMC), local emergency medical center (LEMC), and local emergency medical institution (LEMI). External and temporal validation used data from emergency department (ED) of the study site from 2019 to 2021. Patient features obtained during the triage process and the initial KTAS scores were used to develop the prediction model. Federated learning was used to rectify the disparity in data quality between EDs. The patient's demographic information, vital signs in triage, mental status, arrival information, and initial KTAS were included in the input feature.Results: 3,626,154 patients' visits were included in the regional emergency medical center cohort; 8,278,081 patients' visits were included in the local emergency medical center cohort; and 48,652 patients' visits were included in the local emergency medical institution cohort. The study site cohort, which is used for external and temporal validation, included 135,780 patients visits. Among the patients in the REMC and study site cohorts, KTAS level 3 patients accounted for the highest proportion at 42.4% and 45.1%, respectively, whereas in the LEMC and LEMI cohorts, KTAS level 4 patients accounted for the highest proportion. The area under the receiver operating characteristic curve for the prediction model was 0.786, 0.750, and 0.770 in the external and temporal validation. Patients with revised KTAS scores had a higher admission rate and ED mortality rate than those with unaltered KTAS scores.