用机器学习方法识别低紧急程度急诊就诊:低紧急程度就诊算法(LAVA)

Identifying low acuity Emergency Department visits with a machine learning approach: The low acuity visit algorithms (LAVA)

Health Services Research · 2024
被引 4
ABS 3

中文导读

研究用机器学习模型(逻辑回归、随机森林、XGBoost)识别低紧急程度急诊就诊,相比传统ICD编码算法,预测准确率(PPV)最高提升83%,但模型在不同人群中的表现差异需进一步研究。

Abstract

OBJECTIVE: To improve the performance of International Classification of Disease (ICD) code rule-based algorithms for identifying low acuity Emergency Department (ED) visits by using machine learning methods and additional covariates. DATA SOURCES: We used secondary data on ED visits from the National Hospital Ambulatory Medical Survey (NHAMCS), from 2016 to 2020. STUDY DESIGN: We established baseline performance metrics with seven published algorithms consisting of International Classification of Disease, Tenth Revision codes used to identify low acuity ED visits. We then trained logistic regression, random forest, and gradient boosting (XGBoost) models to predict low acuity ED visits. Each model was trained on five different covariate sets of demographic and clinical data. Model performance was compared using a separate validation dataset. The primary performance metric was the probability that a visit identified by an algorithm as low acuity did not experience significant testing, treatment, or disposition (positive predictive value, PPV). Subgroup analyses assessed model performance across age, sex, and race/ethnicity. DATA COLLECTION: We used 2016-2019 NHAMCS data as the training set and 2020 NHAMCS data for validation. PRINCIPAL FINDINGS: The training and validation data consisted of 53,074 and 9542 observations, respectively. Among seven rule-based algorithms, the highest-performing had a PPV of 0.35 (95% CI [0.33, 0.36]). All model-based algorithms outperformed existing algorithms, with the least effective-random forest using only age and sex-improving PPV by 26% (up to 0.44; 95% CI [0.40, 0.48]). Logistic regression and XGBoost trained on all variables improved PPV by 83% (to 0.64; 95% CI [0.62, 0.66]). Multivariable models also demonstrated higher PPV across all three demographic subgroups. CONCLUSIONS: Machine learning models substantially outperform existing algorithms based on ICD codes in predicting low acuity ED visits. Variations in model performance across demographic groups highlight the need for further research to ensure their applicability and fairness across diverse populations.

急诊医学机器学习算法医疗管理人工智能