Performance Evaluation of SXI++ and Comparative Triage Machine Learning Models for Enhanced Medical Decision-Making

Authors

  • Mahesh Banavar* Department of ECE, Clarkson University, Potsdam, USA
  • Reeshabh Kumar Sriya.AI, Atlanta, GA, USA
  • Prashant Yadav Sriya.AI, Atlanta, GA, USA
  • Srinivas Kilambi* Sriya.AI, Atlanta, GA, USA

DOI:

https://doi.org/10.18178/JAAI.2026.4.1.59-75

Keywords:

triage prediction, artificial intelligence, SXI++, machine learning, deep neural networks

Abstract

Effective triage is vital to prioritize patient care and optimize resource utilization. This study compares traditional machine learning, represented by an XGBoost classifier, with SXI++, a proprietary deep neural network and ensemble learning framework, for predicting Emergency Severity Index (ESI) levels. An emergency department dataset of 560,486 records and 972 features was reduced to 180 through correlation filtering, Least Absolute Shrinkage and Selection Operator (LASSO) regression, and principal component analysis. A 100,000-record sample was imputed, normalized, and split into training (70%), validation (10%), and test (20%) sets. On the large dataset test set (10,000 records), SXI++ achieved 99.8% accuracy, 99.8% precision, 99.8% sensitivity, 99.8% specificity, and an AUC of 0.999, outperforming XGBoost (82.9% accuracy, 85.5% precision, 73.7% sensitivity, 91.1% specificity, AUC 0.779) and SXI (90.76% accuracy, 80.97% precision, 90.7% sensitivity, 92.0% specificity, AUC 0.967). Validation on a smaller dataset of 1,267 adult ED cases confirmed adaptability, with SXI++ achieving 100% accuracy, precision, sensitivity, specificity, and AUC. These findings highlight SXI++’s potential for accurate and scalable triage automation. However, near-perfect metrics warrant further validation on diverse, real-world datasets to assess generalizability, computational efficiency, and overfitting risk before clinical deployment.

References

[1] Robertson-Steel, I. (2006). Evolution of triage systems. Emergency Medicine Journal, 23(2), 154–155. https://doi.org/10.1136/emj.2005.030270

[2] Romig, L. E. (2002). Pediatric triage: A system to JumpSTART your triage of young patients at MCIs. JEMS: Journal of Emergency Medical Services, 27(7), 52–63.

[3] Stanfield, L. M. (2015). Clinical decision making in triage: An integrative review. Journal of Emergency Nursing, 41(5), 396–403. https://doi.org/10.1016/j.jen.2015.02.003

[4] Ghanbarzehi, N., Balouchi, A., Sabzevari, S., Darban, F., & Khayat, N. H. (2016). Effect of triage training on concordance of triage level between triage nurses and emergency medical technicians. Journal of Clinical and Diagnostic Research, 10(5), IC05–IC07. https://doi.org/10.7860/JCDR/2016/19071.7798

[5] National Library of Medicine. National Library of Medicine. Retrieved from https://www.ncbi.nlm.nih.gov/

[6] FitzGerald, G., Jelinek, G. A., Scott, D., & Gerdtz, M. F. (2010). Emergency department triage revisited. Emergency Medicine Journal, 27(2), 86–92. https://doi.org/10.1136/emj.2009.077081

[7] Tanabe, P., Travers, D., Gilboy, N., Rosenau, A., Sierzega, G., Rupp, V., Martinovich, Z., & Adams, J. G. (2005). Refining Emergency Severity Index triage criteria. Academic Emergency Medicine, 12(6), 497–501. https://doi.org/10.1197/j.aem.2005.02.004

[8] Jordi, K., Grossmann, F., Gaddis, G. M., Cignacco, E., Denhaerynck, K., Schwendimann, R., & Nickel, C. H. (2015). Nurses’ accuracy and self-perceived ability using the Emergency Severity Index triage tool: A cross-sectional study in four Swiss hospitals. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, 23, 62. https://doi.org/10.1186/s13049-015-0142-y

[9] Bullard, M. J., Musgrave, E., Warren, D., Unger, B., Skeldon, T., Grierson, R., van der Linde, E., & Swain, J. (2017). Revisions to the Canadian Emergency Department Triage and Acuity Scale (CTAS) guidelines 2016. CJEM, 19(S2), S18–S27. https://doi.org/10.1017/cem.2017.365

[10] Zhu, A., Zhang, J., Zhang, H., & Liu, X. (2019). Comparison of reliability and validity of the Chinese four-level and three-district triage standard and the Australasian Triage Scale. Emergency Medicine International, 2019, 8490152. https://doi.org/10.1155/2019/8490152

[11] Ebrahimi, M., Heydari, A., Mazlom, R., & Mirhaghi, A. (2015). The reliability of the Australasian Triage Scale: A meta-analysis. World Journal of Emergency Medicine, 6(2), 94–99. https://doi.org/10.5847/wjem.j.1920-8642.2015.02.002

[12] Brouns, S. H. A., Mignot-Evers, L., Derkx, F., Lambooij, S. L., Dieleman, J. P., & Haak, H. R. (2019). Performance of the Manchester triage system in older emergency department patients: A retrospective cohort study. BMC Emergency Medicine, 19(1), 3. https://doi.org/10.1186/s12873-018-0217-y

[13] Zachariasse, J. M., Seiger, N., Rood, P. P., Alves, C. F., Freitas, P., Smit, F. J., Roukema, G. R., & Moll, H. A. (2017). Validity of the Manchester triage system in emergency care: A prospective observational study. PLOS ONE, 12(2), e0170811. https://doi.org/10.1371/journal.pone.0170811

[14] Hodge, A., Hugman, A., Varndell, W., & Howes, K. (2013). A review of the quality assurance processes for the Australasian Triage Scale (ATS) and implications for future practice. Australasian Emergency Nursing Journal, 16(1), 21–29. https://doi.org/10.1016/j.aenj.2012.12.003

[15] Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785–794). Association for Computing Machinery. https://doi.org/10.1145/2939672.2939785

[16] Sun, Z., Wang, G., Li, P., Wang, H., Zhang, M., & Liang, X. (2024). An improved random forest based on the classification accuracy and correlation measurement of decision trees. Expert Systems with Applications, 237(Part A), 121549. https://doi.org/10.1016/j.eswa.2023.121549

[17] Ivanov, O., Wolf, L., Brecher, D., et al. (2020). Improving emergency department ESI acuity assignment using machine learning and clinical natural language processing, arXiv preprint, arXiv:2004.05184.

[18] Yildiz, I. Emergency Service-Triage Application [Data set]. Kaggle. Retrieved from https://www.kaggle.com/datasets/ilkeryildiz/emergency-service-triage-application

[19] Mahto, D., Yadav, P., Joseph, A. T., & Kilambi, S. (2025). AI2-SXI algorithm enables predicting and reducing the risk of less than 30 days patient readmissions with 99% accuracy and precision. Journal of Medical Artificial Intelligence, 8, 10. https://doi.org/10.21037/jmai-24-148

[20] Kilambi, S. (2024). AI Square Enabled by Sriya Expert Index (SXI): Method of Determining and Use. (U.S. Provisional Patent Application No. 63/549,553).

[21] Kilambi, S. (2024) AI Square Enabled by Sriya Expert Index (SXI) Plus Reinforcement Learning. U.S. Provisional Patent Application No. 63/553,335.

[22] Kilambi, S. (2024) Processing of Large Numerical Models (LNM) by AI2 enabled SXI. U.S. Provisional Patent Application No. 63/575,991.

[23] Kilambi, S. (2024) AI Square Enabled by Sriya Expert Index (SXI): Generative AI. U.S. Provisional Patent Application No. 63/554,252.

[24] Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1), 267–288.

[25] Luss, R., & d’Aspremont, A. (2007). Clustering and feature selection using sparse PCA. arXiv preprint, arXiv:0707.0705.

[26] Peng, H.-C., Long, F., & Ding, C. (2005). Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(8), 1226–1238. https://doi.org/10.1109/TPAMI.2005.159

[27] Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785–794). Association for Computing Machinery. https://doi.org/10.1145/2939672.2939785

[28] Lewis, D. D. (1998). Naïve (Bayes) at forty: The independence assumption in information retrieval. In C. Nédellec & C. Rouveirol (Eds.), Machine Learning: ECML-98 (Lecture Notes in Computer Science, Vol. 1398, pp. 4–15). Springer. https://doi.org/10.1007/BFb0026666

[29] Raita, Y., Goto, T., Faridi, M. K., Brown, D. F., Camargo, C. A., & Hasegawa, K. (2019). Emergency department triage prediction of clinical outcomes using machine learning models. Critical Care, 23(1), 64. https://doi.org/10.1186/s13054-019-2351-7

[30] Yoon, J., Kim, M. Y., Kim, M., Yeo, S. Y., & Hwang, H. (2024). Development of a pediatric emergency triage prediction model using natural language processing with pre-trained BERT models. Healthcare Informatics Research, 30(2), 123–131. https://doi.org/10.4258/hir.2024.30.2.123

Downloads

Published

2026-03-27

Issue

Section

Article