Comparative analysis of the accuracy of an automated machine learning model for detecting cardiovascular diseases

T.V. Afanasieva, A.P. Kuzlyakin, A.V. Komolov

Abstract


cardiovascular diseases (CVD) are widespread among patients with chronic non-communicable diseases and are one of the leading causes of mortality in the population, including those of working age. The development of patient-oriented systems for early detection of cardiovascular diseases using machine learning models is a promising direction that integrates medical knowledge and information intelligent technologies for medical decision support systems. To simplify and speed up the process of developing a specific solution based on a wide variety of machine learning models, the field of automatic machine learning (AutoML) is actively developing. The article provides a comparative analysis of the accuracy of an AutoML model created using the AutoGluon-Tabular library. The accuracy comparison was carried out in two directions: in relation to three scenarios for preprocessing data from patients with CVD and in relation to the basic machine learning models contained in the AutoGluon-Tabular library. A comparative analysis on the open UCI database showed that the accuracy of the AutoML model in identifying cardiovascular diseases varies from 87.41% to 95.65%, with the maximum accuracy obtained in the scenario with Z-normalization of the original data, and the minimum accuracy - when using data preprocessing algorithm built into AutoML.


Full Text:

PDF (Russian)

References


Cai Y, Yu F, Kumar M, Gladney R, Mostafa J. Health Recommender Systems Development, Usage, and Evaluation from 2010 to 2022: A Scoping Review. Int J Environ Res Public Health. 2022 Nov 16;19(22):15115. doi: 10.3390/ijerph192215115. PMID: 36429832; PMCID: PMC9690602

Chiang, P.H.; Wong, M.; Dey, S. Using Wearables and Machine Learning to Enable Personalized Lifestyle Recommendations to Improve Blood Pressure. IEEE J. Transl. Eng. Health Med. 2021, 9, 2700513

Gellert GA, Orzechowski PM, Price T, Kabat-Karabon A, Jaszczak J, Marcjasz N, Mlodawska A, Kwiecien AK, Kurkiewicz P. A multinational survey of patient utilization of and value conveyed through virtual symptom triage and healthcare referral. Front Public Health. 2023 Feb 2;10:1047291. doi: 10.3389/fpubh.2022.1047291. PMID: 36817183; PMCID: PMC9932322

Mohd Javaid, Abid Haleem, Ravi Pratap Singh, Rajiv Suman, Shanay Rab, Significance of machine learning in healthcare: Features, pillars and applications, International Journal of Intelligent Networks,Volume 3,2022,Pages 58-73, ISSN 2666-6030, https://doi.org/10.1016/j.ijin.2022.05.002

Bhatt, C.M.; Patel, P.; Ghetia, T.; Mazzeo, P.L. Effective Heart Disease Prediction Using Machine Learning Techniques. Algorithms 2023, 16, 88. https://doi.org/10.3390/a16020088

Javeed A, Khan SU, Ali L, Ali S, Imrana Y, Rahman A. Machine Learning-Based Automated Diagnostic Systems Developed for Heart Failure Prediction Using Different Types of Data Modalities: A Systematic Review and Future Directions. Comput Math Methods Med. 2022 Feb 3;2022:9288452. doi: 10.1155/2022/9288452. PMID: 35154361; PMCID: PMC8831075

Nashif, S., Raihan, Md. R., Islam, Md. R. and Imam, M.H. (2018) Heart Disease Detection by Using Machine Learning Algorithms and a Real-Time Cardiovascular Health Monitoring System. World Journal of Engineering and Technology, 6, 854-873. https://doi.org/10.4236/wjet.2018.64057

Seneviratne MG, Li RC, Schreier M, Lopez-Martinez D, Patel BS, Yakubovich A, Kemp JB, Loreaux E, Gamble P, El-Khoury K, Vardoulakis L, Wong D, Desai J, Chen JH, Morse KE, Downing NL, Finger LT, Chen MJ, Shah N. User-centred design for machine learning in health care: a case study from care management. BMJ Health Care Inform. 2022 Oct;29(1):e100656. doi: 10.1136/bmjhci-2022-100656. PMID: 36220304; PMCID: PMC9557254

Rizzo G., & Lengelle R. The Evolution of Automated Machine Learning // IEEE Access, 2021, vol. 9, pp. 36595-36606

Nick Erickson, Jonas Mueller, Alexander Shirkov, Hang Zhang, Pedro Larroy, Mu Li, Alexander Smola. AutoGluon-Tabular: Robust and Accurate AutoML for Structured Data. 2020. ArXiv.org 2003.06505v1.

Shashank Prasanna. Machine learning with AutoGluon, an open source AutoML library. 2020. AWS Open Source Blog. https://aws.amazon.com/ru/blogs/opensource/machine-learning-with-autogluon-an-open-source-automl-library/

Waring J, Lindvall C, Umeton R. Automated machine learning: Review of the state-of-the-art and opportunities for healthcare. Artif Intell Med. 2020 Apr;104:101822. doi: 10.1016/j.artmed.2020.101822. Epub 2020 Feb 21. PMID: 32499001

Sarra, Raniya & Dinar, Ahmed & Mohammed, Mazin. (2023). Enhanced accuracy for heart disease prediction using artificial neural network. Indonesian Journal of Electrical Engineering and Computer Science. 29. 375-383. 10.11591/ijeecs.v29.i1.pp375-383

Alaa AM, Bolton T, Di Angelantonio E, Rudd JHF, van der Schaar M (2019) Cardiovascular disease risk prediction using automated machine learning: A prospective study of 423,604 UK Biobank participants. PLoS ONE 14(5): e0213653. https://doi.org/10.1371/journal.pone.0213653

Kotthoff,L.,Thornton,C.,Hoos,H.H.,Hutter,F.,and Leyton-Brown,K.Auto-WEKA2.0:Automaticmodel selectionandhyperparameteroptimizationinweka.JournalofMachineLearningResearch,18(25):1–5,2017.

Pandey,P.ADeepDiveintoH2OsAutoML, 2019.URLhttp://www.h2o.ai/blog/a-deepdive-into-h2os-automl/.

Feurer,M.,Klein,A.,Eggensperger,K.,Springenberg,J.T., Blum,M.,andHutter,F.Auto-sklearn:efficientandrobustautomatedmachinelearning.InAutomatedMachine Learning,pp.113–134.Springer,2019.


Refbacks

  • There are currently no refbacks.


Abava  Кибербезопасность IT Congress 2024

ISSN: 2307-8162