Severity Identification of Graves Orbitopathy via Random Forest Algorithm

Abstract

This study aims to establish a random forest model for detecting the severity of Graves Orbitopathy (GO) and identify significant classification factors. This is a hospital-based study of 199 patients with GO that were collected between December 2019 and February 2022. Clinical information was collected from medical records. The severity of GO can be categorized as mild, moderate-to-severe, and sight-threatening GO based on guidelines of the European Group on Graves’ orbitopathy. A random forest model was constructed according to the risk factors of GO and the main ocular symptoms of patients to differentiate mild GO from severe GO and finally was compared with logistic regression analysis, Support Vector Machine (SVM), and Naive Bayes. A random forest model with 15 variables was constructed. Blurred vision, disease course, thyroid-stimulating hormone receptor antibodies, and age ranked high both in mini-decreased gini and mini decrease accuracy. The accuracy, positive predictive value, negative predictive value, and the F1 Score of the random forest model are 0.83, 0.82, 0.86, and 0.82, respectively. Compared to the three other models, our random forest model showed a more reliable performance based on AUC (0.85 vs. 0.83 vs. 0.80 vs. 0.76) and accuracy (0.83 vs. 0.78 vs. 0.77 vs. 0.70). In conclusion, this study shows the potential for applying a random forest model as a complementary tool to differentiate GO severity.

Keywords

Graves orbitopathy - severity - random forest algorithm

• References

• 1 Bartalena L, Kahaly GJ, Baldeschi L. et al. The 2021 European Group on Graves’ orbitopathy (EUGOGO) clinical practice guidelines for the medical management of Graves’ orbitopathy. Eur J Endocrinol 2021; 185: G43-G67
• 2 Drui D, Du Pasquier Fediaevski L, Vignal Clermont C. et al. Graves’ orbitopathy: diagnosis and treatment. Ann Endocrinol (Paris) 2018; 79: 656-664
• 3 Bartalena L. Prevention of Graves’ ophthalmopathy. Best Pract Res Clin Endodrinol Metab 2012; 26: 371-379
• 4 Biscarini F, Masetti G, Muller I. et al. Gut microbiome associated with Graves disease and Graves orbitopathy: the INDIGO multicenter European study. J Clin Endocrinol Metab 2023; 108: 2065-2077
• 5 Breiman L. Random forests. Mach Learn 2001; 45: 5-32
• 6 Kim SY. Effects of sample size on robustness and prediction accuracy of a prognostic gene signature. BMC Bioinformatics 2009; 10: 147
• 7 Li G, Liu X, Wang M. et al. Predicting the functional outcomes of anti-LGI1 encephalitis using a random forest model. Acta Neurol Scand 2022; 146: 137-143
• 8 Moradian H, Lau MA, Miki A. et al. Identifying suicide ideation in mental health application posts: a random forest algorithm. Death Stud 2023; 47: 1044-1052
• 9 Couronné R, Probst P, Boulesteix A-L. Random Forest versus logistic regression: a large-scale benchmark experiment. BMC Bioinformatics 2018; 19: 270
• 10 Lim SL, Lim AK, Mumtaz M. et al. Prevalence, risk factors, and clinical features of thyroid‑associated ophthalmopathy in multiethnic malaysian patients with Graves’ disease. Thyroid 2008; 18: 1297-1301
• 11 Muralidhar A, Das S, Tiple S. Clinical profile of thyroid eye disease and factors predictive of disease severity. Indian J Ophthalmol 2020; 68: 1629-1634
• 12 Prummel MF, Bakker A, Wiersinga WM. et al. Multi‑center study on the characteristics and treatment strategies of patients with Graves’ orbitopathy: the first European group on Graves’ orbitopathy experience. Eur J Endocrinol 2005; 148: 491-495
• 13 Tanda ML, Piantanida E, Liparulo L. et al. Prevalence and natural history of Graves’ orbitopathy in a large series of patients with newly diagnosed Graves’ hyperthyroidism seen at a single center. J Clin Endocrinol Metab 2013; 98: 1443-1449
• 14 Laurberg P, Berman DC, Bülow Pedersen I. et al. Incidence and clinical presentation of moderate to severe graves’ orbitopathy in a Danish population before and after iodine fortification of salt. J Clin Endocrinol Metab 2012; 97: 2325-2332
• 15 Bartley GB. The epidemiologic characteristics and clinical course of ophthalmopathy associated with autoimmune thyroid disease in Olmsted County, Minnesota. Trans Am Ophthalmol Soc 1994; 92: 477-588
• 16 Tanda ML, Piantanida E, Liparulo L. et al. Prevalence and natural history of Graves’ orbitopathy in a large series of patients with newly diagnosed graves’ hyperthyroidism seen at a single center. J Clin Endocrinol Metab 2013; 98: 1443-1449
• 17 Seo S, Sánchez Robledo M. Usefulness of TSH receptor antibodies as biomarkers for Graves’ ophthalmopathy: a systematic review. J Endocrinol Invest 2018; 41: 1457-1468
• 18 Bylander T. Estimating generalization error on two-class datasets using out-of-bag estimates. Mach Learn 2002; 48: 287-297
• 19 Wiersinga WM. Advances in treatment of active, moderate-to-severe Graves’ ophthalmopathy. Lancet Diabetes Endocrinol 2017; 5: 134-142
• 20 Eckstein AK, Plicht M, Lax H. et al. Thyrotropin receptor autoantibodies are independent risk factors for Graves’ ophthalmopathy and help to predict severity and outcome of the disease. J Clin Endocrinol Metab 2006; 91: 3464-3470
• 21 Dolman PJ. Evaluating Graves’ orbitopathy. Best Pract Res Clin Endocrinol Metab 2012; 26: 229-248
• 22 Bahn RS. Graves’ ophthalmopathy. N Engl J Med 2010; 362: 726-738
• 23 Oeverhaus M, Winkler L, Stähr K. et al. Influence of biological sex, age and smoking on Graves’ orbitopathy – a ten-year tertiary referral center analysis. Front Endocrinol (Lausanne) 2023; 14: 1160172
• 24 Wiersinga WM. Smoking and thyroid. Clin Endocrinol (Oxf) 2013; 79: 145-151
• 25 Bartalena L, Tanda ML. Current concepts regarding Graves’ orbitopathy. J Intern Med 2022; 292: 692-716
• 26 Weiler DL. Thyroid eye disease: a review. Clin Exp Optom 2017; 100: 20-25
• 27 González-García A, Sales-Sanz M. Treatment of Graves’ ophthalmopathy. Tratamiento de la oftalmopatía de Graves. Med Clin (Barc). 2021. 156. 180-186
• 28 Genere N, Stan MN. Current and emerging treatment strategies for Graves’ orbitopathy. drugs 2019; 79: 109-124