Download This Paper
Preprints with The Lancet is a collaboration between The Lancet Group of journals and SSRN to facilitate the open sharing of preprints for early engagement, community comment, and collaboration. Preprints available here are not Lancet publications or necessarily under review with a Lancet journal. These preprints are early-stage research papers that have not been peer-reviewed. The usual SSRN checks and a Lancet-specific check for appropriateness and transparency have been applied. The findings should not be used for clinical or public health decision-making or presented without highlighting these facts. For more information, please see the FAQs.
Automatic Transformer-Based Grading of Multiple Retinal Inflammatory Signs on Fluorescein Angiography
24 Pages Posted: 24 Sep 2024
More...Abstract
Background: Grading fluorescein angiography (FA) in the context of uveitis is complex, often leading to the oversight of retinal inflammation in clinical studies. This study aims to develop an automated method for grading retinal inflammation.Methods: Patients from Jules-Gonin Eye Hospital with active or resolved uveitis who underwent FA between 2018 and 2021 were included. FAs were acquired using a standardized protocol, anonymized, and annotated following the Angiography Scoring for Uveitis Working Group criteria, focusing on four inflammatory signs of the posterior pole. Intergrader agreement was assessed by four independent graders. Four deep learning transformer models were developed, and their performance was evaluated using the Ordinal Classification Index (1-OCI), accuracy, F1 scores, and Kappa scores. Grad-CAM analysis was employed to visualize model predictions.Findings: A total of 543 patients (1042 eyes, 40987 images) were included in the study. The models closely matched expert graders in detecting vascular leakage (F1-score=0.87, 1-OCI=0.89), capillary leakage (F1-score=0.86, 1-OCI=0.89), macular edema (F1-score=0.82, 1-OCI=0.86), and optic disc hyperfluorescence (F1-score=0.72, 1-OCI=0.85). Saliency analysis confirmed that the models focused on relevant retinal structures. The mean intergrader agreement across all inflammatory signs was F1-score=0.78 and 1-OCI=0.83.Interpretation: We developed a vision transformer-based model for the automatic grading of retinal inflammation in uveitis, utilizing the largest dataset of FAs in uveitis to date. This approach provides significant clinical benefits for the objective evaluation of uveitis and paves the way for future advancements, including the identification of novel biomarkers through the integration of clinical data and other imaging modalities.Funding: This work was supported by the Swiss National Science, Kattenburg, Schmieder-Bohrisch, AURIS, W.&E. Grand dʼHauteville, Ingvar-Kamprad, Fleurette-Wagemakers Foundations, the Kononchuk, Blatter Grants, and Rhumatismes-Enfants-Suisse.
Keywords: fluorescein angiography, retinal inflammation, vasculitis, macular edema, papillitis, vascular leakage, Deep Learning, optic disc hyperfluorescence, capillaropathy, disease grading, Uveitis, transformers, ordinal classification index, inter-grader agreement
Suggested Citation: Suggested Citation