Model for ASsessing the Value of AI in Medical Imaging (MAS-AI)

Abstract

Introduction: Artificial intelligence (AI) is seen as one of the major disrupting forces in the future healthcare system. However, the assessment of the value of these new technologies is still unclear, and no agreed international health technology assessment (HTA)-based guideline exists. Therefore, a multidisciplinary group of experts and patient representatives developed a Model for ASsessing the value of AI (MAS-AI) in medical imaging. Methods: The MAS-AI guideline was developed in three phases. First, we conducted a literature review of existing guides, evaluations, and assessments of the value of AI in the field of medical imaging (5890 studies were assessed, with 86 studies included in the scoping review). Next, we interviewed six leading researchers in AI in Denmark. The third phase consisted of two workshops where decision-makers, patient organizations, and researchers discussed crucial topics when evaluating AI. The multidisciplinary team revised the model between workshops according to comments from workshop participants. Results: The MAS-AI guideline consists of two steps covering nine domains and process factors supporting the assessment. Step one contains a description of patients, how the AI model was developed, and initial ethical and legal considerations. Finishing the four domains in step one is a prerequisite for moving to step two. In step two, a multidisciplinary assessment of outcomes of the AI application is done for the five remaining domains: safety, clinical aspects, economics, organizational aspects, and patient aspects. Five critical factors support the assessment and facilitate a good evaluation process. Conclusions: We have developed an HTA-based framework to support the introduction of novel AI technologies into healthcare in medical imaging. MAS-AI can assist HTA organizations (and companies) in selecting the relevant domains and outcome measures in assessing AI applications. It is essential to ensure informed and valid decisions regarding the adoption of AI technology with a structured process and tool. MAS-AI can help support decision-making and provide greater transparency for all parties involved.

Keywords: Value assessment, HTA, evaluation, Artificial Intelligence, medical imaging