Estimating Global Public Health Security Preparedness Capacity: The Contribution of Spar and Jee

Abstract

BackgroundTo promote transparency and mutual accountability in global public health security among WHO States Parties, Article 54 of the International Health Regulations (2005) (IHR) obliges State Parties to regularly report capacities to prevent, protect against, control, and provide a public health response to the international spread of disease. Two prominent tools for assessing capacities, a mandatory State Parties Annual Self-Assessment (SPAR) and a voluntary Joint External Evaluation (JEE), cover similar concepts and structure, but agreement between the tools has not been assessed in a long term global analysis.MethodsThis ecological study compared quantitative capacity scores from 1,445 indicator-matched paired observations from 108 SPAR and JEE assessments completed in the same year, by 93 States Parties, between 2016 and 2023. Mixed effects methods were used to estimate mean agreement for each indicator, comparing tool editions/years, regions, and income groups.FindingsOverall, SPAR scores were higher than JEE scores, with the least agreement observed with indicators scoring near Level 3-4 capacity. However, consistency between SPAR and JEE evaluations improved recently, particularly in the latest 2022-2023 editions where 25 of the 28 matched indicator capacity scores were not significantly different on average. Three indicators with significant score disagreement pertained to infection prevention and control, health-care association infection surveillance, and national IHR focal point functions.InterpretationDespite different assessment processes, SPAR and JEE are comparable tools for most indicators with improved alignment in recent years in both indicator scope and scores.

Keywords: Global health security, pandemic preparedness, International Health Regulations (IHR) (2005), State Parties Annual Self-Assessment (SPAR), Joint External Evaluation (JEE), Capacity assessment