Twelve principles for transformation-focused evaluation

Abstract

There are growing calls for societies to transform towards regenerative futures that support the flourishing of life and transcend interlinked social and ecological crises. Many actors are now trying to identify whether desired transformations are occurring, and how different interventions are contributing to transformation. These are questions of evaluation. However, we lack a holistic appreciation of how evaluation can most effectively assist transformation efforts. Here, we undertake a systematized scoping review of a  large body of evaluation literature to identify principles and methodologies for transformation-focused evaluation. We identify twelve distinct but interdependent principles which, when applied by evaluators (and supported by evaluation commissioners and funders), are considered to significantly enhance the effectiveness of evaluation in assessing and assisting transformations, although tensions exist between some of the principles. The principles were clustered into three overarching themes of Complexity Principles (how evaluation approaches complex systems), Power Principles (evaluators’ power relations), and Purpose Principles (evaluation’s deeper purpose and values). The Complexity Principles call on evaluators to: 1) treat evaluands as nested systems with complex interactions; 2) recognize that evaluands are unique and need context-adapted evaluation; 3) use mixed methods to understand contributions to change under conditions of uncertainty and imperfect information; 4) use more agile and developmental approaches; and 5) use foresight alongside retrospective evidence. The Power Principles ask evaluators to: 6) promote justice in power relations, rights, and use of knowledge; 7) shift power towards evaluation users and blur the evaluator-evaluand dichotomy; 8) support autonomous evaluation practice; and 9) cultivate mutualistic partnerships of knowledge and action. Finally, the Purpose Principles encourage evaluators to: 10) surface, question and uphold values; 11) foster evaluation cultures centered around ongoing learning; and 12) focus on evaluating and supporting systemic transformations towards regenerative futures. Relevant methodologies are suggested for operationalizing the principles. Transformation-focused evaluation is a radical shift from conventional practice but the urgency to address global crises makes the shift a crucial one.