Rewarding for Causal Impact: Integrating Policy Evaluation and Incentive Alignment in the Design of Cross-Sector Contracts

37 Pages Posted: 18 Jun 2020

See all articles by Sérgio G. Lazzarini

Sérgio G. Lazzarini

Insper Institute of Education and Research

Thomaz Teodorovicz

affiliation not provided to SSRN

Sergio Firpo

Insper

Sandro Cabral

Insper Institute of Education and Research; Federal University of Bahia (UFBA)

Date Written: May 16, 2020

Abstract

Despite the emergence of contracts between governments and private actors involved in public services, a critical issue is how to enforce payments based on outcomes such as student learning or prisoner recidivism. Imperfect measurement may fail to reflect changes in outcomes that were caused by superior managerial effort. A possible way to address this problem is to adopt policy evaluation techniques that use control groups to examine what would have happened without the intervention, as is done in randomized controlled trials (RCTs) and other methods of counterfactual assessment. However, our database of outcome-based contracts launched or in development worldwide shows that the majority of contracts (70%) simply assess changes in outcomes measured in the treated population. In this paper we bridge the literatures of contractual incentives and policy evaluation to explain this puzzle. We develop a theoretical model to compare payment rules based on the assessment of the treated to payment rules based on a comparison between treated and control groups. Building on the idea of statistical power, we show that the later contracts may under certain conditions undermine effort. This occurs, for instance, when the number of treated subjects is small and there is limited investment per treated subject, which is associated with potential effect size. Preliminary evidence from our database of outcome-based contracts is consistent with our predictions. Our results suggest that under certain conditions RCTs and other evaluation techniques may not be optimal to reward for social outcomes, even though they are considered best practice to assess policy interventions.

Keywords: cross-sector contracts, incentives, policy evaluation, RCT

JEL Classification: L24, L32, L33

Suggested Citation

Lazzarini, Sérgio Giovanetti and Teodorovicz, Thomaz and Firpo, Sergio and Cabral, Sandro, Rewarding for Causal Impact: Integrating Policy Evaluation and Incentive Alignment in the Design of Cross-Sector Contracts (May 16, 2020). Available at SSRN: https://ssrn.com/abstract=3603045 or http://dx.doi.org/10.2139/ssrn.3603045

Sérgio Giovanetti Lazzarini (Contact Author)

Insper Institute of Education and Research ( email )

R Quata 300
Sao Paulo, 04542-030
Brazil
55-11-45042387 (Phone)

HOME PAGE: http://www.insper.edu.br/docentes/sergio-lazzarini-en/

Thomaz Teodorovicz

affiliation not provided to SSRN

Sergio Firpo

Insper ( email )

R Quata 300
Sao Paulo, 04542-030
Brazil

HOME PAGE: http://https://sites.google.com/site/sergiopfirpo/

Sandro Cabral

Insper Institute of Education and Research ( email )

R Quata 300
Sao Paulo, 04542-030
Brazil

Federal University of Bahia (UFBA) ( email )

Av. Reitor Miguel Calmon, s/n
Vale do Canela
Salvador, Bahia
Brazil

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
11
Abstract Views
122
PlumX Metrics