Talk or Text? Evaluating Response Rates and Sensitive Data Measurement: Evidence from a Randomized Controlled Experiment

48 Pages Posted: 17 Dec 2024

See all articles by Sofia Amaral

Sofia Amaral

World Bank; South Asia Gender Innovation Lab

Lelys Dinarte

World Bank

Patricio Dominguez

Pontificia Universidad Católica de Chile

Santiago M. Perez-Vincent

Inter-American Development Bank (IDB)

Steffanny Romero

World Bank

Abstract

Researchers and policymakers face substantial challenges in selecting methods for conducting remote surveys, particularly when collecting sensitive information, reaching hard-to-access populations during emergencies, or working in vulnerable contexts. This study provides experimental evidence on the relative effectiveness of two survey methods: enumerator-led phone surveys and self-administered online surveys. In a randomized trial in El Salvador, we find that respondents assigned to phone surveys were, on average, 42 percentage points more likely to complete the survey, with particularly higher completion rates among women and older adults. Phone surveys also improved data quality and reduced the likelihood of respondents reporting high parental stress, without altering the composition of respondents. Although the direct cost of phone surveys is nearly double that of online surveys, the adjusted cost per completed response shows that phone surveys can be 25% less expensive when accounting for completion probabilities.

Keywords: Phone-based surveys, self-completion surveys, response rate, sensitive data, survey experiments

Suggested Citation

Amaral, Sofia and Dinarte, Lelys and Dominguez, Patricio and Perez-Vincent, Santiago M. and Romero, Steffanny, Talk or Text? Evaluating Response Rates and Sensitive Data Measurement: Evidence from a Randomized Controlled Experiment. Available at SSRN: https://ssrn.com/abstract=5047777 or http://dx.doi.org/10.2139/ssrn.5047777

Sofia Amaral

World Bank ( email )

1818 H Street, NW
Washington, DC 20433
United States

South Asia Gender Innovation Lab

Lelys Dinarte (Contact Author)

World Bank ( email )

1818 H Street, NW
Washington, DC 20433
United States

Patricio Dominguez

Pontificia Universidad Católica de Chile ( email )

Av Libertador General Bernardo O'Higgins 340
Santiago, Región Metropolitana 8331150
Chile

Santiago M. Perez-Vincent

Inter-American Development Bank (IDB) ( email )

1300 New York Avenue NW
Washington, DC 20577
United States

Steffanny Romero

World Bank ( email )

1818 H Street, NW
Washington, DC 20433
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
13
Abstract Views
92
PlumX Metrics