Test Score Gap Robustness to Scaling: The Scale Transformation Command

16 Pages Posted: 20 Aug 2019

Date Written: August 19, 2019

Abstract

Social scientists frequently rely on the cardinal comparability of test scores to assess achievement gaps between population subgroups and their evolution over time. This approach has been criticized due to the ordinal nature of test scores and the sensibility of results to order-preserving transformations, which are theoretically plausible. Bond and Lang (2013) document the sensitivity of measured ability to scaling choices and develop a method to assess the robustness of changes in ability over time to scaling choices. This paper presents the scale transformation command, which expands the Bond and Lang method to more general cases and optimizes their algorithm to work with large data sets. The program assesses the robustness of an achievement gap between two subgroups to any arbitrary choice of scale by finding bounds for the original gap estimation. Additionally, the program finds scale transformations that are very likely and unlikely to benchmark against the results obtained. Finally, the program also allows the user to measure how much gap growth coefficients change when including controls in their specifications.

Keywords: Educational Sciences, Inequality, Health Care Services Industry, Health Service Management and Delivery, Education for Development (superceded), Educational Populations, Education For All

Suggested Citation

Yi Chang, Andres, Test Score Gap Robustness to Scaling: The Scale Transformation Command (August 19, 2019). World Bank Policy Research Working Paper No. 8986. Available at SSRN: https://ssrn.com/abstract=3439757

Andres Yi Chang (Contact Author)

World Bank ( email )

1818 H Street, NW
Washington, DC 20433
United States

Register to save articles to
your library

Register

Paper statistics

Downloads
8
Abstract Views
51
PlumX Metrics