← ireadpaper · 顶刊中的公共政策研究

利用抽签评估学校增值:检验与估计*

Leveraging Lotteries for School Value-Added: Testing and Estimation*
Quarterly Journal of Economics · 2017 · Joshua D. Angrist、Peter Hull、Parag A. Pathak、Christopher Walters

中文摘要

传统增值模型(VAMs)在对学生的人口学特征和先前成绩进行回归调整后,比较各学校的平均考试成绩。本文通过考察增值模型估计能否准确预测随机分配到特定学校对学业成绩的影响,检验增值模型的偏误。基于波士顿招生抽签的检验结果提示,传统增值模型估计存在偏误。这一发现促使我们构建一个分层模型,用以刻画学校增值、偏误与抽签依从性的联合分布。我们利用该模型评估传统增值模型估计中偏误的实质重要性,并构建混合增值估计,以最优方式结合增值模型参数的普通最小二乘估计与基于抽签的估计。这种混合估计策略为结合非实验估计与准实验估计提供了一种通用方法。尽管仍存在偏误,混合学校增值估计的均方误差低于传统增值模型估计。根据波士顿数据校准的模拟表明,尽管存在偏误,基于控制滞后学业成绩的传统增值模型所做出的政策决策,很可能带来可观的学业成绩提升。纳入抽签信息的混合估计则带来进一步的提升。

Abstract

Abstract Conventional value-added models (VAMs) compare average test scores across schools after regression-adjusting for students’ demographic characteristics and previous scores. This article tests for VAM bias using a procedure that asks whether VAM estimates accurately predict the achievement consequences of random assignment to specific schools. Test results from admissions lotteries in Boston suggest conventional VAM estimates are biased, a finding that motivates the development of a hierarchical model describing the joint distribution of school value-added, bias, and lottery compliance. We use this model to assess the substantive importance of bias in conventional VAM estimates and to construct hybrid value-added estimates that optimally combine ordinary least squares and lottery-based estimates of VAM parameters. The hybrid estimation strategy provides a general recipe for combining nonexperimental and quasi-experimental estimates. While still biased, hybrid school value-added estimates have lower mean squared error than conventional VAM estimates. Simulations calibrated to the Boston data show that, bias notwithstanding, policy decisions based on conventional VAMs that control for lagged achievement are likely to generate substantial achievement gains. Hybrid estimates that incorporate lotteries yield further gains.
在 ireadpaper 查看全部 →