The Sorted Effects Method: Discovering Heterogeneous Effects Beyond Their Averages
中文摘要
非线性及交互线性模型中所关注的偏(其他条件不变)效应具有异质性,因为它们可能随着潜在的观测或未观测协变量发生剧烈变化。尽管异质性显然十分重要,现代经验研究中的一个常见做法却是主要通过报告平均偏效应(或至多报告某些组的平均效应)来忽略它。虽然平均效应为典型效应提供了非常方便的标量概括,但根据定义,它们无法反映异质性效应的全部多样性。为了更充分地发现这些效应,我们提出估计并报告排序效应——一组按递增顺序排列并按百分位数索引的估计偏效应。按其构造,排序效应曲线完全表征并有助于在一张图中可视化异质性效应的范围。它们在实践中与传统平均偏效应一样方便且易于报告。它们还构成分类分析的基础,在该分析中我们将观测单位划分为受影响最大或最小的组,并概括其特征。我们为估计的排序效应及相关分类分析提供了不确定性的量化(标准误和置信带),并为受影响最大和最小的组提供了置信集。所导出的统计结果依赖于建立关于多变量排序算子及相关分类算子Hadamard可微性的关键新数学结果,这些结果具有独立意义。我们应用排序效应方法及分类分析,展示了性别工资差距中的若干显著模式。
Abstract
The partial (ceteris paribus) effects of interest in nonlinear and interactive linear models are heterogeneous as they can vary dramatically with the underlying observed or unobserved covariates. Despite the apparent importance of heterogeneity, a common practice in modern empirical work is to largely ignore it by reporting average partial effects (or, at best, average effects for some groups). While average effects provide very convenient scalar summaries of typical effects, by definition they fail to reflect the entire variety of the heterogeneous effects. In order to discover these effects much more fully, we propose to estimate and report sorted effects -- a collection of estimated partial effects sorted in increasing order and indexed by percentiles. By construction the sorted effect curves completely represent and help visualize the range of the heterogeneous effects in one plot. They are as convenient and easy to report in practice as the conventional average partial effects. They also serve as a basis for classification analysis, where we divide the observational units into most or least affected groups and summarize their characteristics. We provide a quantification of uncertainty (standard errors and confidence bands) for the estimated sorted effects and related classification analysis, and provide confidence sets for the most and least affected groups. The derived statistical results rely on establishing key, new mathematical results on Hadamard differentiability of a multivariate sorting operator and a related classification operator, which are of independent interest. We apply the sorted effects method and classification analysis to demonstrate several striking patterns in the gender wage gap.