Fisher–Schultz Lecture: Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, With an Application to Immunization in India
Econometrica · 2025 · Victor Chernozhukov、Mert Demirer、Esther Duflo、Iván Fernández‐Val
中文摘要
我们提出了在随机实验中估计异质性效应的关键特征并对其进行推断的策略。这些关键特征包括利用机器学习代理变量构建的效应最佳线性预测器、按影响程度分组的平均效应,以及受影响最大和最小的单位的平均特征。该方法在高维情形下有效,其中,预测性和因果性机器学习方法为效应提供代理变量,但不一定能对效应进行一致估计。我们对这些代理变量进行后处理,得到关键特征的估计值。我们的方法具有通用性,可以与惩罚方法、神经网络、随机森林、提升树和集成方法结合使用,既适用于预测性方法,也适用于因果性方法。估计与推断基于重复数据分割,以避免过拟合并保证有效性。我们对多种可能的数据分割所得结果进行分位数聚合,具体包括取 p 值的中位数,以及置信区间的中位数和其他分位数。我们表明,相较于单次分割程序,分位数聚合能够降低估计风险,并确立了其主要推断性质。最后,我们的分析揭示了通过因果学习构建可证明更优的机器学习代理变量的途径:我们可以利用所开发的、用于构建效应最佳线性预测器的目标函数,在初始步骤中获得更好的机器学习代理变量。我们通过一项随机实地实验,展示推断工具和因果学习器的使用;该实验评估了一组旨在刺激印度免疫接种需求的助推措施的组合。
Abstract
We propose strategies to estimate and make inference on key features of heterogeneous effects in randomized experiments. These key features include best linear predictors of the effects using machine learning proxies, average effects sorted by impact groups , and average characteristics of most and least impacted units . The approach is valid in high‐dimensional settings, where the effects are proxied (but not necessarily consistently estimated) by predictive and causal machine learning methods. We post‐process these proxies into estimates of the key features. Our approach is generic; it can be used in conjunction with penalized methods, neural networks, random forests, boosted trees, and ensemble methods, both predictive and causal. Estimation and inference are based on repeated data splitting to avoid overfitting and achieve validity. We use quantile aggregation of the results across many potential splits, in particular taking medians of p ‐values and medians and other quantiles of confidence intervals. We show that quantile aggregation lowers estimation risks over a single split procedure, and establish its principal inferential properties. Finally, our analysis reveals ways to build provably better machine learning proxies through causal learning: we can use the objective functions that we develop to construct the best linear predictors of the effects, to obtain better machine learning proxies in the initial step. We illustrate the use of both inferential tools and causal learners with a randomized field experiment that evaluates a combination of nudges to stimulate demand for immunization in India.