External Validity in a Stochastic World

This paper examines the generalizability of internally valid estimates of causal effects in a fixed population over time when that population is subject to aggregate shocks. This temporal external validity is shown to depend upon the distribution of the aggregate shocks and the interaction between these shocks and the casual effects. It shows that returns to investment in agriculture, small and medium enterprises and human capital differ significantly from year to year. It also shows how returns to investments interact with specific aggregate shocks, and estimate the parameters of the distributions of these shocks. The paper further shows how to use these estimates to appropriately widen estimated confidence intervals to account for aggregate shocks. [Working Paper 22449]