Citation:
designs.pdf | 855 KB |
Abstract:
Experimentation is a powerful methodology that enables scientists to empirically establish causal claims. However, one important criticism is that experiments merely provide a black-box view of causality and fail to identify causal mechanisms. Critics argue that although experiments can identify average causal effects, they cannot explain how such effects come about. If true, this represents a serious limitation of experimentation, especially for social and medical science research whose primary goal is to identify causal mechanisms. In this paper, we consider several different experimental designs and compare their identification power. Some of these designs require the direct manipulation of mechanisms, while others can be used even when only imperfect manipulation is possible. We use recent social science experiments to illustrate the key ideas that underlie each design.