While corruption crackdowns have been shown to effectively reduce missing government expenditures, their effects on public service delivery have not been credibly documented. This matters because, if corruption generates incentives for bureaucrats to deliver those services, then deterring it might actually hurt downstream outcomes. This paper exploits variation from an anti-corruption program in Brazil, designed by the federal government to enforce guidelines on earmarked transfers to municipalities, to study this question. Combining random audits with a differences-in-differences strategy, we find that the anti-corruption program greatly reduced occurrences of overinvoicing and off-the-record payments, and of procurement manipulation within health transfers. However, health indicators, such as hospital beds and immunization coverage, became worse as a result. Evidence from audited amounts suggests that lower corruption came at a high cost: after the program, public spending fell by so much that corruption per dollar spent actually increased. These findings are consistent with those responsible for procurement dramatically reducing purchases after the program, either because they no longer can capture rents, or because they are afraid of being punished for procurement mistakes.