This paper examines the role of mixed and multi-level methods datasets used to inform evaluations of transitional justice mechanisms. The Colombia reparation program for victims of war is used to illustrate how a convergent design involving multiple datasets can be used to evaluate the effectiveness of a complex transitional justice mechanism. This was achieved through a unique combination of (1) macro-level analysis enabled by a global dataset of transitional justice mechanisms, in this case the reparations data gathered by the Transitional Justice Research Collaborative, (2) meso-level data gathered at the organizational level on the Unidad para las Victimas (Victims Unit), the organization in charge of implementing the reparations program and overseeing the domestic database of victims registered in the reparations program, and (3) micro-level population- based perception datasets on the Colombian reparations program collected in the Peacebuilding Data database. The methods used to define measures, access existing data, and assemble new datasets are discussed, as are some of the challenges faced by the inter-disciplinary team. The results illustrate how the use of global, domestic, and micro- level datasets together yields high quality data, with multiple perspectives permitting the use of innovative evaluation methods and the development of important findings and recommendations for transitional justice mechanisms.
The authors comment to an article by David Richards about their paper "Information Effects and Human Rights Data". They discuss the argument by Richards on how word counts are related to coding, the use of Latin American cases as illustrations of how coding responds to the changes in human rights conditions, and the global averages of Cingranelli-Richards data presented by Richards.