Evaluation 2016: Evaluation + Design

View Printable Version

New Approaches to the Design and Evaluation of Global Programs to End Modern Slavery: Establishing an Evidence Base and Understanding What Works

Session Number: 2280
Track: International and Cross Cultural Evaluation
Session Type: Panel
Tags: "hard to reach" populations, community context, data science, human rights
Session Chair: Kerry Bruce [Vice President, Performance Evaluation - Social Impact]
Presenter 1: Jacqueline Berman [Head of Evaluation and Deputy Director, OIO - OSCE]
Presenter 2: Lisa O'Reilly, CE [Monitoring, Learning, and Evaluation - Free the Slaves]
Presenter 3: Kerry Bruce [Vice President, Performance Evaluation - Social Impact]
Presentation 2 Additional Author: Lisa O'Reilly, CE [Monitoring, Learning, and Evaluation - Free the Slaves]
Presentation 2 Additional Author: Karen Snyder [Director of Monitoring, Learning and Evaluation - Free the Slaves]
Session Facilitator: Kerry Bruce [Vice President, Performance Evaluation - Social Impact]
Time: Oct 29, 2016 (09:45 AM - 10:30 AM)
Room: L508

Abstract 1 Title: Pivoting toward the Evidence: Using accumulated knowledge and a shared monitoring, evaluation and learning (MEL) approach to build effective counter-trafficking responses
Presentation Abstract 1:

Fifteen+ years on from the UN trafficking in persons Protocol, the effectiveness of counter-trafficking (CTIP) efforts remains unclear. Reviews of the literature and consultations with a range of stakeholders highlight (1) a lack of investment in assessing the contribution and impact of CTIP programmes, (2) insufficient use of knowledge accumulated in the field, and (3) infrequent building of logics and linkages needed to support effective implementation and results into these efforts.

As a way forward, this paper initiates development of a shared framework that encourages harnessing accumulated knowledge, and evolving MEL approaches and tools to build an evidence base of “what works” in CTIP. The goal is to help practitioners use existing knowledge to inform their work, while aligning and strengthening efforts to develop rigorous evidence of effectiveness, ultimately accelerating progress toward assisting people to exit sustainably, preventing new cases, and reducing the number and reach of trafficking networks.

Presentation 1 Other Authors: Phil Marshall, RCG Global
Abstract 2 Title: Using “Community” Rather than Individuals as the Unit of Analysis in Anti-Slavery Interventions
Presentation Abstract 2:

Free the Slaves (FTS) uses a community-based model for fighting modern slavery in six countries. The theory of change explains that strengthening community resistance and resilience reduces new cases of slavery, liberates those in slavery and yields sustained declines in the prevalence of slavery. Over the 2014-2016 period, FTS is assessing whether and how the model is having an impact. Information on key indicators is being collected from 19 local partner organizations. Traditional impact measures of anti-slavery interventions have focused on individuals – changes in slavery prevalence and knowledge and awareness. Our model is focused on community-level transformation, and we have developed a “Community Maturity Tool” to measure changes in community level resistance and resilience. This paper describes the design, implementation and review of the Community Maturity Tool for both program intervention and evaluation, including the costs and time required to permanently liberate communities from all forms of slavery.

Abstract 3 Title: How data analytics can help us to better design interventions to end modern slavery: Examples from the Philippines
Presentation Abstract 3:

Human trafficking occurs within hidden populations and is notoriously difficult to measure. This paper will present new approaches to harness the availability of large amounts of indirect “secondary” data to support design and evaluation in sector.
Using thousands of variables from more than 20 secondary datasets, we produced a model to predict the occurrence of and underlying causal relationships of human trafficking among overseas foreign workers in the Philippines in 2 regions. The analysis included human trafficking case data from more than 10 organizations.
This analysis has enabled us to target interventions to specific populations and geographies in the Philippines, based on existing data. The results provide a prioritized suite of interventions that would most effectively reduce the prevalence of trafficking for each sociocultural landscape in which they would be implemented. This approach could be effectively used beyond the trafficking sector to prioritize interventions and design programs in a more nuanced manner.

Presentation 3 Other Authors: Gregory van der Vink, PhD.
Audience Level: Intermediate

Session Abstract: 

The design and evaluation of interventions that respond effectively to modern slavery, human trafficking and multiple forms of exploitation is subject to much discussion in the professional community. This session will present 3 papers that address questions related to the design and evaluation of programs from different perspectives. The first paper explores integrating a more comprehensive use of existing knowledge in the field with monitoring, evaluation, and learning resources to develop a shared framework for building evidence of ‘what works.’  The second paper considers what we can learn from community-based approaches and introduces a new tool to help evaluate the effectiveness of these approaches. The final paper examines how we can use big data analytics to harness existing secondary data and create better predictive models for the sector.

For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.

Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 3, 2016. Email cancellation requests to registration@eval.org. Fax request to (202) 367-2173. All refunds are processed after the meeting. After October 3, 2016 all sales are final.