Evaluation 2016: Evaluation + Design

View Printable Version

Case studies of Outcome Harvesting principles in practice around the world

Session Number: 2197
Track: International and Cross Cultural Evaluation
Session Type: Panel
Session Chair: Ricardo Wilson-Grau [Principal - Ricardo Wilson-Grau Consultoria em Gestão Empresarial Ltda]
Presenter 1: Ricardo Wilson-Grau [Principal - Ricardo Wilson-Grau Consultoria em Gestão Empresarial Ltda]
Presenter 2: Steff G.M. Deprez [Independent Consultant - Steff Deprez Training & Consultancy]
Presenter 3: Goele Scheers [independent consultant - independent consultant]
Presenter 4: Heidi Schaeffer [Knowledge Management and Learning Lead - Alliance for Healthier Communities ]
Presenter 5: Barbara Klugman [Strategy & evaluation practitioner - Barbara Klugman Concepts PTY Ltd]
Presentation 2 Additional Author: Goele Scheers [independent consultant - independent consultant]
Time: Oct 27, 2016 (08:00 AM - 09:30 AM)
Room: M104

Abstract 1 Title: Introduction to Outcome Harvesting principles in practice
Presentation Abstract 1:

Introduce the six steps of Outcome Harvesting—1) Design the harvest, 2) Review documentation and draft outcomes, 3) Engage with informants, 4) Substantiate, 5) Analyse and interpret the findings and 6) Support use of findings-- and exemplify the importance of the underlying Outcome Harvesting principles.


Abstract 2 Title: The use of Outcome Harvesting as part of the impact assessment of a cereal value chain project in Mali
Presentation Abstract 2:

This presentation outlines how Outcome Harvesting was used as part of a broader impact assessment of a Cereal Value Chain (CVC) project in Mali (USAID/ Feed the Future). Outcome Harvesting provided an additional layer of analysis on the existing survey data by focusing on changes in practice of the key societal actors influencing the Cereal Value Chain. The Cereal Value Chain Activity is an important component of the Feed the Future (FTF) initiative in Mali and offers a comprehensive approach to increase food security and reduce poverty in the agriculture sector by improving competition in the rice, sorghum and millet value chains and developing better market access for smallholder farmers. The project is designed to raise agricultural productivity, expand markets and trade and increase the resiliency of vulnerable households and communities.


Abstract 3 Title: Harvesting outcomes from a global network dedicated to improving the life of vulnerable children worldwide
Presentation Abstract 3:

Family for Every Child is a global alliance of over 20 local civil society organizations from as many countries working together to improve the life of vulnerable children around the world. The Family for Every Child network aims to ensure that children can grow up in caring families safe from exploitation, trafficking, child labor, early marriage and other forms of abuse. By learning and working together, these organizations have a stronger voice to advocate for children and their families. Outcome Harvesting was used to measure the behavioral changes of actors inside the network (internal outcomes) as well as the behavior of actors outside of the network (external outcomes). Through a highly participatory process, outcomes were harvested in person and virtually from the network’s secretariat as well as the network members. This evaluation formed the basis for the subsequent inclusion of Outcome Harvesting into the M&E system of the network.


Abstract 4 Title: Evaluating Community Belonging in Oxford County, Canada: An Outcome Harvesting Approach
Presentation Abstract 4:

It is hard to evaluate interventions that try to address complex challenges such as improving the quality of life for populations with barriers to the determinants of health. Such a complex multi-stakeholder process was initiated by the Woodstock Community Health Centre, working in partnership with five other organizations to strengthen community belonging, including: Canadian Mental Health Association, Oxford County Branch; Children's Aid Society of Oxford County; Oxford County - Public Health and Emergency Services, Social Planning Council of Oxford and the United Way of Oxford.

This presentation will be an evidence-based story about their Outcome Harvest evaluation and the changes in relationships, practices and policies that are contributing to building wellbeing in Oxford county. As well, the outcome harvest will describe new capacities built in local organizations and groups that contribute to experiences of wellbeing (belonging, trust and inclusion) for community members experiencing barriers to health and wellbeing.


Abstract 5 Title: Using Outcome Harvesting in a mixed methods evaluation of the African Centre for Biodiversity
Presentation Abstract 5:

This presentation considers the advantages and challenges of outcomes harvesting for evaluating organizations’ achievements, effectiveness and organizational capacities. It identifies what kinds of questions outcomes harvesting can answer well, for example illustrating how outcomes harvested over time into ‘outcomes chains’ reveal patterns and processes of change, one of the principles of OH. It simultaneously explores where other evaluation methods can complement findings from OH, and the value of triangulation across methods. The presentation illustrates its argument drawing on findings of a five year retrospective external evaluation using outcomes harvesting alongside social network mapping, interviews and surveys of the African Centre for Biodiversity, a South African based NGO that is generating and enabling networks of farmers and other civil society groups to promote food and seed sovereignty across the continent.


Audience Level: Intermediate

Session Abstract: 

The purpose of this panel is to illustrate how Outcome Harvesting has been customised in four practical applications of the approach, highlighting the principles that guided the effort. It will provide concrete examples to commissioners of evaluations and evaluators of social change and development programs insights into how to design evaluations to ensure their customized use of Outcome Harvesting corresponds to the principles embodied in the approach and thus avoid misusing or disregarding essential elements. 

After a 10 minute introduction to the six steps of the Outcome Harvesting approach, we present in 15 minutes each, four cases of 2015-2016 customized Outcome Harvesting use in evaluating an international child rights network, a USAID cereal value chain project, belonging in a Canadian community, and an African center for promoting bio-diversity in agriculture. In each presentation, in addition to explaining how OH was customized, the underlying principles are highlighted. Questions and answers lasting 20 minutes are foreseen.

 



For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.



Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 3, 2016. Email cancellation requests to registration@eval.org. Fax request to (202) 367-2173. All refunds are processed after the meeting. After October 3, 2016 all sales are final.