Evaluation 2017: From Learning to Action

View Printable Version

Using M&E data to evaluate the impacts of an integrated and holistic international development model

Session Number: 1580
Track: International and Cross Cultural Evaluation
Session Type: Panel
Session Chair: Veronica M Olazabal [Director, Measurement, Evaluation and Organizational Performance - The Rockefeller Foundation]
Presenter 1: Julie Carandang [Program Strategic Advisor - Nuru International]
Presenter 2: Ashweeta Patnaik [Research Associate - Ray Marshall Center, The University of Texas at Austin]
Presenter 3: Julie Carandang [Program Strategic Advisor - Nuru International]
Presenter 4: Heath Prince, Director and Research Scientist [Director and Research Scientist - University of Texas, Austin; LBJ School of Public Affairs; Ray Marshall Center]
Time: Nov 10, 2017 (05:30 PM - 06:15 PM)
Room: Roosevelt 1

Abstract 1 Title: Data collection for Monitoring & Evaluation (M& E)
Presentation Abstract 1:

Nuru’s Monitoring and Evaluation (M&E) team conducts annual reviews of progress toward impact goals for Nuru’s four programs (Agriculture, Financial Inclusion, Healthcare, and Education) by annually surveying households receiving the interventions (treatment cohorts) as well as households not receiving the interventions (comparison cohort). Surveys include an agriculture survey that measures crop yields, food security, agriculture income, household production and household hunger; a financial inclusion survey that measures savings and loans behavior, access to financial services and coping with shocks; a healthcare survey that measures the adoption of ten healthy behaviors related to maternal and child health, safe water, sanitation and malaria prevention; an education survey that measures child literacy; and a poverty survey that measure multiple dimensions of poverty. In this presentation, Nuru M &E representatives will discuss their survey methodology (including survey design, sampling frame, and cohort creation); challenges in data collection; and, lessons learned and applied.

Abstract 2 Title: Assessing individual and holistic program impacts using Monitoring & Evaluation (M& E) data
Presentation Abstract 2:

Researchers at the Ray Marshall Center (RMC) have completed preliminary outcomes analyses of Nuru’s Agriculture, Financial Inclusion, Healthcare, and Education programs in Ethiopia by analyzing data collected from the five household surveys (agriculture, financial inclusion, healthcare, education and MPI) administered to Nuru’s treatment and comparison cohorts at baseline and follow-up. Researchers have studied (1) change in outcomes from baseline to follow-up for the different cohorts; (2) change in outcomes for treatment cohorts compared to change in in outcomes for the comparison cohort; and, (3) change in outcomes at an individual or household level (using matched households that were surveyed at both baseline and follow-up). Researchers have constructed the Multi Poverty Index (MPI) for surveyed households, and are studying changes in the MPI to quantify the impact of Nuru’s integrated model. In this presentation, RMC representatives will discuss their analytical approaches; key findings; challenges in data analysis; and, lessons learned.

Abstract 3 Title: Using Monitoring & Evaluation (M&E) data for continuous improvement
Presentation Abstract 3:

Nuru’s Monitoring and Evaluation (M&E) team produces useful and relevant information that can contribute to key decision - making about Nuru’s programs (e.g. whether to continue, replicate and/or scale an intervention). This focus on utilization is at the center of Nuru’s M&E strategy. In this presentation, Nuru M &E representatives will share how findings from the impact assessments of Nurus’ four programs are used to make decisions about the implementation of Nuru’s programs; identify programmatic or operating problems; advance organizational learning and knowledge-sharing for future programming; highlight and promote accomplishments and achievements; and, mobilize resources.


Abstract 4 Title: Using the MPI to study the impact of an integrated and holistic international development model
Presentation Abstract 4:

This presentation will cover next steps in the evaluation, including the construct of a household multi poverty index (MPI) to study the impact of Nuru’s integrated model and holistic approach on household well-being. The panel will connect their work with the wider policy context in which non-governmental organizations are seeking evidence of effectiveness. .

Theme: Learning What Works and Why
Audience Level: All Audiences

Session Abstract (150 words): 

As the development world explores integrated solutions to poverty, evaluators are challenged to find ways to measure integrated impact. Nuru International and the Ray Marshall Center (RMC) present their experience with building a study design to assess an integrated model, analyzing the yearly results, and applying the data to adapt programs in Kenya and Ethiopia. During the panel discussion, Nuru will discuss the design, methodology, and implementation of its four programs in Agriculture, Financial Inclusion, Healthcare, and Education. RMC will discuss the analytical approaches and initial findings from the evaluation. Next, Nuru will talk through the application of the evaluation results for continuous improvement. Finally, the panel will discuss the next steps in the evaluation, including the construct of a household’s Multi Poverty Index (MPI) to study the impact of Nuru’s integrated model and holistic approach on household well-being.

For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.

Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 16, 2017. Email cancellation requests to registration@eval.org. Fax request to (202) 367-2173. All refunds are processed after the meeting. After October 16, 2017 all sales are final. For Evaluation 2017, international attendees and presenters who encounter complications due to the international travel environment will have up to 30 days after the event to request a refund and submit appropriate documentation. No administrative fee will apply for the international requests. The $50 fee will be waived for registrants who planned to travel into the US and experienced international travel issues.