Systems informed evaluations. Insights from case studies in philantropy, health, agriculture, and evaluation systems

Session Number: SE2
Track: Systems in Evaluation
Session Type: TIG Multipaper
Session Chair: Royce Jan Holladay, Human Systems Dynamics Institute [Director, Services - Human Systems Dynamics Institute]
Presenter 1: Shamam Kabir, Khan, Manager [Manager Monitoring & Evaluation - Agha Khan Development Network ]
Presenter 2: Iffat Ara, Manager [Expert- Innovation and Quality Management (Monitoring and Results Measurement), iDE - iDE Bangladesh ]
Presenter 4: Ian David Moss [CEO - Knowledge Empower]
Presentation 4 Additional Author: Elizabeth Ruedy [Democracy Fund]
Time: Nov 15, 2019 (08:00 AM - 09:00 AM)
Room: CC M100 B

Abstract 1 Title: Evaluations with local contexts through social and cultural lens
Presentation Abstract 1:

The international evaluation associations are bringing in various regional practices, innovating and introducing new definitions and explanations. In Pakistan, the evaluation systems are evolving and a major consideration remains to implement the outcomes of these evaluation systems. Little has been written about how culturally contextualized evaluation enhances the effectiveness and ownership of the results of any given evaluation process. Therefore, this piece of work sheds light on best practices of evaluation which are undertaken by the authors in the global south in particular Gilgit Baltistan,Khyber-Pakhtunkhwa and Sindh province of Pakistan. Constant analysis within local setups and consideration of socio-cultural constraints and environments are crucial in reforming evaluation systems. The author attempts to present opportunities, ways, techniques, professional and personal capacities within socio economic and cultural context, through which global best practices of evaluation, can be molded socio-culturally and given a coherent form to yield maximum output.

Abstract 2 Title: Measuring Systemic Change in Agricultural Mechanization Markets in Bangladesh
Presentation Abstract 2:

This paper provides findings from using two tools to measure the systemic change in an agricultural mechanization value chain from 2013 to early 2018 in USAID funded CSISA-MI (Cereal Systems Initiative for South Asia- Mechanization and Irrigation) within Bangladesh. The Springfield Centre Adopt-Adapt-Expand-Respond Framework measures 'pro-poor change' within a market system into four distinct components that each serve to describe market player ownership over, and responsiveness to, behaviour and practice changes at different levels. In addition, in order to measure impact level systems change an extended version of the DCED (Donor Committee for Enterprise Development) assessing systemic change indicators was also used.  This paper discusses how both frameworks are used to measure systemic change in agriculture mechanization in Bangladesh. The session will reflect on lessons learned for others to adapt these frameworks to their own systems change evaluation.

Abstract 4 Title: What We Talk About When We Talk About Risk
Presentation Abstract 4:

Philanthropic organizations typically operate in highly complex, often tumultuous environments, making it difficult to predict and understand the eventual impact of grantmaking strategies. Yet foundations, governments, and other social sector actors need to make decisions about the allocation of scarce resources anyway. How can we make effective use of information (including evaluation findings) for decision-making and risk management even as we recognize that life offers us no guarantees? Drawing on the firsthand experiences of the Strategy, Impact, and Learning team at Democracy Fund, this session examines the discipline of risk management through a broader lens of decision-making and explores how philanthropic organizations can prepare themselves to take well-informed, savvy risks in complex system environments.

Audience Level: All Audiences

Session Abstract (150 words): 

Systems informed evaluations. Insights from case studies in philantropy, health, agriculture, and evaluation systems