Evaluation 2015: Exemplary Evaluations in a Multicultural World

View Printable Version

Building Capacity for Organizational Learning and Development

Session Number: OLECB4
Track: Organizational Learning & Evaluation Capacity Building
Session Type: Multipaper
Session Chair: Eden Kyse [Montclair State University]
Presenter 1: Btissam El Hassar
Presenter 2: Imelda Castaneda-Emenaker [University of Cincinnati]
Presenter 3: Jacob Laden [USAID LEARN at Dexis Consulting]
Presenter 4: Claudia Kornahrens [GIZ]
Presentation 1 Additional Author: Cheryl Poth [Associate Professor - University of Alberta]
Presentation 1 Additional Author: Rebecca Gokiert [University of Alberta]
Presentation 2 Additional Author: Kathie Maynard [University of Cincinnati]
Time: Nov 12, 2015 (04:45 PM - 06:15 PM)
Room: Addams

Abstract 1 Title: Towards Culturally Responsive Approaches to Evaluation Capacity Building Using an Iterative Process
Presentation Abstract 1: Research identifying components of culturally (i.e., organizational and contextual) responsive evaluation capacity building (ECB) frameworks is ongoing. In a departure from typical retrospective approaches, we forward an iterative procedure for developing an organization-level ECB framework. Our procedures involved conducting a literature review, consulting stakeholders representing diverse perspectives (e.g., community organizations, government agencies), undertaking an expert review, and finally developing and validating an instrument for testing the framework. This study was implemented as part of a project that aims to establish provincial multidisciplinary and intersectoral partnership, in the Canadian context in the field of early childhood development (ECD). The goal of the partnership was to develop evaluation capacity that is responsive to stakeholders' needs, and appropriate to their organizational context and culture. Our presentation will describe the development and components of the framework, and illuminate the lessons learned.
Abstract 2 Title: Promoting the Development of the Collaborative's Eco-System: Striving for Culturally Relevant Program Evaluation
Presentation Abstract 2: This presentation highlights the developmental evaluation journey of a collaborative working to promote STEM education and the development of workforce within a regional, multi-sectoral, and multi-cultural context of a Midwestern region in the United States. The evaluator, together with the collaborative leadership, continue to learn about the nature and growth of its programs and the "growing wonders" of involvement of the different stakeholders - promoting the development of the learning community, instituting the feedback loop as a systemic process, involving the stakeholders in an on-going evaluative journey. With evaluation capacity building, the personnel became more attuned to the dynamic aspects of evaluation. More and more, the collaborative is recognizing its eco-system and is striving to be more culturally relevant in instituting its growing initiatives to promote a collective impact meant to grow and sustain initiatives for the common good of the students in the region and the larger community.
Abstract 3 Title: Learning and Adapting from USAID Evaluations
Presentation Abstract 3: In the context of evaluating international development projects, lessons tend to get lost in reports as hundreds of pages of information are produced without a plan in place for how to apply the knowledge generated by the study. This presentation and paper looks at how evaluation practice can move beyond accountability to focus on learning for course correction and future planning. Several key steps including determining the evaluation's audience and how to reach that audience effectively can greatly improve the chances that recommendations and lessons from the evaluation will be taken into account when making future design decisions. Drawing on the tradition of utilization focused evaluation, this presentation advocates for international development programs to be planned and conducted in ways that enhance evaluation use to improve program effectiveness. The presentation will discuss strategies and cases of USAID programs/Missions that have used evaluation findings to support organizational learning.
Abstract 4 Title: Driving Corporate Change and Management Quality: Lessons from Evaluating Management Practice in International Development
Presentation Abstract 4: <span style="font-family: "Arial","sans-serif"; mso-bidi-theme-font: minor-bidi; mso-ansi-language: EN-US;">GIZ is a German public implementing agency for international development projects. Capacity WORKS is GIZ's tailor-made model for managing international development projects. It adapts EFQM and RBM principles to enhance project success according to the DAC evaluation criteria. GIZ's board requested its evaluation, in order to generate evidence-based recommendations for enhancing management quality. Based on a multi-method design, the evaluation confirmed that the model's systematic use leads to better results of development projects. However, the evaluation illustrates the intricacies of engraining the model in the organization. Areas for improvement included: the role of Capacity WORKS in branding, managerial competency of staff, incentive mechanisms, monitoring systems and leadership for a culture of management quality. A company-wide group tabled recommendations to the board, who adopted a plan of action with far-reaching changes at the organizational level. The presentation will demonstrate how evaluation processes were managed to stimulate use by corporate decision makers.</span></span>
Audience Level: None

Session Abstract: 

Building Capacity for Organizational Learning and Development

For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.

Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 6, 2015. Email cancellation requests to registration@eval.org. Fax request to (202) 367-2173. All refunds are processed after the meeting. After October 6, 2015 all sales are final.