Innovations in the Design of ECB Initiatives

Session Number: OLECB2
Track: Organizational Learning & Evaluation Capacity Building
Session Type: Multipaper
Session Chair: Gwynne Ellen Morrissey [Collaborative for Educational Services]
Presenter 1: Kassandra Ann Alia [University of South Carolina]
Presenter 2: Shannon Edward Coulter [San Diego County Office of Education]
Presenter 3: Chris Y. Lovato [University of British Columbia]
Presentation 1 Additional Author: Abraham Wandersman [Professor - University of South Carolina]
Presentation 1 Additional Author: Marilyn L. Ray [Executive Director - Finger Lakes Law & Soc. Pol. Ctr.]
Presentation 1 Additional Author: Andrea Lamont, PhD [Postdoctoral fellow; Consultant - University of South Carolina]
Presentation 2 Additional Author: Todd Langager [Program Evaluation Coordinator - San Diego County Office of Education]
Presentation 3 Additional Author: Kylie Hutchinson [Principal - Community Solutions Planning & Evaluation]
Presentation 3 Additional Author: Ali Boyle [University of British Columbia]
Time: Nov 11, 2015 (06:15 PM - 07:00 PM)
Room: Plaza A

Abstract 1 Title: Getting To Outcomes Contracting (GTOC): A Novel Approach to Building Evaluation Capacity for Funders and Provider Organizations using Outcomes-Oriented Contracting
Presentation Abstract 1: In recent years, there has been increasing support for use of outcomes-oriented (versus traditional fee-for-service) contracting as a technique for holding healthcare and social service programs accountable for the services they provide. In order for outcomes-oriented contracts to be successful, funding organizations need the capacity to develop and monitor contracts that focus on outcomes. Furthermore, buy-in from service providers for evaluating outcomes needs to be addressed. The purpose of this presentation is to describe the use of Getting To Outcomes Contracting (GTOC) as a novel approach for building funder and provider evaluation capacity for planning, implementing, evaluating and sustaining evidence-based services within the Philadelphia Department of Behavioral Health and Intellectual disAbilities Services (DBHIDS). Strategies implemented in the procurement (development of request for proposals, proposal review, contracting) and monitoring stages of an initiative will be discussed along with the formative, mixed methods evaluation plan used to assess delivery of GTOC.
Presentation 1 Other Authors: Gordon Hannah, PhD, gordonjhannah@gmail.com
Ronnie Rubin, PhD, ronnie.rubin@phila.gov
Abstract 2 Title: Engaging Teachers in Program Evaluation and Decision Making
Presentation Abstract 2: <span><span>Involving stakeholders in both evaluation and decision making has never been more important. By involving key stakeholders in the decision making process, we make organizational actions more transparent while improving the organization's capabilities to monitor and measure its own effectiveness. In this capacity building work, we wrote a semi-fictional story that reflected the major findings from a large scale literacy evaluation. We engaged teachers with the story and questions that asked them to analyze the story, their professional practice, and propose actions that would close the gap between the reality presented in the story and an ideal literacy program. We compiled these actions into a district wide action plan, presented the plan to teachers, and asked them to reflect on both the plan and process. Our findings suggested that the case story method improved teachers' perceptions of evaluation, built organizational capacity to solve problems, and increased the likelihood of successfully implementing actions.</span></span>
Abstract 3 Title: Mobile Learning in Evaluation for Senior Decision-makers: Evaluation of an Innovative Capacity-Building Initiative
Presentation Abstract 3: Capacity-building in evaluation tends to focus on program-level staff and managers, ignoring the key role that senior leaders also play in using evaluation for making better decisions. However, informed decision-making and evidence-informed practice depend on senior decision-makers having a full understanding and appreciation of evaluation. How can we best maximize their use of evaluation in planning and decision-making while also capturing the attention of these extremely busy individuals? This session will present on the evaluation of a unique tablet-based mobile learning designed specifically for senior health leaders that incorporates elements of personalization and interactive gamification. We will report evaluation findings around usability, stakeholder preferences and use, and early indicators of the effectiveness of mobile learning as an evaluation capacity-building tool.
Audience Level: None

Session Abstract: 

Innovations in the design of ECB initiatives