Evaluation 2015: Exemplary Evaluations in a Multicultural World

View Printable Version

Funder and Evaluator Perspectives on Implementing and Evaluating Statewide Efforts to Achieve Comprehensive Community Change

Session Number: 1743
Track: Nonprofit and Foundations
Session Type: Multipaper
Session Chair: Evelyn Yang [Community Science]
Discussant: Lori Fuller [Kate B. Reynolds Charitable Trust]
Presenter 1: Lori Fuller [Kate B. Reynolds Charitable Trust]
Presenter 2: David M Chavis [Community Science]
Presenter 3: Evelyn Yang [Community Science]
Presentation 1 Additional Author: Allen Smart [Vice President, Programs - Kate B. Reynolds Charitable Trust]
Presentation 1 Additional Author: Jehan Benton-Clark [Senior Program Officer - Kate B. Reynolds Charitable Trust]
Presentation 2 Additional Author: Kien S Lee [Principal Associate & Vice President - Community Science]
Presentation 3 Additional Author: Brandon Coffee-Borden [Associate - Community Science]
Presentation 3 Additional Author: Kien S Lee [Principal Associate & Vice President - Community Science]
Presentation 3 Additional Author: Sarya Sok [M&E Specialist - Solidarity Center]
Time: Nov 11, 2015 (06:15 PM - 07:00 PM)
Room: Grand Suite 5

Abstract 1 Title: Implementing Comprehensive Change Efforts: A Funder’s Perspective on Leveraging Resources, Relationships and Supports to Promote Health and Systems Change
Presentation Abstract 1: The Kate B. Reynolds Charitable Trust (the Trust) funded an effort to support the state-wide implementation of a comprehensive community change initiative to address prescription opioid misuse, abuse and overdose (Project Lazarus – a project of Community Care of North Carolina). This initiative incorporates state- and local-level programmatic, systems, policy, and infrastructure changes to reduce access to, demand for, and dangers associated with prescription opioids. This presentation describes the impetus behind the Trust’s desire for an objective assessment to capture lessons learned of the implementation of this effort at the community level. Additionally, the presenter will discuss how the findings from the external evaluation are informing the Trust’s future support of initiatives with similar attributes of utilizing cross-sector collaboration and coalition building; addressing an issue that is multifaceted and concerns people’s personal values; and involving changes in state, local, and organization policies, procedures, practices, as well as community norms.
Abstract 2 Title: Using Cross-Case Study Methods to Evaluate Community Change
Presentation Abstract 2: Case study evaluation often involves a detailed examination of one or more cases – whether individuals, groups, organizations, or communities – to provide an analysis of the context and processes related to an evaluand. However, examining comprehensive community and systems change initiatives across diverse sites adds a significant layer of complexity to case study evaluation. This session will describe cross-case study methodology as a valuable approach to identifying clusters of patterns based on important community characteristics to understand processes and factors critical to achieving key objectives in community change efforts. The presenter will discuss principles for deciding when multiple case study methods are appropriate for evaluation, case selection, choosing appropriate data collection methods, sampling respondents, analyzing and interpreting data, developing findings, and reporting. The presenter will stress the need for evaluators to be clear about the methodological choices they make when using cross-case study methods in the context of evaluation.
Abstract 3 Title: A Cross-Case Study of Six North Carolina Counties’ Work to Address Prescription Opioid Misuse, Abuse, and Overdose
Presentation Abstract 3: To combat the ongoing challenge of prescription opioid misuse, abuse, and overdose in the state of North Carolina, the Kate B. Reynolds Charitable Trust is funding an effort to take a comprehensive community initiative, Project Lazarus – a project of Community Care of North Carolina – to scale in the state. The initiative integrates the development and support of community-based coalitions; training, resources, technical assistance, and education for medical professionals and prescribers; and the collection and analysis of data on key outcome indicators to reduce prescription opioid misuse, abuse, and overdose in communities. This presentation will describe how a cross-case study design was used to understand implementation progress within six communities participating in the initiative. The presentation will also describe findings on how communities mobilized to address the issue, the development and maintenance of community coalitions, cross-sector collaboration and community engagement, and activities implemented to address opioid misuse, abuse, and overdose.
Presentation 3 Other Authors: Rekha Ansari, Community Science, Research Assistant
Audience Level: Intermediate

Session Abstract: 

To combat the ongoing challenge of prescription opioid misuse, abuse, and overdose in the state of North Carolina, the Kate B. Reynolds Charitable Trust (the Trust) funded an effort to take a comprehensive community initiative designed to address prescription opioid issues, to scale in the state. The Trust engaged an external evaluator to identify factors that facilitated or impeded the ability of communities to produce community and systems changes and community conditions that are related to more effective implementation. Cross-case study methodology was used to identify patterns of similarity and difference across communities. This panel presentation describes this complex systems change initiative, the use of an innovative methodology to capture important nuances within and among communities related to effective systems change implementation, and how the findings have been used to inform The Trust’s future strategic efforts to support similar comprehensive community change initiatives. 



For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.



Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 6, 2015. Email cancellation requests to registration@eval.org. Fax request to (202) 367-2173. All refunds are processed after the meeting. After October 6, 2015 all sales are final.