Evaluation 2017: From Learning to Action

View Printable Version

Learning from Evaluation Data: Interpreting and Tailoring Findings for Multiple Stakeholders

Session Number: 1547
Track: Use and Influence of Evaluation
Session Type: Panel
Tags: Dissemination, evaluation reporting, evaluation use, Feedback loops, Informing stakeholders, Opioids, Tailoring findings
Session Chair: Kari Cruz [Behavioral Scientist - National Center for Injury Prevention and Control, Centers for Disease Control and Prevention ]
Presenter 1: Kerry Zaleski, MPH [Evaluation Consultant - UW-Madison School of Medicine and Public Health]
Presenter 2: Kathryn Lowerre [Evaluator - Epidemiology and Response Division, NM Dept. of Health]
Presenter 3: Kelly K. Gurka [Assistant Professor - University of Florida]
Time: Nov 10, 2017 (03:30 PM - 04:15 PM)
Room: Maryland C

Abstract 1 Title: Creating Feedback Loops to Link Evaluation Findings to Policy and On-going Program Development
Presentation Abstract 1:

This presentation will describe a system put in place to reflect, track progress and collectively make sense of data from local efforts under the CDC-funded Prescription Drug Overdose Prevention for States grant. Through this process, the program team meets face-to-face with partners on a regular basis to discuss key activities, how data has informed those activities, and resulting outcomes. By asking evaluative questions, the team is able to identify emerging issues, lessons learned about effective principles and promising practices, barriers to quality programming and ideas for overcoming program challenges. Information from these meetings is shared through rapid feedback loops to inform other areas of the grant, which uses multiple strategies to address the opioid epidemic. An example will be shared from a regional assessment of Emergency Department (ED) doctors, describing how findings were used to inform ED practices and insurance coverage policies in Wisconsin.

Abstract 2 Title: Evaluating Changes in Programs and Policies around Prescription Drug Monitoring with Multi-Level Stakeholders in New Mexico
Presentation Abstract 2:

Evaluation efforts funded by CDC’s PfS initiative in New Mexico (NM) involve a complex web of stakeholders and organizations encompassing community action groups and health councils, professional licensing boards, clinics and hospital systems, managed care organizations, local law enforcement, and various state agencies. This presentation will briefly outline the players involved in the ongoing evaluation of an important 2016 policy change and related program development: the passage of NM Senate Bill 263 mandating use of NM’s Prescription Monitoring Program by providers and the Board of Pharmacy’s implementation of Prescriber Feedback Reports. I will address the tools and methods used to collect, interpret, and disseminate evaluation findings including input from stakeholders at all levels from individual healthcare providers to a statewide advisory council with members appointed by the governor, and the successes and challenges encountered in providing valid and timely assessments that will be used.

Abstract 3 Title: Informing Quality Improvement of an Insurance-Based Overdose Prevention Program through Process Evaluation
Presentation Abstract 3:

The evaluation team is charged with program and/or policy evaluation for multiple strategies employed in the West Virginia Prescription Drug Overdose: Prevention for States (PfS) cooperative agreement. One strategy, an insurance mechanism to improve opioid prescribing safety and effectiveness for pain, is being developed, implemented, and evaluated through PfS. This panel will illustrate through examples how the evaluation team collaborates with the Safe and Effective Management of Pain Program (SEMPP) team, catalyzing program improvements through process evaluation. The methods by which the evaluation team communicates with, evaluates the work of, and advises the SEMPP team will be described, emphasizing communication and feedback. These methods have afforded opportunities for the program to make change in nearly real-time, facilitating evaluation of and instituting changes to program operations of SEMPP. Evaluation efforts are considerate of future opportunities to scale up the program should its safety and effectiveness be demonstrated through PfS.

Presentation 3 Other Authors: Emily Vasile, MPAff; Herbert I. Linn, MS; Mark K. Garofoli, PharmD, MBA, BCGP
Theme: Learning About Evaluation Use and Users
Audience Level: All Audiences

Session Abstract (150 words): 

Evaluators are increasingly asked to evaluate programs and policies to address emerging public health issues, such as prescription drug overdose. These highly visible and pressing problems call for a rapid scale-up of initiatives. Evaluators are often under pressure to provide data and evaluation findings to fit a range of stakeholders for a variety of purposes. Evaluators often use a set of tools to engage stakeholders, like sense making and other participatory practices, to interpret evaluation data and determine findings to meet their needs. This presentation will highlight evaluation efforts in three states, funded by the Centers for Disease Control and Preventions’ Prescription Drug Overdose Prevention for States program.  In each presentation the evaluators will describe how they engaged their stakeholders to interpret evaluation data and tailor findings to inform a variety of stakeholder needs.  State evaluators will highlight their successes, barriers, and lessons learned throughout this process.

For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.

Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 16, 2017. Email cancellation requests to registration@eval.org. Fax request to (202) 367-2173. All refunds are processed after the meeting. After October 16, 2017 all sales are final. For Evaluation 2017, international attendees and presenters who encounter complications due to the international travel environment will have up to 30 days after the event to request a refund and submit appropriate documentation. No administrative fee will apply for the international requests. The $50 fee will be waived for registrants who planned to travel into the US and experienced international travel issues.