Implementation Strategies for Fidelity-Measuring Tools in Preventative Family and Child Welfare Programs

Session Number: 1173
Track: Cluster, Multi-site and Multi-level Evaluation
Session Type: Roundtable
Tags: accelerating evaluation theory, practice, adaptive evaluation, child abuse and neglect prevention, Child Care Systems, child welfare, cluster, multi-site and multi-level eval, Fidelity Assessments, High Fidelity Wraparound, implementation, Survey Methodology, WFI-EZ
First Author or Discussion Group Leader: Jessica Tufte [Senior Evaluation Associate - CCNY, Inc.]
Second Author or Discussion Group Leader: Meghan Santiago Harris [Evaluation Associate - Community Connections of NY]
Third Author or Discussion Group Leader: Sandra Sheppard [Evaluation Associate]
Time: Nov 16, 2019 (11:15 AM - 12:00 PM)
Room: Hilton Symphony I

Audience Level: All Audiences

Session Abstract (150 words): 

A nonprofit/consultant evaluation organization in Erie County, NY implemented and collected WFI-EZ (Wraparound Fidelity Index-EZ) surveys via three High Fidelity Wraparound (HFW) Care Coordination Agencies (CCAs) using a random stratified sample. After a literature review, evaluators engaged with the CCAs to encourage awareness and positive message framing around the surveying. Then the evaluation organization sent clients and team members paper surveys, while vendors and facilitators were emailed online survey links for completion. Response rates will be finalized before fall 2019.

Discussion questions:

  • What other evaluation methods/tools have attendees used to measure the fidelity of Evidence-based Interventions (EBIs)?
  • What challenges or successes occurred during these evaluations? What strategies helped overcome challenges? (Examples of challenges include follow-up, response rates, stakeholder buy-in, client engagement, etc.)
  • What are some strategies to engage stakeholders from all levels of an evaluation? Stakeholders may include the survey participants/community members, CCAs, other evaluators, or government funders.