Session Number: HSE2
Track: Human Services Evaluation
Session Type: TIG Multipaper
Session Chair: Mansoor A. F. Kazi [Director Program Evaluation Center - The State University of New York at Fredonia]
Presenter 1: Tara Foti, MPH [Graduate Research Assistant/PhD Student - University of South Florida]
Presenter 2: Luke Heinkel [Senior Program Officer - Results for Development]
Presenter 3: Jessica Smith [Research Associate - IMPAQ International]
Presenter 4: Ryoko Yamaguchi [President - Plus Alpha Research & Consulting]
Presentation 1 Additional Author: Jennifer Marshall [Associate Professor - University of South Florida]
Presentation 3 Additional Author: Zachary Miller [Research Associate - IMPAQ International]
Presentation 4 Additional Author: Bruce Randel [McREL]
Time: Nov 16, 2019 (08:00 AM - 09:00 AM)
Room: CC 101 A
Abstract 1 Title: A Statewide Mixed-Methods Evaluation of Florida’s Healthy Start Coordinated Intake & Referral Using an Implementation Science Framework
Presentation Abstract 1:
A multi-year, statewide Coordinated Intake and Referral (CI&R) implementation evaluation across 23 local Healthy Start coalitions identified relationships between Consolidated Framework for Implementation Research (CFIR) domains at baseline and will identify how they influence CI&R processes and outcomes over time. The mixed-methods evaluation included focus groups, implementation surveys based on CFIR domains, fuzzy set Coincidence Analysis (fsCNA), and social network analysis (PARTNER). Baseline focus groups revealed both support (belief that CI&R is important, will improve family services, generally positive attitudes/commitment) and concerns (contractual obligations, external pressure, unpreparedness regarding CI&R changes). Three categories of site performance were identified: high CFIR domains; mixed low-high; and mostly low domains with varied individual characteristics. CNA identified two independent routes whereby outer setting and individual characteristics features lead to high functioning CI&R inner settings. This fsCNA solution had nearly perfect consistency (.94) and coverage (.93). PARTNER network variation was not associated with CFIR domains.
Presentation 1 Other Authors: Deborah Cragun, PhD, MS; Takudzwa Sayi, PhD, MS; Oluwatosin Ajisope, MBBS, MPH; Emanuelle Dias, BA; Igbagbosanmi Oredein, MBBS
Abstract 2 Title: Can Parenting Programs Give Children Wings?: Findings from an Impact Evaluation of Parenting Program in Roma Communities in Serbia
Presentation Abstract 2:
Roma communities in Serbia have been disadvantaged for years, but new investments by the government, foundations, and multilaterals are increasing the need for evidence of existing programs that could be scaled to make a difference in child outcomes. Strong from the Start - Dam Len Phaka (Give Them Wings) is a parenting program administered by NGOs within Roma settlements to build parenting skills, but also to build healthy relationships between parents and their children. The endline findings from our quasi-experimental impact evaluation showed a statistically significant correlation between program participation and child school readiness outcomes (particularly socio-emotional development) for children aged 3-6. This presentation shares these promising findings as well as lessons learned from two years evaluating a marginalized and underrepresented group.
Abstract 3 Title: Career Jump Start: Innovating and Adapting to Serve Job-seekers with Multiple Barriers to Employment
Presentation Abstract 3:
We present our findings from an implementation and outcome evaluation of Career Jump Start, an ambitious, 5-year demonstration program in Northwest Pennsylvania that combined barrier-reduction services and occupational skills training for job seekers with multiple barriers to employment (e.g., returning citizens, individuals with disabilities, the long-term unemployed, low-literacy individuals, single-parents). Career Jump Start was designed to prepare these job seekers for in-demand, entry-level jobs in the region. The evaluation team partnered with the program from start-up to carefully trace the program evolution. Our research highlights the innovations and adaptations Career Jump Start made to address key challenges and improve the program over its duration. We also highlight lessons learned and successes. We discuss how this and other similar evaluation practices can support informed and productive conversations on the best program models to address important societal challenges in the workforce system, and beyond.
Abstract 4 Title: Court-mandated parent education program to support children of divorce: Results from a longitudinal evaluation
Presentation Abstract 4:
This paper showcases the results of an on-line parent education program, where parents are mandated by the court to take the course as part of their divorce proceedings. Across the country, there are very few evidence-based programs for parent education focused on divorce even though state court systems require them. This evaluation builds the evidence-base by using a population of parents who took an on-line parent education course to measure change over time in parent knowledge associated with positive parenting skills and behaviors. The paper also discusses methodological challenges and best practices learned during the study, such as evaluation design (e.g., comparison groups, program logic model, internal versus external validity), data collection (e.g., confidentiality, response rate), and analysis (e.g., subgroup analysis).
Audience Level: All Audiences
Session Abstract (150 words):
Path to the future in Human services