Evaluation 2019: Paths to the Future of Evaluation: Contribution, Leadership, and Renewal

View Printable Version

Real World YFE: Implementation Challenges & Opportunities

Session Number: YFE3
Track: Youth Focused Evaluation
Session Type: TIG Multipaper
Session Chair: Julie Poncelet [Independent Evaluation Consultant - Action Evaluation Collaborative]
Presenter 1: Mahkah Wu [Technical Analyst II - Analytics Services, Inc.]
Presenter 2: Amy Grack Nelson [Evaluation & Research Manager - Science Museum of Minnesota]
Presenter 3: Brittany Hite [Senior Associate Evaluator - Claremont Evaluation Center]
Presentation 1 Additional Author: Peggy McCarthy [Principal Analyst - Analytic Services]
Presentation 3 Additional Author: Haley E Umans [Student - Claremont Graduate University]
Presentation 3 Additional Author: Tiffany D Berry [Research Associate Professor - Claremont Graduate University]
Time: Nov 14, 2019 (02:45 PM - 03:30 PM)
Room: Hilton Marquette VI

Abstract 1 Title: Evaluating Violence Prevention Programs- Easier Said than Done!
Presentation Abstract 1:

Violence fueled by extremist ideology is a significant problem that challenges many communities around the world. There are a range of programs addressing this issue being implemented in different communities, but not necessarily based on evidence-based practices. ANSER, and its two community implementing partners, funded by National Institute of Justice, presents a study reporting the evaluation of a positive youth development program implemented in two high schools in Maryland. The study was designed to assess the program performance, and also generate a replication and evaluation framework to help other researchers and practitioners working in violence prevention. This paper will provide a holistic view into our experience and the steps used to implement and evaluate such a program. We will share our journey, related challenges (including the ones that directly flow from the evaluation effort itself) and how we had to modify our evaluation design to actually continue implementing the program.

Abstract 2 Title: Measuring teamwork skills in out-of-school time settings
Presentation Abstract 2:

As 21st century skills become more popular, an increasing number of evaluators are looking for ways to measure these skills in out-of-school time (OST) programs. However, few instruments exist for evaluators to adequately measure OST programs’ impact on these outcomes and the literature lacks detailed definitions of many of these skills. A key 21st century skill addressed by many OST programs is teamwork. The Youth Teamwork Skills Survey is a tool that evaluators can be confident will gather reliable data, has adequate validity evidence for use with OST programs, is grounded in what actually occurs in these programs, and provides data that a wide range of programs will find useful. This presentation will describe the development and validation process of the survey, as well as share the results from OST practitioner interviews to operationalize the definitions of teamwork skills within the context of OST programs.   

Abstract 3 Title: Quality on a Budget: Cutting Costs not Quality in Youth Development Evaluations
Presentation Abstract 3:

Conducting high-quality evaluations takes skill and practice but conducting high-quality evaluations on a budget takes a miracle. Organizations most in need of high-quality evaluations as a mechanism to improve programming and impact their communities are the same ones stretched thin in terms of available resources. After years of working with organizations on a tight budget, the facilitators have compiled a list of strategies around evaluation approaches, prioritization of needs, and utilization of resources to improve evaluation quality when working with organizations who have less resources to spare. Attendees will walk away from this session with tangible techniques to work within a budget while providing the quality evaluations organizations and communities deserve.

Audience Level: All Audiences

Session Abstract (150 words): 

Real World YFE: Implementation Challenges & Opportunities

For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.

Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 11, 2019. Email cancellation requests to registration@eval.org. All refunds are processed after the meeting. After October 11, 2019 all sales are final. For Evaluation 2019, international attendees and presenters who encounter complications due to the international travel environment will have up to 30 days after the event to request a refund and submit appropriate documentation. No administrative fee will apply for approved international requests.