Evaluation 2018: Speaking Truth to Power

View Printable Version

Innovative Methods in Youth Focused Evaluation

Session Number: YFE2
Track: Youth Focused Evaluation
Session Type: TIG Multipaper
Session Chair: Cassandra Jessee [Director, YouthPower Learning - International Center for Research on Women]
Presenter 1: Colleen Keilty [Monitoring and Evaluation Advisor - Plan International Canada]
Presenter 2: Timothy Ryan Duckett [Research Associate - Grant Fundamentals, LLC]
Presenter 3: Denise Hartsock [Project Manager - Kaiser Permanente]
Presenter 4: Jessica Sperling [Lead, Evaluation & Engagement - Duke University, Social Science Research Institute]
Presentation 2 Additional Author: Gale A Mentzer [Partner and Director - Grant Fundamentals, LLC & Acumen Research and Evaluation, LLC]
Presentation 3 Additional Author: Carmen Luna [Kaiser Permanente]
Presentation 3 Additional Author: Cheryl Kelly [Evaluation Investigator - Kaiser Permanente Colorado]
Presentation 4 Additional Author: Megan Gray [Program Associate - Duke University]
Time: Nov 02, 2018 (02:15 PM - 03:15 PM)
Room: CC - 5

Abstract 1 Title: Innovative Methods in Youth-Focused Sexual and Reproductive Health Evaluation: Lessons Learned From Audio Computer-Assisted Self Interview Surveys in Bangladesh
Presentation Abstract 1:

Born On Time is a public-private partnership for the prevention of preterm birth, implemented in rural Bangladesh (as well as two other countries). Given high rates of early marriage, teenage pregnancy and newborn death, a contextual understanding of prevailing contraception risk factors is critical to effective interventions for adolescent populations in this context. To address a paucity of data on sexual and reproductive health knowledge and practices among adolescents who are unmarried and/or under 15 years, and to mitigate challenges in under-reporting by this population, an Audio Computer-Assisted Self-Interview survey was conducted with unmarried adolescent girls and boys, ages 13 – 18 years. This session will present key considerations for survey design on this highly sensitive topic with this vulnerable population (literacy and numeracy levels, age, gender, and culture); and best practices and lessons learned from this study, including reflections on the use of Audio Computer-Assisted Self Interview methods from enumerators and respondents alike.


Abstract 2 Title: From the mouths of children: A Qualitative evaluation of the positive power of group mentoring at the Boys and Girls Club of America
Presentation Abstract 2:

Mentoring provides benefits to youth who ordinarily have limited exposure to positive relationships with adults although evidence of the positive impacts have often been either marginal or inconsistent due to both the abundance of mentoring models and variance in program design and implementation. This presentation examines the contributions group mentoring made to youth development as relayed from the perspective of the mentees—members of the Boys & Girls Club of America. Findings from a four year in-depth case study of 19 Clubs, and findings from interviews with nearly 200 youth are shared. Analysis of responses used a phenomenological approach that identified coding themes related to mentoring best practices. Mentee interviews attest to the profound impact of the Clubs and mentors, and abound with appreciation for the leadership, citizenship, educational, and interpersonal skills they developed as a result of the mentoring programs and through the example of the mentors.


Abstract 3 Title: Development and Implementation of a Multi-Coalition Statewide Youth Survey – Lessons Learned
Presentation Abstract 3:

Evaluators often must develop and implement methods that have a broad geographic reach and that capture impact of programs that have varied activities. Surveys are one method that can be used to address this challenge. The PiER Center is currently conducting a cross-site evaluation of multiple coalitions across Colorado working to get youth and their families to spend more time outdoors.  The coalitions are providing programs for youth to experience the outdoors and offering pathways for kids to gain leadership skills and experience. One specific aim of the cross-site evaluation is to capture change in youth attitudes related to the outdoors and time spent outdoors. This presentation will describe the process used to develop and implement a youth survey (ages 12-25) across fifteen coalitions and will address the various challenges and lessons learned associated with meeting the funder’s expectations and the diversity in coalition’s geographic location and program activities.   


Abstract 4 Title: Methodological Directions in Evaluation of an Appalachian Girls’ Out-of-School Program: Comparing True and Retrospective Baseline Assessments, and Incorporating Mixed Methods
Presentation Abstract 4:

The Partnership for Appalachian Girls’ Education (PAGE) provides out-of-school mentoring, digital storytelling experiences, and literature programming for middle school girls in Appalachian North Carolina. Since its 2010 founding, it has served over 250 participants; in partnership with the local public school district, it has become an integral part of its rural mountain community. Beginning in 2016, Duke University partnered with PAGE to foster evaluation-based learning. This presentation focuses on two specific 2017 methodological directions that emerged from earlier evaluation challenges. First, based on previous challenges assessing pre/post change, we implemented two forms of baseline assessment; we collected “true pre” data at the program start, as well as a “retrospective pre” data at program close, and we assessed their relation to a parallel-structured post-program assessment. In addition, we initiated qualitative data collection with program alumni. We discuss how these steps facilitated meaningful data that reflected youth voices and informed program direction. 


Audience Level: All Audiences

Session Abstract (150 words): 

Innovative Methods in Youth Focused Evaluation



For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.



Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 8, 2018. Email cancellation requests to registration@eval.org. All refunds are processed after the meeting. After October 8, 2018 all sales are final. For Evaluation 2018, international attendees and presenters who encounter complications due to the international travel environment will have up to 30 days after the event to request a refund and submit appropriate documentation. No administrative fee will apply for the international requests.