Design Considerations When an Intervention Refuses to Sit Still

Session Number: 1548
Track: PreK-12 Educational Evaluation
Session Type: Panel
Tags: Pre-K 12 Evaluation
Session Chair: Jennifer Bagnell Stuart [Associate - Abt Associates]
Discussant: Beth Gamse [Abt Associates Inc]
Presenter 1: Diana Epstein [Corporation for National and Community Service]
Presentation 1 Additional Author: Jennifer Bagnell Stuart [Associate - Abt Associates]
Time: Oct 27, 2016 (04:45 PM - 06:15 PM)
Room: International South 10

Abstract 1 Title: Design Considerations When an Intervention Refuses to Sit Still
Presentation Abstract 1:

This panel will discuss the methodological challenges and practical considerations of designing and implementing a comparative research design in rapidly changing school contexts. The Corporation for National and Community Service (CNCS), in partnership with the Department of Education (ED), launched the School Turnaround AmeriCorps program in 2013; the program supports placement of AmeriCorps members in low-performing K-12 schools. After CNCS commissioned an independent evaluation of the program, changing school contexts led to a shift from a quasi-experimental design to a comparative case study design midway through the evaluation's first year. In this panel presentation, CNCS and ED staff, selected grantees, and the evaluator will describe the study purpose, implementation experiences, and the initial and subsequent study designs, and the discussant will moderate a discussion about the trade-offs between study design and feasibility in fluid school/district contexts. Target audiences include evaluators, policy makers, education agencies, and school reform practitioners.


Presentation 1 Other Authors: CNCS requires additional time to review and discuss which grantee representatives will participate as presenters. The School Turnaround AmeriCorps program has 13 grantee programs operating across the country. The Department of Education presenter is also not known at this time.
Audience Level: Intermediate

Session Abstract: 

This panel will discuss the methodological challenges and practical considerations of designing and implementing a comparative research design in rapidly changing school contexts. The Corporation for National and Community Service (CNCS), in partnership with the Department of Education (ED), launched the School Turnaround AmeriCorps program in 2013; the program supports placement of AmeriCorps members in low-performing K-12 schools. After CNCS commissioned an independent evaluation of the program, changing school contexts led to a shift from a quasi-experimental design to a comparative case study design midway through the evaluation's first year. In this panel presentation, CNCS and ED staff, selected grantees, and the evaluator will describe the study purpose, implementation experiences, and the initial and subsequent study designs, and the discussant will moderate a discussion about the trade-offs between study design and feasibility in fluid school/district contexts. Target audiences include evaluators, policy makers, education agencies, and school reform practitioners.