Evaluation 2017: From Learning to Action

View Printable Version

Encouraging Engagement and Use: Supplementing Traditional Data Collection and Reporting

Session Number: PREK125
Track: PreK-12 Educational Evaluation
Session Type: TIG Multipaper
Session Chair: Dana Linnell Wanzer [Research and Evaluation Associate - Claremont Graduate University]
Discussant: Michaele Webb [Syracuse University]
Presenter 1: Yin Burgess [Office of Program Evaluation]
Presenter 2: Sahjabin Kabir, Junior Consultant [Environment, Climate and Disaster Management Circle - Dhaka North City Corporation]
Presenter 4: Bradley Rogers [Research Assistant - University of South Carolina]
Presentation 1 Additional Author: Ashlee A Lewis [Research Assistant Professor - University of South Carolina]
Presentation 1 Additional Author: Ning Jiang [Research assistant]
Presentation 2 Additional Author: Papon Kumar Dev, PhD Student [Academic and Research Associate - Technical University Berlin Campus El Gouna]
Presentation 4 Additional Author: Dawn Coleman [University of South Carolina]
Presentation 4 Additional Author: Constance W. Shepard [Research Associate - University of South Carolina]
Presentation 4 Additional Author: Ashlee A Lewis [Research Assistant Professor - University of South Carolina]
Time: Nov 11, 2017 (08:00 AM - 09:00 AM)
Room: Washington 2

Abstract 1 Title: Increasing Stakeholder Use of Assessment Data through Improved Reporting
Presentation Abstract 1:

Assessment results are routinely reported to administrators, teachers, parents, and students to provide information on the performance of entire programs or individual test takers.  Recent research on score reporting has shown growing concerns about misinterpretation and misuse of large-scale assessment results (Goodman & Hambleton, 2004).  In this presentation, evaluators will share improvements made to data reporting on a statewide arts assessment and describe how the changes in reporting made an impact on educators’ understanding and interpretation of results.  The presenters will share the process they used to make major revisions to an annual school report card.  The presenters will also collect feedback from educators in order to identify which improvements had the greatest impact on teachers’ understanding of their students’ assessment results.  This presentation will be informative for those interested in exploring best practices for organizing and reporting assessment data to meet the needs of a variety of intended audiences.

Abstract 2 Title: Early Care, Education and Child Development: A Case Study on 'Deyalkotha' Project
Presentation Abstract 2:

Deyalkotha is a project in which public space is designed predominately for slum and footpath children as an interactive learning platform. This innovative approach upholds a learning toolkit by which children and young kids will learn through entertainment rather than traditional memorisation of A for Apple, D for Dog etc. It broadcasts the inclusion of subject matters beyond the text books like lessons of trustworthiness, citizenship, leadership, responsibility, mutual sharing etc. In Bangladesh, the portfolio of early childhood development is not matured. There are only limited numbers of public & private schools available (hardly reached) which nurture 1-2 years of pre-primary education. This bottleneck accelerates the development of an exceptional curriculum to educate the children modelling the learning pedestal into paying station, cultural dais, cinema hall, drawing canvas, creative gallery and economic breeding space. This paper attempts to evaluate the contemporary practices in early childhood development and its contrast with Deyalkotha project. 

Presentation Abstract 3:

Educators in positions with formal or informal authority have more opportunity to leverage, regulate, and guide reform efforts (Park, Daly, & Guerra, 2012). Likewise, the long established role of a district central office in supporting and bringing about change in education highlights the implications of decision-making by district leaders (Farley-Ripple, 2012). Although research on the decision-making process by district leaders is only beginning to emerge the focus on research-based evidence in decision-making continues to escalate; requiring the examination of factors that lead to policy and practice to connect research use, decision-making, and the potential for educational change (Farley-Ripple). District leaders in their positions of authority and decision-making capabilities are among the elite (Morris, 2009). This presentation will focus on strategies for conducing elite interviews with district leaders through the lens of an exploratory qualitative study with 32 district leaders representing 12 levels of leadership within a large urban school district.

Abstract 4 Title: Gaining Insight into Programs through a Formative Approach to Site Visits
Presentation Abstract 4:

Abstract   Although site visits are a common component of program evaluations, there is often very little formal discussion among evaluators of the methods, practices, and purposes of site visits.  During this presentation, we will discuss how we use site visits as part of a multi-site Race to the Top District grant evaluation.  This includes: soliciting feedback on program activities from various levels of stakeholders and participants including students, teachers, coaches, and administrators, allowing time during the visits for debriefing as a means of clarification and contextualization, using template coding to analyze the gathered qualitative data, and providing evaluative feedback directly to school level leadership in a user-friendly newsletter format.  The site visits also allow the evaluation team to observe firsthand how program activities are being implemented at different sites, including exemplars and challenges of implementation, which leads to more individualized formative feedback. 

Presentation 4 Other Authors: Dalisha Williams
Theme: My presentation doesn't specifically relate to the theme
Audience Level: All Audiences

Session Abstract (150 words): 

Encouraging Engagement and Use: Supplementing Traditional Data Collection and Reporting

For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.

Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 16, 2017. Email cancellation requests to registration@eval.org. Fax request to (202) 367-2173. All refunds are processed after the meeting. After October 16, 2017 all sales are final. For Evaluation 2017, international attendees and presenters who encounter complications due to the international travel environment will have up to 30 days after the event to request a refund and submit appropriate documentation. No administrative fee will apply for the international requests. The $50 fee will be waived for registrants who planned to travel into the US and experienced international travel issues.