Evaluation 2017: From Learning to Action

View Printable Version

Shared Measurement and Strategic Learning: Arts Education Collective Impact Initiatives

Session Number: 2281
Track: Arts, Culture, and Audiences
Session Type: Panel
Tags: arts and culture, Collective Impact
Session Chair: Don Glass [Research Manager - The Kennedy Center]
Discussant: Patricia Moore Shaffer [Deputy Director, Research & Analysis - National Endowment for the Arts]
Presenter 1: Patricia Moore Shaffer [Deputy Director, Research & Analysis - National Endowment for the Arts]
Presenter 2: Don Glass [Research Manager - The Kennedy Center]
Presenter 3: Stacy Hughey Surman, PhD [Assistant Professor - The University of Alabama]
Presenter 4: Steven Shewfelt [Director of Data & Research - Ingenuity]
Time: Nov 10, 2017 (08:00 AM - 09:30 AM)
Room: PARK TWR STE 8209

Abstract 1 Title: Evaluation at Varying Phases of Collective Impact Initiatives
Presentation Abstract 1:

The collective impact change process typically involves three stages of development, each of which requires a different approach to performance measurement and evaluation. Using illustrative work from NEA grantees, the types of performance measurement and evaluation activities associated with early, middle, and mature examples of collective impact initiatives in arts education will be discussed as part of an overview presentation about collective impact in arts education. The National Endowment for the Arts (NEA) has funded Collective Impact projects in arts education since 2014. These grants are intended to impact entire systems that serve students—for example, neighborhoods, schools, school districts, states—in rural, suburban, or urban areas. All funded projects must embrace the guiding principles of cross-sector partnerships, data, planning, programming, and evaluation.


Abstract 2 Title: Early Phase: Common Definitions and Testing Shared Measures
Presentation Abstract 2:

As a national organization that provides technical assistance and initial funding to arts education collective impact initiatives across the United States, we also act as network hub for knowledge management and shared measurement. This year, teams from four sites have initiated a Community of Practice on defining, measuring, and improving access to arts education. Our initial work is agreeing on an operational definition of “equitable access” and taking stock of current measures and systems of data collection and use that may help us measure progress towards our targets. This is early phase collective impact work that will set the stage to use developmental evaluation and improvement science to test out potential cross-site process and outcomes measures in varying contexts


Abstract 3 Title: Mid-Phase: Implementing a Shared Measurement System
Presentation Abstract 3:

The Shared Evaluation System for the Arts is an approach to evaluating the diverse arts programs and providers across a rural southern state. It is the result of the collective work of a state-wide Arts Education Leadership Team made up of executive-level leadership in education, business, communities, government, and cultural institutions. The team recognized that success in arts education requires the collective impact of multiple and diverse stakeholders, and that a shared mission would be beneficial to all arts organizations and schools. From 2013-2015, the team developed a shared mission and set of goals; established a Plan for Arts Education; and commissioned the Shared Evaluation System to measure the collective impact of the arts in the state. The shared measurement system, administered by state university faculty, provides opportunities for recognizing diverse cultural voices, and utilizing data to assist small arts agencies and rural schools to collaborate and optimize resources


Abstract 4 Title: Mature Phase: Using Digital Shared Data Systems and Mapping
Presentation Abstract 4:

As a backbone organization, we work to ensure that the arts are a core component of every student’s education in our school district. As a collective impact organization, we coordinate with 1,100 cultural institutions, arts organizations, and teaching artists serving 380,000 students. Our data – selected to represent the district’s priorities and collected from schools and arts organizations - provide a detailed overview of the availability and intensity of arts education in the district. The tool is designed to promote equitable access to high-quality arts education for all students by helping principals and teachers make informed decisions about how to increase students’ access to arts instruction and by aiding arts partners in designing programs and targeting resources to better meet the needs of schools. The data also help advocates engage the community and inform an arts advocacy agenda and communications plan geared at district leadership, and local and state legislators.


Theme: Learning What Works and Why
Audience Level: All Audiences

Session Abstract (150 words): 

Collective Impact initiatives are growing in currency in many sectors- including the field of arts education. Working together across organizations has become more than just about effective partnerships, it is a shift in how we organize our collective work, optimize often limited resources, and make reliable improvements across complex and varied contexts. Of the five common conditions for collective impact, a shared measurement system is the most germane to evaluation. This panel will feature collective impact backbone organizations and network hubs in the arts education field who are learning how to do this complex work together. Fostering measurement know-how, establishing routines of data use and strategic learning, and co-developing shared systems of data collection and reporting are the central activities. Making sure that the measurement system is reliable, focused, and flexible enough for varied use across contexts is the design challenge for the evaluation field.



For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.



Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 16, 2017. Email cancellation requests to registration@eval.org. Fax request to (202) 367-2173. All refunds are processed after the meeting. After October 16, 2017 all sales are final. For Evaluation 2017, international attendees and presenters who encounter complications due to the international travel environment will have up to 30 days after the event to request a refund and submit appropriate documentation. No administrative fee will apply for the international requests. The $50 fee will be waived for registrants who planned to travel into the US and experienced international travel issues.