Evaluation 2018: Speaking Truth to Power

View Printable Version

Discovering Truth While Sailing Out To SEA-Support Evaluation Activities: An internal voyage at MaineHealth Corporate to evaluate individual and departmental needs for using program evaluation.

Session Number: 2146
Track: Internal Evaluation
Session Type: Poster
Tags: Evaluative Thinking, Innovative Designs, internal evaluation, Needs Assessment, organizational capacity building, Program Evaluation Standards
First Author or Discussion Group Leader: Lori Travis [Program Manager - MaineHealth Center for Tobacco Independence]
Time: Oct 31, 2018 (06:30 PM - 08:00 PM)
Room: Poster 148

Audience Level: All Audiences

Session Abstract (150 words): 

Background: The Evaluation Manager for the Center for Tobacco Independence sought to learn if other departments used program evaluation. Initially, 12 interviews with department leaders on this topic occurred.  But there was an opportunity to speak to a wider audience through an novel survey tool. 

Methods: The development and testing of the SEA Survey.took about four months. The final online SEA Survey had 27 questions and was sent in a newsletter link to all 250 employees. 

Results: About 40% responded, and 63% had leadership roles. While 49% knew their job description included an expectation to use evaluation, about 33% were unaware. Over half, 57% agreed there was no adequate system in place for internal evaluation support.  Many were not familiar with the CDC Framework, or how to conduct simple data analyses. There was great interest in receiving training on a variety of evaluation topics. 

Conclusions: While managers understand that they are accountable for tracking progress towards their program goals, the truth remains there is a wide gap in evaluation knowledge and resources to assess outcomes. The next most powerful step to address this gap would be to increase capacity for developing an internal system to Support Evaluation Activities-SEA!


For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.

Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 8, 2018. Email cancellation requests to registration@eval.org. All refunds are processed after the meeting. After October 8, 2018 all sales are final. For Evaluation 2018, international attendees and presenters who encounter complications due to the international travel environment will have up to 30 days after the event to request a refund and submit appropriate documentation. No administrative fee will apply for the international requests.