Evaluation 2018: Speaking Truth to Power

View Printable Version

Checklists: Useful tools for Managing Complex Evaluation Processes

Session Number: IE1
Track: Internal Evaluation
Session Type: TIG Multipaper
Session Chair: Jessica E Britt [Research & Evaluation Manager - Year Up]
Presenter 1: Boris Volkov [Director of Monitoring & Evaluation, Clinical and Translational Science Institute - University of Minnesota]
Presenter 2: Jessica E Britt [Research & Evaluation Manager - Year Up]
Presentation 2 Additional Author: Jackson Young [Research & Evaluation Specialist]
Presentation 2 Additional Author: Garrett Yursza Warfield [Director of Evaluation - Year Up]
Time: Oct 31, 2018 (04:30 PM - 05:30 PM)
Room: CC - 23

Abstract 1 Title: Capturing Truth: A Checklist for Integrating the Voice of the Customer (VOC) in Program Monitoring & Evaluation
Presentation Abstract 1: This presentation introduces a checklist with a step-by-step set of guidelines for developing a viable system for capturing and integrating the Voice of the Customer (VOC), i.e., the collective voice of the wide range of program customers and stakeholders. The checklist is grounded in VOC and M&E research and practice, providing practical guidance for multi-level customer engagement and more effective M&E in organizations. It highlights thorough triangulation of methods and sources of customer engagement and related data. Key concepts and strategies include:
  1. VOC Mapping via program customer/stakeholder analysis.
  2. VOC Structures that enable VOC capture and utilization.
  3. VOC Translation into functional and measurable service requirements, accountability, and improvement.
This presentation is expected to be of interest to diverse audiences including M&E and evaluation capacity building practitioners, program staff, continuous improvement professionals, and other audiences interested in optimizing program and M&E processes and impact.
Abstract 2 Title: We are your clients. 10-item checklist for creating a tight internal/external evaluation team from the program’s perspective
Presentation Abstract 2: Year Up is a large national nonprofit that aims to close the “opportunity divide” between millions of low-income young adults and career opportunities with top-notch businesses facing employment shortages across the U.S. Year Up’s scale, promise, and rigorous research agenda makes us an appealing subject of research and evaluation by others. As such we have dozens of working relationships with diverse external researchers and evaluators– private firms, universities, students, individual consultants, etc.—across the country. Power dynamics in these relationships can vary depending on a variety of factors: who is funding the work, education and experience levels of individuals involved, reputations, project design, etc.  In this presentation we’ll speak truth to the powerful notion that “external” evaluators or consultants often find working with “their clients,” usually a program team, challenging by sharing our checklist of 10 best practices for creating a tight internal/external evaluation team from the program “client” perspective. 
Audience Level: None

Session Abstract (150 words):  Checklists: Useful tools for Managing Complex Evaluation Processes

For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.

Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 8, 2018. Email cancellation requests to registration@eval.org. All refunds are processed after the meeting. After October 8, 2018 all sales are final. For Evaluation 2018, international attendees and presenters who encounter complications due to the international travel environment will have up to 30 days after the event to request a refund and submit appropriate documentation. No administrative fee will apply for the international requests.