Integrating Implementation Fidelity Assessment into an impact evaluation of urban water infrastructure

Session Number: 2194
Track: Qualitative Methods
Session Type: Poster
Tags: Africa, Implementation Fidelity, infrastructure, Mixed-Methods Evaluation, urban water, water and sanitation
First Author or Discussion Group Leader: Danae Roumis [Program Director, Impact Evaluation - Social Impact, Inc.]
Second Author or Discussion Group Leader: Miguel Albornoz [Program Associate - Social Impact]
Time: Oct 31, 2018 (06:30 PM - 08:00 PM)
Room: Poster 212

Other Authors: C.R.H. Clanahan
Audience Level: All Audiences

Session Abstract (150 words): 

A multi-disciplinary evaluation team from Social Impact completed an ex post process evaluation of urban water components of the MCA-Lesotho Water Sector Project in October, 2017. Through direct observation, key informant interviews, and review of engineering drawings and reports the team defined the implementation fidelity of twelve new or upgraded urban water networks according to the fidelity of their design, installation, operation and maintenance, and funding to original program plans as well as their success in delivering water to communities as intended. A common scoring criteria applied to each site creates a "Fidelity Index" on a 0-10 scale, rendering the results comparable across sites and allowing for them to be communicated to non-engineering audiences. The implementation fidelity exercise provided valuable information to MCC in planning future water sector activities, substantively informed the summative evaluation design, and will ultimately contextualize the results of the summative evaluation.