Bridging the qualitative and quantitative divide to measure change: Metric based process mapping

Session Number: 1600
Track: Qualitative Methods
Session Type: Demonstration
First Author or Discussion Group Leader: Daniel M. Sabet [Senior Impact Evaluation Advisor - Social Impact]
Time: Nov 09, 2017 (04:30 PM - 05:15 PM)
Room: Virginia C

Theme: Learning to Enhance Evaluation
Audience Level: All Audiences

Session Abstract (150 words): 

Many development initiatives aim to reform or build the capacity of government agencies, civil society organizations, or market actors, but it is often hard to know if these reforms are working. Quantitative indicators are often too narrowly focused and qualitative data is often anecdotal.  In this demonstration, I’ll introduce an evaluation tool for measuring reform change called Metric Based Process Mapping (Martin and Osterling 2008). At baseline, we use this method to map out processes, identify and develop qualitative and quantitative indicators that can be tracked over time, and identify and explore challenges, bottlenecks, quality problems, and obstacles to change. This highly structured qualitative data collection technique allows for easy replication at a midline or endline to measure change with greater confidence than traditional approaches.  In the presentation, I’ll use examples from a baseline and midline evaluation of an effort to reform an electrical utility in Malawi.