Technological Tools Enhancing Evaluation

Session Number: ITE2
Track: Integrating Technology into Evaluation
Session Type: TIG Multipaper
Session Chair: Kristina M. Rabarison [Health Services Researcher - CDC - Division of Population Health ]
Presenter 1: Roshan Kumar Nayak [Produce Safety Extension Specialist - Colorado State University]
Presenter 2: Sophia Magalona [Senior RM&E Officer - John Snow, Inc. ]
Presenter 3: Kristina M. Rabarison [Health Services Researcher - CDC - Division of Population Health ]
Presentation 1 Additional Author: Bader Mohsen Alotaibi [Doctoral Student - The Pennsylvania State University]
Presentation 2 Additional Author: Soumya Alva [Senior Evaluation Advisor - John Snow, Inc.]
Presentation 3 Additional Author: Rose A. Marcelin, MPH [Centers for Disease Control and Prevention]
Presentation 3 Additional Author: Connie L Bish [Team Lead, Evaluation and Translation Team - CDC, NCCDPHP, Division of Population Health, Applied Research and Translation Branch]
Time: Nov 09, 2017 (10:30 AM - 11:15 AM)
Room: Roosevelt 4

Abstract 1 Title: Text Mining using R: An Evaluation Tool in Exploring Food Safety Policy Compliance Issues
Presentation Abstract 1:

Good Agricultural Practices (GAPs) are effective in reducing on-farm microbial contamination of fresh produce. GAP audits by third-party agencies such as the United States Department of Agriculture (USDA) ensure that producers are in compliance with food safety policies on their farms. Recognizing the deficiencies in implementing GAPs, this study utilized harmonized USDA GAP audits as a valid source of evidence and text mining technique as an evaluation tool to explore major issues associated with food safety compliance. Text mining procedures with R included transformation, processing, analysis, and visualization of text data. Auditors’ comments to GAP-noncompliance were mined and results were presented in the form of word clouds, frequencies, correlations, and association plots. Latent Dirichlet Allocation (LDA) technique was used to extract two topics related to water and employees, and associated terms. The presentation will focus on various functionalities of R in extracting evidence from text documents to enhance evaluation practice.  

Presentation 1 Other Authors: Luke LaBorde, John Ewing
Abstract 2 Title: Using multiple technology platforms to collect data for the evaluation of an mHealth intervention to improve community health nurse motivation in Ghana
Presentation Abstract 2:

Identifying opportunities to improve global health interventions requires creative thinking and innovative methods, and the use of real-time, valid data to inform program implementation continues to be important given the growing demand for impact health evaluations.  However, this can be challenging in resource poor settings where existing data sources are often incomplete or outdated.  In addition, implementing surveys requires many resources, time, and quality assurance inputs in order to get valid data.  In Ghana, we utilized multiple technology platforms to feedback data into the implementation of the Gates Foundation funded Care Community Hub project. This paper presents findings from the triangulation of real-time, high quality data collected through a Magpi electronic survey, mobile phone push survey, and a Tableau monitoring dashboard, and how they were used to inform ongoing improvements in the rollout of an mhealth intervention to improve health worker motivation.     

Abstract 3 Title: Prevention Research Centers cost analysis and Tableau dashboard
Presentation Abstract 3:

Economic evaluation, such as cost analysis, is becoming an integral part of public health practice and decision-making. In response to this need, the 2014-2019 CDC's Prevention Research Center (PRC) Funding Opportunity Announcement explicitly stated “all applicants will be expected to collaborate with CDC to collect data to be able to perform cost analysis.” For the first time in thirty years of existence, a cost indicator was included in the PRC Program Evaluation and a cost analysis (CA) instrument was developed. The PRC-CA instrument systematically collects data on the actual costs related to the PRC core research project and answers PRC Program Evaluation question: “To what extent do investments in PRCs support the scalability, sustainability, and effectiveness of the outcomes resulting from community-engaged efforts to improve public health?” The instrument’s cost measures include the dollars spent on labor, materials and consumables, travel, and location expenses associated with the PRC core research project.    

Theme: My presentation doesn't specifically relate to the theme
Audience Level: All Audiences

Session Abstract (150 words): 

Technological Tools Enhancing Evaluation