Evaluation 2015: Exemplary Evaluations in a Multicultural World

View Printable Version

Technology, Social Media & Communication in Health Evaluation

Session Number: HE5
Track: Health Evaluation
Session Type: Multipaper
Session Chair: Catherine Z Dizon [University of California, Davis]
Presenter 1: Elyse Levine [Booz Allen Hamilton]
Presenter 2: Sasigant O'Neil [Mathematica Policy Research]
Presenter 3: Elyse Levine [Booz Allen Hamilton]
Presenter 4: George Tremblay [Antioch University New England]
Presentation 1 Additional Author: Sergey Blok [Booz Allen Hamilton]
Presentation 1 Additional Author: Mark Kokoska [Booz Allen Hamilton]
Presentation 1 Additional Author: Chi Bahk [Epidemico]
Presentation 2 Additional Author: Keith Kranker [Mathematica Policy Research]
Presentation 3 Additional Author: Jodie Abbatangelo-Gray [Booz Allen Hamilton]
Presentation 3 Additional Author: Amy Mobley [University of Connecticut]
Time: Nov 11, 2015 (04:30 PM - 06:00 PM)
Room: Michigan B

Abstract 1 Title: Comparing Social Media Content to a National Health Survey
Presentation Abstract 1: <span style="color: black; font-family: "Verdana",sans-serif; font-size: 9pt;">Effective health interventions require understanding the beliefs, attitudes, and perceived norms of the target population. Surveys and focus groups are good
methods for collecting this information, but they can be expensive. Social media may provide a proxy for survey findings on beliefs, attitudes, and norms
for certain populations. We used Natural Language Processing to analyze comments about childhood vaccinations from social media including Twitter, Facebook, and BabyCenter.com. We developed a sentiment analysis classification tool and conducted topic modeling on the social media postings to determine a number of distinct profiles. We will report on a comparison of findings from social media with responses to the National Immunization Survey and the extent to which they correlate. These findings provide guidelines to researchers on opportunities and limitations for using social media content analysis to help prepare, monitor, and evaluate interventions for public health campaigns.</span>
Abstract 2 Title: Evaluating a Pilot Mobile Health Program: Design and First-Year Results
Presentation Abstract 2: The Centers for Medicare & Medicaid Services (CMS) supports a four-year study on the implementation and evaluation of a pilot mobile health (mHealth) program in four states: California, Louisiana, Ohio, and Oklahoma. This mHealth program, Text4baby, is a free health text messaging service for pregnant women and new mothers with an infant up to age 1. The evaluation provides a framework for assessing mobile technology by examining the participation of Medicaid women in Text4baby (reach); the use of Text4baby among subscribers (engagement); provision of critical health information to influence knowledge and behaviors (education); use of recommended health care (connection); and factors that facilitate institutionalization and spread of the program (sustainability). Results will be used to understand how well the pilot mHealth program achieved its ultimate goal---improving maternal and infant health outcomes. This paper describes the framework for mHealth evaluation and first year results from the evaluation.
Abstract 3 Title: Validating a Framework for Evaluating Health Communication
Presentation Abstract 3: Evaluating the effectiveness of health communication initiatives incurs several challenges, including how to assign attribution of communication efforts in observed behavior change. The MyPlate Communication Initiative is a good case study for illustrating challenges in evaluating the effectiveness of health communications, and to demonstrate a proposed framework to facilitate the evaluation. MyPlate messages and digital products communicate the Dietary Guidelines for Americans (DGA), which has as goals healthier food choices and calorie consumption by consumers. Adding to the complexity of evaluating the effectiveness of MyPlate are competing health communication campaigns, changes in policy, and food industry initiatives that may also contribute to observed changes in food consumption. We use the MyPlate Initiative to demonstrate an evaluation framework which incorporates the socio-ecological, logical, and RE-AIM models. We will describe steps toward validating the framework for use with the MyPlate Initiative and other health communication efforts.
Abstract 4 Title: Maximizing Practitioner Utility of Data Dashboards
Presentation Abstract 4: Data dashboards can powerfully and efficiently inform clinical decision-making, but any increment in data entry burden is a major barrier to use, in the highly stressed contemporary healthcare environment. We describe and illustrate principles that have helped us design well-used dashboards in the contexts of suicide prevention for psychiatric inpatients returning to their communities, and care coordination for severely emotionally disturbed youth and their families. We design for clinical utility first: how can the dashboard generate the information needed for case-level decision making, and also produce the documentation needed for the patient chart, with minimal effort from busy clinical staff? Second, in addition to depicting patient-level outcomes, we aggregate outcomes across patients to yield program-level outcomes. Finally, we look for ways to monitor fidelity to designed care pathways: how is the focal service being allocated across the patient population (practice often deviates from intention!)?
Presentation 4 Other Authors: James Fauth, John Erdmann, Patrick Roberts
Audience Level: None

Session Abstract: 

Technology, Social Media & Communication in Health Evaluation

For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.

Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 6, 2015. Email cancellation requests to registration@eval.org. Fax request to (202) 367-2173. All refunds are processed after the meeting. After October 6, 2015 all sales are final.