Using Administrative Data in Science, Engineering, and Public Health Investment Program Evaluation

Session Number: RTDE1
Track: Research, Technology & Development Evaluation
Session Type: TIG Multipaper
Session Chair: Christina Freyman [SRI International]
Presenter 1: Christina Freyman [SRI International]
Presenter 2: Robin Marian Wagner [Chief Science Officer - Office of Public Health Scientific Services, Centers for Disease Control and Prevention]
Presentation 1 Additional Author: Christina Freyman [SRI International]
Presentation 1 Additional Author: Roland Stephen, SRI International [Director]
Presentation 1 Additional Author: John Chase [SRI International]
Presentation 2 Additional Author: Robin Marian Wagner [Chief Science Officer - Office of Public Health Scientific Services, Centers for Disease Control and Prevention]
Presentation 2 Additional Author: Matthew Eblen [Mathematical Statistician - Centers for Disease Control and Prevention]
Presentation 2 Additional Author: Laura M Mann [Epidemiologist & Presidential Management Fellow - CDC]
Time: Oct 28, 2016 (11:00 AM - 11:45 AM)
Room: L404

Abstract 1 Title: Evaluating Investments in Human Capital in the Dept. of Energy’s Industrial Assessment Center Program
Presentation Abstract 1:

The Department of Energy’s Industrial Assessment Center (IAC) program invests in research and training related to energy efficiency at universities around the country. Centers are led by engineering faculty from 24 universities with the extensive involvement of graduate and undergraduate students. SRI’s analysis of IAC program’s impact used a mixed-methods evaluation design to measure the program’s contribution to training the next generation of energy efficiency engineers. The analysis used qualitative data from interviews with stakeholders, a survey of IAC alumni, the IAC students exit survey, and SRI’s novel text-analytics-based approach that compared IAC alumni resumes with two comparison groups.

This presentation will show how SRI aligned the evaluation design with stakeholders’ goals, and how the approach combined both traditional approaches (interviews and a survey) with new approaches in text analytics (based on unique data sources) to develop reliable and useful measures of the impacts of the program on human capital.


Abstract 2 Title: Evaluating the Surveillance-Related Programs and Workforce of the U.S. Centers for Disease Control and Prevention (CDC)
Presentation Abstract 2:

We are using available administrative data to characterize CDC’s surveillance-related programs and workforce to identify gaps and opportunities for enhancements to CDC programs and workforce.  We are using advanced statistical methods, including topic modeling, to describe CDC’s intramural surveillance systems as well as extramural support to external partners, including state health departments, through grants and cooperative agreements.  We are also characterizing the surveillance-related workforce, and identifying factors associated with staff promotion, retention and separation from CDC, using survival analysis.   These results and other planned studies should inform CDC policies and future investments in surveillance to maximize their effectiveness and efficiency and, ultimately, improve public health.

 


Presentation 2 Other Authors: Chesley Richards, Director, Centers for Disease Control and Prevention (CDC), cir6@cdc.gov
Audience Level: None

Session Abstract:  Using Administrative Data in Science, Engineering, and Public Health Investment Program Evaluation