Evaluation 2015: Exemplary Evaluations in a Multicultural World

View Printable Version

Evaluation of Domestic and International Biomedical Research Training and Capacity Building Activities—Examples from the National Institutes of Health (NIH)

Session Number: 2459
Track: Research, Technology & Development Evaluation
Session Type: Panel
Tags: Health, R&D, Training Evaluation
Session Chair: James Corrigan [National Institutes of Health]
Presenter 1: Julie L. Mason [National Institutes of Health]
Presenter 2: Jennifer Sutton [National Institutes of Health]
Presenter 3: Celia M Wolfman [National Institutes of Health]
Presenter 4: Margaret Mary Bertram [National Institutes of Health]
Presentation 1 Additional Author: Kristin Sachi Mendoza [National Institutes of Health]
Presentation 1 Additional Author: Erica Blue Roberts [Research Associate - James Bell Associates, Inc.]
Presentation 1 Additional Author: Lawrence Solomon [Senior Health Science Analyst - National Institutes of Health]
Presentation 2 Additional Author: Katrina Pearson [Acting Director, Division of Statistical Analysis and Report - National Institutes of Health]
Presentation 2 Additional Author: Deepshikha Roychowdhury [Senior Data Analyst - National Institutes of Health]
Presentation 2 Additional Author: Cassandra Spears [Information Technology Specialist - National Institutes of Health]
Presentation 3 Additional Author: Rachel Sturke [Deputy Director, DISPPE, Fogarty International Center - National Institutes of Health]
Presentation 4 Additional Author: Catherine Hidalgo [Program Analyst - National Institutes of Health]
Presentation 4 Additional Author: Brenda Kostelecky [Program Officer/Science Policy Advisor - National Institutes of Health]
Time: Nov 13, 2015 (08:00 AM - 09:30 AM)
Room: Wright

Abstract 1 Title: Evaluation of the National Cancer Institute’s Intramural Training Program—Experience, Satisfaction, and Diversity
Presentation Abstract 1: Each year the National Cancer Institute (NCI) trains nearly 850 international and domestic fellows and students in its laboratories, clinics, and research groups. Trainees’ experiences are shaped by the culture and environment of NCI’s intramural program, the unique characteristics of each fellow (e.g., citizenship, gender, parental status), and the length and type of training. As a part of a continual process evaluation, NCI regularly surveys its intramural trainees to understand fellow experience and satisfaction from an aggregate perspective, and to examine the diversity of experiences in mentorship, professional development, scientific preparation, career plans, and work-life balance. The survey was administered in November 2014, and NCI obtained a 45% response rate (N=382). Overall, trainees are satisfied with their experience; however, opportunities for program enhancement and improved communication exist. Survey findings and lessons learned will be presented in this session and have broader implications for STEM and biomedical research workforce training programs.
Presentation 1 Other Authors: Jonathan S. Wiest, , wiestj@mail.nih.gov, 240-276-5628, Director, Center for Cancer Training, National Institutes of Health

Abstract 2 Title: The Pathway to Independence—Early Outcomes of the National Institutes of Health (NIH) K99/R00 Career Transition Awards
Presentation Abstract 2: In 2006, NIH announced a major new program to help post doctorates navigate the transition to faculty positions and research independence. Because of the size and significance of the “Pathway to Independence” program and the new features it introduced, NIH has been monitoring program participants ever since and has begun to compare their career progress to that of other early stage investigators. This presentation will cover what has been learned about the background and demographics of participants in the program, their progression into faculty positions, and their subsequent research activity. The presentation will conclude with a discussion of how the evaluation results are being used to inform NIH policies and planning.
Abstract 3 Title: Capturing Long-Term Impacts Associated with Capacity Building
Presentation Abstract 3: Addressing today’s complex global health challenges requires a critical mass of first-class scientists. To address this important need, the Fogarty International Center (FIC) invests in building capacity in global health research. Evaluation of these capacity building programs is important to understanding the outputs, outcomes, and impacts of these investments. To better evaluate and report on the effectiveness of its extramural research-training programs and capture the long-term impacts associated with its programs, FIC in collaboration with the National Institute of Environmental Health Sciences developed CareerTrac. The system goes beyond standard metrics to understand the long term career trajectories of trainees after their training is completed. Specifically, the program fosters trainee tracking by allowing data entry of a wide variety of accomplishments such as employment, funding, publications and patents. The system helps FIC capture critical data on a broad range of long-term outcomes and helps to enhance the mission of capacity building.
Abstract 4 Title: Evaluation of Cancer Control Leadership Forums at the National Cancer Institute’s Center for Global Health
Presentation Abstract 4: Since 2013, the National Cancer Institute (NCI), Center for Global Health (CGH) has partnered with foreign Ministries of Health and research institutions, international non-governmental organizations, and U.S. academic institutions to host regional Cancer Control Leadership Forums, with the aims of increasing participating countries’ capacity to initiate or enhance cancer control planning and implementation in their respective countries. The Cancer Control Leadership Forums are an opportunity for countries to exchange experiences and ideas about creating and implementing comprehensive cancer control plans. Baseline cancer control information is collected prior to each forum, and evaluation data is collected 3-24 months afterwards to measure the effectiveness of the forum and to inform future programming and funding decisions. This presentation will highlight the status of cancer control planning and implementation in each participating country, outcomes related to the action plans, successes and challenges related to the action plans, and new cancer control partnerships and networks.
Audience Level: Advanced

Session Abstract: 

Biomedical research training is an essential component of the mission of the National Institutes of Health (NIH). Developing an optimal flow of a diverse population of scientists and clinicians into sustainable careers focused on advancing science and promoting health is a significant challenge. The NIH employs a diverse array of strategies to address this challenge. NIH supports individuals in the biomedical training and career development pipeline through a number of mechanisms, including intramural training programs, traditional extramural training grants, extramural research grants, and post-degree career development activities at both US and non-US institutions. A key question regarding the outcomes of such programs is: how to define success? Presentations will cover evaluation design and implementation, analytic methods, measures, data sources, findings, lessons learned and future plans. Perspectives will be shared from three NIH organizations: the NIH Office of the Director, the National Cancer Institute, and the Fogarty International Center.

For questions or concerns about your event registration, please contact registration@eval.org or 202-367-1173.

For questions about your account, membership status, or help logging in, please contact info@eval.org.

Cancellation Policy: Refunds less a $50 fee will be granted for requests received in writing prior to 11:59 PM EDT October 6, 2015. Email cancellation requests to registration@eval.org. Fax request to (202) 367-2173. All refunds are processed after the meeting. After October 6, 2015 all sales are final.