2019 ATE Principal Investigators Conference

ATE Evaluation Networking Reception

Thursday | 6:45-8:15 p.m. | OpenCity

EvaluATE invites you to our annual ATE Evaluation Networking Reception. Connect with ATE evaluators and others committed to advancing evaluation within the ATE program. Discover ways to collaborate. Exchange ideas about how to promote rigorous evaluation and evaluative thinking in the program. Light refreshments will be served.

EvaluATE Preconference Workshops

Impact Evaluation Essentials: Why, What, and How

Wednesday | 1-4:00 p.m.

Impact evaluation can be a powerful way to assess the long-term or broader effect of a project. Attention to causal inference, which requires determining if a change can be attributed to the project and its activities, sets impact evaluation apart from other types of evaluation. This workshop is an introduction to impact evaluation and a forum for discussing how it can be realistically implemented in ATE projects. Two examples from ATE evaluations will be highlighted as case studies. ATE principal investigators, project and center staff, and evaluators who attend this workshop will learn (1) the basic tenets of impact evaluation, (2) how to identify impact measures for ATE projects, (3) strategies for determining causal attribution, and (4) the resources needed to implement impact evaluation for your project.

Workshop Slides

Workshop Handout

Getting Started for New Grantees
Wednesday | 1-5:00 p.m.

This workshop is recommended for all principal investigators, co-principal investigators, and other team members involved in newly awarded projects and centers in FY19. Others who may find the workshop useful include new awardees in FY18 and other project personnel from prior years who have recently become involved in ATE projects and centers. The workshop will be divided into three parts: (1) ATE Program Issues. Topics to be covered include reporting requirements, such as annual and final reports, working with NSF program officers, changes in project personnel or scope, data collection, FastLane and other reporting systems, use of advisory boards and national visiting committees, preparing project highlights for NSF and others, institutional review boards (IRBs), and many other relevant topics. (2) Financial Management and Grant Management Issues. This section will focus on financial accounting issues and discuss in detail problems often seen in monitoring visits, such as participant support, time and effort accounting, subawardees, record keeping, changes in scope, overload, and use of consultants. (3) Evaluation. This segment will address building in evaluation from the start of your project or center. The ATE program conducts an annual survey of all projects and centers that have been active for more than one year. Additional evaluation topics to be addressed include, but are not limited to, evaluation design, methods and instrumentation, resources for learning about productive evaluation, the roles of internal and external evaluators, and evaluation challenges.

ATE PI Survival Guide: Surviving and Thriving in the ATE Program
Wednesday | 1-4:00 p.m.

This workshop is designed for ATE PIs and co-PIs entering the second or third year of their grants who could use assistance and guidance in elements of grants award management in order to “Survive and Thrive” in the ATE program. Come talk with experienced ATE PIs to learn successful tips and hear lessons learned in troubleshooting common challenges such as implementing budget and personnel changes; engaging administrators in support of your efforts; navigating grant guidelines and documents such as the Proposal and Award Policies and Procedures Guide (PAPPG); preparing annual reports; and understanding NSF expectations for ATE awards. There also will be time set aside for small group discussion for participants to bring their own challenges to the table for discussion, feedback, and guidance.

EvaluATE Main Sessions

Beyond the Evaluation Report: Creating One- Page Reports 
Breakfast Roundtable
Thursday | 7:45-8:45 a.m. | Ambassador Ballroom

One-page reports are a great way to provide stakeholders with a snapshot of a project’s activities and impact. Summarizing key evaluation facts in a format that is easily and quickly digestible engages the busy reader and draws attention to the important details of the project. We will discuss what a one-page report is, why you might want to create one, and how they are different from other reports. Attendees will receive a handout and access to training videos to help them start creating one-page reports.

Community-Driven Solutions to ATE Evaluation Challenges 
Discussion Session
Thursday | 11:10-12:00 p.m. | Cabinet Room

This discussion is about what works well in ATE evaluation; what is problematic; and how the expertise and resources in the ATE community can be harnessed to generate community-driven solutions to challenges. Attendees will connect with others in the ATE community and identify opportunities for sharing and collaboration related to evaluation. We encourage all evaluation stakeholders to attend–evaluators, principal investigators, program officers, project staff, grant specialists, and others.

Putting Evaluation to Use: Sharing Stories of How Evaluation is Being Used in ATE 
Breakfast Roundtable
Friday | 7:45-8:45 a.m. | Ambassador Ballroom

ATE grantees spend on average 8% of their grant budgets on evaluation, almost $5 million annually. To understand how this commitment is affecting change, EvaluATE is studying ATE evaluation use. At this breakfast roundtable, we’ll share what we’ve learned from the recent PI survey & ask PIs to share how evaluation has informed their program. We hope this intersection will deepen our understanding of evaluation use & provide examples for others to learn from.


Advancing Innovation Through STEM Research and Evaluation 
Breakfast Roundtable
Friday | 7:45-8:45 a.m. | Ambassador Ballroom

NSF is committed to broadening participation in STEM, and is particularly focused on Equity, Diversity, and Inclusion (EDI). This project examines how and in what ways ATE PIs and evaluators define EDI within their projects. Findings from surveys conducted will be shared and discussed in order to explore strategic ways for collecting reliable and meaningful data around this topic. Attendees will leave the session with new ideas and strategies to employ in attending to EDI in their STEM programs.


A look at Findings from the 2019 ATE Survey 
Breakfast Roundtable
Friday | 7:45-8:45 a.m. | Ambassador Ballroom

The annual survey of ATE PIs gathers data about the activities and achievements of ATE projects and centers. The survey went through a substantial revision in 2018-19 in order to better reflect the current state of the program. In this session, we will discuss this revision process and present the 2019 findings, including the major activities ATE projects and centers engaged in, students and educators served, and new programs developed. Audience members will have a chance to comment on the results, ask questions, and suggest follow-up analyses

ATE Getting Started Meet and Greet 
Evaluation Support Session
Friday | 10:15 – 11:15 a.m. | Bird Cage Walk