Library - ATE Research & Evaluation

Report: ATE Program Evaluation: Contributors and inhibitors influencing program improvement

Posted on October 8, 2014 by , , in

This brief focuses on project/center evaluation and is divided into 4 sections. This section, Section 1, provides an overview of ATE expectations for evaluation and principal investigators’ responses that describe how they meet those requirements—who conducts the evaluations, how much money is spent on evaluations, and the extent to which these evaluations vary by characteristics such as the type of grant and type of evaluator conducting the evaluation. Section 2 describes PI perceptions of the utility of their evaluations and the extent to which PI perceptions of utility are related to the evaluation characteristics described in Section 1. Section 3 focuses on the activities of external evaluators — PI satisfaction with these evaluators, the relationship between PI ratings and standards for sound program evaluations, whether the PIs view their evaluations as meeting ATE intellectual merit requirements, and PIs’ characterizations of the attributes of their external evaluators. Section 4 draws together findings reported in Sections 1 to 3 to identify strengths and weaknesses of project-level evaluations and to suggest changes that appear likely to improve on current evaluation practices.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Arlen Gullickson, Chris Coryn, Liesel Ritchie

Report: ATE Program Evaluation: Project level evaluation practices

Posted on October 8, 2014 by , , in

This study analyzes project-level evaluation practices occurring in the Advanced Technological Education program of the National Science Foundation. Of special interest in this study were factors thought to affect the quality and utility of evaluations such as the cost of evaluations, who engaged in evaluation planning, and the use of external evaluators. The ATE program requires project-level evaluations and provides guidelines regarding what evaluations can and should do. The report closes with a discussion of discrepancies between expectations and project level actions and the apparent strengths and weaknesses of project evaluations. Suggestions are offered on how to improve these evaluation practices.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Arlen Gullickson, Chris Coryn, Liesel Ritchie

Report: Evaluation of Materials Produced by the ATE Program

Posted on October 8, 2014 by , , in

This report describes the outcomes and processes used to determine expert opinion of the
quality of materials developed through the ATE program. A detailed scoring rubric was
developed based on existing research and expert review, and experts in technological
fields, instructional design, and technological education used the rubric to review the
materials. Of the 65 projects and centers that had reported being involved in materials
development on the yearly ATE survey in 2002, 37 responded to our request to send us a
copy of their best material to review. Preliminary review reduced the number of
materials to 29 judged suitable and sufficiently complete for review.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Frances Lawrenz, Jim Appleton, Jonathan Keiser

Report: ATE Evaluation Survey 2005 at a glance: Projects

Posted on October 8, 2014 by  in

The 2005 survey is the sixth annual survey of the NSF ATE program, conducted by The Evaluation Center at Western Michigan University. This survey is conducted annually to describe the program characteristics, work activities, accomplishments, and impacts. This fact sheet presents selected survey indicators for projects only, and an added breakdown of results for the top one-third of center spenders in each program activity category.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): EvaluATE

Report: ATE Evaluation Survey 2005 at a glance: Centers

Posted on October 8, 2014 by  in

The 2005 survey is the sixth annual survey of the NSF ATE program, conducted by The Evaluation Center at Western Michigan University. This survey is conducted annually to describe the program characteristics, work activities, accomplishments, and impacts. This fact sheet presents selected survey indicators for centers only, and an added breakdown of results for the top one-third of center spenders in each program activity category.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): EvaluATE