Arlen Gullickson

Co-Principal Investigator, EvaluATE – Western Michigan University

One of four children, Arlen Gullickson was born and raised in a farming family in the state of Iowa. His education includes baccalaureate, masters, and Ph.D. degrees in mathematics, physics and education, respectively. He has 30 years of teaching experience at the high school and college levels and altogether more than 40 years of experience working in education. In the past, Arlen was the director of The Evaluation Center and Chair of the Joint Committee on Standards for Educational Evaluation. Currently, he is supposed to be retired. But he serves as a Co-Principal Investigator for EvaluATE (after serving as the PI) and fishes whenever he can.


Report: ATE Program Evaluation: Contributors and inhibitors influencing program improvement

Posted on October 8, 2014 by , , in

This brief focuses on project/center evaluation and is divided into 4 sections. This section, Section 1, provides an overview of ATE expectations for evaluation and principal investigators’ responses that describe how they meet those requirements—who conducts the evaluations, how much money is spent on evaluations, and the extent to which these evaluations vary by characteristics such as the type of grant and type of evaluator conducting the evaluation. Section 2 describes PI perceptions of the utility of their evaluations and the extent to which PI perceptions of utility are related to the evaluation characteristics described in Section 1. Section 3 focuses on the activities of external evaluators — PI satisfaction with these evaluators, the relationship between PI ratings and standards for sound program evaluations, whether the PIs view their evaluations as meeting ATE intellectual merit requirements, and PIs’ characterizations of the attributes of their external evaluators. Section 4 draws together findings reported in Sections 1 to 3 to identify strengths and weaknesses of project-level evaluations and to suggest changes that appear likely to improve on current evaluation practices.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Arlen Gullickson, Chris Coryn, Liesel Ritchie

Report: ATE Program Evaluation: Project level evaluation practices

Posted on October 8, 2014 by , , in

This study analyzes project-level evaluation practices occurring in the Advanced Technological Education program of the National Science Foundation. Of special interest in this study were factors thought to affect the quality and utility of evaluations such as the cost of evaluations, who engaged in evaluation planning, and the use of external evaluators. The ATE program requires project-level evaluations and provides guidelines regarding what evaluations can and should do. The report closes with a discussion of discrepancies between expectations and project level actions and the apparent strengths and weaknesses of project evaluations. Suggestions are offered on how to improve these evaluation practices.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Arlen Gullickson, Chris Coryn, Liesel Ritchie

Report: Assessing the impact and effectiveness of the ATE program Volume 3 (2004)

Posted on October 8, 2014 by , , in

This report, Volume 3 of the 2004 Annual Survey Report, focuses on the following fundamental elements of the ATE program:

1) What is the size and scope of work for ATE projects?

2) To what degree do ATE projects apply rigorous internal practices in their operations?

3) How extensive are ATE project collaborations?

4) How productive are ATE projects in terms of the primary ATE work categories?

5) What impact are ATE projects having on students?

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Arlen Gullickson, Carl Hanssen, Chris Coryn

Report: Assessing the impact and effectiveness of the ATE program Volume 2 (2004)

Posted on October 8, 2014 by , , in

This report, Volume 2 of the 2004 Annual Survey Report, specifically addresses the following fundamental elements of the ATE centers:

1) What are the size and the scope of work for ATE centers?

2) To what degree do ATE centers apply rigorous internal practices in their operations?

3) How extensive are ATE center collaborations?

4) How productive are ATE centers in terms of the primary ATE work categories?

5) What impact are ATE centers having on students?

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Arlen Gullickson, Carl Hanssen, Chris Coryn

Report: Assessing the impact and effectiveness of the ATE program (2003)

Posted on October 8, 2014 by , , in

This report presents results from the fourth annual survey of ATE projects. Intended as a means to provide evidence of the work of ATE projects and centers, this survey is part of a larger effort to evaluate the ATE program.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Arlen Gullickson, Carl Hanssen, Frances Lawrenz

Report: Survey of ATE Projects and Centers (2002)

Posted on October 8, 2014 by , , in

This third annual survey of projects and centers describes these projects’ efforts and impacts and through them provides insights to the parent National Science Foundation’s (NSF) Advanced Technological Education (ATE) program. When combined with other information and criteria, these annual descriptive findings and indices provide a basis for judging the overall impact and effectiveness of the ATE program. Findings from this survey are expected to be useful to NSF staff in preparing their annual GPRA reports and making programmatic decisions. ATE projects are likely to use survey results to learn about the activities and findings of other projects and to serve their own improvement needs.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Arlen Gullickson, Frances Lawrenz, Nanette Keiser

Report: The ATE program: Issues for consideration, a monograph

Posted on October 8, 2014 by , , , , , , , , in

This report addresses nine issues of interest to ATE program stakeholders: Collaboration, dissemination, materials development, professional development, program improvement, advisory committees, evaluation, recruitment and retention,and sustainability.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Arlen Gullickson, Frances Lawrenz, Gloria Rogers, Gloria Tressler, Karen Powe, Lester Reed, Norman Gold, Thomas Owens, Wayne Welch

Report: Recruitment and Retention in the ATE program

Posted on October 8, 2014 by , in

This report describes findings from current literature that helped our understanding of the general background issues surrounding recruitment and retention as well as the various strategies employed to enhance both efforts. We present a model for R & R practice that contains three elements: Information, Preparation, and Support. Those elements and methods to serve them are elaborated through a series of tables. We supplemented the tabular information with five case examples. These cases show recruitment and retention from different vantage points.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Arlen Gullickson, Gloria Tressler

Report: Assessing the Value Added by NSF’s ATE Program: Business and Industry Perspective’s Cross-Site Analysis Report

Posted on October 1, 2014 by , , , in

This report presents the results from a targeted study designed to address the accountability of the ATE program in terms of its impact on the business and industry workforce.

File: Click Here
Type: Report
Category: ATE Research & Evaluation
Author(s): Amy Germuth, Arlen Gullickson, Carl Hanssen, Frances Lawrenz