LogoHomeAbout CAENewsPublicationsPrograms
About CLACLA NewsArticles/ResearchStudent LoginInstitutions

Many of the articles, research pieces and white papers listed below have been or will forthcoming be published in book form or in a variety of magazines, journals, and anthologies. As such, we wish to recognize the support of these publications through the Collegiate Learning Assessment Publications and Projects list.

CLA Research

The Contribution of the Collegiate Learning Assessment to Teaching and Learning
Roger Benjamin, May 2008
An abridged and slightly modified version of this document may be accessed by clicking here.

Holistic Tests in a Sub-score World: The Diagnostic Logic of the CLA
Roger Benjamin, Marc Chun and Richard Shavelson

Multiple Drafts of a College’s Narrative
Paul Sotherland, Anne Dueweke, Kiran Cunningham and Bob Grossman

The Collegiate Learning Assessment: Facts and Fantasies (2007)
Stephen Klein, Richard Shavelson, Roger Benjamin and Roger Bolus
This paper presents the approach the CLA program takes to assessment and score reporting, the types of measures it uses, the similarities and differences between the CLA approach and the methods used by other large-scale assessment programs such as MAPP and NSSE, and finally, some of the important statistical properties of the CLA's measures, including their reliability.

Conceptual Framework
Richard J. Shavelson and Leta Huang provide the CLA conceptual framework.

An Approach to Measuring Cognitive Outcomes Across Higher Education Institutions
Research in Higher Education, Vol. 46, No. 3, May 2005
Stephen P. Klein, George D. Kuh, Marc Chun, Laura Hamilton, and Richard Shavelson

The Search for Value-Added: Assessing and Validating Selected Higher Education Outcomes
Paper presented at 88th American Educational Research Association (AERA), April 2003
Stephen P. Klein, George D. Kuh, Marc Chun, Laura Hamilton, and Richard Shavelson

CLA in the News

No Gr_du_te Left Behind
New York Times Magazine, September 2007
James Traub discusses the CLA in light of both recent federal pushes toward higher education accountability and assessment initiatives undertaken by the likes of NASULGC and AASCU. In so doing, Traub describes the CLA as “light years ahead of the fill-in-the-blanks format of most standardized tests.”

Colleges, Accreditors Seek Better Ways to Measure Learning
Wall Street Journal, November 2006
Daniel Gordon explores the various means—including the CLA—through which colleges and universities are rethinking the role of assessment in higher education.

The Group Approach
The New York Times, November 2006
Karen Arenson profiles the Council of Independent Colleges’ consortium approach to the CLA.

Should College Students Be Tested to Hold Institutions Accountable for Student Learning?
Trusteeship, May/June 2006
Steve Uhlfedler and Stephen Klein articulate two perspectives on assessment.

Panel Explores Standard Tests for Colleges
The New York Times, February 9, 2006
Karen Arenson, New York Times reporter, looks at the role of the U.S. Secretary of Education’s Commission on the Future of Higher Education and features the CLA.

What Does College Teach?
The Atlantic Monthly, November 2005
Richard Hersh, CLA Adjunct Staff Member, begins by asking the provocative question: "What makes your college worth $35,000 a year?"

Life Isn’t a Multiple Choice Question
CAE, 2006
Richard Hersh, CLA Adjunct Staff Member, argues that what, where, and how we measure should reflect the outcomes we espouse.

Faster, Better, Cheaper: The Iron Triangle of Higher Education Assessment
CAE, 2006
Marc Chun, CAE Research Scientist, writes a piece chronicling the assessment options available to colleges and universities.

Measure by Measure
The Atlantic Monthly, 2006
Jay Matthews explores the advent of the CLA.

What Now? What Can We Do Once We Have the CLA Results?
CAE, 2006
Richard Hersh, CLA Adjunct Staff Member, explores the next steps institutions may take once they have received their CLA results.

Assessment

How the CLA Differs from No Child Left Behind
In the face of recent comparisons, Stephen Klein, CLA Director of Research and Development, discusses what sets the Collegiate Learning Assessment apart from NCLB.

Characteristics of hand and machine-assigned scores to college students’ answers to open ended tasks
2008
Stephen Klein examines whether scoring concerns related to open-ended measures of assessment can be addressed through machine scoring. This article may also be accessed by visiting the Institute of Mathematical Statistics Collections.

Assessment Versus Accountability in Higher Education: Notes for Reconciliation
March 2006
Roger Benjamin and Stephen Klein clarify the roles of assessment and accountability.

A Brief History of Student Learning Assessment
2007
Richard J. Shavelson, Stanford University, tracks the evolution of college learning assessment in the United States.

For the June 1, 2006 PowerPoint presentation on this topic, click here.

A Test of Leadership: Higher Education's Need to Reclaim Learning and Accountability
November, 2006
In a speech presented before the MHEC/SHEEO Summit, Richard Hersh discussed the Spellings Commission Report and the CLA's related role in higher education assessment.

Faculty

Recreating the Faculty Role in University Governance
November 9, 2005
Roger Benjamin, in this chapter (part of a forthcoming book, Fixing the Fragmented Public University: Decentralization with Direction, edited by Joseph C. Burke), reflects on the need to redefine governance and faculty participation in the public research university so as to increase faculty participation in governance.

For High School Assessment

Teaching to a Test Worth Teaching To
Richard Hersh, CLA Adjunct Staff Member, discusses some of the obstacles faced in current K-12 assessment practices.

Assessing Critical Thinking, Analytical Reasoning, Problem-Solving and Writing in High School
Richard Hersh, CLA Adjunct Staff Member, discusses how the application of the CLA may be adapted to meet K-12 assessment needs through the College and Work Readiness Assessment (CRWA).

Background and Context

Given a higher education system facing skyrocketing cost increases, huge state budget cuts and rapidly falling retention and graduation rates, it is not surprising that both the public and the state legislatures have renewed their demand for accountability and assurances of higher education quality.  Despite widespread agreement that student learning is at the core of the mission of all institutions of higher education, most measures of quality are based solely on factors that are at best indirectly tied to the institutional contributions to student learning.  Current approaches to determine quality depend primarily on "input" variables (such as SAT scores, endowment level), "output" variables (such as student satisfaction measures or self-reports), or rankings by college and university presidents. (See also Marc Chun's literature review of higher education assessment efforts.)

There has been no quality of learning metric that has been widely used as a benchmark for institutional efficacy; without an assessment regime focused on quality in terms of student learning, an accountability movement focused on input and budget factors will increasingly fill the vacuum to the detriment of higher education. Moreover, we believe it is imperative that the academy itself take the lead in the assessment of quality if it is to regain its rightful leadership and credibility and avoid the political micro management now seen in the K-12 high-stakes testing movement. 

The CLA focuses on student learning, and equating institutional quality with the "value added" of overall improvement in student skills.  Most observers agree that an "educated" college graduate ought to have knowledge and skills, as well as be able to use these to address situations they will face given the complexities of modern life, as well as to continue learning throughout life.  We therefore take as our starting point the elements that all higher education institutions share -- namely, that all students, regardless of major or professional ambition, should be proficient in critical thinking, analytic reasoning and written communication skills.

The implementation of the project rests on two key points.  First, assessment should be based on the institution (rather than the student) as the unit of analysis.  Second, assessment should be based on the value-added provided by colleges and universities.  If institutional quality is determined solely by the students' scores on entrance examinations, there is no measure of what students actually learned; similarly, if student ability is only measured upon graduation, there is no way to determine the students' relative growth while enrolled.  It is only by contrasting what students know and are able to do when they start college with what they know and are able to do when they finish that it is possible to assess the learning that actually occurred while in college.  Thus, the goal of the CLA project is to demonstrate the contributions institutions make to student learning and to provide institutions with information about how their contributions compare to those of other colleges with similarly situated students.  As a result, this assessment can serve as the basis for evaluation of the progress of the institution and individual programs and majors in contributing to student learning.

To explore the technical merits of this approach to measuring student learning, CAE completed a feasibility study in which the CLA measures were administered to 1,365 students from 14 colleges and universities.  The feasibility study provided empirical evidence that led to four key conclusions: (1) the measures can validly assess value added; (2) the measures could be used reliably with the institution as the unit of analysis; (3) the measures could be effectively machine-scored; and (4) the measures were found by students to be interesting and engaging.