This study looks at the use of curriculum maps, rubrics, new grading paradigms, use of the course management system in assessment, use of standardized testing, competency based courses, focus groups, pandemic-era special measures, and much else about the practice of student assessment in colleges and universities. Data and commentary in the report are derived from a survey of chief assessment officials and related officers at 40 colleges and universities. The study also looks at spending on assessment, trends in assessment office salaries and budgets, and relations of the assessment office with other student and college administrative services.
In addition, the study gives detailed data on the perception of assessment officers and those with similar college functions on the impact of their assessment efforts and the level of cooperation with them from faculty and administration. It includes an assessment of stakeholders (state government/boards of directors/accreditation agencies/etc.) of pressure for assessment-related results. Survey participants also list some of their favorite sources of assessment-related advice and name the college assessment efforts that they most admire - and why they admire them.
The report is designed to give its readers a tour of the assessment horizon, quickly enabling its readers to get up to speed on peer opinion and where that opinion is going - and why.
Just a few of the report’s many findings are:
- 27.5% of those sampled felt that faculty more or less just “paid lip service” to the college’s assessment efforts.
- Research oriented institutions were much likelier than others to say that assessment-related pressures from stakeholders had markedly increased in recent years.
- A mean of 8.24% of students tests out of the basic English writing and composition course designed for fist-year-students.
Table of Contents
- Characteristics of the sample
- Use of Curriculum Mapping
- Recommended Resources for Development of Curriculum Mapping
- Use of Rubrics
- How Colleges Encourage Use of Course Rubrics
- Institutional Home for Assessment Efforts
- Number of Employees in the Assessment Office or Other Office with this Function
- Salary for the Chief Assessment Officer
- Annual Budget for the Assessment Office
- Course Management Systems Commonly in Use
- Making Use of the Course Management System in Assessment
- Use of Standardized Testing in English Writing and Composition Competency Assessment
- Use of Standardized Testing in Information Literacy and Information Technology Use Competency Assessment
- Use of Standardized Testing in Mathematics Competency Assessment
- Policies on Accepting for Transfer Students the Results of Standardized Tests Conducted by Other Institutions
- Percentage of First Year Students Testing Out or Otherwise Qualifying for Opting Out of the Basic First Year English Writing Course
- Impact of the Pandemic on Use of Standardized Tests
- Confidence Level in Preparatory or Remedial Classes at the Institution
- Pandemic-Era Special Measures
- Frequency of Use of Focus Groups in Student Assessment Efforts
- Topics and Goals of Some Recent Focus Groups
- Use of Competency-Based Courses
- Extent of Faculty’s Role and College Administration’s Role in Developing College Assessment Strategy
- How College Faculty View the Assessment Effort
- Level of Coordination Among Various Administrative Departments in Assessment Efforts
- Impact of Assessment Efforts on Campus
- Measuring the Progress of Academic Departments in Assessment Goals
- Examples of How Assessment Efforts Led to Improved Results
- College Role Models for Assessment Efforts
- Pressure from Stakeholders to Achieve Assessment-Related Results
- Degree of Growth in Pressure from Stakeholders in the Past Two Years
- Experiments with New Grading or Evaluation Schemes During the Pandemic
Table 1.2 How common is the use of curriculum mapping by academic departments at your institution? Broken out by type of college or Carnegie class
Table 1.3 How common is the use of curriculum mapping by academic departments at your institution? Broken out by public or private college
Table 1.4 How common is the use of curriculum mapping by academic departments at your institution? Broken out by enrollment
Table 1.5 How common is the use of curriculum mapping by academic departments at your institution? Broken out by tuition, $ Recommend a website, publication, listserv, Libguide or other information source on how to develop an excellent curriculum map.
Table 2.1 How common is the use of rubrics, clear and transparent standards of grading and student evaluation, by instructors at your institution?
Table 2.2 How common is the use of rubrics, clear and transparent standards of grading and student evaluation, by instructors at your institution? Broken out by type of college or Carnegie class
Table 2.3 How common is the use of rubrics, clear and transparent standards of grading and student evaluation, by instructors at your institution? Broken out by public or private college
Table 2.4 How common is the use of rubrics, clear and transparent standards of grading and student evaluation, by instructors at your institution? Broken out by enrollment
Table 2.5 How common is the use of rubrics, clear and transparent standards of grading and student evaluation, by instructors at your institution? Broken out by tuition, $
How has your institution encouraged and stimulated the development of course rubrics?
Table 3.1 Does the college have an office of assessment or similar office or department that primarily devotes itself to assessment? Choose the phrase that best summarizes your college's position.
Table 3.2 Does the college have an office of assessment or similar office or department that primarily devotes itself to assessment? Choose the phrase that best summarizes your college's position. Broken out by type of college or Carnegie class
Table 3.3 Does the college have an office of assessment or similar office or department that primarily devotes itself to assessment? Choose the phrase that best summarizes your college's position. Broken out by public or private college
Table 3.4 Does the college have an office of assessment or similar office or department that primarily devotes itself to assessment? Choose the phrase that best summarizes your college's position. Broken out by enrollment
Table 3.5 Does the college have an office of assessment or similar office or department that primarily devotes itself to assessment? Choose the phrase that best summarizes your college's position. Broken out by tuition, $
Table 4.1 In FTE terms, how many employees are in the college’s office of assessment, or similar office that is primarily devoted to this function?
Table 4.2 In FTE terms, how many employees are in the college’s office of assessment, or similar office that is primarily devoted to this function? Broken out by type of college or carnegie class
Table 4.3 In FTE terms, how many employees are in the college’s office of assessment, or similar office that is primarily devoted to this function? Broken out by public or private college
Table 4.4 In FTE terms, how many employees are in the college’s office of assessment, or similar office that is primarily devoted to this function? Broken out by enrollment
Table 4.5 In FTE terms, how many employees are in the college’s office of assessment, or similar office that is primarily devoted to this function? Broken out by tuition, $
Table 5.1 Please choose an annual salary range for the highest ranking assessment officer at your institution:
Table 5.2 Please choose an annual salary range for the highest ranking assessment officer at your institution: Broken out by type of college or Carnegie class
Table 5.3 Please choose an annual salary range for the highest ranking assessment officer at your institution: Broken out by public or private college
Table 5.4 Please choose an annual salary range for the highest ranking assessment officer at your institution: Broken out by enrollment
Table 5.5 Please choose an annual salary range for the highest ranking assessment officer at your institution: Broken out by tuition, $
Table 6.1 What is the annual budget of the assessment office, including salaries and overhead? (in USD)
Table 6.2 What is the annual budget of the assessment office, including salaries and overhead? Broken out by type of college or Carnegie class (in USD)
Table 6.3 What is the annual budget of the assessment office, including salaries and overhead? Broken out by public or private college (in USD)
Table 6.4 What is the annual budget of the assessment office, including salaries and overhead? Broken out by enrolment (in USD)
Table 6.5 What is the annual budget of the assessment office, including salaries and overhead? Broken out by tuition, $ (in USD)
Which course management systems is in most common use at your institution?
Table 7.1 How important are the use of embedded features of your institutional course management system in the management of assessment at your institution?
Table 7.2 How important are the use of embedded features of your institutional course management system in the management of assessment at your institution? Broken out by type of college or Carnegie class
Table 7.3 How important are the use of embedded features of your institutional course management system in the management of assessment at your institution? Broken out by public or private college
Table 7.4 How important are the use of embedded features of your institutional course management system in the management of assessment at your institution? Broken out by enrollment
Table 7.5 How important are the use of embedded features of your institutional course management system in the management of assessment at your institution? Broken out by tuition, $
Table 8 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: (check all that apply)
Table 8.1.1 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: English Writing and Composition
Table 8.1.2 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: English Writing and Composition Broken out by type of college or Carnegie class
Table 8.1.3 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: English Writing and Composition Broken out by public or private college
Table 8.1.4 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: English Writing and Composition Broken out by enrollment
Table 8.1.5 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: English Writing and Composition Broken out by tuition, $
Table 8.2.1 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Library Services/Information Literacy
Table 8.2.2 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Library Services/Information Literacy Broken out by type of college or Carnegie class
Table 8.2.3 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Library Services/Information Literacy Broken out by public or private college
Table 8.2.4 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Library Services/Information Literacy Broken out by enrollment
Table 8.2.5 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Library Services/Information Literacy Broken out by tuition, $
Table 8.3.1 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Computer/Technology Literacy
Table 8.3.2 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Computer/Technology Literacy Broken out by type of college or Carnegie class
Table 8.3.3 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Computer/Technology Literacy Broken out by public or private college
Table 8.3.4 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Computer/Technology Literacy Broken out by enrollment
Table 8.3.5 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Computer/Technology Literacy Broken out by tuition, $
Table 8.4.1 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Mathematics
Table 8.4.2 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Mathematics Broken out by type of college or Carnegie class
Table 8.4.3 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Mathematics Broken out by public or private college
Table 8.4.4 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Mathematics Broken out by enrollment
Table 8.4.5 Does the college offer a standardized test to all students (except for those that might have qualified to not take a basic course) in any of the following areas: Mathematics Broken out by tuition, $
Table 9.1 For transfer students to the college, does the college generally accept the results of standardized placement tests taken at prior institutions?
Table 9.2 For transfer students to the college, does the college generally accept the results of standardized placement tests taken at prior institutions? Broken out by type of college or Carnegie class
Table 9.3 For transfer students to the college, does the college generally accept the results of standardized placement tests taken at prior institutions? Broken out by public or private college
Table 9.4 For transfer students to the college, does the college generally accept the results of standardized placement tests taken at prior institutions? Broken out by enrollment
Table 9.5 For transfer students to the college, does the college generally accept the results of standardized placement tests taken at prior institutions? Broken out by tuition, $
Table 10.1 Approximately what percentage of incoming first-year students at your institution test out of or otherwise qualify for opting out of the basic first-year student or other first year English writing course? if none put in "0".
Table 10.2 Approximately what percentage of incoming first-year students at your institution test out of or otherwise qualify for opting out of the basic first-year student or other first year English writing course? if none put in "0". Broken out by type of college or Carnegie class
Table 10.3 Approximately what percentage of incoming first-year students at your institution test out of or otherwise qualify for opting out of the basic first-year student or other first year English writing course? if none put in "0". Broken out by public or private college
Table 10.4 Approximately what percentage of incoming first-year students at your institution test out of or otherwise qualify for opting out of the basic first-year student or other first year English writing course? if none put in "0". Broken out by enrollment
Table 10.5 Approximately what percentage of incoming first-year students at your institution test out of or otherwise qualify for opting out of the basic first-year student or other first year English writing course? if none put in "0". Broken out by tuition, $
How has the pandemic impacted your institution's use of standardized tests for student acceptance, assessment and placement?
Table 11.1 How confident are you in the effectiveness of preparatory classes at your institution for students who do not immediately meet requirements in math, English or other core subjects?
Table 11.2 How confident are you in the effectiveness of preparatory classes at your institution for students who do not immediately meet requirements in math, English or other core subjects? Broken out by type of college or Carnegie class
Table 11.3 How confident are you in the effectiveness of preparatory classes at your institution for students who do not immediately meet requirements in math, English or other core subjects? Broken out by public or private college
Table 11.4 How confident are you in the effectiveness of preparatory classes at your institution for students who do not immediately meet requirements in math, English or other core subjects? Broken out by enrollment
Table 11.5 How confident are you in the effectiveness of preparatory classes at your institution for students who do not immediately meet requirements in math, English or other core subjects? Broken out by tuition, $
The pandemic has obstructed the intellectual development of many high school students. What measures has your college taken to remediate some of these consequences, for new and returning students?
Table 12.1 About how often do you use student focus groups in your assessment efforts?
Table 12.2 About how often do you use student focus groups in your assessment efforts? Broken out by type of college or Carnegie class
Table 12.3 About how often do you use student focus groups in your assessment efforts? Broken out by public or private college
Table 12.4 About how often do you use student focus groups in your assessment efforts? Broken out by enrollment
Table 12.5 About how often do you use student focus groups in your assessment efforts? Broken out by tuition, $
What were the topics and goals of some of the more instructive focus groups that you have held over the past two years?
How has the college deployed competency-based courses to improve its learning outcomes and assessment efforts? Such courses generally use various forms of standardized tests that students can take periodically to demonstrate competence.
Table 13.1 Which phrase best describes your college faculty's role in developing the college's assessment vehicles?
Table 13.2 Which phrase best describes your college faculty's role in developing the college's assessment vehicles? Broken out by type of college or Carnegie class
Table 13.3 Which phrase best describes your college faculty's role in developing the college's assessment vehicles? Broken out by public or private college
Table 13.4 Which phrase best describes your college faculty's role in developing the college's assessment vehicles? Broken out by enrollment
Table 13.5 Which phrase best describes your college faculty's role in developing the college's assessment vehicles? Broken out by tuition, $
Table 14.1 Which phrase best describes how your college's faculty views the assessment efforts of the college administration?
Table 14.2 Which phrase best describes how your college's faculty views the assessment efforts of the college administration. Broken out by type of college or Carnegie class
Table 14.3 Which phrase best describes how your college's faculty views the assessment efforts of the college administration. Broken out by public or private college
Table 14.4 Which phrase best describes how your college's faculty views the assessment efforts of the college administration. Broken out by enrollment
Table 14.5 Which phrase best describes how your college's faculty views the assessment efforts of the college administration. Broken out by tuition, $
Table 15.1 How well coordinated are these functions on your campus: advising, tutoring, counseling, placement and assessment?
Table 15.2 How well coordinated are these functions on your campus: advising, tutoring, counseling, placement and assessment? Broken out by type of college or Carnegie class
Table 15.3 How well coordinated are these functions on your campus: advising, tutoring, counseling, placement and assessment? Broken out by public or private college
Table 15.4 How well coordinated are these functions on your campus: advising, tutoring, counseling, placement and assessment? Broken out by enrollment
Table 15.5 How well coordinated are these functions on your campus: advising, tutoring, counseling, placement and assessment? Broken out by tuition, $
Table 16.1 Assessment efforts at your institution have:
Table 16.2 Assessment efforts at your institution have: Broken out by type of college or Carnegie class
Table 16.3 Assessment efforts at your institution have: Broken out by public or private college
Table 16.4 Assessment efforts at your institution have: Broken out by enrollment
Table 16.5 Assessment efforts at your institution have: Broken out by tuition. $
Table 17.1 Does the college have means or subject benchmarks to test the progress of various academic departments in particular disciplines to assess year to year progress in achieving student outcomes? Please comment if appropriate.
Table 17.2 Does the college have means or subject benchmarks to test the progress of various academic departments in particular disciplines to assess year to year progress in achieving student outcomes? Please comment if appropriate. Broken out by type of college or Carnegie class
Table 17.3 Does the college have means or subject benchmarks to test the progress of various academic departments in particular disciplines to assess year to year progress in achieving student outcomes? Please comment if appropriate. Broken out by public or private college
Table 17.4 Does the college have means or subject benchmarks to test the progress of various academic departments in particular disciplines to assess year to year progress in achieving student outcomes? Please comment if appropriate. Broken out by enrollment
Table 17.5 Does the college have means or subject benchmarks to test the progress of various academic departments in particular disciplines to assess year to year progress in achieving student outcomes? Please comment if appropriate. Broken out by tuition. $
Provide some examples of instances when assessment procedures revealed student or program deficiencies, how those deficiencies were addressed, and what were the results?
Which colleges do you feel have particularly good assessment practices and can serve as role models for others? What do you like about what they do?
Table 18.1 How much pressure from stakeholders such as boards of director, state governments, donors and benefactors, administrators and others is your school under to improve student assessment tools and student performance
Table 18.2 How much pressure from stakeholders such as boards of director, state governments, donors and benefactors, administrators and others is your school under to improve student assessment tools and student performance Broken out by type of college or Carnegie class
Table 18.3 How much pressure from stakeholders such as boards of director, state governments, donors and benefactors, administrators and others is your school under to improve student assessment tools and student performance Broken out by public or private college
Table 18.4 How much pressure from stakeholders such as boards of director, state governments, donors and benefactors, administrators and others is your school under to improve student assessment tools and student performance Broken out by enrollment
Table 18.5 How much pressure from stakeholders such as boards of director, state governments, donors and benefactors, administrators and others is your school under to improve student assessment tools and student performance Broken out by tuition. $
Table 19.1 Over the past two years how much has pressure grown, or not, to improve assessment and student performance?
Table 19.2 Over the past two years how much has pressure grown, or not, to improve assessment and student performance? Broken out by type of college or Carnegie class
Table 19.3 Over the past two years how much has pressure grown, or not, to improve assessment and student performance? Broken out by public or private college
Table 19.4 Over the past two years how much has pressure grown, or not, to improve assessment and student performance? Broken out by enrollment
Table 19.5 Over the past two years how much has pressure grown, or not, to improve assessment and student performance? Broken out by tuition, $
Did your institution experiment with new grading or formal evaluation schemes during the pandemic? If so, what were the results?
Samples
LOADING...
Methodology
LOADING...