GCU's Office of Assessment seeks to remain flexible when it comes to assessment vocabulary in order to preserve each college's distinct disciplinary vocabulary and to avoid redundancy in reporting assessment results for those colleges which must also report to specialized accrediting agencies. Thus, some terms, such as objectives, goals, and learning outcomes, might be used to mean almost the same things as domains, sub-domains, and competencies at different times, in different disciplinary documents. However, for the most part, these terms are used at GCU in the following ways when talking about assessment:
AAC--Academic Affairs Committee. The AAC is a GCU-working committee comprised of academic leadership and faculty that recommend and approve new policies and procedures affecting the delivery of academic services and curricula. It is a key component of faculty governance on campus.
AAC&U--Association of American Colleges and Universities. The AAC&U is a national association that develops and advances assessment practices that deepen, integrate, and demonstrate student learning through advocacy of learning-centered assessment policies, support for campus work to develop meaningful assessment approaches, and experimentation with common e-portfolio frameworks. http://www.aacu.org/resources/assessment/index.cfm
AALHE--Association for the Assessment of Learning in Higher Education. The AALHE is an organization of practitioners interested in using effective assessment practice to document and improve student learning. http://aalhe.org/
ACBSP--Accreditation Council for Collegiate Business Schools & Programs. The ACBSP, founded in 1988, was created by its members to fulfill a need for specialized accreditation by institutions of higher education with business schools and programs. http://www.acbsp.org/p/cm/ld/fid=204
Accreditation--The designation that an institution earns indicating that it functions appropriately with respect to its resources, programs, and services. The accrediting association, often comprised of peers, is recognized as the external monitor. Maintaining fully accredited status ensures that the university remains in compliance with federal expectations and continues to receive federal funding.
Alignment--The logical connection between learning outcomes and the curriculum. Curriculum mapping is an example of the alignment process.
ALT--Academic Leadership Team. The ALT is a GCU academic body comprised of individuals representing the highest levels of leadership from each college and academic service. This group oversees the policies, procedures, and processes that ensure academic and institutional integrity.
AMT Report--Academic Metrics and Trends Report. The AMT Report is a quantitative report generated by the Office of Budget and Financial Analysis several times a month. The report contains key student performance data disaggregated at the course level, tracking student pass rates, withdraw rates, failure rates, persistence, retention, and a number of other statistics.
Analytic Rubric--A rubric that articulates and measures levels of performance or competencies for a set of criteria. Each criterion is scored individually. An analytical rubric is in contrast to a holistic rubric.
Anchor--A student artifact that represents a specific level of performance. An anchor is used by raters to score student work, usually comparing the student's performance to the anchor.
ANGEL--GCU's primary Learning Management System (LMS) from 2007-2012. ANGEL stands for "A New Global Environment for Learning."
Artifact--A student work product that is assessed to evaluate the level of competency mastery.
ASL--Assessment of Student Learning. The ASL is Grand Canyon University's campus-wide assessment of student learning process. It is conducted by the Office of Assessment, applied to all levels, and covers key mission-based competencies.
Assessment: Collection and analysis of information about student learning and institutional effectiveness.
Assessment Findings--Data that have been collected to serve as evidence of student learning.
Assessment Instrument--A tool used to evaluate assignments, activities, artifacts, or events that support outcomes or objectives. These can be measurement tools such as standardized tests, locally designed tests, exit interviews, or student, alumni, or staff surveys.
Assessment Methods--Tools or instruments used for measuring student learning. Direct measures demonstrate student performance of objectives and can include research essays, oral presentations, projects, performances, portfolios, examinations, case study analyses, and internships. Indirect methods, from which student perception is assessed, include surveys and interviews.
Assessment Plan--A document that outlines and describes assessment activities, including identifying learning outcomes or program competencies, benchmarks, findings, improvement action plans, and status reports.
Authentic Assessment--A form of assessment that measures a student's ability to demonstrate meaningful application of skills and knowledge. Authentic assessment usually consists of a task that students perform, as opposed to taking an exam. This form of assessment can take place repeatedly in order to measure the ability to apply knowledge and skills and meet learning outcomes. Authentic assessment most often utilizes a rubric to measure a student's performance level associated with a learning outcome. Authentic assessment is also called performance-based assessment.
Automated Rubric--This analytic rubric makes use of an LMS feature (either ANGEL or LoudCloud) to create a system-generated rubric that allows faculty to score the work product. The LMS stores these scores in a database. They are important pieces of data in most college assessment plans.
Benchmark--A defined standard or measure that serves as a point of reference by which performance is measured. It identifies a specific level of performance.
Benchmark Assessment--Assessments or measurements that evaluate student performance, knowledge or skills relative to a defined, explicit set of learning outcomes or goals.
Benchmark Assignment--An assignment that is used to measure a specific level of proficiency or mastery.
Blind Review--A method for review and assessment of artifacts after all identifiers have been removed. This technique is used in GCU's annual ASL process.
Bloom's Taxonomy--A classification of levels of thinking or learning that range from a basic level of thinking to a more sophisticated level of thinking (remembering, understanding, applying, analyzing, evaluating, and creating). Bloom identified three domains of learning: cognitive, or knowledge; affective, or attitude; and psychomotor, or skills. The cognitive domain involves levels of learning and intellectual outcomes. Within this domain are categories that are arranged in order of increasing complexity from the foundational level of thinking to the highest level of creating new ideas. These include:
CAATE--The Commission on Accreditation of Athletic Training Education. The organization produces the Academic Accreditation of Professional Athletic Training Programs Standards. http://www.caate.net/
CAE--Council for Aid to Education. The CAE is a national nonprofit organization based in New York City and focused on improving quality and access in higher education. Central to that focus is the Collegiate Learning Assessment (CLA), a national effort to assess the quality of undergraduate education by directly measuring student learning outcomes. http://www.cae.org/default.asp
CAEP--Council for the Accreditation of Educator Preparation. The CAEP ensures the preparation of highly qualified educators through the accreditation of programs in which data drive decisions, resources and practices support candidate learning, and candidates demonstrate knowledge, skills, and professional dispositions geared toward raising student achievement. NCATE and TEAC are in the process of transferring non-accreditation functions to CAEP and expect to complete these tasks no later than December 2012. Because the U.S. Department of Education requires CAEP to perform a small number of accreditation decisions before it recognizes the new accrediting body, the transfer of accreditation functions will take place during 2013. http://www.caepsite.org/
CCNE--Commission on Collegiate Nursing Education. The CCNE is an autonomous accrediting agency contributing to the improvement of the public's health. The commission ensures the quality and integrity of baccalaureate, graduate, and residency programs in nursing. It also serves the public interest by assessing and identifying programs that engage in effective educational practices. http://www.aacn.nche.edu/ccne-accreditation
CD--Curriculum Developer. At GCU, curriculum developers are part of Curriculum Design and Development (CDD) and work on course revisions and new course development.
CDD--Curriculum Design and Development. CDD is a professional services group at GCU that assists the colleges in the development of programs of study and in course development.
CHEA--The Council for Higher Education Accreditation. A national advocate and institutional voice for self-regulation of academic quality through accreditation, the CHEA is an association of 3,000 degree-granting colleges and universities and recognizes 60 institutional and programmatic accrediting organizations. http://www.chea.org/
CLA--This acronym is used for two terms in this glossary that are unrelated to each other.
1. Collegiate Learning Assessment--A national web-based assessment designed to assess critical thinking, analytic reasoning, problem solving, and written communication. The CLA is offered in the fall to freshmen and in the spring to seniors. Both cross-sectional and longitudinal studies are available. Over 500 institutions have participated in the CLA. http://www.collegiatelearningassessment.org/
2. Center for Learning & Advancement--The GCU Center for Learning & Advancement oversees the following areas related to student support and enrichment: Tutoring, Lifelong Learning Assessment, First Year Experience Program, Honors Institute, and Study Abroad.
Cohort--A group of students that begin a program together.
Competencies--The specific skills developed within a program of study, or what students should be able to do after completing the program. In GCU Program Maps, domains are associated with specific competencies developed in individual courses.
Course Assessment--A method of evaluating student learning through course assignments, quizzes or projects that are designed to demonstrate the achievement of the articulated goals of learning outcomes at the course level.
Criterion-Referenced Test (CRT)--A testing method by which scores are based on specific, articulated criteria. The CRT, also called standards-based assessment, is in contrast to norm-referenced tests that compare an individual score against a group.
Cross-Sectional Study--A study in which the performance of a specified individual or group is observed at one point in time. The CLA (Collegiate Learning Assessment) test conducts a cross-sectional study of freshmen in the fall and seniors in the spring of every year.
Culture of Assessment--An institutional characteristic that shows evidence for valuing and engaging in assessment for ongoing improvement.
Curriculum Map--A matrix that documents the connection between outcomes (what students will be able to do or demonstrate as a result of their studies) and where the curriculum addresses those outcomes. A curriculum map can be an analytic tool for tracking and aligning curriculum content to learning outcomes. GCU uses the curriculum map feature in TaskStream to track the benchmark assignments in college programs and align them to learning competencies.
Detailed Course Outline (DCO)--A document created by CDD and the colleges that works as an outline or a framework for the development of a new course. DCOs are started during the program design process, where they bridge programmatic competencies and course objectives. Later, the Subject Matter Expert (SME) and the Curriculum Developer (CD) flesh out the DCO with content suggestions, lecture summaries, benchmark info, and assessment summaries.
Direct Measure--An assessment method that utilizes student work to demonstrate competency in specific student learning outcomes. Direct measures include:
Disaggregate--To divide a whole into parts or groupings.
Domains--The educational tracks, themes, and expectations in a particular course or set of courses. Specifically, a domain is a key thematic element that runs throughout a program, including domains derived from the mission statement. Domains are used at GCU primarily in the Program Designs and Maps that are produced for each program/program of study through CDD.
Effectiveness--The degree to which programs, events, activities or institutions achieve intended results and purposes.
Embedded Assessment--A form of assessment that gathers information on proficiency through regular activities. When assessment is embedded, it is routine, unobtrusive, and an ongoing part of the teaching-learning or operational process.
EOCS--End of Course Survey. EOCS are offered to all GCU students at the end of a course.
EOPS--End of Program Survey. EOPS are offered to GCU students at the end of a program.
ETS--Educational Testing Service. ETS is a nonprofit organization that develops, administers, and scores more than 50 million tests annually-including the TOEFL® and TOEIC® tests, the GRE® General and Subject Tests, and The Praxis SeriesTM assessments-in more than 180 countries. http://www.ets.org/
ETSPP--Educational Testing Services Proficiency Profile. The ETSPP assesses four core skill areas-critical thinking, reading, writing and mathematics-in a single test to gauge general education outcomes for improvements in the quality of instruction and learning. http://www.ets.org/proficiencyprofile/about
FEOCS--Faculty End of Course Survey. FEOCS are offered to all GCU faculty at the end of each course.
Formative Assessment--An assessment method that uses assessment information as immediate feedback to improve instruction and student performance and is therefore used by individual faculty members in ongoing activities.
Goals--The educational expectations of a planned program or set of programs, such as the goals of a particular college or the overall GCU goals. The term is associated primarily with program- and institutional-level assessment.
HERI--Higher Education Research Institute. HERI serves as an interdisciplinary center for research, evaluation, information, policy studies, and research training in postsecondary education. HERI is located in the Graduate School of Education at UCLA. http://www.heri.ucla.edu/index.php
HLC--Higher Learning Commission. The HLC is an independent corporation and one of two commission members of the North Central Association of Colleges and Schools (NCA), which is one of six regional institutional accreditors in the United States. The HLC accredits degree-granting post-secondary educational institutions in the North Central region. http://www.ncahlc.org/
Holistic Rubric--A rubric that assigns a level of performance by measuring performance across multiple criteria as a whole. It does not give single scores for each criterion. A holistic rubric is in contrast to an analytic rubric.
Holistic Scoring--A method of obtaining a score that results from an overall judgment of performance using specified criteria.
ICS--Initial Course Survey. The ICS is a survey offered to all GCU students in the middle of their first course.
ID--Instructional Designer. At GCU, instructional designers are part of Curriculum Design and Development (CDD) and work on program revisions and new program development.
Indirect Measure--A method that assesses learning student opinion or perception rather than knowledge, skills, or abilities. Indirect measures include:
Institutional Effectiveness--The measure of an organization's achievement of articulated goals.
Inter-Rater Reliability--The extent to which two or more scorers or raters reach agreement in assessment.
LC--LoudCloud. LoudCloud has been GCU's primary Learning Management System (LMS) from 2012 forward.
Learning Outcomes or Student Learning Outcomes--The expected learning outcomes of an educational experience or a series of educational experiences (assignment outcomes, course outcomes, and program outcomes). Learning outcomes are most often associated with course- and program-level assessment.
Likert Scale--A method used in questionnaires and surveys to prompt a respondent to express a view on a statement being presented, thereby signaling his or her level of agreement or disagreement with the statement presented.
LMS--Learning Management System. The online web-based interface that facilitates online classes and the web-enhanced components of hybrid classes. Content is presented, forums are used for asynchronous communication, and assignments and quizzes are collected and completed.
Longitudinal Study--A study in which a specified individual or group is followed over a period of time to discover changes that may be attributable to the influence of the educational experience.
Measurement Tool--Any standardized method used to collect data for assessing outcomes.
Mission Statement--A statement that articulates an organization's essential nature, its values, and its work.
NCA--North Central Association. Also known as the North Central Association of Colleges and Schools. The Higher Learning Commission (NCA-HLC) is one of six regional institutional accreditors in the United States. Its membership include 19 institutions in the states of, Arizona, Arkansas, Colorado, Illinois, Indiana, Iowa, Kansas, Michigan, Minnesota, Missouri, Nebraska, New Mexico, North Dakota, Ohio, Oklahoma, South Dakota, West Virginia, Wisconsin, Wyoming. The Higher Learning Commission accredits degree-granting post-secondary educational institutions in the North Central region. http://www.ncahlc.org/
NCATE--The National Council for the Accreditation of Teacher Education. NCATE is the profession's mechanism to help establish high-quality teacher preparation. NCATE was founded in 1954. When NCATE was founded as an independent accrediting body, it replaced AACTE as the agency responsible for accreditation in teacher education. NCATE and TEAC are in the process of transferring non-accreditation functions to CAEP and expect to complete these tasks no later than December 2012. Because the U.S. Department of Education requires CAEP to perform a small number of accreditation decisions before it recognizes the new accrediting body, the transfer of accreditation functions will take place during 2013. http://www.ncate.org/
NOAA--The NOAA (National Office for Arts Accreditation) is the parent organization of the separate Arts-accrediting bodies in COFAP. http://www.arts-accredit.org/index.jsp?page=NOAA
Norm-Referenced Test (NRT)--A testing method by which an individual's score is compared to peer scores. It contrasts with criterion-referenced tests, where scores are based on specific criteria.
Norming--The process by which assessment readers learn to apply rubric criteria consistently to student work products and align their scoring.
NSSE--National Survey of Student Engagement. The NSSE is a survey instrument that collects information at hundreds of four-year colleges and universities about student participation in programs and activities that institutions provide for their learning and personal development. The results provide an estimate of how undergraduates spend their time and what they gain from attending college. More than 1,400 different colleges and universities in the U.S. and Canada have participated in NSSE since it was first administered in 2000. http://nsse.iub.edu/
Objective Measure--Data that avoid bias from observers' feelings, interpretations, or other extraneous factors.
OPs--Refers to the operations side of GCU rather than the academic side. OPs generally encompass enrollment, academic counseling, financial aid, campus operations, and marketing.
Objectives--The educational expectations of a planned course of learning experiences, or in other words the skills and knowledge that students develop within a specific course, expressed in terms of Bloom's taxonomy. The term "objectives" is thus primarily associated with course-level assessment and is generally used as synonymous with "expected learning outcomes."
Outcome-Based Education--An educational approach or philosophy focusing on student learning that is achieved and assessed utilizing a system of established goals or learning outcomes.
PDD--Program Design Document. The PDD is a summary of programmatic outcomes using Domains and Competencies developed by GCU and CDD.
Pedagogy--The art and science of how something is taught and how students learn it. Pedagogy refers to the approach to teaching and learning, the way the content is delivered, and what the students learn as a result of the process.
Performance-based Assessment--Also called authentic assessment, performance-based assessment uses real-life tasks to measure performance.
Portfolios--A systematic and organized collection of a student's work that exhibits to others the direct evidence of a student's efforts, achievements, and progress over a period of time.
POS--Program of study.
Program Assessment--An ongoing process of measuring the extent to which students are learning specific knowledge and skills determined by the faculty within programs. The results are then used by faculty to substantiate curriculum and pedagogical changes needed to enhance student learning.
Program Design--A summary of programmatic outcomes using Domains and Competencies, developed by the college and CDD.
Program Outcome--The specific, measureable knowledge, skill, or ability that students should be able to demonstrate as a result of their program of study.
Program Review--An in-depth process of reviewing aspects of a college's program and assessing the efficacy and validity of a program on a three-year cycle.
Qualitative Data--Non-numeric information, such as conversation, text, audio, or video.
Quantitative Data--Numeric information including quantities, percentages, and statistics.
Reliability--The extent to which a set of results can be generalized and repeated over time, across tasks, and among interpreters. Reliability indicates how consistently assessment procedures measure their specified target with high levels of agreement.
Rubric--A scoring and instructional tool used to assess student performance using a task-specific range or set of criteria. A rubric is used to measure student performance against this pre-determined set of criteria and contains the essential criteria for the task and levels of performance (i.e., from low to high) for each criterion.
Sample--A defined subset of the population based on defined criteria.
Scaffolding--An instructional technique in which a complex task is divided into smaller tasks to accomplish the desired learning strategy.
Standard of Performance--A specific expectation of student performance that shows progress toward a criterion.
Student Artifact--A written sample of a student assignment, such as an essay or subject paper.
Student Learning Outcomes or Learning Outcomes--The expected learning outcomes of an educational experience or a series of educational experiences (assignment outcomes, course outcomes, program outcomes). Learning outcomes are most often associated with course and program-level assessment.
Subjective Measure--A score, grade, or evaluation that relies on opinion or judgment.
Summative Assessment--An assessment method that is culminating and does not inform the immediate learning experience. The goal of summative assessment is to make a judgment of student competency after an instructional phase is complete. A department or program would conduct summative assessment at the completion of the major or the end of the program to ensure students have met the major or program goals and objectives.
Target--The level of student performance expected for an outcome. GCU uses acceptable and ideal target performance in programmatic assessment. Targets identify the percentage of students who will achieve a specified score.
TaskStream AMS (Accountability Management System)--GCU's web-based system for managing and tracking programmatic assessment. Used by each college, TaskStream AMS provides a means for curriculum mapping, recording assessment plans and findings, and tracking improvement actions plans and status reports. In addition, the University Assessment of Student Learning (ASL) benchmarks and result reports are in TaskStream.
TaskStream LAT (Learning Achievement Tools)--GCU's web-based e-portfolio system, used by the College of Education. TaskStream LAT assists students in building a portfolio of key benchmark assignments related to programmatic requirements and outcomes, and is used by faculty to evaluate artifacts.
TEAC--Teacher Education Accreditation Council. Founded in 1997, TEAC is a nonprofit organization dedicated to improving academic degree programs for professional educators, those who will teach and lead in schools pre-K through grade 12. TEAC's primary work is accrediting undergraduate and graduate professional education programs in order to assure the public about the quality of college and university programs. The education program, not the college, school, department, or other administrative unit of the institution, receives TEAC accreditation. NCATE and TEAC are in the process of transferring non-accreditation functions to CAEP and expect to complete these tasks no later than December 2012. Because the U.S. Department of Education requires CAEP to perform a small number of accreditation decisions before it recognizes the new accrediting body, the transfer of accreditation functions will take place during 2013. http://www.teac.org/
TOEFL--Test Of English as a Foreign Language. TOEFL is one of several nationally recognized tests that assess the level of English competency for non-native speakers who wish to apply to a US institute of higher education.
Triangulation--A method of data collection using multiple methods in order to determine if the results show a consistent outcome.
UAC--University Assessment Committee. The University Assessment Committee (UAC) identifies assessment goals for the University, provides discussion and assistance in the development of assessment tools, and assists with creating a culture of assessment at GCU.
UBD--Understanding by Design. UBD is an instructional design model based on backwards design that focuses on student understanding by beginning with desired outcomes and working backwards through curriculum design, assessment development, and classroom instruction. Used to programmatic outcomes.
University Mission Critical Competencies--The Mission Critical competencies are an articulation of the core skills Grand Canyon University expects of all students, regardless of college, program, or major, upon completion of a degree. These expectations reflect the Christian liberal arts nature of GCU's educational experience, and demonstrate the connection of all University programs of study, and the courses that make up those programs, to a Christian liberal arts heritage. These competencies include:
Validity--The degree to which evidence or results support a specific interpretation of test scores or results. Validity is a concept that defines quality in assessment. It addresses the extent to which assessment methods actually measure what is intended and provide accurate information that supports its intended purpose.
Value added--The increase in learning that occurs during a course, program, or by the completion of a degree. Measurement of value added can focus on the individual student (how much better a student can write, for example, at the end than at the beginning) or on a cohort of students (i.e., senior papers that contain more sophisticated writing skills than freshmen papers). A baseline measurement is required for comparison.
Allen, Mary; Noel, Richard, C.; Rienzi, Beth, M.; and McMillin, Daniel, J. (2002). Outcomes Assessment Handbook. California State University, Institute for Teaching and Learning, Long Beach, CA. Retrieved from http://www.academicprograms.calpoly.edu/content/assessment/assessplanguide#glossary
Bloom B.S. (1956). Taxonomy of Educational Objectives, Handbook 1 : The Cognitive Domain. New York: David Mckay Co. Inc.
Hambleton, Ronald. Criterion-Referenced Tests. The Gale Group, http://www.education.com/reference/article/criterion-referenced-tests1/
Heer, Rex (2011). A Model of Learning Objectives-based on A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives. Center for Excellence in Learning and Teaching, Iowa State University . Retrieved from http://www.celt.iastate.edu/teaching/RevisedBlooms1.html
Herman, J. L., Osmundson, E., & Dietel, R. (2010). Benchmark assessments for improved learning (AACC Policy Brief). Los Angeles, CA: University of California. Retrieved from http://www.cse.ucla.edu/products/policy/R1_benchmark_polbrief_Herman.pdf
George Washington University. Office of Academic Planning, Institutional, Research, and Assessment. Retrieved from http://www.gwu.edu/~assess/programtoolkit.html
Mueller, Jon. (2012). Authentic Assessment Toolbox. North Central College, Naperville, Il. Retrieved from http://jfmueller.faculty.noctrl.edu/toolbox/whatisit.htm
North Central Regional Educational Laboratory. (2002) Glossary of Education Terms and Acronyms. Retrieved from www.ncrel.org/sdrs/areas/misc/glossary.htm
Oakland Community College. Student Outcomes Assessment. (2010) Assessment Terminology. Retrieved from http://www.oaklandcc.edu/Assessment/terminology.aspx
Santa Clara University . Office of Assessment. (2011) Assessment Glossary. Retrieved from http://www.scu.edu/provost/assessment/programs/glossary.cfm
University of Texas at Austin. (2011) Institutional Effectiveness Glossary. Retrieved from http://www.utexas.edu/provost/planning/assessment/iapa/resources/pdfs/Glossary.pdf