general education assessment review: a report to the faculty assembly suny canton february 13, 2007

General Education General Education Assessment Review: A Assessment Review: A Report to the Faculty Report to the Faculty AssemblyAssembly

SUNY CantonSUNY Canton

February 13, 2007February 13, 2007

What is the purpose of What is the purpose of assessment at SUNY Canton?assessment at SUNY Canton?

Assessment is a simple method faculty can Assessment is a simple method faculty can use to collect feedback on how well the use to collect feedback on how well the students are learning what the faculty students are learning what the faculty believe the students are being taught. believe the students are being taught.

The purpose of assessment is to provide The purpose of assessment is to provide faculty and students with information and faculty and students with information and insights needed to improve teaching insights needed to improve teaching effectiveness and learning quality.effectiveness and learning quality.

College instructors use feedback gleaned College instructors use feedback gleaned through assessment to inform adjustments through assessment to inform adjustments in their teaching. in their teaching.

Faculty also share feedback with students, Faculty also share feedback with students, using it to help them improve their learning using it to help them improve their learning strategies and study habits in order to strategies and study habits in order to become more independent and successful become more independent and successful learners.learners.

History and Types of History and Types of AssessmentAssessment1. 1. General Education AssessmentGeneral Education Assessment GER 1—GER 10GER 1—GER 10 GER 11—GER 12 (Infused competencies)GER 11—GER 12 (Infused competencies)

2. Assessment in the Major2. Assessment in the Major

3. Student Opinion Survey (SOS) 3. Student Opinion Survey (SOS)

4. Strengthened Campus Based Assessment4. Strengthened Campus Based Assessment --Math --Math GER 1GER 1 --Basic Communication --Basic Communication GER 10GER 10 --Critical Thinking (Infused)--Critical Thinking (Infused) --NSSE--NSSE

Other forms of Assessment at SUNY Other forms of Assessment at SUNY Canton:Canton:

Student Opinion Survey (SOS)Student Opinion Survey (SOS)

National Survey of Student National Survey of Student Engagement (NSSE)Engagement (NSSE)

STUDENT OPINION SURVEY (SOS):STUDENT OPINION SURVEY (SOS):

SUNY sponsored for all state-operated SUNY sponsored for all state-operated schoolsschools

Comparison Group: Technology Colleges Comparison Group: Technology Colleges and all state-operated campusesand all state-operated campuses

Purpose: determine student satisfaction Purpose: determine student satisfaction with academics, student life and other with academics, student life and other services and facilitiesservices and facilities

(SOS cont.)(SOS cont.)

Started in 1985 and administered every Started in 1985 and administered every three yearsthree years

Most recent survey Spring 2006Most recent survey Spring 2006

Used to help with benchmarking and to Used to help with benchmarking and to understand better how students view understand better how students view services offered by SUNY Canton services offered by SUNY Canton

Results will be available on reserve in the Results will be available on reserve in the Library, Institutional Research office, and Library, Institutional Research office, and the Provost’s office, and will be published on the Provost’s office, and will be published on the SUNY Canton web site.the SUNY Canton web site.

NATIONAL SURVEY OF STUDENT NATIONAL SURVEY OF STUDENT ENGAGEMENT (NSSE):ENGAGEMENT (NSSE):

National SurveyNational Survey

SUNY mandated for Strengthening SUNY mandated for Strengthening Campus Based Assessment (SCBA)Campus Based Assessment (SCBA)

SUNY pays administrative and scoring SUNY pays administrative and scoring costs.costs.

Comparison Group: Comparison Group: Technology Colleges, all state-operated Technology Colleges, all state-operated campuses, and National Comparisons campuses, and National Comparisons

Purpose: assess student learningPurpose: assess student learning

Started: 2000 and offered every year but Started: 2000 and offered every year but SUNY Canton has not participatedSUNY Canton has not participated

SUNY Canton will participate in Spring 2008 SUNY Canton will participate in Spring 2008 with other State Operated Campuseswith other State Operated Campuses..

(NSSE cont.)

Future PlansFuture Plans

WebsiteWebsite Approved coursesApproved courses Assessment cycles for Gen-Ed, Assessment cycles for Gen-Ed,

Assessment in the Major, SOS, and Assessment in the Major, SOS, and NSSENSSE

GER requirementsGER requirements SUNY Canton RubricsSUNY Canton Rubrics GEAR reportGEAR report ResourcesResources

General Education General Education Assessment Assessment

GER 1—12GER 1—12

According to Barbara E. Valvord, an Ideal According to Barbara E. Valvord, an Ideal system for Assessment and Improvement of system for Assessment and Improvement of Student Learning includes the following Student Learning includes the following characteristics:characteristics:

1.1. Exams, assignments, and classroom Exams, assignments, and classroom participation are valid indicators of the participation are valid indicators of the actual learning that the teacher desiresactual learning that the teacher desires

2.2. Evaluations/analyses accurately reflect Evaluations/analyses accurately reflect learning and are appropriately learning and are appropriately diagnostic and explicit for their purposesdiagnostic and explicit for their purposes

3.3. The system promotes healthy The system promotes healthy motivation and fair treatment motivation and fair treatment

at every at every level.level.

4.4. Evaluations are Evaluations are communicated communicated appropriately to their appropriately to their various various audiences and serve their audiences and serve their purposespurposes

5.5. The system is efficient: no The system is efficient: no valuable valuable information is lost; no information is lost; no useless useless information is information is communicatedcommunicated

6. The system is sustainable in terms of 6. The system is sustainable in terms of time and resourcestime and resources

7. Appropriate autonomy is protected 7. Appropriate autonomy is protected (Walvoord(Walvoord))

Specific Assessment AreasSpecific Assessment Areas(Complete assessment plans are in the report Appendix.)(Complete assessment plans are in the report Appendix.)

(GER 1) MATHEMATICS:(GER 1) MATHEMATICS:

Students will demonstrate the ability to:Students will demonstrate the ability to: -interpret and draw inferences from -interpret and draw inferences from

mathematical models such as formulas, graphs, mathematical models such as formulas, graphs, tables and schematics;tables and schematics;

-represent mathematical information -represent mathematical information symbolically, visually, numerically and verbally;symbolically, visually, numerically and verbally;

(GER 1 cont.)(GER 1 cont.)

-employ quantitative methods such as, -employ quantitative methods such as, arithmetic, algebra, geometry or statistics to arithmetic, algebra, geometry or statistics to solve problems;solve problems;

-estimate and check mathematical results for -estimate and check mathematical results for reasonableness; andreasonableness; and

-recognize the limits of mathematical and -recognize the limits of mathematical and statistical methods.statistical methods.


METHODS:METHODS: The learning outcomes will be assessed by The learning outcomes will be assessed by

course embedded questions on hourly and course embedded questions on hourly and final exams for each of the designated math final exams for each of the designated math courses. The mathematics department will courses. The mathematics department will collect a random sample (20%) from these collect a random sample (20%) from these exams and employ the rubrics proposed by exams and employ the rubrics proposed by the “Discipline Panel in Mathematics – the “Discipline Panel in Mathematics – (09/08/05)” as the assessment tool.(09/08/05)” as the assessment tool.

The mathematics department assessment The mathematics department assessment team will develop and pilot exam questions, team will develop and pilot exam questions, conduct a training session on the use of the conduct a training session on the use of the rubrics, and will establish guidelines for rubrics, and will establish guidelines for levels of competence according to the levels of competence according to the SUNY discipline panel’s rubric levels.SUNY discipline panel’s rubric levels.

The actual grading process will include at The actual grading process will include at least two (2) mathematics faculty members least two (2) mathematics faculty members per exam question with the introduction of per exam question with the introduction of additional faculty in cases of disagreement. additional faculty in cases of disagreement. Papers will be scored as defined by the Papers will be scored as defined by the rubric and success will be determined per rubric and success will be determined per outcome if 70% of participants score 2 or 3. outcome if 70% of participants score 2 or 3.

(GER 1 cont.)

(GER 2) NATURAL SCIENCE:(GER 2) NATURAL SCIENCE:

Students will demonstrate:Students will demonstrate:

-understanding of the methods scientists -understanding of the methods scientists use to explore natural phenomena, including use to explore natural phenomena, including observation, hypothesis development, observation, hypothesis development, measurement and data collection, measurement and data collection, experimentation, evaluation of evidence, experimentation, evaluation of evidence, and employment of mathematical analysis; and employment of mathematical analysis; andand

-application of scientific data, concepts, and -application of scientific data, concepts, and models in one of the natural sciences.models in one of the natural sciences.


Methods:Methods:

Student learning outcome Student learning outcome one one will be will be assessed by administering a fifteen-assessed by administering a fifteen-question test developed by the science question test developed by the science faculty work group.faculty work group.

Student learning outcome Student learning outcome twotwo will be will be assessed by course embedded questions assessed by course embedded questions on hourly exams or final exams.on hourly exams or final exams.

(GER 3) SOCIAL SCIENCE:(GER 3) SOCIAL SCIENCE:


-understanding of the methods social -understanding of the methods social scientists use to explore social phenomena, scientists use to explore social phenomena, including observation, hypothesis including observation, hypothesis development, measurement and data development, measurement and data collection, experimentation, evaluation of collection, experimentation, evaluation of evidence, and employment of mathematical evidence, and employment of mathematical and interpretative analysis; and interpretative analysis;

AndAnd

knowledge of major concepts, models and knowledge of major concepts, models and issues of at least one discipline in the social issues of at least one discipline in the social sciences.sciences.

Method:Method:

Course embedded questions will be used to Course embedded questions will be used to assess both objectives. All courses listed assess both objectives. All courses listed that are taught within the Social Science that are taught within the Social Science cycle will be assessed.cycle will be assessed.

(GER 3 cont.)

(GER 4) AMERICAN HISTORY:(GER 4) AMERICAN HISTORY:


-knowledge of a basic narrative of American -knowledge of a basic narrative of American history: political, economic, social, and history: political, economic, social, and cultural, including knowledge of unity and cultural, including knowledge of unity and diversity in American society;diversity in American society;

-knowledge of common institutions in -knowledge of common institutions in American society and how they have American society and how they have affected different groups; andaffected different groups; and

-understanding of America’s evolving -understanding of America’s evolving relationship with the rest of the world.relationship with the rest of the world.

Method:Method: All students completing American History All students completing American History

(HIST 103, HIST 105, ECON 105, HIST (HIST 103, HIST 105, ECON 105, HIST 204, HIST 205, HIST 304) will be assessed. 204, HIST 205, HIST 304) will be assessed.

Mid-term and final examination questions Mid-term and final examination questions will be evaluated by the individual instructor will be evaluated by the individual instructor and another history faculty member. and another history faculty member.

A rating rubric will be used with individual A rating rubric will be used with individual student scores averaged to indicate level of student scores averaged to indicate level of performance. performance.

The instructor will provide a point scale of 0-The instructor will provide a point scale of 0-4 points indicating key content required for 4 points indicating key content required for each level.each level.

(GER 4 cont.)

(GER 5) WESTERN CIVILIZATION:(GER 5) WESTERN CIVILIZATION:

Students will:Students will:

-demonstrate knowledge of the -demonstrate knowledge of the development of the distinctive features of development of the distinctive features of the history, institutions, economy, society, the history, institutions, economy, society, culture, etc., of Western civilization; andculture, etc., of Western civilization; and

-relate the development of Western -relate the development of Western civilization to that of other regions of the civilization to that of other regions of the world.world.


Method:Method:

The assessment tool for Western Civilization (HIST The assessment tool for Western Civilization (HIST 101, HIST 102) will be course embedded. 101, HIST 102) will be course embedded.

A comprehensive question in the final exam will A comprehensive question in the final exam will reflect the two student outcomes listed for (GER 5).reflect the two student outcomes listed for (GER 5).

All students present at the final exam will be All students present at the final exam will be

evaluated by the individual instructor utilizing a evaluated by the individual instructor utilizing a rubric indicating exceeding meeting, approaching, rubric indicating exceeding meeting, approaching, and not meeting general education outcomes. and not meeting general education outcomes.

An additional history faculty member will also An additional history faculty member will also

evaluate the selected outcomes using the same evaluate the selected outcomes using the same standards.standards.

(GER 6) OTHER WORLD CIVILIZATIONS(GER 6) OTHER WORLD CIVILIZATIONS::

Students will demonstrate:Students will demonstrate: -knowledge of either a broad outline of world -knowledge of either a broad outline of world

history, history,

oror -the distinctive features of the history, -the distinctive features of the history,

institutions, economy, society, culture, etc., institutions, economy, society, culture, etc., of one non-Western civilization.of one non-Western civilization.


Method:Method:

The assessment tool for courses addressing The assessment tool for courses addressing (GER 6) will be course embedded. (GER 6) will be course embedded.

For assessment key components of the stated For assessment key components of the stated objectives in (GER 6) will be incorporated into objectives in (GER 6) will be incorporated into assigned research papers and/or examinations. assigned research papers and/or examinations.

All the students evaluated on the basis of a All the students evaluated on the basis of a rating rubric by the instructor responsible for the rating rubric by the instructor responsible for the course will have an additional faculty member course will have an additional faculty member in the discipline also evaluate the selected in the discipline also evaluate the selected outcomes using the same standards.outcomes using the same standards.

(GER 7) HUMANITIES:(GER 7) HUMANITIES:


-knowledge of the conventions and methods -knowledge of the conventions and methods of at least one of the humanities in addition of at least one of the humanities in addition to those encompassed by other knowledge to those encompassed by other knowledge areas required by the General Education areas required by the General Education program.program.


Method:Method: Students in all humanities courses designated as Students in all humanities courses designated as

general education, ones which are not general education, ones which are not encompassed by other knowledge areas required encompassed by other knowledge areas required by the General Education program, will be provided by the General Education program, will be provided with the outcome/objectives at the start of the with the outcome/objectives at the start of the semester. semester.

Students will complete at least one writing Students will complete at least one writing assignment that addresses the learning assignment that addresses the learning outcomes/objectives. outcomes/objectives.

These writing products may vary from class to class These writing products may vary from class to class but will be assessed in terms of the learning but will be assessed in terms of the learning outcomes/objectives and by the same rubric. outcomes/objectives and by the same rubric.

When assessment occurs, writing samples from all When assessment occurs, writing samples from all departments within the humanities will be chosen departments within the humanities will be chosen randomly, an equal number of writing products from randomly, an equal number of writing products from each department (on a course by course basis).each department (on a course by course basis).

(GER 8) THE ARTS:(GER 8) THE ARTS:


-understanding of at least one principal form -understanding of at least one principal form of artistic expression and the creative of artistic expression and the creative process inherent therein.process inherent therein.


Methods:Methods:

General Education Arts Assessment will be General Education Arts Assessment will be accomplished by reviewing two embedded accomplished by reviewing two embedded assignments designed for the student to assignments designed for the student to discuss the creative process in reference to a discuss the creative process in reference to a student’s creative writing, performance, or student’s creative writing, performance, or studio piece (with one assignment as a studio piece (with one assignment as a benchmark) benchmark)

OR one comprehensive exam from a random OR one comprehensive exam from a random sample of students drawn from all Arts sample of students drawn from all Arts approved courses being offered during the approved courses being offered during the sampling semester.sampling semester.

(GER 9) FOREIGN LANGUAGE:(GER 9) FOREIGN LANGUAGE:

Students will demonstrate:Students will demonstrate: -basic proficiency in the understanding and -basic proficiency in the understanding and

use of a foreign language; use of a foreign language;

andand -knowledge of the distinctive features of -knowledge of the distinctive features of

culture(s) associated with the language they culture(s) associated with the language they are studying.are studying.


Method:Method:

The assessment tool for Spanish I and The assessment tool for Spanish I and Spanish II will be course embedded. Spanish II will be course embedded.

Questions on the Comprehensive Final Questions on the Comprehensive Final Examination will be mapped to each of the Examination will be mapped to each of the two student learning outcomes listed for two student learning outcomes listed for (GER9) Foreign Language.(GER9) Foreign Language.

(GER 10) BASIC COMMUNICATION:(GER 10) BASIC COMMUNICATION:

Students will:Students will: -produce coherent texts within common -produce coherent texts within common

college-level written forms;college-level written forms;

-demonstrate the ability to revise and -demonstrate the ability to revise and improve such texts;improve such texts;

-research a topic, develop an argument, and -research a topic, develop an argument, and organize supporting details;organize supporting details;

-develop proficiency in oral discourse; and-develop proficiency in oral discourse; and

-evaluate an oral presentation according to -evaluate an oral presentation according to established criteria.established criteria.

(GER 10 cont.)

(GER 10 cont.)

Method:Method:

The first two student learning outcomes will The first two student learning outcomes will be assessed using the national normed test be assessed using the national normed test developed and administered by ACT. The developed and administered by ACT. The last three objectives will be measured using last three objectives will be measured using rubrics developed by the Humanities faculty.rubrics developed by the Humanities faculty.

The Director of Institutional Research will The Director of Institutional Research will select classes of ENGL 101 and ENGL 102 select classes of ENGL 101 and ENGL 102 students to be assessed for the student students to be assessed for the student learning outcomes.learning outcomes.

INFUSED COMPETENCIESINFUSED COMPETENCIES(GER 11) CRITICAL THINKING (GER 11) CRITICAL THINKING

(REASONING):(REASONING):


-identify, analyze, and evaluate arguments -identify, analyze, and evaluate arguments as they occur in their own or others’ work, as they occur in their own or others’ work,

andand

-develop well-reasoned arguments.-develop well-reasoned arguments.

(GER 11 cont.)

Method:Method:

Critical Thinking skills will be measured in the Critical Thinking skills will be measured in the Writing Intensive courses. Writing Intensive courses.

All Writing Intensive Courses are subject to All Writing Intensive Courses are subject to assessment. assessment.

The nationally normed test developed and The nationally normed test developed and administered by ACT will be used. This was be administered by ACT will be used. This was be tried at SUNY Canton for the first time Spring tried at SUNY Canton for the first time Spring semester 2006. semester 2006.

The courses to be tested will be selected by the The courses to be tested will be selected by the Director of Institutional Research. Since this Director of Institutional Research. Since this method of testing is new to the campus, there is method of testing is new to the campus, there is much to learn about the reports that will be much to learn about the reports that will be generated after the tests have been scored.generated after the tests have been scored.

(GER 12) INFORMATION (GER 12) INFORMATION MANAGEMENT:MANAGEMENT:


-perform the basic operations of personal -perform the basic operations of personal computer use;computer use;

-understand and use basic research -understand and use basic research techniques; andtechniques; and

-locate, evaluate, and synthesize -locate, evaluate, and synthesize information from a variety of sources.information from a variety of sources.

Method:Method:

A forty (40) question multiple choice test will A forty (40) question multiple choice test will be administered in Writing Intensive be administered in Writing Intensive sections.sections.

(GER 12 cont.)

General Education Assessment TeamGeneral Education Assessment Team2006-20072006-2007

Amani AwwadAmani Awwad

Mary BucherMary Bucher

Nadine JenningsNadine Jennings

Raymond KrisciunasRaymond Krisciunas

Christopher (Kit) SweeneyChristopher (Kit) Sweeney

Christopher NouryehChristopher Nouryeh

Michael PeeblesMichael Peebles

Linda Pellett, ChairLinda Pellett, Chair

Alice ReedAlice Reed

Judith SinghJudith Singh

ReferenceReference

Walvoord, Barbara E. Walvoord, Barbara E. Strengthening Campus-Based Strengthening Campus-Based Assessment. Assessment. SUNY AssessmentSUNY Assessment Workshop handout.Workshop handout.

general education assessment review: a report to the faculty assembly suny canton february 13, 2007

Documents

purpose of assessment

math ger

forms of assessment

types of assessment

student life

student satisfaction

faculty assembly suny

infused competencies