standard 1 the institution’s mission and goals define the institution the institution’s mission...
TRANSCRIPT
Standard 1Standard 1
The institution’s mission and goals define The institution’s mission and goals define the institutionthe institution
……evaluation proceeds from the evaluation proceeds from the institution’s own definition of its mission institution’s own definition of its mission and goals.and goals.
The institution engages in ongoing The institution engages in ongoing planning to achieve its mission and goals.planning to achieve its mission and goals.
Standard 1Standard 1
The institution’s mission and goals The institution’s mission and goals widely understood by, the campus widely understood by, the campus are periodically reexaminedare periodically reexaminedappears in appropriate institutional publications appears in appropriate institutional publications give direction to all its give direction to all its
» educational activities, educational activities, » to its admission policies, to its admission policies, » selection of faculty, selection of faculty, » allocation of resources, allocation of resources, » and to planning.and to planning.
Standard 1Standard 1
The institution reviews with the The institution reviews with the Commission Commission changes that would alter its mission changes that would alter its mission intention to offer a degree at a higher level than intention to offer a degree at a higher level than
is included in its present accreditation is included in its present accreditation
[Policy A-2 [Policy A-2 Substantive ChangeSubstantive Change]]
Standard 1Standard 1
Through its planning process, the Through its planning process, the institution asks questions, seeks answers, institution asks questions, seeks answers, analyzes itself, and revises its goals, analyzes itself, and revises its goals, policies, procedures, and resource policies, procedures, and resource allocation.allocation.
clearly defines its evaluation and planning clearly defines its evaluation and planning processes processes
engages in systematic planning engages in systematic planning process is participatory process is participatory
Faculty Data
Qualifications: degrees, sources of degrees, experience
Faculty Rank Salaries and Benefits. Comparison data, e.g. from
the College and University Personnel Association (CUPA)
Number, sufficient for the mission
Faculty Data
Workload Retention data Exit interview data Student survey data on faculty advising, etc. Standard faculty surveys with comparisons
Policies and Implementation
Academic planning, curriculum development and review
Academic advising Faculty role in governance
Give examples and data about how policies are applied.
Policies and Implementation
Salaries and Benefits Workload: amount and the procedure for
assignment Systematic faculty evaluation (See 4.1) Personnel policies and procedures Recruitment and appointment
Standard 4.B
ScholarshipResearchArtistic Creation
Time to Catch Up
If data is not available, make a plan to collect pertinent information.
If policies are not in place or outdated, inform decision makers and get moving!
Faculty Evaluation, 4.1
Clear proceduresOngoing, regularBased on the institution’s
SizeComplexityMission
Faculty Evaluation, 4.1
Multiple indices that may include Annual merit salary evaluations Promotions Tenure reviews Post-tenure reviews Student/peer/administrator evaluations of teaching and
service Peer review of scholarship
Faculty Evaluation, 4.1
A comprehensive evaluation of each faculty member at least once every five years.
A policy that addresses concerns that may arise between regular evaluations
Standard 9Standard 9
adheres to the highest ethical standards adheres to the highest ethical standards in its representationin its representation
advocates high ethical standards in the advocates high ethical standards in the management and operations management and operations
policy defines and prohibits conflict of policy defines and prohibits conflict of interest interest
commitment to the free pursuit and commitment to the free pursuit and dissemination of knowledge consistent with dissemination of knowledge consistent with the institution’s mission the institution’s mission
Data CollectionData Collection
Implement Trustworthy Methods Implement Trustworthy Methods
ReliabilityReliability Carry out systematic, well-defined processesCarry out systematic, well-defined processes Use well-designed instrumentsUse well-designed instruments
ValidityValidity Measure the right thingMeasure the right thing Minimize sources of contamination and biasMinimize sources of contamination and bias
SufficiencySufficiency Use multiple methodsUse multiple methods Think of how findings are supportedThink of how findings are supported
SamplingSampling Use proper sampling (mostly random)Use proper sampling (mostly random) Think of sample sizeThink of sample size
PROCESS & INPUT
DESCRIPTIONS
ANECDOTES & WAR STORIES
REPUTATIONFEELING & IMPRESSIONS
Data CollectionData Collection
Select MethodsSelect Methods
Embedded test questionsEmbedded test questions Capstone projectsCapstone projects Portfolio evaluationPortfolio evaluation Nationally normed testsNationally normed tests Focus groups , interviewsFocus groups , interviews Pre- and post-testingPre- and post-testing VideotapesVideotapes Outside expertsOutside experts Licensure and qualifying Licensure and qualifying
examinations.examinations. Research/creative projectsResearch/creative projects Review boardsReview boards
Telephone surveysTelephone surveys Internships, practicaInternships, practica Exit interviewsExit interviews Data from past reports and Data from past reports and
studiesstudies Narrative descriptionsNarrative descriptions SurveysSurveys Formal studiesFormal studies Interviews, focus groupsInterviews, focus groups Multiple sourcesMultiple sources Expert judgmentExpert judgment And many others . . . And many others . . .
Data Collection Data Collection
Get the data you need.Get the data you need.
““Mountains of data that never get Mountains of data that never get digested or used to improve programs digested or used to improve programs represent a monumental waste of represent a monumental waste of faculty/staff energy and good will.”faculty/staff energy and good will.”
Task Force on Assessment, Willamette U.Task Force on Assessment, Willamette U.
Data you need (part 1)Data you need (part 1)
For each Commission standard:For each Commission standard: Do we comply?Do we comply? What evidence do we have to show What evidence do we have to show
compliance?compliance? If we don’t have evidence, how will we get If we don’t have evidence, how will we get
it?it? If we don’t comply, what is our plan to If we don’t comply, what is our plan to
comply?comply?
RequirementRequirement ComplianceCompliance EvidenceEvidence Course of ActionCourse of Action
Standards Analysis Worksheet
Data you need (part 1)Data you need (part 1)
Accreditation Standards WorksheetStandard One – Institutional Mission and Goals, Planning and EffectivenessStandard 1.A – Mission and Goals
RequirementRequirement ComplianceCompliance EvidenceEvidence Course of ActionCourse of Action
1.A.1 1.A.1 Widely understoodWidely understood
Adopted by Board; Adopted by Board; Periodically reexaminedPeriodically reexamined
??????
YESYES
None.None.
Memo from board or Memo from board or other public statementother public statementMeeting minutes, Meeting minutes, agendas.agendas.
Conduct survey. Conduct survey. Interview students and Interview students and faculty.faculty.
Acquire memo or Acquire memo or statement. Acquire statement. Acquire minutes, agendas;minutes, agendas;Generate narrative of Generate narrative of outcomes assessment outcomes assessment activity & provide results.activity & provide results.
1.A.2 Mission published1.A.2 Mission published YESYES Catalog, Student Catalog, Student handbook, display handbook, display plaquesplaques
Collect books, sample Collect books, sample plaque. Identify location plaque. Identify location of plaquesof plaques
1.A.3 Documented 1.A.3 Documented progressprogress
YESYES Indicators of Indicators of institutional institutional effectiveness effectiveness
Summarize indicators and Summarize indicators and institutional effectiveness institutional effectiveness studies.studies.
Accreditation Standards WorksheetStandard One – Institutional Mission and Goals, Planning and EffectivenessStandard 1.A – Mission and Goals
RequirementRequirement ComplianceCompliance EvidenceEvidence Course of ActionCourse of Action
1.A.4 Mission/goals 1.A.4 Mission/goals consistent with resourcesconsistent with resources
YESYES Human – faculty needs Human – faculty needs study; workload study; workload assessments. assessments.
Financial – analyses. Financial – analyses.
Physical – ????Physical – ????
Acquire studies and Acquire studies and analyses.analyses.
Gather/generate financial Gather/generate financial statisticsstatistics
Summarize information Summarize information about physical resources about physical resources from unit self-studies.from unit self-studies.
Data you need (part 1)Data you need (part 1)
Data you need (part 2)Data you need (part 2)
Institutional level performanceInstitutional level performance College/department level performanceCollege/department level performance Program level outcomesProgram level outcomes Course level outcomesCourse level outcomes
MISSIONMISSION INDICATORSINDICATORS SOURCESOURCE METHODMETHOD
Maintain a Maintain a wholesome wholesome academic, academic, cultural, cultural, social, and social, and spiritual spiritual environment.environment.
Low crime rateLow crime rate Campus policeCampus police Obtain annual Obtain annual reportreport
Low rate of Low rate of Honor Code Honor Code infractionsinfractions
Dean of Dean of Students, Students, ecclesiastical ecclesiastical leadersleaders
Obtain annual Obtain annual report from Dean of report from Dean of Students OfficeStudents Office
High High adherence to adherence to "higher "higher principles"principles"
Students Students (former, (former, current)current)
SurveySurvey Focus groupFocus group
Positive Positive attitude and attitude and perception of perception of Honor Code and Honor Code and environmentenvironment
Students Students (former, (former, current)current)
Analysis of Mission Worksheet
Data Analysis and SynthesisData Analysis and Synthesis
The KEY:The KEY:Adhering to the templates and Adhering to the templates and
guidelines set at the beginning of the guidelines set at the beginning of the process.process.
Data analysis/synthesisData analysis/synthesis
Bolster your analysis with …Bolster your analysis with …
Statistical simplicityStatistical simplicity Visual materialVisual material
Well labeled and neatly organized tablesWell labeled and neatly organized tables Charts, graphs, and other visual imagesCharts, graphs, and other visual images
Electronic versionsElectronic versions Web documentsWeb documents Drill-downDrill-down
ANALYSISANALYSIS
JUDGMENTJUDGMENT
ACTION
Data analysis/synthesisData analysis/synthesis
Show judgment and actionShow judgment and action
Data analysis/synthesisData analysis/synthesis
Establish benchmarksEstablish benchmarks
Expert judgmentExpert judgment Comparison with past performanceComparison with past performance Comparison with other groups Comparison with other groups
(controls, peers)(controls, peers) Cut points generated from the dataCut points generated from the data
Data Analyses & SynthesesData Analyses & Syntheses
If data are organized, collected, and analyzed If data are organized, collected, and analyzed by Standard, how are data analyses by Standard, how are data analyses synthesized across the institution?synthesized across the institution?
THANK YOU!!!THANK YOU!!!