assessing students learning outcomes senia terzieva 2 -8 march 2015 semey
TRANSCRIPT
Assessing Students Learning Outcomes
Senia Terzieva
2 -8 March 2015 SEMEY
Assessment and Evaluation - expectations for achieving quality of education
• Assessment is a process that focuses on student learning, a process that involves reviewing and reflecting on practice as academics have always done.
• The institution demonstrates that each course for which academic credit is awarded establishes and evaluates program and learning outcomes.
2 -8 March 2015 SEMEY
What is the Difference between Assessment & Evaluation?
Assessment in education is specific process for:
• Establishing a clear, measurable expected outcomes of
student learning
• Ensuring students have sufficient opportunities to achieve
these outcomes
• Systemically gathering, analyzing, and interpreting evidence
to determine how well student learning matches our
expectations
• Using the resulting information to understand and improve
student learning
• Focuses solely on the process and outcomes of learning
Evaluation in education is:
•Using assessment information to make informed judgment
on learning outcomes, and change pedagogical strategies
if it not effective
•Determining the match between intended outcomes and
actual outcomes
•Investigating and judging quality of program, project, or
other subject maters than student learning
What is the Difference between Assessment & Evaluation?
2 -8 March 2015 SEMEY
The value of Assessing Student Learning Outcomes
• Academic and faculty management, based on feedback -
provide feedback to the faculty about how well they are
meeting their program goals; not an administrative tool
for making decisions regarding program cuts.
• Added benefit: Assessment results provide objective
information that can be used in program review or
budget planning to document the need for additional
resources necessary to improve student learning.
• Documenting how teaching staff used results from how teaching staff used results from
assessment to make program improvements assessment to make program improvements .2 -8 March 2015 SEMEY
Why is assessment of student learning important?
There are two reasons for massessment student learning.
• opportunities for the academic community to engage in self-reflection of
its learning goals, to determine the degree to which these goals
correspond to student and societal needs, and to evaluate if students’
activities, products, or performances coincide with the academic
community’s expectations;
• offers information to students about the knowledge, skills, and other
attributes they can expect to possess after successfully completing
coursework and academic programs.
• establishes ways for academic units to understand the dimensions of
student learning when seeking to improve student achievement and the
educational process. 2 -8 March 2015 SEMEY
Emphasis on documenting the way that we evaluate Outcomes of
Educational
Importance for institution:• Identifies expected outcomes for its educational
programs and its administrative and educational support services;
• Assesses whether it achieves these outcomes; and• Provides evidence of improvement based on analysis
of those results.
2 -8 March 2015 SEMEY
Student Learning Outcomes (SLO) Assessment Differs from..
• Program review process – focuses primarily on measuring program inputs (quality of entering students, faculty resources, etc.) and outcomes that are important to other areas of the mission but not directly related to student learning (e.g., research productivity)
• Academic staff evaluations – End-of-Course measurement student perceptions about individual teaching behaviors, not actual learning.
• Individual student evaluations – assessment for program improvement purposes is based on aggregated student performance data; not intended to give feedback to student.
2 -8 March 2015 SEMEY
The assessment system accomplish mission and strategic goals at the University Education
• 'topic objectives' - relating to each particular topic
within the course, and
• 'course objectives' - where the student may need
to synthesize ideas from several topics and
perhaps demonstrate more developed skills or
attitudes than could have been expected earlier.
For Example:
The Process of Assessing SLO
The assessment is a permanent, on-going process, not just an periodic measurement of student achievements.
The process must provide documentation on assessment activities from every program ….
For measuring learning outcomes already we have to use as much as possible:
– Standards/requirements of academic objectives, professional associations and accrediting bodies or governance
– Local/specific methods of assessing learning
2 -8 March 2015 SEMEY
Assessing SLO • Focus is on assessing what are students are able to:
– Know (cognitive),– Think (attitudinal)– Do (behavioral)as a result of the educational program.
• Purpose: To obtain information that can be used by program faculty to answer the following questions:– Are our students learning what we think is important?– Are they learning what they need to succeed in this field or
profession?– Are we improving in our ability to help students learn?– Should our curriculum or teaching strategies be modified?– Are there other techniques or additional resources that would help
our students learn more effectively?
2 -8 March 2015 SEMEY
Steps in Student Learning Outcomes Assessment
• Define intended educational outcomes • Identify methods of measuring outcomes:
– Where in the curriculum or program would we expect that learning to occur ?
– When and how data are collected
• Prepare and provide assessments procedures• Review results and use to make decisions
regarding program improvement• Repeat assessments in subsequent cycles to
make improvements, change, trends, relevancy
2 -8 March 2015 SEMEY
How to Choose anAssessment Method?
• Think about what meeting the outcome looks like
- describe the result of the outcome by using active verbs
- This helps articulate the criteria for identifying
when the outcome has been met• Describe how your program is delivering the
outcome
- There may be activities in the delivery of the outcome that help you determine how to еvaluate it
2 -8 March 2015 SEMEY
Category learning outcomes
Student Learning Outcome: Students will be able to...
Knowledgedefine, describe, demonstrate, and explain knowledge within a field of study.
Skillsapply, use, perform, exhibit, and demonstrate skills required of a particular career or field of endeavor.
Creativityplan, design, develop, seek, find, synthesize, and create solutions, strategies, documents, and products.
Intellect exhibit the capacity for independent thought and critical thinking.
Communicationcommunicate effectively through writing, speaking, performing, exhibiting, or other forms of expression.
Analysis acquire, interpret, analyze, assess, and evaluate information.
Measuring Student Learning Outcomes
2 -8 March 2015 SEMEY
Questions for choosing an instrument
• What outcome(s) are you measuring?
• What criteria will determine if the outcome is met?
• Who is being assessed? (How often do I have access to them? Do I know them?)
• What is my budget – time, sources?
• What is my timeline?
• What type of data is most meaningful to me:
direct/indirect and qualitative/quantitative?
• Who will analyze the data and how?
• Who needs to see this data – student, administration, academic council …?
• How easily can I use this method into my teaching? (every day, week, semester)
• Who needs to make decisions with this data?
• How will I document the evidence and the decisions made from that evidence?
Helpful Reminders
• Clearly communicate assessment expectations
• Write every program and learning outcome down
but…do not assess every outcome every
semester.
• Do you want to start with workshop outcomes
and build program outcomes from those?
2 -8 March 2015 SEMEY
Student Learning Outcome Assessment Techniques
• Standardized tests• Performance on licensure or
professional exams• Essays• Exhibits• Performances• Course assignments• Portfolios of work samples• Authentic assessments• Job placement rates
• Student surveys• Graduates satisfaction • Focus groups• Interviews
Direct Indirect
2 -8 March 2015 SEMEY
Chemical Analysis of Environment - example
• Credit: ??? ECTS
• Description: This module covers the operating principles of a range of techniques that are used in the chemical analysis of environmental samples; hands-on experience is provided in laboratory practicals. Topics include: units of measurement, classical methods of analysis (e.g. titration), electrometric methods (conductimetry, potentiometry), optical methods (colorimetry, atomic spectroscopy), and chromatography (ion chromatography, gas-liquid chromatography, high performance liquid chromatography), assessment of method performance, quality control and quality assurance. Visits to laboratories in other institutions are included.
• Learning OutcomesOn successful completion of this module students will be able to:
• Explain the principles and practice of a range chemical analytical techniques• Select appropriate procedures for the chemical analysis of environmental
substrates (surface waters, waste waters, sediments and biological samples)• Carry out a range of chemical analysis procedures in the laboratory• Present and interpret results of chemical analyses of environmental
substrates• Assessment: Written report (50%), short reports (25%), exam (25%).
Defining objectives requires faculty and others to reflect on the questions below:
• How can the learning goals be stated as an activity, product, or performance that can be measured?
• What will students know, understand, and be able to do when they complete studies within this academic unit?
• Will the specified learning objectives provide direction for educational activities in the unit and inform students about the expectations of the faculty?
2 -8 March 2015 SEMEY
Possible Assessment Tools
• Quiz /test/• Journal /summary/• Case Study• Observation and lab work - performance and
report• Peer Evaluation with criteria or rubric• Essay /not necessary/• Professional Evaluation with criteria or rubric
2 -8 March 2015 SEMEY
Lab work
• Use the scientific method for laboratory exercises and scientific reports.
• Use modern college-level laboratory equipment• Participate actively in learning• Write effective documents that are audience specific
use correct scientific terminology• Work effectively as members or leaders of a team to
accomplish an objective.• Apply scientific principles and critical thinking to current
societal issues.
2 -8 March 2015 SEMEY
Portfolio as assessment instrument
Each student have to write a paper for inclusion in the Portfolio, which explains the process that was used in selecting each particular document The focus of the portfolio is to provide evidences that student
be able to:• Select and organize information about own activities . • Identify assumptions and underlying relationships. • Synthesize information, and draw reasoned inferences. • Formulate an appropriate problem solving strategy. • Evaluate the feasibility of the strategy.
2 -8 March 2015 SEMEY
Students portfolio
• The student have to explain what score he or she believes should be assigned for each item included in the Environmental Science Portfolio;
• The paper will include reflection on what the student views his or her particular achievements throughout the program and portfolio process to be, as well as what the student perceives his or her strengths and weaknesses to be.
• This portfolio will be graded using a topics or rubric which will be developed during the course
2 -8 March 2015 SEMEY
Essay is a specific method to measurement the SLO.In teaching practice could be used examination questions to facilitate its application. Essay questions normally contain an 'operative' word, such as:
define describe (or list) explain (or
account for) analyse assess
Essay assessment
compare
contrast
argue (or justify)
critically examine
evaluate
2 -8 March 2015 SEMEY
THANK YOU FOR YOUR ATTENTION