essays
TRANSCRIPT
![Page 1: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/1.jpg)
This presentation was developed for the exclusive use of students enrolled in:
Educational Testing & Grading, Professor Gregory E. Stone.
© 2004 Gregory E. Stone. All rights reserved. This presentation may not be reproduced in any form, in part or as a whole, without the express written permission of the author.
![Page 2: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/2.jpg)
Essays& other non-objective items
![Page 3: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/3.jpg)
We’ll include:
Essays, Short answers andother items that can fitwithin the general parameters
Mathematical problem solving
Other partial credit items
![Page 4: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/4.jpg)
Allow for free expressionwithout artificial restriction
and without prompting.
![Page 5: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/5.jpg)
Extended Response
Restricted Response
Two Fundamental Types:
![Page 6: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/6.jpg)
Restricted Response
Limit the ways in which you willpermit the students to answer.
![Page 7: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/7.jpg)
Restricted Response
Limit the ways in which you willpermit the students to answer.
� There ARE correct answers. � We allow students to express
the answer in their own words.
![Page 8: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/8.jpg)
Restricted Response
“Write a brief essay comparing andcontrasting the term analysis and
synthesis as they relate toconstructing (a) objective items
and (b) essay items.”
example
![Page 9: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/9.jpg)
Restricted Response
“What is the poet’s attitudetoward literature as it isapparent in lines 1 to 8?what words in these linesmake this apparent.
example
![Page 10: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/10.jpg)
Restricted Response
“A car traveling 50 mph leaves Chicago at 9am. A train traveling at 70 mph leaves Milwaukee at 10 am. Who will arrive in Toledo (250 miles away) first? Show your work.”
example
Short Answer
![Page 11: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/11.jpg)
Restricted Response
Predicated on the notion that students supply the answers rather than selecting the answer from a group options.
![Page 12: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/12.jpg)
Extended Response
Allow students to express their ownideas and interrelationships amongideas and use their own strategy fororganization.
� No “correct” answers but reasonable/un logic..
![Page 13: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/13.jpg)
Extended Response
Sometimes people write just for the fun of it. This is a chance for you to have some fun writing. Pretend that you are a pair of tennis shoes. You’ve done all kinds of things with your owner in all kinds of weather. Now you are being picked up again by your owner. Tell what you, as the tennis shoes, think about what’s going to happen to you. Tell how you feel about your owner. Space it provided below and on the next page.
example
![Page 14: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/14.jpg)
Extended Response
Devise a plan to determine whether the democrats or republicans are evenly distributed throughout the city, or whether the supporters of each party are concentrated in certain wards.
Design an experiment to calculate the height of a redwood tree.
Create an original story.
example
![Page 15: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/15.jpg)
Extended Response
Because the focus is on logicalargument and reasoned answeringthe teacher must be open andaccepting of uncomfortable responses.
![Page 16: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/16.jpg)
Extended Response
Based on the creative process of the student - often including reasoning and factual presentations.
![Page 17: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/17.jpg)
Essays have a unique ability to assess multiple taxonomic levels at once - while
maintaining a good understanding of strengths and weaknesses.
Look at the family photo attached. Describe the mood or feeling in the photo as well as the body
language of the people. Use metaphors or similes to make these descriptions.
Analysis Knowledge
Comprehension
![Page 18: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/18.jpg)
Is your essay a good essay?
Checklist
1. Does the item test an important aspect of the learning objective?
Essays should ideally be targeted at no less than Application!
![Page 19: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/19.jpg)
Is your essay a good essay?
Checklist
2. Does the item match the learning objective in terms of performance, emphasis and “number of points” (on the exam)?
![Page 20: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/20.jpg)
Is your essay a good essay?
Checklist
3. Does the item require the students to apply their knowledge and skill to solve a new and novel problem?Essays should ideally be targeted at no less than Application!
![Page 21: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/21.jpg)
Is your essay a good essay?
Checklist
4. When viewed in relation to the other items on the test, does this item measure new information covering the range of content and behavior specified in the learning objectives?
![Page 22: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/22.jpg)
Is your essay a good essay?
Checklist
5. Is the item focused? Does it define a task with specific directions, rather than leave the assignment so broad that almost any answer would be acceptable?
![Page 23: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/23.jpg)
Is your essay a good essay?
Checklist
6. Is the task defined by the item within a level of complexity that is appropriate for the intellectual maturity of the students?
![Page 24: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/24.jpg)
Is your essay a good essay?
Checklist
7. To get a good grade on the item, is the student required to demonstrate more than facts, ideas, lists, definitions, generalizations, etc.
![Page 25: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/25.jpg)
Is your essay a good essay?
Checklist
8. Is the item worded in a way that leads all students to interpret the assignment in the way you intended.
![Page 26: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/26.jpg)
Is your essay a good essay?
Checklist
9. Does the wording of the item make clear to the students: Length, purpose, time needed and the basis for evaluation?
![Page 27: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/27.jpg)
Is your essay a good essay?
Checklist
10. If the essay asks students to state and support their opinions on controversial matters, does the wording of the item make it clear that students’ assessments will be based on the logic and evidence supporting their arguments, rather than on the actual position or opinion?
![Page 28: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/28.jpg)
Creating scoring rubrics
Essential for ensuring fair,reliable, valid and meaningfulassessments.
One of the hardest problems!
![Page 29: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/29.jpg)
Rubrics come in 2 varieties:
Holistic (logic of argument)
Analytic (correct answersprovided in the student’s ownwords)
![Page 30: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/30.jpg)
Holistic (logic of argument)
Best used for Extended Response Essays
Grading essays on how well the argument/essay is written in
general.
![Page 31: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/31.jpg)
Analytic (correct answers)
Best used for Restricted Response Essays
Grading essays on whether or not the student has provided the
correct answer.
![Page 32: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/32.jpg)
Analytic rubrics require thestudent to provide specific
information in their answerin order to receive credit.
No “bluffing” allowed!
![Page 33: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/33.jpg)
To construct a rubric:
(1)Ask - what is your objective?(2)Ask - what is the taxonomy?(3)Ask - what pieces of the puzzle do I expect the student to provide?
![Page 34: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/34.jpg)
Example: Comprehend Vertical Leap
Concepts: Potential/Kinetic energy
Describe the concepts of Potential and Kinetic energy. Give an example of each in your description.
![Page 35: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/35.jpg)
Describe the concepts of Potential and Kinetic energy. Give an example of each in your description.
1. Student correctly defined terms 2 points: Answer was clear and fully correct. 1 point: One or more answers were nearly correct, but student missed key concept. 0 points: Student failed to provide correct answer.2. Examples were clear and correct 2 points: Both examples were appropriate. 1 point: One example was appropriate. 0 points: Neither example was appropriate.
![Page 36: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/36.jpg)
Creating rubrics is essential.
Using the rubrics in a standard, systematic fashion is vital!
![Page 37: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/37.jpg)
The loss of reliability and validity are the leading causes of essay
derailment.
May be caused by poorly written essays; or
May be caused by poor use of the created rubrics.
![Page 38: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/38.jpg)
Inconsistent Standards
Raters of essays may vary greatly. Individuals may grade essays differently on one day versus the next.
(Reliability loss)
![Page 39: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/39.jpg)
Rater Drift
Raters tend to either fail to pay attention to criteria or change them - midstream - over time.
(Reliability loss)
![Page 40: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/40.jpg)
Changes in Topic and Prompt
Raters often grade essays of different topics differently. (e.g. I like this topic more so I’m easier)
(Validity loss)
![Page 41: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/41.jpg)
Reader Bias
Halo Effect
Grading based on non-graded topics. (e.g If the student uses good grammar, grade the essay higher, even if the student doesn’t fully answer the item)
![Page 42: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/42.jpg)
Reader Bias
Carryover Effect
If question 1 was answered poorly, the rater already has a bad feeling about the student when theybegin grading question 2.
Or vice versa!
![Page 43: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/43.jpg)
Scoring Suggestions!
You’ve created a rubric, so USE it!
Score one item at a time.
Score essays “anonymously”
Score subject-matter correctness separately.
Provide your students with feedback!
![Page 44: Essays](https://reader035.vdocument.in/reader035/viewer/2022062703/55524c11b4c905954f8b4d78/html5/thumbnails/44.jpg)
Essays& other non-objective items