wv writes: a roadmap to writing success
DESCRIPTION
WV Writes: A Roadmap to Writing Success. Stacey Murrell RLA Acuity and WV Writes Coordinator West Virginia Technology Conference Morgantown, WV August 3, 2011. Benefits. Increases rigor and expectations Uses WV writing rubrics Simulates WESTEST 2 Online Writing experience - PowerPoint PPT PresentationTRANSCRIPT
WV Writes:A Roadmap to Writing
SuccessStacey Murrell
RLA Acuity and WV Writes CoordinatorWest Virginia Technology Conference
Morgantown, WVAugust 3, 2011
Benefits
– Increases rigor and expectations– Uses WV writing rubrics– Simulates WESTEST 2 Online Writing
experience– Allows data-driven curriculum design– Student using Writing Roadmap five or
more times scored 3 points higher on WESTEST 2 RLA than those who had not logged into the program at all.
WV Students wrote-
•491,916 essays in WV Writes in 2010-2011 school year!!
Using WV Writes Data to Facilitate Writing
Sample County 2010-2011 WV Writes Proficiency Summary
23,349 Essays Submitted
1%
8%
30%
32%
29%1% Distinguished8% Above Mastery30% Mastery32% Partial Mastery29% Novice
Organiza
tion
Development
Sente
nce St
ructu
re
Word
Choice/ G
rammar
Usage
Mech
anics
00.5
11.5
22.5
33.5
44.5
55.5
6
Elementary Middle
High
Five analytic traits proficiency range for Elementary, Middle, and High School
WESTEST 2 Practice Prompts-Sample County
Organiza
tion
Development
Sentence
Stru
cture
Word
Choice/G
rammar U
sage
Mech
anics0
1
2
3
4
5
6
2.9 2.9 3 3.1 3.2
County Average
Five analytic traits proficiency range based on WV WESTEST 2 9th-12th grade prompts-sample county
Controversy-Artificial intelligence scoring
Comparing Rates of Agreement
Exact Agreement – occurs when the human score is exactly the same as the corresponding engine score (e.g., human rating for Mechanics is 3 and Engine rating is 3).
Exact + Adjacent Agreement – occurs when the human score is exactly the same as the corresponding engine score or is equal to the engine score +/- one point. Similar to a margin of error estimate (e.g., human rating for Mechanics is 4 and Engine rating is 3, 4 or 5).
(Online Writing Scoring Comparability Study – 2010, WVDE)
Exact Agreement
Human to Human Human to Machine (1) Human to Machine (2)0
10
20
30
40
50
60
70
80
90
100
42.639.2 39.9
Summary of Exact Agreement Across All Traits by Scorer Pair
Median Exact Agreement
(Online Writing Scoring Comparability Study – 2010, WVDE)
Exact + Adjacent Agreement
Human to Human Human to Machine (1) Human to Machine (2)0
10
20
30
40
50
60
70
80
90
100
88 87.5 88.5
Summary of Exact and Adjacent Agreement Across All Traits by Scorer
Pair
Median Exact and Adjacent Agreement
(Online Writing Scoring Comparability Study – 2010, WVDE)
Your Turn
Stop
Read
Score using rubric
Group Consensus
Cool Tricks
• Quickly open and print WV writing rubric.• See a list of every essay a student wrote regardless
of who assigned it.• Back door to viewing and scoring essays that you
have assigned.• Edit a prompt that you created.• Quickly add a student to a writing prompt
assignment that has been transferred into your class.
• Quickly view completed essays to change scores or make comments to students.
WV Writes• Navigating the site-Hands on
– Assign an Essay to Selected Students
– View/Edit Existing Assignments– Create Your Own Essay
Prompt/Assessment– Score Items– View/Print Group Reports
Incorporating WV Writes
• Teaching strategies from WV teachers– Quick checks for content– Writing process checklist– Revision for extra points
• Writing portfolio-paper and/or online blog, wiki, etc.
The Future• 2nd grade students rostered in WV Writes, 2nd
grade teachers may need to be created– 2nd grade teachers can create prompts– Plans to add 2nd grade prompts at state level
written by 2nd grade teachers this fall – 2nd grade students scored using 3rd grade rubric
• Automatic rostering when students transfer schools and/or counties– teachers can no longer create students– School rosters will update 1st and 3rd Friday
• Anticipated 2011-2012 site opening on August 15, 2011
Questions?
