data analysis
DESCRIPTION
Data Analysis. Looking at Student Work November 2013. allows us to: to learn more about the competencies and deficiencies of the individual being tested. to identify specific problem areas and/or needs. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/1.jpg)
DATA ANALYSIS
Looking at Student Work
November 2013
![Page 2: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/2.jpg)
allows us to:
• to learn more about the competencies and deficiencies of the individual being tested.
• to identify specific problem areas and/or needs.
• to evaluate the individual's performance in relation to others, a set of standards or goals.
HIGH SCHOOL REGENTS ANALYSIS
![Page 3: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/3.jpg)
and also……
• Provide teachers with feedback on effectiveness of:
-Instruction-Teaching Strategies-Interventions• Action plans from Teacher
Leads• We knew in March and April
that they couldn’t write why did we end up in last place• Questions 24, 3, & 9• Ineffective teaching
HIGH SCHOOL REGENTS ANALYSIS
![Page 4: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/4.jpg)
item analysis:
• A method of assessment of how a question on a test measures the performance of a student.
• Analyzing each item on a test to determine the proportions of students selecting each answer.
• Evaluate student strengths and weaknesses.
LOOKING AT STUDENT
WORK FROM
REGENTS
![Page 5: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/5.jpg)
main uses:
• Understanding patterns of achievement in your school-wide Regents performance
• Identifying particular areas in which students need assistance in
LOOKING AT STUDENT
WORK FROM
REGENTS
![Page 6: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/6.jpg)
for each question number:
• Content Standard (strand.)
• Question Type (T); MC, CR, etc.
• Question Number (#)• Correct Answer ( )
• Distractor Analysis (A, B, C, D)
• Correct Answer ( ) % Correct (G,Y,R)
• Individual Student Answers (A, B, C, D)
HIGH SCHOOL REGENTS ANALYSIS
![Page 7: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/7.jpg)
individual student responses:
• Incorrect – White• Correct – Light Green• M – Multiple Answers• X – Missing Answer
(left blank)• (-) - ???
HIGH SCHOOL REGENTS ANALYSIS
![Page 8: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/8.jpg)
written essay responses on Disc:
• Individual Student (taking the Regents for the 2nd time) –Written Reponses printed
and provided to teachers for analysis
– Teachers adjust curriculum and instruction to address individual student areas of weakness• In class • After school Regents
Prep
HIGH SCHOOL REGENTS ANALYSIS
![Page 9: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/9.jpg)
what does it tell us:
• Were students guessing?
• What should I re-teach?
• Common Misconceptions?
• Strengths?
LOOKING AT STUDENT
WORK FROM
REGENTS
![Page 10: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/10.jpg)
in addition:
• Focus on questions that the students answered between 30% and 80% correct
• These are the ones that are most valuable
LOOKING AT STUDENT
WORK FROM
REGENTS
![Page 11: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/11.jpg)
Distractors:
• Information on the (frequency of) selection can help teachers identify student/class/school misconceptions and problems.
LOOKING AT STUDENT
WORK FROM
REGENTS
![Page 12: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/12.jpg)
before you get started:
• Identify 5 questions (each) from the M/C section that they believe students would find the …
• “Least Challenging” (circle) – Why?
• “Most Challenging” (star) – Why?
LOOKING AT STUDENT
WORK FROM
REGENTS
![Page 13: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/13.jpg)
Then, based on the data analysis
• Identify the lowest 5 questions or strands, and begin to think about: Why were these the most difficult for students?
LOOKING AT STUDENT
WORK FROM
REGENTS
![Page 14: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/14.jpg)
ITEM AND OR ESSAY QUESTION DISCUSSION
What is this question asking students to know (content) and be able to do (process/skills)?
What is/are the reason(s) this was a difficult question for our students?
How does this question assess student mastery of an idea, concept, … , and/or skill/process?
What are the implications for instruction?
![Page 15: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/15.jpg)
REFLECTIONS ON ITEM/ESSAY QUESTION ANALYSIS
What surprised me most about the data was … From the data I learned …
The impact of the data on my future teaching/assessment will be …
In thinking about revising the curriculum, the data clearly indicates …
![Page 16: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/16.jpg)
Identify:
• Major Concepts and Big Ideas that students would need to understand to successfully complete this test item.
• The requisite process skills (inquiry or problem solving) that are embedded in the test item
• The cognitive demand as indicated by the Webb Depth of Knowledge level are identified.
LOOKING AT STUDENT
WORK FROM
REGENTS
![Page 17: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/17.jpg)
additional resources:
• http://www.regentsreviewlive.net/
• http://www.edusolution.com/regentsindex.htm
•
• http://www.jmap.org/
LOOKING AT STUDENT
WORK FROM
REGENTS
![Page 18: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/18.jpg)
arisnyc.org:
• Click on connect
• Select TAPCo. Private
• Download item skills analysis tool
MIDDLE SCHOOL
ITEM ANALYSIS
![Page 19: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/19.jpg)
identify:
• Find most common mistakes
• Standards associated with each question
• Compare writing scores to NYC Performance Assessments
• Can you see a pattern?
MIDDLE SCHOOL
ITEM ANALYSIS
![Page 20: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/20.jpg)
support:
• EngageNY.org-Common Core
Curriculum & Assessments-Data Driven
Instruction-Video Library
MIDDLE SCHOOL
ITEM ANALYSIS
![Page 21: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/21.jpg)
featured resources:
• EngageNY.org-Curriculum Modules
for ELA & Math-NYS Metrics &
Expectations(2013-2014)
MIDDLE SCHOOL
ITEM ANALYSIS
![Page 22: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/22.jpg)
featured resources:
• EngageNY.orgMIDDLE SCHOOL
SAMPLE EXAM QUESTIONS(MULTIPLE
CHOICE AND ESSAY)
![Page 23: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/23.jpg)
ITEM AND/OR QUESTION DISCUSSION
What is this question asking students to know (content) and be able to do (process/skills)?
What is/are the reason(s) this was a difficult question for our students?
How does this question assess student mastery of an idea, concept, … , and/or skill/process?
What are the implications for instruction?
![Page 24: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/24.jpg)
REFLECTIONS ON ITEM AND/OR QUESTION ANALYSIS
What surprised me most about the data was … From the data I learned …
The impact of the data on my future teaching/assessment will be …
In thinking about revising the curriculum, the data clearly indicates …
![Page 25: Data Analysis](https://reader035.vdocument.in/reader035/viewer/2022062800/56814039550346895daba727/html5/thumbnails/25.jpg)
• Upload your class Data Analysis results and action plans to teacher-only pages on our school website.
• Have meeting with Administration at end of each marking period to discuss Scholarship reports, instructional and other interventions.
• Be prepared to share student work that has changed as a result of your closing the data loop!
CLOSING THE DATA LOOP