2013 star reports preview
DESCRIPTION
May 22, 2013 Webcast starts at 9 a.m. Mark Hansen and Michael McDaniel. 2013 STAR Reports Preview. 2013 STAR Reports Preview Agenda. Objectives: Identify the reports districts receive; understand the information provided on each report and how to use the information - PowerPoint PPT PresentationTRANSCRIPT
2013 STARReports Preview
May 22, 2013
May 22, 2013Webcast starts at 9 a.m.Mark Hansen and Michael McDaniel
2013 STAR Reports Preview Webcast | May 2013
2013 STAR Reports Preview Agenda
May 22, 2013
Objectives: Identify the reports districts receive; understand the information provided on each report and how to use the information
• Shipment Schedule and Packaging • Student Reports
– CSTs (California Standards Tests) – CMA (California Modified Assessment)– CAPA (California Alternate Performance Assessment)– STS (Standards-based Tests in Spanish)
• Individual Reports• Summary Reports • Data CD• Quick-turnaround Reporting
2
2013 STAR Reports Preview Webcast | May 2013
What’s New for 2013
May 22, 2013
• Quick-turnaround Reporting is now available for the spring 2013 administration.
• STS performance levels—advanced, proficient, basic, below basic, and far below basic—are now also reported for RLA in grades eight through eleven and EOC Algebra I and Geometry.
• ELA scale scores for the grades four and seven CSTs and CMA will be provided based on the multiple-choice items only.– The reporting cluster “Writing Applications” is no longer part of the
CST and CMA ELA cluster groups.– The writing score is provided as a standalone score called “Writing
Response Score.”3
2013 STAR Reports Preview Webcast | May 2013
When Will Report Information Be Delivered?
May 22, 20134
What? When Scheduled?
Quick Turn-around Reporting
2–3 weeks after receipt of test materials
Paper reports August 8 (if test returned by July 1, 2013)
Internet Reports Mid August, 2013
Post-Test Guide
Posted End of July, 2013
Hard copy delivered After August 13, 2013
Post-Test Workshop August 7, 2013
2013 STAR Reports Preview Webcast | May 2013
Shipment Schedule for Single Administration Districts
May 22, 2013
• One shipment of reports contains:– All individual reports including Student Reports for CST,
CMA, CAPA, and STS– Student Report Interpretation Guides
English only, except for STS (English and Spanish)– Unmatched reports– All summary reports– Data CD– EAP Roster (if applicable) – DVD-ROM containing Student Report PDFs (if ordered
on Processing Form) 5
2013 STAR Reports Preview Webcast | May 2013
Shipment Schedule forMultiple Administration Districts
May 22, 2013
• One shipment per administration• Early shipment(s) contain:– Student Reports (CST, CMA, CAPA, and STS)– Student Report Interpretation Guides– Student Master List– Student Record Labels– Unmatched reports – Data CD– EAP Roster (if applicable)– DVD-ROM containing Student Report PDFs
(if ordered on Processing Form)
6
Note: Summary (aggregated) reports are not available for early shipments.
2013 STAR Reports Preview Webcast | May 2013 May 22, 2013
• Final shipment contains:– All remaining individual reports including Student
Reports (CST, CMA, CAPA, and STS)– Student Report Interpretation Guides– All summary (aggregated) reports– Unmatched reports– Data CD– EAP Roster (if applicable)– DVD-ROM containing Student Report PDFs
(if ordered on Processing Form)
7
Shipment Schedule forMultiple Administration Districts
2013 STAR Reports Preview Webcast | May 2013
Student Reports
May 22, 2013
• CST, CMA, CAPA, and STS• Receive two report copies for each test students took.– Send one report to parent/guardian within 20 working
days of receipt.– Forward the school shipment, which contains a second
copy for students’ current teacher.
8
2013 STAR Reports Preview Webcast | May 2013
CST Student Report Example
May 22, 20139
2013 STAR Reports Preview Webcast | May 2013
STAR Student Report
• Address on LEFT– Same position as the 2012 STAR
Student Report and the CAHSEEStudent Report
– #10 left window envelope– Address includes POSTNET
barcode• Statewide Student Identifier
(SSID) (“Student #”) and localidentification number (“Local ID #”) printed
• Student name printed on front and back
May 22, 201310
2013 STAR Reports Preview Webcast | May 2013
CST, CMA, and STS Student Report, Front
• Scale scores• Performance levels
May 22, 201311
CST Grade 7 Example
2013 STAR Reports Preview Webcast | May 2013
CST, CMA, and STS Student Report, Back: Reporting Clusters• Number and percent correct• Comparison to statewide proficient scores
May 22, 201312
CST Grade 7 Example
2013 STAR Reports Preview Webcast | May 2013
CST, CMA (4–7) Writing Response Scores
May 22, 201313
• Shows score from 1–4• Shows rubric used to determine that score
Note: The writing score is NOT combined with the multiple-choice score to calculate the ELA score.
CST Grade 7 Example
2013 STAR Reports Preview Webcast | May 2013
CMA Student Report Example
May 22, 201314
2013 STAR Reports Preview Webcast | May 2013
CMA Student Report, Front
• Scale scores and performance levels for:
May 22, 201315
– ELA– Mathematics
– Science
CMA Grade 8 Example
2013 STAR Reports Preview Webcast | May 2013
CMA Student Report, Back
• Reporting clusters for ELA, Mathematics, and Science– Number and percent correct– Comparison to statewide proficient scores
• Description of the CMA
May 22, 201316
CMA Grade 8 Example
2013 STAR Reports Preview Webcast | May 2013
CAPA Student Report Example
May 22, 201317
2013 STAR Reports Preview Webcast | May 2013
STS Student Report Example
May 22, 201318
2013 STAR Reports Preview Webcast | May 2013
STS Student Report, Front• Scale scores and performance levels for all tests– RLA (including grades 8–11)– Mathematics (including Algebra I and Geometry)
May 22, 201319
STS Grade 5 Example
2013 STAR Reports Preview Webcast | May 2013
STS Student Report, Back• Reporting clusters for all tests– Number and percent correct
• How to use the STS results
May 22, 201320
STS Grade 5 Example
2013 STAR Reports Preview Webcast | May 2013
Student Record Labels
• Add to students’ permanent record– Schools are responsible for affixing labels to each pupil’s
permanent school records or for entering the scores into electronic pupil records. [California Code of Regulations, Title 5, section 863(c)]
• Includes SSID number and, if provided, local student ID number
• Available for:– CSTs/CMA– CAPA– STS
May 22, 201321
2013 STAR Reports Preview Webcast | May 2013
CST/CMA Record Label
May 22, 201322
CST/CMA Grade 3 Example
2013 STAR Reports Preview Webcast | May 2013
CAPA Record Label
May 22, 201323
CAPA Grade 5 Level III Example
2013 STAR Reports Preview Webcast | May 2013
STS Record Label
May 22, 201324
STS Grade 8 Example
2013 STAR Reports Preview Webcast | May 2013
Student Master List
• Report that contains details of results for each student• For all grade-level and EOC CSTs, CMA, and STS, the report
includes:– Percent correct for each reporting cluster– Scale scores– Performance levels
• For the CAPA, the report includes:– Scale scores– Performance levels
May 22, 201325
2013 STAR Reports Preview Webcast | May 2013
Student Master ListSort Sequence
• School• Grade• Test type– CSTs/CMA– CAPA– STS
• Alphabetical order by last name
May 22, 201326
Note: STS data are not matched with CST, CMA data.
2013 STAR Reports Preview Webcast | May 2013
Student Master List
May 22, 201327
CST/CMA Grade 3 Example
2013 STAR Reports Preview Webcast | May 2013
Summary Reports
• Review data on reports and use to develop reports for your school or district.– Do NOT compare across grades or across subjects.
• Student Master List Summary includes CSTs, CMA, CAPA, and STS results.
• Student Master List Summary: End-of-Course (EOC) includes EOC results for CSTs, CMA, and STS.
• Subgroup Summary includes results for CSTs, CMA, CAPA, and STS.
May 22, 201328
2013 STAR Reports Preview Webcast | May 2013
Student Master List Summary
May 22, 201329
Grade 7 Example
2013 STAR Reports Preview Webcast | May 2013
Student Master List Summary
May 22, 201330
Grade 3 Partial Example
2013 STAR Reports Preview Webcast | May 2013
Student Master List SummaryEnd of Course
May 22, 201331
CST for Biology Example
2013 STAR Reports Preview Webcast | May 2013
Subgroup Summary
May 22, 201332
Grade 5 Gender Example
2013 STAR Reports Preview Webcast | May 2013
Subgroup Summaries• Compare results among different student demographics– Gender– Disability status
(CAPA, specific disability)
– Economic status– Ethnicity
Two or more races
– English proficiency– Ethnicity for economic status
May 22, 201333
2013 STAR Reports Preview Webcast | May 2013
Subgroup Summary
May 22, 201334
Grade 5 Gender Example
2013 STAR Reports Preview Webcast | May 2013
Data CD—Text Format
• Two files• Three record types
• EAP status data – Reported in file; four positions, 407–410
• 2013 Student Data File Layout– Layout description included in shipment– Contact STAR TAC for questions – Download from www.startest.org/reports.html in
mid-June
May 22, 201335
– 01 = CST/CMA – 02 = CAPA – 03 = STS
2013 STAR Reports Preview Webcast | May 2013
Data CD—XML Format
• One file– Two companion files on www.startest.org/reports.html:
.xsd = Schema .xsl = Data layout
– Available at the end of June• Easy to import data into other formats– Access database
May 22, 201336
2013 STAR Reports Preview Webcast | May 2013
Quick-turnaround Reporting (QTR)
May 22, 201337
2013 STAR Reports Preview Webcast | May 2013
• QTR is a module of the STAR Management System that makes a data file available that contains early student-level results for the CSTs and CMA.
• QTR data file is available upon completion of an entire administration once all scorable test booklets and answer documents for that administration have been received at the STAR Processing Center in Iowa City, IA, and certified by Educational Testing Service.
• The school district will be notified via e-mail that all CST and CMA tests in the administration have been certified and a QTR file is ready for download.
May 22, 201338
QTR—Background
2013 STAR Reports Preview Webcast | May 2013
QTR—Background, continued
May 22, 201339
• QTR data files contain results data for CST and CMA multiple-choice tests:– Scale-scores– Performance-levels– Associated student-identification and test-taken
information• It is important to remember that these are preliminary
results only; the results may change in the reports that are shipped to districts.
2013 STAR Reports Preview Webcast | May 2013
1. Log on to the STAR Management System.
May 22, 201340
QTR—Access
2013 STAR Reports Preview Webcast | May 2013
2. Select the Quick-turnaround Reporting button in the left navigation bar to open the “Quick-turnaround Reporting” application window.
May 22, 201341
QTR—Access, continued
2013 STAR Reports Preview Webcast | May 2013 May 22, 201342
QTR—Access, continued
3. Select a file-name link for the QTR file you wish to download.
4. Select the Save button in the File Download dialog box to download the file or the Open button to open it.
5. Use your zip archive application to extract the contents of the file.
2013 STAR Reports Preview Webcast | May 2013
• Available on the “STAR Management System” Web page at http://www.startest.org/sms.html:– Quick-turnaround Reporting Manual– Student Data Layouts
Fixed-format file—“_FIX.txt.zip” extension Tab-delimited format file —“_TAB.txt.zip” extension
May 22, 201343
QTR—Documentation
2013 STAR Reports Preview Webcast | May 2013
Questions ?
May 22, 201344
2013 STAR Reports Preview Webcast | May 2013 May 22, 201345
• For STAR technical questions:STAR TAC—800-955-2954
• For STAR policies: CDE—916-445-8765
• For accountability questions:CDE Academic Accountability Unit—916-319-0863
More Questions?
2013 STAR Reports Preview Webcast | May 2013
Next Webcast:2013 Post-Test Workshop
August 7, 2013Webcast starts at 9 a.m.
May 22, 201346