office of superintendent of public … · fun flag fact. nepal is the only country with a...

Assessment Update

SY 15-16 UPDATE #10

JUNE 14, 2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

1

Fun Flag FactNepal is the only country with a non-rectangular national flag.

Image licensed under CC-BY-SA, from the Wikipedia article Flag of Nepal (contributors).

6/16/2016


2

https://creativecommons.org/licenses/by-sa/3.0/

https://en.wikipedia.org/wiki/Flag_of_Nepal

https://en.wikipedia.org/w/index.php?title=Flag%20of%20Nepal&action=history

Today’s TopicsWELPA/ELPA21

ORS Scores and Reporting Rates

Data

Technology

WA-AIM

Contacts


3

WELPA/ELPA21


4

WELPA: Placement Test Materials Shipment 2016-17 School Year

For the 2016-17 School Year districts will continue to use the WELPA Placement Test to determine initial student eligibility for English language development (ELD) services. The Placement Test is given to all students whose families answer “a language other than English” to question #2 or to question #3 on the Home Language Survey.

WELPA Placement Test materials will be sent to districts in August based on District Test Coordinator selection of one of two delivery dates in WAMS. There is no need to order materials. Test materials for each district are generated using historical data to account for growth. If a selection is not made, the system will default to the August 25, 2016 delivery date.

Schools not accounted for in the previous year’s data or districts who have new students not accounted for in the initial delivery may contact Assessment Operations to place initial orders. OSPI will require student information to accompany these orders.


5

http://www.k12.wa.us/MigrantBilingual/HomeLanguage.aspx

ELPA21 Screener PilotDuring recent development activities it was determined by the ELPA21 consortium that the original selected vendor will not fulfill all the design requirements and still be able to conduct the planned spring 2016 pilot testing as specified. Thus, the consortium is obliged to delay the operational launch of the screener to allow sufficient time to secure the services to fulfill the intended design specifications.The ELPA21 Screener pilot will be conducted in October 2016. OSPI and the consortium will be reaching out to districts to solicit participation in the screener pilot. Participation in the screener pilot will offer districts the opportunity to familiarize themselves with the new screener and share valuable feedback before the screener is launched.


6

ELPA21 Scores - UpdateOSPI previously announced that student scores would not be available any earlier than late summer due to consortium activities• OSPI would provide electronic score file for district/school use in student placement decisions and resource

allocation• Student reports to follow after the start of school.

Vendor communicated required efforts to achieve early electronic score file might fall short of aim:• OSPI and vendor continue problem-solving to support original score file delivery timeline

OSPI requests that districts and schools allow the agency time to work through possible contingencies• Original process had results in late August, so districts could not make decisions any earlier• OSPI will communicate at earliest opportunity additional guidance should score file availability be delayed

from original plan.


7

Online Reporting System (ORS): as of June 10, 2016

% n-count

Fewer than 10 days 56.0% 617,240

Fewer than 16 days 91.3% 1,006,215

Fewer than 21 days 99.9% 1,100,670

More than 21 days 0.2% 1609


8

From Spring 2016: Number of completed summative Smarter Balanced tests that were reported in ORS within 10 days, 2 weeks (16 days), 3 weeks (21 days), or more than 3 weeks of the completion date of both components of the test.

Testing ends today (6/10), so more scoring is underway. These numbers will continue to grow for three weeks.

Scores Reported in ORS

The scoring process begins shortly after the testing window opens in March. Within a few weeks of testing, or by mid-April, the scores available in ORS are 99.9% accurate and reliable. OSPI considers scores ‘preliminary’ until all scores for the state are processed and reported statewide to districts in July, but schools should feel comfortable sharing scores with parents and institutions of higher ed as needed for placement decisions prior to that time.


9

Alphabet SoupAssessment and Registration Tool (ART)

◦ Digital Library (DL)

Test Information Distribution Engine (TIDE)◦ Managing and editing users/students◦ Registering students for tests◦ Selecting supports and accommodations◦ Processing and viewing test invalidations

Test Delivery System (TDS)◦ Test Administrator Interface◦ Student Interface


10

Alphabet Soup• Teacher Hand Scoring System (THSS)

• Online Reporting System (ORS)

• AIR360 formerly Item Response Viewer (IRV)

• Assessment Viewing Application (AVA)

• Washington Assessment Management System (WAMS)

• Education Data System (EDS)


11

Data


12

Last Notes on Spring Data CleanupCoding reason not tested L2-Basic for EOC tests: ◦ Must select “Spring 2016” rather than “Spring EOC 2016”◦ …in other words, the same place you’d record it for all other tests◦ ONLY necessary not-tested coding is grade 10 biology, only NNEP and Alternate Assessment

◦ Grade 10 Biology is the ONLY EOC assessment that factors into accountability in any way◦ Coding grade 10 bio “Alternate Assessment” indicates that the student will take grade 11 WA-AIM Science next year.

◦ L2 Basic: use ‘Math’ or ‘Science’ for EOC subjects

WAMS CEDARS Data Review now available:◦ “CEDARS Data Review” replaced “Record Reconciliation” tab w/ cleanup instructions◦ Revisit last webinar or most recent WAW ◦ If there is an error in how we’ve processed the data (e.g., NNEP flag calculating incorrectly) report to

OSPI Data Team [email protected] 360-725-6109


13

mailto:[email protected]

AIR Platform RolloverTIDE Go Live (SY2016-2017) –

- July 1 - TIDE becomes Read-Only to All Users

- July 21- 3:00 pm TIDE downtime begins

- July 25 – TIDE Downtime ends

- July 26 – ‘Old’ TIDE goes live for 2016-17 (No actual 2016-17 data until August… next slide…)

- August 11 – 5:00 pm TIDE downtime begins

- August 14 – TIDE downtime ends

- August 15 – ‘New’ TIDE goes live (Initial user guide for “New TIDE” available around this time)

NOTE: any data loaded to “Old” TIDE from 2016-17 CEDARS will roll over when “New” TIDE goes live.


14

AIR Platform RolloverALL DATES BELOW ARE BEST GUESS AS OF NOW IF ALL GOES ACCORDING TO PLAN. UPDATES WILL BE PROVIDED IN TIME FOR 8/5 ASSESSMENT COORDINATORS NETWORK MEETING

August 1 OSPI repopulates TIDE with Districts and Schools (including ESDs as Districts).◦ Prerequisite: directory information provided to and finalized by OSPI staff

August 2 OSPI repopulates TIDE with District Assessment Coordinators (creates statewide DC roles)◦ Prerequisite: DAC contact information populated in WAMS

August 10 CEDARS accepts submissions for 2016-17

August 15 OSPI sends first nightly TIDE student file◦ Prerequisite: CEDARS 2016-17 Go-Live runs smoothly◦ No, we’re not expecting a ton of data in CEDARS on that date

August 15 OSPI turns on “5 minute files” from issuance◦ NOTE: SSID issuance will be adjusted during 2016-17 to send records to WAMS for DACs to choose which records will be used

for


15

AIR Platform RolloverStudent Records in AIR Platforms:

All accommodations and supports reset◦ Good News! “New TIDE” has a plain-language upload template◦ Better News! “New TIDE” has a “show me all kids with X accommodations” filters◦ Even Better News! “New TIDE” allows for ticket/label printing by roster – you can create special rosters

for students needing specific accommodations.

Student records (2016-17) won’t show up in TIDE until CEDARS submissions start

Records are preserved in ORS

AIR360 will start fresh (no previous years’ IRV-type data)


16

AIR Platform RolloverTDS, Secure Browser, and AVA◦ Secure Browser available – July 15, 2016◦ TDS AVA availability for professional development – August 4, 2016◦ TDS Interims Go Live – August 16, 2016 ◦ THSS Go Live – August 16, 2016 ◦ TDS Smarter Practice and Training Tests Go Live - ~September 1, 2016


17

AIR Platform RolloverOnline Reporting System (ORS), Scoring, Reporting, and Analysis

July 18-July 19 – Downtime: Off Grade Science/MSP deployment of scores

July 20 – ORS Go Live: Off Grade Science and MSP Spring 2016

July 25 – ORS rollover to SY2016-2017

August 17 - ORS Live w/ 2016-17 Interims

August 17 - AIR360 (formerly known as IRV) Go Live


18

WaKIDS: Nightly File ProcessThis is what CEDARS admins heard in their webinar last week:

When pre-enrolling kindergarteners, please include the school and grade level of students who will be enrolling as kindergarteners in Fall 2016; OSPI is working with Teaching Strategies to implement an automated nightly file transfer to populate TS GOLD™ with data directly from CEDARS. In our initial file loads to TS GOLD™ , it may be necessary to identify kindergarteners who were issued SSIDs in Spring of 2016, in which case it is necessary to know that they will be in kindergarten. If you have already requested SSIDs for next year’s kindergarteners, it is not necessary to redo that work at this time, but be prepared to do so at some point should your district need to populate TS GOLD™ with student records prior to your first routine CEDARS submission of the 2016-17 school year.


19

WaKIDS: Nightly File ProcessInitial file handoff date: Early-mid August TBD

Who we’re loading in the initial WaKIDS load as “2016-17 Kindergarteners”:

1) All kindergarten students enrolled in 2017 CEDARS. Though not so much enrolled as the record is active. I wasn’t going to look at the district/school enrolled dates.

2) All kindergarten students created in issuance since 9/1/15 but only if they aren’t in CEDARS or were pre-kindergarten for the 15-16 school year.◦ If a record does occur in both issuance for kindergarten and full 2017 CEDARS then we will use the record that

was created most recently.

3) All pre-kindergarten students enrolled in 15-16 CEDARS.

4) All pre-kindergarten issuance records created since 9/1/15 but only if they aren’t in CEDARS or were pre-kindergarten for the 15-16 school year


20

WaKIDS: Nightly File ProcessDistrict Responsibilities and Notes

1) Assign Students to Class◦ Students are put in a Holding Class by default during the initial load and any time a student moves

between schools◦ Local staff must move records to actual Teachers

2) Archiving Students◦ Students are not automatically archived after a move◦ Students will be moved to a new school when that school reports to CEDARS whether active or archived


21

Nightly Files: one last noteSSID Issuance for assessment purposes is getting an enhancement:

1) “…include school and grade when requesting an SSID…” will be replaced with “indicate that this records needs to be sent for assessment purposes”◦ Untangle the “student needs to be assessed in our district” from “student needs an SSID”◦ Reduce accidental “stealing” of student records when requesting SSIDs

2) Exact mechanism and timing TBD◦ Probably a report in WAMS or elsewhere in EDS◦ Responsibility for indicating a record is for assessment shifts to DAC after CEDARS admin issues SSID

rather than 100% on CEDARS admin to record correctly◦ Until we advise otherwise, continue with status quo


22

Digital Library: User Role CleanupDigital Library accounts creation did not go well 2 years ago. ART works better than ever.

Here’s what you need to know and do to start fresh:

1) Extract all Digital Library Users from ART

2) Figure out which users need action taken (see next slides)

3) Take action via upload or UI


23

1. Retrieve All DL_EndUser from ARTSteps:

1) Go to art.smarterbalanced.org and log in (you’ll be directed through sso.smarterbalanced.org)◦ District Assessment Coordinators without login credentials can email [email protected] to

2) Click the “Create/Modify User” icon:

3) Under “Role” select “DL_EndUser”, then click the “search” button


24

https://art.smarterbalanced.org/


2. Use DL_EndUser sheet to track ‘action’ for each recordFive Main Scenarios for DL UsersAn account was created for a Digital Library user and the user…:

1) Logged in just fine, created security questions and a password, and has done work in the digital library.

ACTION: No Action Needed. 2) Never received their welcome email (from technical issues early in the launch of the ART/DL systems)

ACTION: Delete existing account and create a new account

3) Received and ignored their welcome email, allowing it to expire ACTION: Delete existing account and create a new account


25

2. Use DL_EndUser sheet to track ‘action’ for each recordFive Main Scenarios for DL Users (continued)

4) logged in during the preliminary launch without setting security questions and therefore can’t use the ‘forgot password’ link (delete and re-add will only work to the degree that they have no work saved in the DL that they can’t afford to lose)

ACTIONS: Verify with user that they don’t have saved work and delete account OR confirm they have work they do not want to lose and contact AIR helpdesk for assistance

5) moved schools or changed email addresses (need to preserve entire account while changing the email address).

ACTIONS: Smarter Balanced is adding some functionality to self-administer accounts. Preserve DL_EndUser accounts for teachers that have moved until that is available (they can change their own email address).


26

3. Modify AccountsTwo options:

1) Through the ART site, administer accounts user-by-user

2) Administer the accounts via template upload◦ Instructions (ART User Guide) and templates accessed through the “Resources” link in the top right

corner of ART◦ Need to delete unused accounts prior to recreating user accounts

ADVICE: ART and Digital Library are undergoing usability and content improvements this summer. Use late Spring through start of school year to prepare any modifications to DL_EndUser accounts in preparation for an August/September training and update schedule.


27

Who gets to do all this?LOCAL CHOICE: Whoever determines district-level user role

District Assessment Coordinators have district level admin access – can retrieve and assign users throughout the district

-OR-

District Assessment Coordinators can create School Coordinators who can retrieve and assign users throughout the scshool


28


29

Technology Update

Technology Update Updated Secure Browser (version 9.0 for Windows/Mac/Linux) for 2016-2017 school year will be available starting July 15Windows, Mac OSX, and Linux will have an Auto-Update option, so the updated browser does not have to be manually installed (and the old version uninstalled), which will also be available starting in mid-July• Windows will have a pop-up prompt with choice to install immediately or later

All versions of the Secure Browser will include a new splash screen that informs the user of the current SB version and prevents user from landing at a blank white page until an Internet connection is detected


30

WA-AIM


31

WA-AIM HS Fall Retake AdministrationWindow: September 12-November 18, 2016

Who: 12th graders eligible for alternate assessments

What: Off Grade level administration for students needing to fulfill CIA

6/16/2016


32

Content Available Grades Required Achievement Level

ELA/Mathematics 3 or 6 L3

Science 5 or 8 L3

WA-AIM CIA Graduation Cut Scores

WA-AIM High School Graduation Cut ScoresELA Mathematics Science104 103 104

6/16/2016


33

Students who met the following scores on the 2015-2016 Grade 11 WA-AIM have fulfilled the CIA requirement for that content area.

Students who participated in the Grade 11 WA-AIM via the Engagement Rubric have had the CIA requirement waived- the Engagement Rubric replaces the prior Awareness Waiver.

WCAP USER SUPPORT Questions regarding information in the Test Administration Manuals • TAs and School Test Coordinators, contact your District Test Coordinator. • District Test Coordinators contact the OSPI Assessment Operations Team at: [email protected].

Policy or Test Administration Questions • TAs and School Test Coordinators, refer to the Test Administration Manual. If additional support is

needed, contact your District Test Coordinator. • District Test Coordinators contact the OSPI Assessment Operations Team at: [email protected].


34

WCAP ContactsAIR Help Desk for Technical, Network, and password issues

• AIR Help Desk: [email protected] 1-844-560-7366

OSPI Assessment Analysts for student data issues• OSPI Assessment Analysts: [email protected] 360-725-6109

OSPI Assessment Operations for assessment policy and test materials• Assessment Operations [email protected] (360) 725-6348 or (800) 725-4311,

press option 3

The Smarter Balanced Assessment Consortium has updated it website. Check out the revamped and more user friendly site launched this week at http://www.smarterbalanced.org/.


35




http://www.smarterbalanced.org/

WCAP Contacts for Technology, System, or Program Issues

• TAs, School Test Coordinators, and District Test Coordinators contact the WCAP Help Desk (TAs and School Test Coordinators must also alert the District Test and Technology Coordinators of issues).

• The WCAP Help Desk is open Monday–Friday from 6:00 a.m. to 6:00 p.m. PT (except holidays or as otherwise indicated on the Washington Comprehensive Assessment Program Portal).

• Washington Comprehensive Assessment Program Help Desk

Toll -Free Phone Support: 1-844-560-7366

Email Support: [email protected]


36

Have a wonderful summer!


37

office of superintendent of public … · fun flag fact. nepal is the only country with a...

Documents