DTC Session

August 29, 2016

DTC Welcome

• New DTCs

• OoA for 2016-17 School Year

2

DTC Communication

2016-2017

Communications

• Face-to-Face sessions

• Webinars

• eNewsletters

• Weekly call/contact via assessment liaison

• Monday memos

• School visits

• Weekly testing window webinars

4

DeSSA Calendar

2016-2017

• Grade 10 : Feb 21 – Apr 14

• Feb 6 – Mar 31

Delaware System of Student Assessments (DeSSA): 2016-2017 Calendar O

pti

on

al A

ssessm

en

t

Re

so

urc

es

Re

qu

ire

d S

tate

As

se

ss

me

nt

Re

so

urc

es

August 2016 January 2017 June 2017

• Grades 5, 8 & 10: Mar 8-June 1DCAS-Alt1 Science

• Grades 5, 8, & 10: Mar 1 – June 1

• *P/P: Mar 29 – Apr 13DCAS Science

• Grades 3–8: Mar 8 – June 1

• *P/P: May 1 – May 19

Smarter ELA &

Mathematics

• Grades 3–12: Aug 29- end of school yearSmarter Interim Assessments

• EOC—Algebra II, Integrated Math III: Aug 29 – March 31EOC Pre-Test

(for DPAS II)

ACCESS

• Grades 3–8: Mar 8–June 1

• Grades 10-11: Mar 8-June 1

DCAS-Alt1 Reading

& Mathematics

* P/P = Paper and Pencil Test

• Grades K–12: Available entire school yearSmarter Digital Library

PSAT 10

P

PSAT 8/9

• Grade 11: April 5

• Makeup Day: April 25SAT School Day

• Grades 4, 8 : Jan 30 – Mar 10NAEP

PSAT 8/9

Document Control No. 2016/07/02 Replaces:

2016/06/01

• Grades 9: Feb 21 – Apr 14 • Grades 9: Sept 26 – Jan 27

EOC : Alg II/Int

Math III & *P/P• Jan 4 – Feb 3

EOC : Alg II/Int

Math III• Mar 29 – June 1

• *P/P: Mar 29 – Apr 13

Smarter Interims

Update

IABs for 2016-2017- ELA

Grades 3-5

Delaware Department of Education 8

IAB ELA/Literacy Block Name

* New IABs in 2016-2017

Grade

3 4 5

Read Literacy texts

Read Informational Texts

Brief Writes

Editing* * * *

Language & Vocabulary Use* * * *

Revision* * * *

Listen/Interpret

Research

Informational Performance Task

(not in 2016/2017)

- - -

Opinion Performance Task - -

Narrative Performance Task -

IABs for 2016-2017- ELA

Grades 6-8

Delaware Department of Education 9

IAB ELA/Literacy Block Name

* New IABs in 2016/2017

Grade

6 7 8

Read Literacy texts

Read Informational Texts

Edit/Revise - -

Brief Writes

Editing -

Language & Vocabulary Use* * * -

Revision -

Listen/Interpret

Research

Explanatory Performance Task -

Argument Performance Task - -

Narrative Performance Task * N/A in 2016/2017 - - -

IABs for 2016-2017- Math

Grades 3-5

Delaware Department of Education 10

IAB Mathematics Block Name

* New IABs in 2016-2017

Grade

3 4 5

Operations and Algebraic Thinking *

Fractions

Measurement and Data *

Numbers and Operations in Base 10 *

Geometry* - * *

Mathematics Performance Task

IABs for 2016-2017- Math

Grades 6-8

Delaware Department of Education 11

IAB Mathematics Block Name

* New IABs in 2016-2017

Grade

6 7 8

Ratio and Proportional Relationships -

Expressions and Equations -

Expressions and Equations with Proportionality, Statistics

& Probability

* *

Number System * -

Functions - -

Geometry *

Mathematics Performance Task

SAT Updates

SAT School Day Cut Scores Approved

Achievement

Level 1

Achievement

Level 2

Achievement

Level 3

Achievement

Level 4

200-410 420-470 480-620 630-800

13

Achievement

Level 1Achievement

Level 2Achievement

Level 3Achievement

Level 4

200-410 420-520 530-640 650-800

School Day SAT ERW Performance

School Day SAT Mathematics

Performance

SAT School Day Proficiency

Statewide ERW and Mathematics

Proficient and Achievement Levels, 2016

14

Proficiency AL 1 AL 2 AL 3 AL 4

ERW 53% 26% 21% 42% 11%

Mathematics 31% 27% 42% 24% 7%

SAT School Day Participation

Statewide SAT Assessment Participation Rates

15

ERW Math

Statewide 95% 95%

2017 SAT School Day

School Day SAT Administration Dates

16

Date Tests Administered

April 5, 2017

April 25, 2017

School Day SAT

School Day SAT Make-Up

PSAT Updates

2016-2017 PSAT 10 Information

18

Test Window: Feb 21, 2017 – Apr 14, 2017

Important Dates – Feb & March Testing

• Deadline to complete SSD requests – Dec. 16

• Deadline for schools to order tests using the pre-administration option – Dec. 23

• Deadline to order test materials – Jan. 27

• Test materials arrive for schools testing in Feb and March – Feb. 8

Important Dates – April Testing

• Deadline to complete SSD requests – Feb. 13

• Deadline for schools to order tests using the pre-administration option – Feb. 17

• Deadline to order test materials – Mar. 3

• Test materials arrive for schools testing in Feb and March – Mar. 27

DCAS-Alt1 Overview

DCAS-Alt1 Tested Subjects and Grades

• Reading and Mathematics

– Grades 3-8, 10-11

– No grade 9

• Science

– Grade 5, 8 and 10

• For 2016-17 there will be no DCAS-Alt1

Social Studies

20

Manuals and Professional Development

• New Test Administrator and District Test

Coordinator Manuals

• No significant changes

– Available on portal end of August

– Sent to TAs with their test kits

• Professional Development Mandatory

– Full Day for new TAs

– Update (Schoology) for previous trained TAs

21

2017 National Assessment of

Educational Progress

(NAEP)

2017 NAEP

23

School Name GrScheduled

Assessment Date

Multiple-

Team

School

Alpha

Sample

Flag

Beta

Sample

Flag

AlphaNum

tablet

Num

P/PBeta

Estimate

Student

Sample

Letter Type

Brick Mill Elementary School 4 2/15/2017 NO 1 0 1 25 12 62 Math & Reading

Bunker Hill Elementary School 4 3/1/2017 NO 1 0 1 25 12 62 Math & Reading

Cedar Lane Elementary School 4 2/28/2017 NO 1 0 1 25 12 62 Math & Reading

Loss (Olive B.) Elementary School 4 2/7/2017 NO 1 0 1 25 12 62 Math & Reading

Meredith (Everett) Middle School 8 2/23/2017 YES 1 0 3 75 36 186Math & Reading Multi-

Hit

Old State Elementary School 4 3/7/2017 NO 1 0 1 25 12 62 Math & Reading

Redding (Louis L.) Middle School 8 2/22/2017 YES 1 0 3 75 36 186Math & Reading Multi-

Hit

Silver Lake Elementary School 4 2/2/2017 NO 1 0 1 25 12 62 Math & Reading

Waters (Alfred G.) Middle School 8 2/10/2017 YES 1 1 3 75 36 1 186 Overlap

Nellie Hughes Stokes Elementary

School4 3/9/2017 NO 0 1 1 Writing & Pilot

Jones (Albert H.) Elementary School 4 2/2/2017 NO 0 1 1 Writing & Pilot

Shue-Medill Middle School 8 3/2/2017 YES 1 1 3 75 36 1 186 Overlap

Family Foundations Academy 8 2/14/2017 NO 0 1 1 Writing & Pilot

Delaware State System of AssessmentsSocial Studies Development

Social Studies Assessment Updates

• Paused testing in grades 4, 7, EOC for Spring 2017

• DeSSA RFP released July 22nd; proposals due Sept 9th

• Social Studies tests in one elementary, one middle, one high school grade

• Updated Standards

• Updated Clarifications

25

2016-17 SY 2017-18 SY 2018-19 SY 2019-20 SY 2020-21 SY

Social

Studies

RFP/Contract

Item and Test

Development

Field test and

continued

Item Development

Summative

iin place and

continued Item

Development

Summative

iin place and

continued Item

Development

Summative

in place and

continued Item

Development

Delaware State System of AssessmentsScience Phase I Development

Proposed

• Teacher driven• Immediate classroom

feedback

• Coalition Driven• Data reported for

curriculum, instruction and PD decision making.

• ESSA Requirement Grades 5, 8, and 10 (Biology)

Science Next Steps

The purpose of this Phase I RFP is to solicit high-quality proposals from qualified bidders to work with the Delaware Department of Education (DDOE) to design, develop, and pilot innovative science assessment tasks to inform specifications for a statewide science assessment to measure student learning of the Next Generation Science Standards (NGSS).

The proposed schedule of events subject to the RFP is outlined below:

Public Notice Date: August 26, 2016

Deadline for Questions Date: September 9, 2016

Bidder’s Conference and

Response to Questions Posted by: Date: September 16, 2016

Deadline for Receipt of Proposals Date: September 23, 2016 at 3:00 PM

(Local Time)

Estimated Notification of Award Date: October 7, 2016

MANDATORY PREBID MEETING

A mandatory pre-bid meeting has been established for this Request for Proposal and is scheduled for September 16, 2016 from 1:00-3:00 p.m. EDT.

28

Test Security

2015 vs. 2016 Test Security Incidents by

Type

30

0

5

10

15

20

25

30

35

40

45

Cheating CellphoneUsage

No ClassroomActivity before

PT

Not ShreddingNotes

Teacherstartingincorrectsession

StudentDisruption

AdvantageGiven by TA

ComputerUsage

CalculatorUsage

Component V Other

Series1 Series2

DeSSA Training

Trainings Page on Portal

32

http://de.portal.airast.org/resources/?section=6

• Training course numbers are unchanged. Content is being updated in Schoology and course record

updated in PDMS. PDMS course registration will be released when course update is complete.

Trainings Page on Portal, Continued

33

Training Available in

Early September

Number Title

24246 DeSSA Entry Training (includes Security Training)

24248 DeSSA District & School Test Coordinator Training

24288 Smarter Interim Test Administrator Training

24251 DCAS-EOC Test Administration Training

34

Other Trainings Available

35

Number Title Audience

24473 What is a CAT Educators, Students

24472 Let’s Talk Universal tools Educators, Students

24484 Student Test Interface Educators, Students

2016-17 Manuals Published

• Technical Specifications Manual

– For your technology supervisors and tech

support persons

• Secure Browser Version 9.0 Installation

Manual

• Online Error Messages Document

• System Requirements Document

36

New Ticket System

New Ticket System to Replace SysAid

• SysAid to be retired

• New system to be implemented – a DELL

product

• Will integrate better with other DOE

systems

• Assessment will notify DTCs when it

becomes available

38

System Update

TIDE Down Time

• August 22-28, 2016

• Preparation of systems for 2016-17 School

Year

40

DeSSA Site Visits

Overview of 2015-2016

Site Visit Pilot

• Used protocol during school visits

• Similar to CCSS Site Visits used by

Curriculum workgroup

• Focused on assessment areas

– Training and Administration

– Accommodations

– Test Security and Environment

– System improvements

42

Purpose of Site Visits

43

• to assist LEAs with refining and improving assessment administration,

training, and security

• to maximize best testing conditions for all students and reduce security

infractions

• to provide on-going support and gather information about district needs

• to refine and improve support for the DeSSA system and ongoing

implementation

DeSSA Site Visit Activities

44

Beginning Winter 2016-17

• DOE Lead will coordinate schedules for site visits and agendas with schools (point of contact is likely STC)

• On-site visit

- Student focus group

- Interviews with TAs, STC, and DTC

- Classroom visits

• Site Visit Report provided to DTC, STC

Peer Review

August 2016

Purpose of Peer Review

The purpose of Peer Review of State assessment systems is to support states in meeting statutory and regulatory under Title I of the Elementary and Secondary Education Act of 1963 (ESEA) for implementing high technical quality assessment system and, where applicable, provide for ESEA flexibility with an opportunity to demonstrate that they have met requirements for high-quality assessments under Principle 1 of ESEA flexibility.

A key purpose of Title I of the ESEA is to promote educational excellence and equity so that when students graduate from high school, they have mastered the knowledge and skills to be successful in college and careers.

The ESEA requires a state to develop and implement challenging academic content standards and achievement standards in at least reading/language arts and mathematics, and science, and to apply the same academic standards to all public schools and public school students in the State.

46

Process for Preparation

The Delaware preparation for Peer Review started in

early April;

The Center for Assessment (CFA) provided us

(assessment and some curriculum staff) with an

intensive training about the six critical elements and the

process; and

It was a joint effort of DDOE staff, CFA consultants, and

AIR to collect documents, files, and data, and prepare

evidence to demonstrate the technical quality of

Delaware assessment system.

47

Six Critical Elements

1. Statewide System of Standards and Assessments: For example, state adoption of academic content standards for all students; policy for including all students in assessments; participation data

2. Assessment Systems Operations: For example, test design & development; monitoring test administration; test security; system for protecting data integrity & privacy

3. Technical Quality – Validity: For example, overall validity, including validity based on content; validity based on cognitive process; validity based on internal structure; validity based on relations to other variables

4. Technical Quality – Others: For example, reliability; f airness & accessibility; scoring; multiple versions of an assessment; technical analysis & ongoing maintenance

48

Six Critical Elements

5. Inclusion of All Students: For example, procedures for

including SWDs; procedures for including ELs;

accommodations; monitoring test administration for special

populations

6. Academic Achievement Standards and Reporting: For

example, state adoption of academic achievement standards

for all students; achievement standards setting; challenging &

aligned academic achievement standards; reporting

49

Submission

All preparations were completed by the end of May;

The submission included the State Assessment Peer

Review Submission Cover Sheet; Submission Cover

Letter, Executive Summary, Delaware Peer Review

Exhibit List by Critical Element (an index of

documentations, page numbers and relevance), and

Summary (with detailed evidence); and

Dr. Steve Godowsky, Secretary of Education reviewed

the submission and approved the submission on June 1,

2016, on schedule.

50

Consortium

Since Smarter Balanced Assessment Consortium is adopted by multiple states, including Delaware and the peer review for Smarter was a joint effort.

Evidence such as test design, item/test development, achievement standards, was prepared by the consortium; while the evidence such as adoption of content standards, test administration, technical quality from operation, was prepared by each state.

Smarter Balanced submitted evidence for Peer Review in June. Like other member states, Delaware submission will be reviewed in late August.

51

DTC Questions and Support

DTC Monthly Meeting March 16, 2016 52