DOK & the PA Core Standards

WIU Crossroads

August 2014

Objectives: Develop a shared understanding of the concept of

cognitive rigor Understand Depth of Knowledge levels Apply Depth of Knowledge levels to instructional tasks,

questions and assessments Understand the instructional implications of the shifts

called upon by the PA Core Standards Examination of the PA Core Standards and the PA Core

Instructional Frameworks Identification of resources to support Curriculum,

Instruction, and Assessment aligned to the PA Core Standards

Writing and revision of current curricula to reflect PA Core Standards

What the Research Says…

Teachers are the Key!

“Teachers must be the primary driving force behind change. They are best positioned to understand the problems that students face and to generate possible solutions.”

Research has indicated that... “teacher quality trumps virtually all other influences on student achievement.”

“If a student is in one of the most effective classrooms he or she will learn in 6 months what those in an average classroom will take a year to learn. And if a student is in one of the least effective classrooms in that school, the same amount of learning take 2 years.”

Closing the Gap…

The secret to closing achievement gaps and making significant progress in student assessment results can only be accomplished by holding all students accountable to the same rigorous standards regardless of the demographic subgroup.

Wiener, R., & Hall, D. The Clearing House, 78(1), pp. 17-21.

Close Reading

A close read is… Engaging Has a defined purpose See connections within text Provides a reason to learn Teaches students to dig deeper

Close reading means reading to uncover layers

of meaning that lead to deep comprehension.

Brain Dump Activity Take two minutes to write down everything you

know regarding rigor as it pertains to curriculum,  instruction and assessment.

Table groups will combine responses and choose top three ideas.

Use an Answer Garden poll to share ideas with the whole group and create a word cloud to drive discussion

http://answergarden.ch/view/102341

Rigor-Background Knowledge

Rigor-Building Knowledge

Reading Assignments: 1s—The Beginner’s Guide to Understanding Rigor 2s—4 Myths About Rigor in the Classroom 3s—What is Instructional Rigor? 4s—The Characteristics of a Rigorous Classroom

Each person will share 3 AHAs from the article they read.

The group will collaborate and choose 1 person to post the top 3 AHAs on the Answer Garden.

http://answergarden.ch/view/102341

Rigor-Process What We’ve Learned

What are we doing well?What do we need to strengthen?

Only by creating a culture of high expectations and providing support so students can truly succeed do you have a rigorous classroom.

Barbara Blackburn 2008

Rigor is Producing Cognitive Sweat!

How does all of this connect to the PA Core Standards and the PA Assessments?

Depth of Knowledge

DOK-Building Knowledge Adapted from the model used by Norman

Webb, University of Wisconsin, to align standards with assessments

Used by the Council of Chief State School Officers (CCSSO) for assessment alignment

Why DOK? Mechanism to ensure that the intent of the

standard and the level of student demonstration required by that standard matches the assessment items (required under NCLB)

Are we assessing the true intent of the standard?

Provides cognitive processing ceiling (highest level students can be assessed) for item development

To ensure that teachers are teaching to a level that will promote student achievement.

DOK vs. Bloom’s Bloom-What type of thinking is needed to

complete the task? Webb-How deeply do you have to understand

the concept to successfully interact with it? How complex is the content?

It’s not about the verb, but rather the complexity of the task.

DOK Level is determined by the degree of mental processing required by the student to correctly answer the question.

How Does DOK Impact the Classroom? We can no longer rely solely on “tell-me-what-

I-told-you” classroom assessments. We can no longer build assessments that do

not require the child to read the text provided to acquire the answer.

We must begin creating “demonstrate-and-apply-what-you-have-learned” assessments to ensure our students have truly mastered what the standards have asked of them.

The state assessments should not be the only time they see this kind of assessment.

Webb’s Depth of Knowledge Levels

Recall and Reproduction: Level 1

Skills & Concepts: Level 2

Strategic Thinking: Level 3

Extended Thinking: Level 4

Recall and Reproduction: Level 1 Curricular elements that fall into this category

involve basic tasks that require students to recall or reproduce knowledge and/or skills.

DOK 1 requires recall of information, such as a fact, definition, term, or performance of a simple process or procedure.

It may also involve use of simple procedures or formulas. It can be difficult without requiring reasoning.

A student answering a Level l item either knows the answer or does not; that is, the answer does not need to be figured out” or “solved.

DOK Level 1 Examples

• List animals that survive by eating other animals.

• Locate or recall facts explicitly found in text

• Describe physical features of places• Determine the perimeter or area of

rectangles given a drawing or labels• Identify elements of music using

musical terminology• Identify basic rules for participating

in simple games and activities

DOK 1: Recall and Reproduction Teacher Role Student Role

Questions to direct or focus attention, shows, tells, demonstrates, provides examples, examines, leads, breaks down and defines

Recognizes, responds, remembers, memorizes, restates, absorbs, describes, demonstrates, follows directions, applies routine processes, definitions and procedures

DOK 1: Recall and ReproductionPossible Products Potential Activities Potential Questions

Recite math facts Make conversions between metric and

customary units

Can you recall. . .

Fill in the blank tasks Complete basic/routine calculation tasks

(addition, subtraction, division, etc.)

What is . . .

Measure, record data Complete measurement tasks

(use a ruler to measure length)

How would you describe. . .

Story facts Recite a fact related to …

When did ___ happen?

Explanation Retell in your own words…

Can you recall ___?

Reproduction Cut out, or draw a picture that illustrates a

character in a story.Who was ___?

Skills/Concepts: Level 2

DOK 2 includes the engagement of some mental processing beyond recalling or reproducing a response. Items require students to make some decisions as to how to approach the question or problem.

These actions imply more than one mental or cognitive process/step.

33

DOK Level 2 Examples

• Compare desert and tropical environments• Identify and summarize the major events,

problem, solution, conflicts in literary text• Explain the cause-effect of historical

events• Predict a logical outcome based on

information in a reading selection• Explain how good work habits are

important at home, school, and on the job.• Classify plane and three dimensional

figures• Describe various styles of music

DOK 2: Skill/ConceptTeacher Role Student Role

Questions to differentiate, infer, or check conceptual understanding, models, organizes/reorganizes, explores possible options or connections, provides examples and non-examples

Solves routine problems/tasks involving multiple decision points and concepts, constructs models to show relationships, demonstrates use of conceptual knowledge, compiles and organizes, illustrates/explains with examples or models, examines

DOK 2: Skill/ConceptPossible Products Potential Activities Potential Questions

Demonstration Explain a series of steps used to find a solution

How or why would you use. . .

Graphic organizer Construct a model to demonstrate how it looks or works

What other ways could you solve/find out. . .

Survey development Create a questionnaire or survey to answer a question

What is your prediction. . . and why?

Scrapbook Identify and summarize the major events of a narrative.

How would you summarize ___?

Paired text Compare the settings of one book to a setting in another book.

What do you notice about ____?

Blog Reflecting Write an explanation about ____ for others.

Can you explain how ____ affected ____?

Strategic Thinking: Level 3

DOK 3 requires deep understanding as exhibited through planning, using evidence, and more demanding cognitive reasoning. The cognitive demands at Level 3 are complex and abstract.

An assessment item that has more than one possible answer and requires students to justify the response they give would most likely be a Level 3.

37

DOK Level 3 Examples

• Compare consumer actions and analyze how these actions impact the environment

• Analyze or evaluate the effectiveness of literary elements (e.g. characterization, setting, point of view, conflict and resolution, plot structures)

• Solve a multiple-step problem and provide support with a mathematical explanation that justifies the answer

• Sort objects into a variety of categories and explain the rule you used.

DOK 3: Strategic Thinking & ReasoningTeacher Role Student Role

Questions to probe reasoning and underlying thinking, asks open-ended questions, acts as a resource and coach, provides criteria and examples for making judgments and supporting claims, encourages multiple approaches and solutions; determines when/where (text, concept) depth and exploration is most appropriate

Uncovers and selects relevant and credible supporting evidence for analyses, critiques, debates, claims and judgments; plans, initiates questions, disputes, argues, tests ideas/solutions, sustains inquiry into topics or deeper problems, applies to the real world

DOK 3: Strategic Thinking & ReasoningPossible Products Potential Activities Potential QuestionsComplex graph Analyze results of a

questionnaire or survey (e.g., survey classmates/industry members to find out what they think about a current issue)

What are the possible design flaws in…

Set up a database Propose an alternate solution to a problem studied

What conclusions can you draw. . .

Analyze survey results Use evidence to generate criteria for making judgments

How can you prove that your solution or estimate is reasonable?

Create a booklet Make a booklet about five rules you see as important and convince others

What would happen if you didn’t follow the rules?

Letter writing Write a letter to a story character

What questions would you ask of the character?

If I Was in Charge Rewrite the story as if you are the main character and you were in charge of fixing the problem identified in the story.

Imagine that you are the main character in the story. Describe how you would have fixed the problem that the main character was confronted with?

Extended Thinking: Level 4

DOK 4 requires high cognitive demand and is very complex. Students are expected to make connections-relate ideas within the content or among content areas—and have to select or devise one approach among many alternatives on how the situation can be solved.

Students are engaged in conducting multi-faceted investigations to solve real-world problems with unpredictable solutions.

Due to the complexity of cognitive demand, DOK 4 often requires an extended period of time.

DOK 4: Extended ThinkingTeacher Role Student Role

Questions to extend thinking and broaden perspectives; facilitates teaming, collaboration, self-evaluation

Designs, takes risks, researches synthesizing multiple resources, collaborates, plans, organizes, and modifies, creates concrete tangible products

DOK 4: Extended ThinkingPossible Products

Potential Activities Potential Questions

Short film Tasks that require making multiple strategic and procedural decisions as new information is processed

Can you propose an alternative solution to. . .

Agency presentation Applying information from more than one discipline to solve ill-defined problems in novel or real-world situations

What could be done to minimize (maximize). . .

Research report Conducting an internship in industry where students are faced with real-world, unpredictable problems

Can you formulate and test a conjecture for. . .

Advertisement Create an idea and try to sell it. Write a jingle to try an sell it.

Devise a way to …

Analyze and Synthesize from multiple sources

Describe and illustrate how common themes are found across multiple texts.

What information can you gather from each of the texts to support what each of the texts has in common?

DOK 4 & Project Based Learning Essential Elements of PBL include:

Significant content—focused on teaching students important knowledge and skills (derived from the standards)

21st century competencies—problem solving, critical thinking, collaboration, communication and creativity/innovation which are explicitly taught and assessed

In-depth inquiry—extended, rigorous process of asking questions, using resources and developing answers

Driving question—focused by an open-ended question that students understand and find intriguing, which captures their task or frames their exploration

Need to know—see the need to gain knowledge, understand concepts and apply skills in order to answer driving questions and create project products

Voice and choice—allowed to make choices about the products to be created, how they work and how they use their time (with teacher guidance)

Critique and revision—provides processes for students to give and receive feedback on the quality of their work

Public audience—students present their work to other people, beyond their classmates and teacher

DOK Reminders! A task requiring extended time or is a project

does not necessarily mean it addresses higher DOK levels.

Project-based learning should not only be about the final product but also the process in which the project is designed.

Emphasis should not be about how spectacular a project looks but rather how substantial are the concepts, ideas, subjects, and topics the final product addresses.

The evaluation should not only be on the project itself but the level of thinking and depth of knowledge students express in their design, invention, plan or production.

DOK is about Complexity! Level 1 requires students to use simple skills

or abilities. Level 2 includes the engagement of some

mental processing beyond recalling. Level 3 requires some higher level mental

processing like reasoning, planning, and using evidence.

Level 4 requires complex reasoning, planning, developing, and thinking over an extended period of time

Applying DOK to Bloom’s Taxonomy Math & Science ELA

Your turn! DOK Assessment Analysis Activity

Reading Math

DOK Supporting Resources

DOK & Keystone Exams: Supporting Resources on SAS

PDE Released Items

DOK-Process What We’ve Learned

What are we doing well?What do we need to strengthen?

Instructional Shifts-ELA

1. Complexity: Regular practice with complex text and its academic language.

2. Evidence: Reading, writing and speaking grounded in evidence from text, both literary and informational.

3. Knowledge: Building knowledge through content-rich nonfiction.

Instructional Shifts-Math1. Focus: Focus strongly where the Standards focus.

2. Coherence: Think across grades and link to major topics within grades.

3. Rigor: In major topics, pursue conceptual understanding, procedural skill and fluency, and application.

Exploring the Instructional Shifts

1. Count off by 6. 2. Read your assigned shift. 3. Within your group, discuss the steps toward infusing

the shift.4. Create a group poster listing additional steps toward

infusing the shift in class/grade/subject.

Instructional Shifts-Process What We’ve Learned

What are we doing well?What do we need to strengthen?

PDE SAS Resources to Support PA Core

Handout

PDE SAS Resources to Support PA Core

PDE SAS Resources: Vertical View

Instructional FrameworksTo access the PA Core Instructional Frameworks…

Login in to SAS Click on Teacher Tools Click on Curriculum Mapping Click on PA Core Standards Instructional Frameworks ELA and

Math

PA Core Instructional Framework Template

PA Core Instructional Framework

Supporting Resources New York Engage Modules

Contain mathematics and ELA modules http://www.engageny.org/mathematics http://www.engageny.org/english-language-arts

New York Engage Modules-Math Grade 6

Ratios and Unit Rates Arithmetic Operations Including Dividing by a Fraction Rationale Numbers Expressions and Equations Area, Surface Area, and Volume Problems Statistics

Grade 7 Rations and Proportional Relationships Rational Numbers Expressions and Equations Percent and Proportional Relationships Statistics and Probability Geometry

Grade 8 Integer Exponents and the Scientific Notation The Concept of Congruence Similarity Linear Equations Examples of Functions from Geometry Linear Functions Introduction to Irrational Numbers Using Geometry

PA Core Mathematics Modules Grade 6

Ratios and Unit Rates Arithmetic Operations Rationale Numbers Expressions and Equations Area, Surface Area, and Volume Problems Statistics

Grade 7 Rations and Proportional Relationships Rational Numbers Expressions and Equations Percents and Proportional Relationships Statistics and Probability Geometry

Grade 8 The Number System and Properties of Exponents Congruence Similarity Linear Equations Functions from Geometry Linear Functions Irrational Numbers Using Geometry

Instructional Frameworks-Process What We’ve Learned

What are we doing well?What do we need to strengthen?

So, what does this mean to me?Educator Effectiveness

Curriculum Writing/Revisions

WIU Crossroads

August 2014

Concepts Competencies AssessmentsKey knowledge; Nouns Key skills; Verbs Specific formative and

summative assessments that will be used

What students should know as a result of this instruction specific to grade level

What students should be able to do as a result of this instruction

Ex: Categorical and Quantitative Data

Use measures of dispersion to describe a set of data (range, quartiles, interquartile, range).

Possible Formative Assessment:

Your math teacher allows you to choose the most favorable measure of central tendency of your test scores to determine your grade for the term. On six tests you earn scores of 89, 81, 85, 82, 89, and 89. What is your grade to the nearest whole number, and which measure of central tendency should you choose?

a. 87; the medianb. 89; the meanc. 91; the moded. 89; the mode

Ex: Text Analysis Apply appropriate strategies to analyze, interpret, and evaluate how an author unfolds an analysis or series of ideas or events, including the order in which the points are made, how they are introduced and developed, and the connections that are drawn between them.

Possible Summative Assessment:

After students have read a short passage, have them respond to multiple choice questions focusing on author’s purpose, central idea of text and drawing evidence from text.

Curriculum Mapping

Have you had enough?