in the beginning, we all used our own tools

In the beginning, we all used our own tools

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

We didn’t have a common language

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

We needed a standard that everyone could use

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

We developed a framework…

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

And used it.

Domain 1: Planning and Preparation

ComponentAreas for Growth

Basic Proficient Distinguished

DesigningCoherentInstruction (1a)

Instructor states goals for the class, and explains how activities relate to those goals. Asks students probing questions about their level of understanding, about linkage between activities and learning outcomes.

Introduces and concludes class.

Use of course outcomes explicitly in class meeting

•Instructional goals do not match instructional design/methods.

•Class session has no established structure.

•Goals not clearly stated

•Goals and methods match each other periodically, but not throughout class meeting.

•Some evidence of class structure.

•Goals and methods match throughout class. •Structure evident.

•Goals and methods match at a higher level—linking with student/course learning outcomes, related to student levels.

•Structure evident throughout class session.

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

It looked like this

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

We got faculty feedback

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

NEW!!! IMPROVED!!

!!

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

It looked like this

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

It was supported by a very detailed explanation

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

2 categories, not 4

Emphasis on narrative, not on ranking

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

How does classroom observation work at your institution?

Innovations 2009 ♦ Northampton Community College ♦ Bortz & Pense

Assessor, Assessor, assess thyselfassess thyself

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

In 2010, 17 observers visited 344 classrooms. We marked “needs attention” 394 times.

The top six categories rated as needing improvement:

•The instructor motivates the students (38)•Students are asked to actively apply the concepts to new or contemporary situations (32)•Goals for the day’s class are linked with the course outcomes (33)•Active listening is consistently practiced (22)•The instructor uses available and appropriate resources (22)•Concepts are presented to appeal to multiple learning styles (21)

We looked at the numbers

We also held a norming session. Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

We had two different understandings of what “active listening” meant.

We couldn’t measure what we couldn’t see. We all agreed to ask three questions before doing an observation.

We changed the order of the form to give positive feedback first.

We learned this…

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

Next

The top three categories remained the same.

There were some changes in the rank order and in the top six categories.

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

In 2010, 17 observers visited 344 classrooms. We marked “needs attention” 394 times. The top six categories rated as needing improvement:

•The instructor motivates the students (38)•Students are asked to actively apply the concepts to new or contemporary situations (32)•Goals for the day’s class are linked with the course outcomes (33)•Active listening is consistently practiced (22)•The instructor uses available and appropriate resources (22)•Concepts are presented to appeal to multiple learning styles (21)

In 2011, 13 observers visited 310 classrooms. We marked “needs attention” 389 times. The top six categories rated as needing improvement:

•The instructor motivates students (32)•Goals for the day’s class are linked with course outcomes (30)•Students are asked to actively apply the concepts to new or contemporary situations (29)•Pacing is adjusted to assure student’s understanding (28)•Concepts are presented to appeal to multiple learning styles (24)•Most students are engaged / Instructor uses available resources (21)

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

We changed our understanding of “active listening”….and it dropped from the top six.

But a new category entered the top six: “most students are engaged”

We think the new category captures the old issue.

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

“Pacing” became part of the online conversation.

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

Are observers prepared with practical ideas and suggestions to address with these commonly identified issues?

Do we have professional development offerings that match our observed needs?

What would individual or institutional improvement look like?

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

Was there anything about this data, this form, or this process that stood out as helpful to you?

What ideas do you have to help others doing observations?

Innovations 2012 ♦ Northampton Community College ♦ Bortz & Pense

Toolsauthor’s collectionTower of Babelhttp://www.ibiblio.org/wm/paint/auth/bruegel/littlebabel.jpgPlumb Linehttp://4.bp.blogspot.com/_vT1FNqbNFhY/TDoHx3KwkMI/AAAAAAAAALM/G5n8-kzMhkc/s1600/plumb2.jpgTape Measuresauthor’s collectionFeedback Formshttp://www.brilliancemastery.com/wp-content/uploads/2011/02/customer-feedback.jpghttp://polyres.net/storage/i-love-feedback.png?__SQUARESPACE_CACHEVERSION=1286685082564Book with Pageshttp://www.4freephotos.com/images/u2/Book-pages1533.jpgPrison Panopticonhttp://www.thinkingshop.com/AIP/ethics/images/Benthampanopticon9-22-02.jpgPrague Astronomical Clockhttp://www.macalester.edu/german/global/images/prague%20clock.jpgNicola Teslahttp://www.museum-joanneum.at/upload/file/Tesla_im_Labor_1_.jpgConversation Silhouettehttp://diedreblake.files.wordpress.com/2011/02/two_silhouette_profile_or_a_white_vase.jpgCalendar Pageshttp://cf.ltkcdn.net/charity/images/std/137221-347x346-Calendar-pages.jpgSeasons Changinghttp://imgisland.com/wallpapers/Nature/2037_Seasons_Change.jpgMarathon Manhttp://media1.break.com/breakstudios/2012/1/9/marathon_runner.jpgHard Questionshttp://www.buzzle.com/img/articleImages/505132-11229-31.jpgArrow on Targethttp://www.olenick.com/images/arrow_vertical.jpg

Imag

e C

redi

ts