evaluation -...

34
EVALUATION Small Shifts: Huge Changes David McClay Northern Adelaide State Secondary Schools Alliance (NASSSA) Katrina Elliott Department for Education and Child Development (DECD)

Upload: tranmien

Post on 01-Jul-2019

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

EVALUATION Small Shifts:

Huge Changes

David McClayNorthern Adelaide State Secondary Schools Alliance (NASSSA)

Katrina ElliottDepartment for Education and Child Development (DECD)

Page 2: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

2 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

Contents Small Shifts: Huge Changes Evaluation ..................................................................... 3

Introduction ............................................................................................................. 3 Background ............................................................................................................ 3

Planning Imperatives ........................................................................................... 3 Pedagogy and curriculum ................................................................................... 3

Professional Collaboration ...................................................................................... 4

NASSSA Principals ............................................................................................. 4 NASSSA Council ................................................................................................. 4 NASSSA Science Curriculum Area Teams ......................................................... 5 NASSSA STEM Reference Group ...................................................................... 5 Other schools ...................................................................................................... 5

Purpose .................................................................................................................. 5 Project Implementation ........................................................................................... 6

Method ................................................................................................................ 6 Workshops .......................................................................................................... 7

Participants ........................................................................................................... 14

Registration ....................................................................................................... 14

Data ...................................................................................................................... 14

Today’s Meet..................................................................................................... 14 Infographics ...................................................................................................... 14

What we learnt ...................................................................................................... 17

Benefits of collaboration .................................................................................... 17 The student perspective .................................................................................... 17 The teacher perspective .................................................................................... 20 Challenges of collaboration ............................................................................... 24

Conclusion ............................................................................................................ 24

Commitment to Action ....................................................................................... 24 Protocols ........................................................................................................... 25 Legacy .............................................................................................................. 26

Acknowledgements ............................................................................................... 26 Participating Schools ............................................................................................ 27 References ........................................................................................................... 27 Appendix 28

Page 3: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

3 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

Small Shifts: Huge Changes Evaluation

Introduction Small Shifts: Huge Changes was an exciting and innovative professional learning program developed in collaboration between the Northern Adelaide State Secondary Schools’ Alliance (NASSSA) and the Teaching for Effective Learning (TfEL) team. This project was ground breaking in its inclusion of student voice as a key driver of pedagogical change in school professional learning. Key elements of the process undertaken as the three workshops evolved, are detailed below.

Background

Planning Imperatives The NASSSA focus on Science, Technology, Engineering and Maths (STEM) is a major strategy in achieving one of its key goals: to ensure successful levels of achievement for every NASSSA student. A second goal is to build the capacity of NASSSA teachers – a key element in achieving student success.

The NASSSA Strategic Plan (2015 – 2017) is aligned with the Department for Education and Child Development (DECD) Strategic Plan (2014 – 2017). Of particular significance to the Small Shifts: Huge Changes project was the DECD priority of higher standards of learning achievement in STEM education. This strategy is aligned to South Australia’s Strategic Plan (SASP) Target 88: Science and Maths – by 2020, increase by 15% the number of students receiving a Australian Tertiary Admission Rank (ATAR) or equivalent with at least one of the following subjects: Mathematics, Physics or Chemistry.

Pedagogy and curriculum In 2014 the TfEL team worked with Dan Meyer and three TfEL pilot schools using Dan’s 3 Act Maths approach to the teaching and learning of Maths. In this approach the central conflict is a perplexing and compelling task that using maths can help answer. The problem requires a simple first step (a low floor) but can stretch for kilometres (a high ceiling). The protagonist/student overcomes obstacles, looks for resources and develops new tools. One method is using guessing as an engagement strategy. In addition a progressive disclosure of information lowers the difficulty in solving the task. By the end the conflict is resolved and a sequel and/or extension task is set up.

Over the last two years NASSSA and the TfEL team have forged a very productive partnership around teacher professional learning. The Small Shifts: Huge Changes project provided the opportunity to expand that partnership to incorporate the vital element of student voice. The essence was to use student voice to drive pedagogical change with teachers in learning science.

In South Australia the introduction of the Australian Curriculum was identified as an ideal opportunity to bring together this national curriculum and pedagogical approaches from the TfEL framework. The opportunity was created to move from an industrial model of education, which is teacher centred and uses a didactic coverage of curriculum content and training, to a 21st Century model of education, which is responsive to student needs and has a high challenge pedagogical approach that compels teachers to build resilience in students. This post-industrial approach is

Page 4: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

4 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

future focused and develops skills and understandings that are transferable and durable.

Professional Collaboration As indicated above strong partnerships and collaboration were an essential part of this project. NASSSA places great importance on Connected Communities to achieve success for every student as indicated in the diagram below.

Those partnerships and the role they played will be outlined in more depth in the following section.

NASSSA Principals The NASSSA Principals are a key driving force in the NASSSA confederation and were a critical part of establishing this project. Viviane Robinson’s Best Evidence Synthesis has noted the key role Principals play in effective professional learning for their staff. The largest Effect Size (0.84) was Principals promoting and participating in teacher learning and development1.

The Small Shifts: Huge Changes proposal for NASSSA to work collaboratively with the TfEL team was taken to the NASSSA Principals’ meeting in April 2015. The proposal was supported from both a pedagogical approach and a resource perspective with principals agreeing to fund the proposal in its entirety. This included costs for international presenter Neil Atkin, catering for participants and, most importantly, TRT for staff attending workshops over three separate days. Future planning for the three days was made much simpler due to this initial commitment and support.

NASSSA Council The NASSSA Council is the governance body for NASSSA. It is made up of

1 Viviane Robinson, School leadership and student outcomes: Identifying what works and why, 2009

Page 5: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

5 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

Governing Council chairs, NASSSA Youth Action Team members and principals from the 10 alliance schools. The Small Shifts: Huge Changes proposal was taken to the NASSSA Council in May and received warm endorsement from both parent and student representatives. One student commented that she would have loved to have learned the “Dan Meyer” way from Year 8 to help her cope with the demands of the Year 12 curriculum.

NASSSA Science Curriculum Area Teams NASSSA has a collaborative structure where every Australian Curriculum learning area forms a Curriculum Area Team (CAT) which meet twice each term to plan professional learning and work cooperatively to achieve NASSSA’s goals. The teams are composed of faculty leaders from each of the10 alliance schools, one member from the NASSSA Leaders’ group and members of the TfEL team and Secondary Australian Curriculum Implementation Officers. This group was pivotal in providing support for organising students and teachers participation in the three workshops.

NASSSA STEM Reference Group The NASSSA STEM Reference Group was formed in 2015 to provide a strategic oversight of STEM related activities in the 10 alliance schools. NASSSA was aware that there were many STEM initiatives happening in NASSSA schools, often in isolation and that there was a risk that schools could become overloaded if approached from a wide range of external players. The NASSSA STEM Reference Group is comprised of a Principal, Deputy Principal, chairs of the Science, Maths and Technology CAT groups, a TfEL team member and a University representative. It is intended to add an industry representative to the group as well. The NASSSA STEM Reference Group provided an important sounding board for the development of the Small Shifts: Huge Changes project.

Other schools The Small Shifts: Huge Changes project also involved two of the TfEL pilot secondary schools outside of NASSSA. This served the dual purpose of sharing best practice beyond the alliance as well as getting a critical independent appraisal of the effectiveness of the process.

Purpose The purpose of Small Shifts: Huge Changes was to position students and teachers as co-innovators of science learning at their site with the aim of increasing both learner engagement and intellectual demand as well as improving higher order learning achievement. The collaborative approach was intended to address the tension between the shift in teacher pedagogy that results from current professional learning (particularly that associated with a problem solving approach) and the student (and wider community) expectation of science education.

The three Small Shifts: Huge Changes workshops were designed to support students and teachers in understanding the reasons for change, the challenges of change and assist them to co-design approaches that could be taken to achieve increased engagement and intellectual demand in the science classroom. A significant focus of the Small Shifts: Huge Changes workshops was to encourage students to explore ‘thinking in the teacher space’. The process used encouraged students to understand the complexities in changing deeply held beliefs and well-

Page 6: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

6 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

rehearsed behaviours so they could see the role they could take in innovating with their teachers. When asked “How do you rate the approach taken in these workshops – students and teachers working together” both sets of participants rated this approach highly at the end of the series of workshops (8.7 out of 10).

Project Implementation The selection of students and teachers was fundamentally important to the success of the Small Shifts: Huge Changes project. Principals were engaged in the selection criteria for students and the Science CAT group was responsible for the mechanics of making selections of staff and students at the Science faculty level.

Method Each school was invited to bring five teachers and five students. The reasons for a 5-5 model were to:

• promote an understanding that we see students and teachers as ‘equalpartners in this learning’

• ensure that there is sufficient student support for each other when they areback at their site

• increase student capacity to work with other students and the broadercommunity at their site

• support teachers to tweak an aspect of their practice or unlearn an outdatedroutine and see the impact of their practice

Professional learning was spaced over a school term involving three workshops. This spacing avoids the learning being seen as “one-off” and allows concepts to be processed, experienced and internalised in-between the workshops.

Student selection Student selection was a very important part of the planning process for Small Shifts: Huge Changes. Increasing science participation rates in the latter years of secondary schooling was a key outcome that Small Shifts: Huge Changes was aiming to achieve. The Conversation2 has reported an OECD study which says “we know that students who do less well in science at school are less likely to continue with it, and we also know that students who take STEM degrees end up glad that they did and get well-paid jobs”. This meant it was necessary to target students from both genders who were “on the cusp” of continuing/not-continuing with science in Year 11 (currently achieving in the B – C grade range).

Some of the key qualities identified to select students were: good communication skills, independent thinking, and the ability to be self-directed in their learning.

Given the desire to have these students act as agents of change back at their schools, a focus on interpersonal skills such as confidence (when not with peers), good self-esteem and being a team player were identified as important criteria for student selection.

These interpersonal qualities were combined with motivational qualities such as being enthusiastic and enthused by opportunity and challenge, demonstrating

2 http://theconversation.com/alarming-gender-gap-in-school-science-sets-women-up-to-fail-38344

Page 7: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

7 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

willingness to challenge and someone who wants to mentor, lead and co-design.

Staff selection Equally important was the selection of staff, ideally those currently teaching some Year 10 Science who would be continuing in their school beyond 2015 (to enact change). Good communication skills were seen as very important to transfer the message to other colleagues and students.

Being able to instigate and implement change meant that it was essential and crucial for the school’s Science Coordinator to be part of the group along with teachers who are open to innovation, intrigued by student voice, able to take risks with pedagogy and “willing to jump into the PIT”.

The teachers selected needed to be willing to be a learner rather than a knower, be prepared to take their learning beyond their local context (for example, link to AITSL standards), look for opportunities to build on existing relationships with students and be open to opportunities for self-growth.

Workshops Day 1: 28th July The first day of Small Shifts: Huge Changes was crucial in setting the tone for the three days of professional learning. Not having embarked on this approach previously meant there were many unknowns to contend with at this early stage.

The aim of Day 1 was to establish the participants as a group of leaders in science education who have been brought together to share their expertise, generate new learning and support each other to share the learning from this project with a wider audience. The combined group of students and teachers had the wonderful opportunity to develop a shared understanding about the imperative for change and a view of what ‘post-industrial pedagogy’ could look like in NASSSA schools.

The strong focus on pedagogy and collaboration allowed participants to develop understanding about quality questioning, integrating different concepts (through shared example) and differentiating through problem solving.

Day 1 commenced with students and teachers arriving with a slight air of apprehension. Presenters from the TfEL team were in a huddle ensuring that they were well prepared for the ground breaking work to follow.

Page 8: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

8 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\Small Shifts Huge Changes Evaluation.docx

Initial seating was highly segregated with both students and teachers arranging themselves in separate (protective) groups. Groups rearranged themselves at the request of the presenters and quickly relaxed as the morning progressed and they started to work collaboratively together to solve science based problems.

Introducing teachers and students to a range of innovative approaches was a key strategy in putting the goal of collaboration and co-design into practice. The group were introduced to questioning strategies as a pedagogy and Community of Inquiry3. All participants were informed about the TfEL pilot (student voice) initiative, of which they will be kept informed and potentially supported post the workshop to experiment with for themselves back at their schools. 3 Community of Inquiry is a structured group process where students work cooperatively to solve a set problem

Page 9: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

9 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

Ensuring student voice was heard was encouraged. The identification of group needs developed clarity with the student group about the challenges of learning in a post-industrial model of pedagogy. They then focused on how they could develop and model resilience and explored with the student group their role in this initiative.

A very successful Day 1 concluded with participants being introduced to Neil Atkin (via YouTube) in preparation for Day 2 so that they could think about his message in the context of the entire science curriculum.

Day 2: 20th August Neil Atkin4, an international educational consultant in pedagogy from the UK, facilitated the second day. Neil’s blog says: “We were focusing on Science through Three Act Science and also on co-construction – using the students as stakeholders in devising activities in the classroom”.

Neil started the day by deconstructing the concept of failure. For Neil there is no failure, merely attempts in learning are made:

First Attempt in Learning

Neil’s concerns about the dynamics of students and teachers working together were quickly allayed by an origami challenge to break down barriers – a scientific levelling of the field. In Neil’s words “as the day went on the teachers moved from dominating to listening and valuing. [This is a] first step towards genuine co-construction and partnerships”. The photo below is an example of students and teachers collaborating to solve problems being set by Neil.

4 See Neil’s blog for more detail http://neilatkin.com/2015/08/24/co-constructing-lessons-giving-students-ownership-of-their-learning-lessons-from-south-australia-leading-learning/

Page 10: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

10 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

Neil in action

Neil challenged the group to think about divergent thinking as shown in the following extract from his blog:

In their study “Break Point and Beyond”, Land and Jarman found that divergent thinking – the ability to find creative solutions to problems diminished rapidly as the students aged – Possibly due to us teaching that there is only one real answer? We need to find questions that google cannot answer and that don’t limit creative solutions. So:

“How many ways can you think of to make a teabag fly?”

Give several minutes to do this with teachers and students working together. Older people tend to suffer fixation – when we have a solution in our minds we struggle to see others. Remember when you have a word to answer a crossword puzzle that doesn’t quite fit, how hard is it to get that word out of your head?

Younger students don’t have this fixation problem and we need to find ways to keep them practicing

Neil introduced the concept of 3 Act Science based on the work of Dan Meyer in Maths. The principles of this approach are:

• Act 1: the Hook• Act 2: the Explore• Act 3: the Reveal

Students and teachers were asked to predict the stability of three cartons – one full, one half full and one empty. Once the hook has been set participants are able to explore and develop problem solving skills. What do we need to know in order to find

Page 11: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

11 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

out? What information have I got? How might this link to other things I have learned

Remembering the learners

or seen before? In the reveal Neil drew on the Zeigarnik affect – basically we lose interest in the cartons when we know what the answer is. We continue to think about incomplete activities so don’t rush to do the reveal.

More predictions rounded out the day. Teachers and students were asked to predict which fruit would fly the furthest in a sling shot. Once predictions had been made the group moved to the oval to test them.

Students and teachers testing their predictions

Executive Function plays a major role in students achieving successful outcomes. One element of Executive Function is the ability to Stop and Think. Day 2 helped to identify metacognitive process to unpack, raising questions such as:

• What are the teacher moves?

We spend huge amounts of time and effort improving teachers but tend to forget about the learners. In the first two days of Small Shifts: Huge Changes there has been considerable focus on implementing realistic and practical strategies based on the work of Daniel Kahneman’s “System 1 and 2 Thinking”, Visible Thinking and Carol Dweck’s “Growth Mindset”.

Small shifts in teaching practice can lead to huge changes in outcomes.

Page 12: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

12 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\Small Shifts Huge Changes Evaluation.docx

• Why would you do that? • What’s going on with the learning? • How can we create outstanding learners who can think?

Day 3: 18th September The final workshop on Day 3 was vitally important to consolidate the learning and ensure that there was a tangible commitment to action, so both students and teachers had the opportunity to leave at the end of the day with a clear sense of what they would take out of the three days (Their Legacy) and a plan to keep the momentum going. The TfEL team structured the initial part of the day to respond to the group needs. There was some reflection on progress so far and an opportunity to share the developments that they have made at their site (and beyond) in relation to the work so far. The sharing section was one of the most dynamic elements of the three days working together. Two concentric circles were formed with an inner circle of students and an outer circle of teachers. Each circle had to interact with the other circle and reflect on the ways they had been interacting with, and implementing, the approaches that they had co-designed over the previous tow sessions. After a set period of time the two circles rotated in opposite directions so both teachers and students had the opportunity to share with a wide range of other participants. This can be clearly seen in the photo below:

Student and teacher sharing reflections and learning

A significant part of the third day focused on growth mindsets – exploring the notions of sharing power and collaboration (which the evaluation graph below shows was

Page 13: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

13 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

well received by participants). Students and teachers were engaged in the challenging task of creating a cardboard chair which incorporated creativity with the need to scientifically work out how it would hold the weight required (5 kg).

Following on from the concept of exploring in science that Neil Atkin presented and the importance of acknowledging that FAIL is the First Attempt In Learning the group embarked on an examination of misconceptions in science. This was combined with the need to hypothesise and both teachers and students were given the task of predicting how far the moon was from the earth.

As can be seen in the following photo the earth was represented by a basketball and the moon by tennis balls. Using these proportions as the basis of their predictions participants had to place the tennis ball in a positon where they thought it represented the distance. Using this technique encouraged the group to take risks and think outside the square.

How far is the moon from the earth?

A fitting conclusion to the series of three workshops was having students and teachers design their legacy – what is it that they want to take away and build on from these three sessions?

Key points identified to further consider were: • Increasing intellectual demand in class through greater exploration and

asking: What if..... ? • Transforming tasks (use the new Leading Learning resource to support

teachers to personalise their learning (building on from the day with Neil)• Focus on how the learning can be developed further using Learning Design

An immediate legacy that was apparent was the desire to continue with this approach to professional learning for teachers and students as shown when

Page 14: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

14 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

responding to the question “How do you rate your willingness to do these types of workshops again” (8.7 out of 10).

Participants

Registration The registration process was carried out using Eventbrite for the eight NASSSA schools and two non-NASSSA schools involved. This proved to be a very useful tool as it provided a database for future evaluation using Survey Monkey and email.

The breakdown of participants by gender and role was:

Column1 Female Male TotalStudent 18 27 45Teacher 18 26 44Total 36 53 89

Data A number of evaluative tools were used to analyse what was occurring across the workshops. These included: Today's Meet, Survey Monkey, paper surveys, infographics. A selection of these have been included throughout the paper to highlight key findings

Today’s Meet Today’s Meet in an online meeting tool which collects formative feedback of the process as it unfolds and allows ongoing dialogue between participants.

TODAY’S MEET

New Professional learning Model. Teachers and students learning together. Great energy in the room, lots of thinking.”

Teachers working together in action groups.”

“Feedback will be given based on current tasks and modifications will be made together.

“Transforming tasks in faculty meetings with students. Both T and S will work in action groups

during the faculty meetings to gain feedback.”

“What is intended learning and why is it important, more people enjoyed science staff and students”

“Change the way teachers teach”

“Focusing on failure as a positive rather than a negative, whole school approach.”

“Tell us what was in the boxes. It is driving me mad!!!”

“Let people talk and have their opinions, don't be afraid to fail”

“1. Stop talking so much, 2. Let people talk and have opinions, 3. Help students when they need it,

4. New day start fresh, 5. Explain things”

“Focus on explore before explaining.”

“Students as part of the process of planning units of work.”

Infographics Infographics were used to show key results from student and teacher feedback

Page 15: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

15 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

forms completed after each workshop. Some interesting observations and perceptions were revealed. Before the workshops 25% of students perceived that their teacher does not talk to them about how they are going in science. After the workshops this had dropped to 18%.

Before and after: how am I going in Science?

In another instance the view perceived by students before the workshops was a mirror view to that expressed by their teachers. The same percentge responses were given by teachers and students, for the question: our teacher enables us to design our own investigations. Once again the same question asked after the workshops indicated a shift in the perception of students.

Before

After

Page 16: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

16 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

Before and after: how much say I get in choosing topics in Science?

This suggests traditional pedagogy of learning science: recipe or closed inquiry investigations. Negotiation of learning is a growth area. This correlates with research that has been undertaken by the TfEL team.

Views held by students and teachers on preferred learning styles for the 21st Century:

Preferred learning: 21st Century

STUDENTS TEACHERS

“I agree that the way students are being taught needs to

change, we are not learning, we cannot memorise

everything.”

“I agree with people needing more creative thinking – find a balance between content and

more creative thinking.”

“The way that students are being taught is more than just

repeating information- students that do this the best are given better grades and

this isn’t always appropriate.”

“I agree we take away the natural curiosity of the child and replace

with information.”

“ Skills over content knowledge – need for

change to keep up with the changing needs of

society”

“Changes- thinking processes – resilience

needs to be developed.”

“I agree that failure should be treated as a

positive learning experience”

Before

After

Page 17: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

17 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

What we learnt Benefits of collaboration There were a number of benefits evident in this joint approach to professional learning. These are reflected in some of the comments from Science Leaders at NASSSA schools. Samples of those comments are listed below:

Benefits of joint approach to professional learning • As a leader the big change I have noticed is a lot more exploring before

explaining happening and assessment tasks which are student driven or havemultiple entry and exit points. This has been going on in both Science andMath classes for a variety of year levels.

• Teachers have been working with students to design this terms program andassessment task, which is year 9 class. Students are so engaged

• Generally there has been more:o Self-discovery tasks. What do they want to know?o Community Circle and Inquiry Based Learningo Non-googable questions, self-learning activities and co-wrote

assessment with students inputo Co-planned whole unit and associated assessment tasks. Amazing

results and engagement!• Explore before Explain• Two students attend science faculty meeting when writing assessment tasks

using the transforming tasks strategies.• Presentation to staff by students at staff meeting.

The student perspective At different stages in the workshops students were asked to create a human graph story in response to a set question.

Student responses Students were asked:

"How is the person in this video like you?" Students stood at various place along the line after watching a video which showed a teacher trying to explain maths to students but they just didn't get it.

Students were asked: "Think about someone like this. Where would they be standing on the line?"

All students went down to the end of not feeling good about learning.

Students were asked: “Which one is like you?" Teacher talks to us ------------------------------------------------------ teacher talks with us Most students were standing down the with us end.

Students were asked: "Now what if we asked you this question yesterday, where would you be standing?"

Most students moved to the other end of the line.

Page 18: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

18 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

What students enjoyed

Positives and questions

Page 19: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

19 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\Small Shifts Huge Changes Evaluation.docx

Reason for teachers and students co-designing together.

Page 20: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

20 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

The teacher perspective The teachers valued student voice and the cultural currency students bring, through building on students interests, using ideas that are of importance to the young adults in their particular contexts.

What the teachers value

Teachers generally reported that they enjoy teaching science. When questioned about the low percentage response of teachers inviting visitors to school to talk about science many teachers said they preferred taking students out of the school to

Page 21: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

21 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

local universities or industries to talk about science topics.

What teachers enjoy

Like the student group teachers enjoyed the exercise of co-designing learning of science. Developing an understanding of what students are thinking, better engagement and the benefits of teamwork were some of the key factors identified.

Page 22: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

22 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\Small Shifts Huge Changes Evaluation.docx

Co-designing responses and questions

Page 23: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

23 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

Key learnings that teachers reported back related to the importance of enquiry based learning, the benefits of task transformation and that students can help inform practice.

What did teachers learn?

Page 24: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

24 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

Challenges of collaboration ICT Access to ICT for guest participants can be challenging in schools. Many schools have ICT protocols which are very restrictive and don’t provide access for visitors to the school. These protocols can have a negative impact on the range of activities undertaken with laptops and tablets and inhibit the pursuit of 21st Century learning approaches.

Keeping groups consistent It is important to ensure students are chosen using the guidelines provided. This project is not intended to attract the same students that are involved in all STEM projects the school is offering. It is intended that this project improves participation in Year 11 and 12 science subjects. The focus on students in the B and C range who are influencers within their peer groups is an important element.

Complexity of day(s) A lesson learned early in the project was that it is important to keep as close as possible to the usual school day. Day 1 had an earlier start and a later finish and it was very clear that concentration and engagement diminished once the school bell went for the end of the day.

Conclusion

Commitment to Action A critically important part of the Small Shifts: Huge Changes workshops was to transfer the learning into practice. In the final session groups brainstormed ideas to make this happen. Strategies identified included:

• Formation of PLCs at their schools• Year 10 students going back to their site and going into year 8/9 classes and

running a ‘problem solving’ exercise and exploring what’s different/why itneeds to be different/resilience needed for the new approach/ the need towork with their teacher/share their understanding of change with theirparents/peers

• Students acting as mentors to support students• Students and teachers presenting to the community/ other subject

departments/primary schools• Students and teachers uploading new resources to the site created on the

Day with Neil• Students/teachers accessing Neils blog• Question for teachers/students – How can you raise up and generalise your

learning and take it into other areas?• At the end/during each day students could write a ‘Dear Diary’ comment about

their learning/thinking/wondering/feeling about their involvement in the projectetc. In this way we are hearing student voice on a regular basis.

Page 25: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

25 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

Protocols NASSSA students and teachers have developed a series of conditions for working together.

Students and teachers working together

NASSSA non-negotiables for student and teacher co-design

• Commit to the work and to influencing other students and teachers• Listen to one another• Be willing to change and learn• Model being a learner and have a good sense of humor!• Be willing to take risks and challenge yourself• Show mutual respect and trust• Challenge one another’s thinking in a respectful manner• Speak up and share your ideas• Create opportunities for ongoing feedback, take it seriously and respond to it• Everyone needs to take responsibility for learning, students and teachers!• With hold any judgments• Have a growth mindset• Ensure an even number of teachers and students• Clarity of purpose and intentions• Acknowledge all ideas and perspectives• Contribute equally and don’t ‘opt-out’• Shared air-time

Page 26: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

26 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

The development of collaboration for co-design between students and teachers

Legacy The outcomes and learnings from this innovative model include a NASSSA protocol for students and teachers conditions on working together. Following the workshops leaders have reported a change in pedagogy:

1) Increase in challenge: Teachers are enabling students to explore beforeexplain.

2) Students co-designing learning tasks for intellectual stretch at facultymeetings.

3) Students rated professional learning experience 9/10 and recommend itcontinues in 2016

4) Increase in growth, student’s self-efficacy and dealing with uncertainty.5) Increase in student engagement.

The post data surveys showed a 7% shift in more teachers providing feedback to students. 85% of students are studying at least one science subject in 2016.

Acknowledgements David McClay Senior Leader Curriculum, NASSSA Katrina Elliott TfEL Manager Pedagogy and Science Neil Atkin Educational Consultant: Humanity – Pedagogy - Technology Val Westwell TfEL Manager Pedagogy and Mathematics Erin Matthews TfEL Pilot Leader Mikelle Meigel TfEL Pilot Leader Sarah Miller TfEL Pilot Leader Garry North TfEL Pilot Leader Yvette Riley Senior Leader STEM, Salisbury East High School Ashley Sykes Coordinator Science, Salisbury East High School Steve Clarke Principal, Salisbury East High School Mark Hodgson Deputy Principal, Salisbury East High School

Page 27: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

27 D:\Dropbox\2016\Curriculum & Pedagogy\STEM\Small Shifts Huge Changes\Evaluation\Paper\SmallShifts Huge Changes Evaluation.docx

Participating Schools NASSSA Craigmore High School Gawler and District College B-12 Para Hills High School Parafield Gardens High School Paralowie R-12 School Playford International College Salisbury East High School Salisbury High School

Other Murray Bridge High School Seaview High School

References Atkin, Neil: Blog http://neilatkin.com/2015/08/24/co-constructing-lessons-giving-students-ownership-of-their-learning-lessons-from-south-australia-leading-learning/

Robinson, Viviane, School leadership and student outcomes: Identifying what works and why, 2009

The Conversation: http://theconversation.com/alarming-gender-gap-in-school-science-sets-women-up-to-fail-38344

Appendix

1. Student and teacher responses : after viewing 'Most Likely to Succeed' editedpromo

South Australian Teaching For Effective Learning Framework: http://www.learningtolearn.sa.edu.au/tfel/pages/tfelresources/satfelframeworkguide/

Page 28: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

APPENDIX 3 NASSSA Small Shifts Huge Changes MOST LIKELY TO SUCCEED Student and Teachers responses after viewing the promo version.

POSITIVES What did you like, or agree with? Student responses Staff responsesThey think we shouldn’t be lectured Content is no ‘free-‘ don’t need a teacher for this anymore I agree that skill is more assessed than the ability to learn I agree we take away the natural curiosity of the child and

replace with information I have discovered that science is important to learn so I should pay more attention

I agree that failure should be treated as a positive learning experience

I agree that the future is going to be built on ideas and innovation rather than facts and knowledge

We are changing as the technology and times change

I agree that the way students are being taught needs to change, we aren’t learning , we aren’t memorizing everything.

The understanding we don’t need cookie-cutter kids, we need independent, creative thinkers

Teachers can act as good friends to students, need to understand that everyone one of us is human, we are all the same and equal

Teaching and learning needs to change

I agree that the teachers just spew out information and expect us to memorise information

Agree that students are being taught facts and to memorise these facts

I liked that the clip was trimmed to 4 mins and not 26 Creativity is valued in the real world That failing is part of the process Small class sizes- homework- higher order thinking The way that students are being taught is more than just repeating information- students that do this the best are given better grades and this isn’t always appropriate

It sounds, interesting, exciting, a new way of learning that fosters creativity and team work

Truthful, teaching differently Stimulating the observation skills That we are just taught to memorise and repeat Science education has to change Having a high overall grade average doesn’t tell them about you, it just says, it just says you did well in some of your courses

Learning should be more of ‘ understanding and not recalling information”

I agree with people needing more creative thinking- find a Learning to learn- not content driven- about experiences

Page 29: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

balance between content and more creative thinking To bring out the fact that teaching needs to change for the better

Role of skills not content as employment factor

I agree that education should be about experience and not just copying and pasting

Failing is just part of the process! RESILIENCE is important- getting up and having another crack at it.

Working with others is better than working alone, have more ideas

Not about failures

Students should continue questioning things and being curious Resilience is needed Remembering is not learning A degree from a fancy UNI does not mean anything in a real

world The students that recall the information the best, get the best grades

Revolutionary thought regarding education reform+ purpose for the future

That teachers tell us information and we have to say it back I like short videos with 1 theme and lots of short snippets The comments were accurate in the way that we currently learn The emphasis that failing isn’t the end of the world

We can teach collaborative problem solving regardless of technological developments

Understanding that we are learning differently, and at different speeds

Change is a continuous process

I agree the world is changing and better skills are needed The statement, ‘how you look on paper does not reflect the person you may be”

You can always learn more- be a continuous learner Changes- thinking processes-resilience needs to be developed Learning is not retention of facts Teaching skills not just content means that we are preparing students for all subjects not just our own Education must allow for the creation of independent thinkers Focus on how- cognitive skills Build in the confidence to learn Industrialised structure of schooling is no longer relevant Skills over content knowledge- need for change to keep up with the changing needs of society Executive functions rear their heads again I agree with the main ideas Learn for learning or passing Learning for learnings sake is hard to mark objectively

Page 30: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

QUESTIONS What are you curious about? Student responses Staff responses I’m curious about why teachers get told what to teach by the government and education when they aren’t teachers?

How can we allocate time for skill ,inquiry, trial and error but still meet content demands of the AC?

I’m curious about how things work How can we build skills when our only available resources are targeted at building knowledge?

Why are we being taught irrelevant skills for life after school? How to link the real world at appropriate levels for all students?

Will be able to live on another planet? Self aware robots? Is content knowledge really dead? How can students be more engaged with learning rather than consuming facts?

What else is on the video , I have not seen anything new here? Are we actually doing anything right? Why do I feel like I am not valued?

America’s schooling system Whys is America the leading country? They test, test, test, we actually teach What do we do right?

How does the US teach differently? How would this approach be accessible? How could we develop effective learners?

I am curious with What’s in the boxes How do I make this work for my students when I am told to get through the content?

What does a problem solving skill look like? Create curiosity amongst students I am curious about whether people prefer being assessed specifically or just meeting the standard?

How do we teach to fail and go again when our system rewards success?

Learn more from your own curiosity, teaching and learning need to change

Ho will it be developed? Any assessment? Types of assessments? Check the knowledge?

Thinking creatively How does it work in practice? How do you apply it to the various science topics?

Using new and different methods to solve problems What skills are needed for students moving into the 21C

Page 31: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

workforce? I’m curious about solar and all the plants and how that works. The school/teacher can ask us what we learn and like and have a discussion on student questions

How do we give students more freedom of choice if they aren’t responsible enough to drive their own learning and choose responsibly? (maturity?)

Why is the main focus following an education model? What will this look like in my classroom? Why don’t the teachers teach the skills? Teachers are unsure about what jobs will look like in 5 years

time? I’m curious to how the most effective method of education is put into process?

Why are traditional, manufacturing, trades considered ‘dead”?

Competency based progressions, vs yr level based progression Why are exams such a large part of education at school and

Uni? If we are so data driven as a school, how do we begin to move

towards an inquiry based learning environment? How I could teach the curriculum but still allow curiosity to

lead? Check the validity of inference? What qualifications are needed to get a job with Salam Khan? How useful is the data (scores) in this more skill driven style of

education?

Page 32: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

CHANGE What could you do differently in Science and why?

Student responses Staff responses More class discussions What I could do is limited by my obligations within the present

economic/political climate. We need to change the system but are largely constrained

Use different programs and tools to extend our thinking Allocate more class time to collaborate, investigate and less time teaching content

Not just be forced to sit and record info for lessons with no discussions

Asking questions (open ended) – stimulating thinking skills

Failed pracs should be good Increase student centered inquiry Solving big problems with more students Inquiry base not content My point of view on science teachers Develop skills among students in terms of collaboration and

problem solving through more inquiry based teaching Think deeper to find new solutions Take science outside of the classroom and relate it to real life Continue with independent learning Explain task more thoroughly write what about what? If I’m curious make the effort to find the answer LOTS! Have started small things, need to be more courageous

and just jump in! Failure is OK as you are going to fail in life And people who work the best

More hands on student guided learning- give them opportunities to ask questions and investigate

Blow stuff up- lots of pracs Be more of a facilitator guide of learning rather than a director of learning

More experiments and interesting tasks The information is all freely available but children do not automatically look for the important information. They do need some guidance from others who know where to look

Page 33: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

Consider school as not such a hole and more of a special place for innovative ideas for the future

If the lesson isn’t successful, modify and retry Engage students in design process

We should be asked what we want to learn, not what they think we should learn

Student directed Engagement through ownership Knowledge through design and investigation

Make it more interesting, more hands on learning and not just theory and practicals

Show the content of the content

If I could, I would have students working on a level that they were comfortable with, but based on content that they were attracted to , and rise up the levels at their own speed. Students should learn the way they play video games. I am at this level, test if I can reach the next level, instant accreditation, rise up through the levels, receive rewards

The curriculum says- get through most of this content now and quickly, this is constraining. Students need to be able to choose more of the content (more choice)

I would broaden the curriculum to let teachers work in their area of expertise

Turn my students into the teachers- they have more control Look at the skills in science that will create more resilient,

creative and other More problem solving in science Prefer for students as groups or individuals to take charge of

teaching and learning (flipped classroom) Begin to facilitate student inquiry skills Try activities where students are given open questions

Page 34: EVALUATION - teachingandlearning.sa.edu.auteachingandlearning.sa.edu.au/.../NASSSASmallShiftsHugeChangesEvaluationReport.pdf · schools, a focus on interpersonal skills such as confidence

EUREKA MOMENT/s What have you discovered for yourself?

Student responses Staff responses I am good at learning when I am curious We do lots well Students are expected to absorb lots of information and are expected to know everything they learn in class

To prepare students for life out of school, they need to be in charge of their own independent though

Students are expected to memorize information and repeat it exactly! (sad face drawn)

Improving pedagogy towards student centered learning and investigations

I have discovered that other schools are the same, they are getting taught like us and they are doing the same things

Marking for improvement What are we currently doing at our school in the science faculty

Failing is good Failure is not necessarily bad

The world wont blow up when people say Always questioning ( let kids always ask questions) That America has a tougher schooling system Confirmed that the world is changing very fast Knowing things is obsolete to learning something I don’t give students enough time to investigate and ask why It is easy to work in groups because you have more ideas than by yourself

Marking for improvement – what we are currently doing at our school in the science faculty

That there are many jobs available, research The world is already looking for curious, resilient, rigorous team players Education is not currently catering for this

That we will constantly progress and advance quickly No clue- didn’t really have that light bulb moment We get taught to memorise and repeat back the same way as we were taught and we aren’t taking it all in .

This sounds like IB

I have discovered that one of, if not the best method of teaching is not being extra nice to students or giving them rewards for work. The kids need to feel like they are in a special place, they have to understand that they are special for the future and that their innovation is needed in this day and age

Focus on science by doing, t works! ( smiley face)

Students learn more when they are happy

IB I didn’t get one, heard it before