developing sustainable feedback
TRANSCRIPT
![Page 1: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/1.jpg)
Developing course climates for sustainable feedback
David Carless, Faculty of Education University of Hong Kong
Maynooth University, 24 June 2016
The University of Hong Kong
![Page 2: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/2.jpg)
Overview
1. Feedback challenges & research
2. Situating feedback
3. Trust, distrust & feedback
4. Feedback as dialogue
5. Issues & Implications
The University of Hong Kong
![Page 3: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/3.jpg)
AimTo explore possibilities for a more dialogic & sustainable approach to feedback processes
The University of Hong Kong
![Page 4: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/4.jpg)
Frustrations
The University of Hong Kong
![Page 5: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/5.jpg)
Staff frustrations• Heavy marking load• Students don’t collect feedback • Students mainly interested in the grade• Students lack motivation to act …..
The University of Hong Kong
![Page 6: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/6.jpg)
Student frustrationsFeedback often seems like a perversely belated revelation of things that should have been made clear earlier (Crook, Gross & Dymott, 2006)
The University of Hong Kong
![Page 7: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/7.jpg)
MY RESEARCH INTO FEEDBACK
The University of Hong Kong
![Page 8: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/8.jpg)
Differing perceptions Study 1. Questionnaire data from 460 staff & 1740 students + qualitative data from BEd Students
Key finding: Teachers thought their feedback was much more useful than students did (Carless, 2006)
The University of Hong Kong
![Page 9: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/9.jpg)
Sustainable feedback Study 2. Interviews with 10 award-winning teachers from 10 different Faculties
Key finding. Conventional & sustainable feedback orientations (Carless et al. 2011)
The University of Hong Kong
![Page 10: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/10.jpg)
Sustainable feedback in practice
Study 3. Follow-up case study of a Business teacher
Key finding. Classroom evidence of sustainable feedback; supported by trust (Carless, 2013a)
The University of Hong Kong
![Page 11: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/11.jpg)
Exploring assessment practice
Study 4. Multiple disciplines.Award-winning teachers
Analyzing learning-oriented assessment in Architecture, History, Law, Geology & Business (Carless, 2015)
The University of Hong Kong
![Page 12: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/12.jpg)
![Page 13: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/13.jpg)
SITUATING FEEDBACK
The University of Hong Kong
![Page 14: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/14.jpg)
Bigger pictureFeedback as assessment design issue
Feedback as a pedagogical issue
Feedback as a relational issue
The University of Hong Kong
![Page 15: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/15.jpg)
The University of Hong Kong
Productive assessment task design
Understanding quality in the discipline
Developing sustainable feedback
processes
Learning-oriented assessment framework
![Page 16: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/16.jpg)
Sustainable feedback defined“Active student participation in dialogic activities in which students generate and use feedback from peers, self or others as part of developing capacities as autonomous self-regulating learners” (Carless, 2013b)
The University of Hong Kong
![Page 17: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/17.jpg)
Sustainable feedback principles
• Prompting learner action
• Peers as active source of feedback
• Inner dialogue/internal feedback/self-
feedback
The University of Hong Kong
![Page 18: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/18.jpg)
Aim of sustainable feedback
To enhance student ability to self-monitor their work in progress
The University of Hong Kong
![Page 19: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/19.jpg)
TRUST AND DISTRUST
The University of Hong Kong
![Page 20: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/20.jpg)
Pervasive distrust• Accountability as antithesis of trust
(Stensaker & Harvey, 2011)
• Distrust inhibits risk-taking and innovation (Vidovich & Currie, 2011)
The University of Hong Kong
![Page 21: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/21.jpg)
Porter: Trust in numbersDecrease in trust, increase in quantification
Societies which trust teachers have less need for standardised testing
The University of Hong Kong
![Page 22: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/22.jpg)
Conservatism in assessment Generally low levels of staff assessment (and feedback) literacy (Norton et al., 2013)
The University of Hong Kong
![Page 23: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/23.jpg)
Trust in teachers Innovative assessment thrives when teachers are trusted (Carless, 2009)
The University of Hong Kong
![Page 24: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/24.jpg)
Relational trustTrust as key factor in feedback processes (Carless, 2013a)
The University of Hong Kong
![Page 25: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/25.jpg)
Trust in students?Students respond to feedback processes based on their own motivations
The University of Hong Kong
![Page 26: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/26.jpg)
Faith in students To carry out peer feedback effectively
To engage in dialogue
To self-regulate
The University of Hong Kong
![Page 27: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/27.jpg)
IMPLEMENTATION OFSUSTAINABLE FEEDBACK
The University of Hong Kong
![Page 28: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/28.jpg)
Sustainable feedback strategies
1. Teacher-facilitated
2. Technology-enabled
3. Peer feedback and internal feedback (Nicol, 2010)
The University of Hong Kong
![Page 29: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/29.jpg)
Assessment dialoguesDiscussing assessment processes to help students understand rules of the game (Carless, 2006)
The University of Hong Kong
![Page 30: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/30.jpg)
Guidance & feedback
Integrated cycles of guidance & feedback within learning activities (Hounsell et al. 2008)
The University of Hong Kong
![Page 31: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/31.jpg)
Failing to connectDifficulties for lower achievers to make sense of feedback (Orsmond & Merry, 2013)
The University of Hong Kong
![Page 32: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/32.jpg)
Exemplars & feedback Analysis of exemplars can support students in decoding teacher feedback (Handley & Williams 2011; To & Carless, 2015)
The University of Hong Kong
![Page 33: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/33.jpg)
TECHNOLOGY ENABLED FEEDBACKSTRATEGIES
The University of Hong Kong
![Page 34: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/34.jpg)
![Page 35: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/35.jpg)
Two common strategies
Learning Management Systems
Use of clickers, EVS
The University of Hong Kong
![Page 36: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/36.jpg)
Use of FacebookHistory students uploaded drafts & received peer feedback (Carless, 2015)
The University of Hong Kong
![Page 37: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/37.jpg)
Audio (& video) feedback
Providing recorded verbal commentary (instead of written feedback?)
The University of Hong Kong
![Page 38: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/38.jpg)
Scaling upNeed for more critical research into technology-enabled feedback strategies (Dawson & Henderson, 2017)
The University of Hong Kong
![Page 39: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/39.jpg)
The University of Hong Kong
![Page 40: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/40.jpg)
STUDENT ROLE IN SEEKING, GENERATING & USING FEEDBACK
The University of Hong Kong
![Page 41: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/41.jpg)
Peer feedback Potentially more plentiful …
But peers often viewed as lacking expertise
The University of Hong Kong
![Page 42: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/42.jpg)
To give is better than to receive
Providing feedback more cognitively engaging (e.g. Nicol et al., 2014)
The University of Hong Kong
![Page 43: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/43.jpg)
Enhanced student roleEnhancing student role to generate & use feedback (Carless et al., 2011; Hounsell, 2007)
The University of Hong Kong
![Page 44: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/44.jpg)
Implications The University of Hong Kong
![Page 45: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/45.jpg)
Programme-based approaches
• Peer feedback embedded• Plentiful in-course guidance• Analysis of exemplars • Trusting relationships developed• Student self-evaluation • Students using feedback
The University of Hong Kong
![Page 46: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/46.jpg)
Feedback designs Feedback as integral part of curriculum & course design (Boud & Molloy, 2013)
The University of Hong Kong
![Page 47: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/47.jpg)
Feedback literacyThe development of staff (and student) feedback literacy
The University of Hong Kong
![Page 48: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/48.jpg)
Good feedback practiceIntegration of feedback & assessment task design;
Timely dialogues: in-class, online & peer feedback;
Development of student self-regulation for sustainable feedback
The University of Hong Kong
![Page 49: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/49.jpg)
Closing feedback loops
It’s only feedback if learners take some action
The University of Hong Kong
![Page 50: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/50.jpg)
THANK YOU
The University of Hong Kong
![Page 51: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/51.jpg)
Shifts in priorities The University of Hong Kong
Increase Decrease
In-class dialogic feedback within module time
Unidirectional comments after completion of module
Written feedback comments on first assessment task of module
Written feedback comments on final task of module
Feedback for first year students
Feedback for final year students
![Page 52: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/52.jpg)
References Boud, D. & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design. Assessment and Evaluation in Higher Education, 38(6), 698-712.Carless, D. (2006). Differing perceptions in the feedback process. Studies in Higher Education, 31(2), 219-233.Carless, D. (2009). Trust, distrust and their impact on assessment reform. Assessment and Evaluation in Higher Education, 34(1), 79-89.Carless, D. (2013a). Trust and its role in facilitating dialogic feedback. In D. Boud & L. Molloy (Eds.), Feedback in Higher and Professional Education (p.90-103). London: Routledge.Carless, D. (2013b). Sustainable feedback and the development of student self-evaluative capacities. In Merry, S., Price, M., Carless, D. & Taras, M. (Eds.). Reconceptualising feedback in higher education: developing dialogue with students. London: Routledge.Carless, D. (2015). Excellence in University Assessment: Learning from award-winning practice. London: Routledge.Carless, D., Salter, D., Yang, M. & Lam, J. (2011). Developing sustainable feedback practices. Studies in Higher Education, 36(4), 395-407.Crook, C., Gross, H. & Dymott, R. (2006). Assessment relationships in higher education: The tension of process and practice. British Educational Research Journal, 32(1), 95-114.Handley, K. & Williams, L. (2011). From copying to learning: Using exemplars to engage students with assessment criteria and feedback. Assessment and Evaluation in Higher Education, 36(1), 95-108.Hounsell, D. (2007). Towards more sustainable feedback to students. In D. Boud & N. Falchikov (Eds.), Rethinking Assessment in Higher Education (p.101-113). London: Routledge.
The University of Hong Kong
![Page 53: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/53.jpg)
References (continued)
Hounsell, D., McCune, V., Hounsell, J. & Litjens. J. (2008). The quality of guidance and feedback to students. Higher Education Research and Development, 27(1), 55-67.Nicol, D. (2010). From monologue to dialogue: Improving written feedback processes in mass higher education. Assessment and Evaluation in Higher Education, 35(5), 501-517.Nicol, D., Thomson, A. & Breslin, C. (2014). Rethinking feedback practices in higher education: A peer review perspective. Assessment and Evaluation in Higher Education, 39(1), 102-122.Norton, L., Norton, B. & Shannon, L. (2013). Revitalising assessment design: What is holding new lecturers back? Higher Education, 66(2), 233-251.Orsmond, P. & Merry, S. (2013). The importance of self-assessment in students’ use of tutors’ feedback: A qualitative study of high and non-high achieving biology undergraduates. Assessment and Evaluation in Higher Education, 38(6), 737-753.Stensaker, B., & Harvey, L. (Eds.). (2011). Accountability in higher education: global perspectives on trust and power. New York: Routledge.To, J. & Carless, D. (2015). Making productive use of exemplars: Peer discussion and teacher guidance for positive transfer of strategies. Journal of Further and Higher Education, DOI: 10.1080/0309877X.2015.1014317. Vidovich, L. & Currie, J. (2011). Governance and trust in higher education. Studies in Higher Education, 36(1), 43-56.
The University of Hong Kong
![Page 54: Developing sustainable feedback](https://reader031.vdocument.in/reader031/viewer/2022022414/587903e61a28ab6f658b4813/html5/thumbnails/54.jpg)
Defining feedback
“A dialogic process in which learners make sense of information from varied sources and use it to enhance the quality of their work or learning strategies”.
Carless (2015, p.192) building on Boud & Molloy (2013)
The University of Hong Kong