1 dr gill ferrell cc by-nc-nd 2. marius kluzniak 18/3/2105 jisc assessment & feedback activities...
TRANSCRIPT
![Page 1: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/1.jpg)
1
Dr Gill Ferrell
CC BY-NC-ND 2. Marius Kluzniak
18/3/2105 Jisc Assessment & Feedback activities 2011-2015Dr Gill Ferrell
A tour around the EMA landscape
![Page 2: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/2.jpg)
2
CC BY-NC-SA 2.0 tiff_ku1
Pre-departure
• Jisc Assessment & Feedback programme 2011-2014
• HEI Baseline reviews• Baseline review of landscape
published 2012
A tour around the EMA landscape2
![Page 3: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/3.jpg)
3
CC BY-NC-SA 2.0 tiff_ku1
Travel advisory (1)
• Traditional culture stubbornly resistant to change
• Devolved responsibility & varied practice
• Limited opportunity for students to engage with process of making academic judgements
• Issues with degree structure
CC BY-NC-ND 2. Richard Lee
A tour around the EMA landscape3
![Page 4: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/4.jpg)
4
• Traditional culture stubbornly resistant to change• Traditional culture stubbornly resistant to change
Travel advisory (2)
• Investment in technical infrastructure not yet delivering efficiencies
• Preference for established technologies but innovation still difficult to scale up
• Current practice not promoting employability
CC BY-NC-ND 2. 0 Soilse
A tour around the EMA landscape4
![Page 5: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/5.jpg)
5
• Traditional culture stubbornly resistant to change• Traditional culture stubbornly resistant to change
Travel essentials
• Lifecycle Model provides our ‘map’ & ‘phrase book’
• Academic model against which processes and systems can be mapped
• Common framework for different stakeholders to discuss issues
• Means of clarifying requirements for suppliers
CC BY-NC 2.0 Marcus Ramberg
A tour around the EMA landscape5
![Page 6: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/6.jpg)
The Assessment and Feedback Lifecycle
Based on an original idea developed by Manchester Metropolitan University
A tour around the EMA landscape6
![Page 7: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/7.jpg)
7
CC BY-NC-SA 2.0 tiff_ku1
Starting point
• Educational principles: REAP project Strathclyde;Hertfordshire Assessment for learning;NUS
• Appreciative Inquiry approaches
• Ulster Viewpoints project
CC BY-SA 2.0 Michael Coglan
A tour around the EMA landscape7
![Page 8: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/8.jpg)
A&F principles at Queen’s University Belfast
A tour around the EMA landscape8
![Page 9: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/9.jpg)
9
CC BY-NC-SA 2.0 CrazyFast
Supporting longitudinal development
• Assessment for learning rather than of learning
• More formative opportunities
• Feed forward• Ipsative approaches• Assesment scheduling• Access to information
A tour around the EMA landscape9
![Page 10: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/10.jpg)
Assessment timelines
University of Dundee course redesign using University of Hertfordshire assessment timelines tool
A tour around the EMA landscape10
![Page 11: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/11.jpg)
11
CC BY-NC-SA 2.0 xdxd_vs_xdxd
The role of feedback
• Feedback is a ‘black box’
• Programme teams don’t discuss feedback
• Useful analytical tools available
A tour around the EMA landscape11
![Page 12: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/12.jpg)
What kind of feedback do you give?
• P1 - Praise. Motivating but if used indiscriminately can appear insincere. • P2 - Recognising Progress (ipsative feedback). Can be motivating and
informs students about their learning. Lack of progress serves as an early warning.
• C - Critique. How work falls short of expectations or criteria; can be discouraging if not accompanied by information on how to improve.
• A - Advice. Help students take future action to improve. • Q - Clarification requests. Asking learners to think more deeply about
their work and generate actions themselves. • O - Unclassified statements. Neutral comments, for example that
describe the piece of work but do not make any judgement.
(adapted from IOE feedback profile)
A tour around the EMA landscape12
![Page 13: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/13.jpg)
13
CC BY 2.0 acme
Electronic Management of Assessment
• Jisc EMA project• HeLF surveys• Questionnaire (65 HEIs)• Think tank & workshops• Interviews• Discussions on EMA blog/
• Landscape review report
A tour around the EMA landscape13
![Page 14: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/14.jpg)
Localised initiatives
A tour around the EMA landscape14
![Page 15: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/15.jpg)
EMA pain points
A tour around the EMA landscape15
![Page 16: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/16.jpg)
16
CC BY-NC-SA 2.0 Cesar Harada
Systems integration
• Limited range of core technologies
• Integration loose & requiring manual intervention
• More HEIs say their A&F systems are ‘completely separate’ than ‘highly integrated’
A tour around the EMA landscape16
![Page 17: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/17.jpg)
17
CC BY-NC-SA 2.0 Cle0patra
Business Processes
• Lots of local variation• Only 12% of HEIs have
‘highly standardised’ processes
• Different interpretations of policy
• Variation hidden till EMA tried
A tour around the EMA landscape17
![Page 18: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/18.jpg)
18
CC BY –NC 2.0 Pondspider
• Necessary safeguard or ‘comfort blanket’ ?
• Avoids unconscious bias• Doesn’t support ipsative
approach• Complicated by second
marking processes• Can be lost when data
transfers between systems
Example: anonymity
A tour around the EMA landscape18
![Page 19: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/19.jpg)
19
CC BY-NC-SA 2.0 jon jordan
Urban Myths
• QAA says ‘No!’• It’s against institutional
regulations• Leads to change taking
place ‘under the radar’ of formal QA processes
A tour around the EMA landscape19
![Page 20: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/20.jpg)
What are your priorities? (1)
A tour around the EMA landscape20
![Page 21: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/21.jpg)
What are your priorities? (2)
A tour around the EMA landscape21
![Page 22: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/22.jpg)
22
Photo: livework for Jisc
Working towards solutions
• Validation of priorities• Workshop to generate
solution ideas• Validation and
refinement of solutions• Projects getting under
way
A tour around the EMA landscape22
![Page 23: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/23.jpg)
23
CC BY –NC-ND 2.0 bendeavin
Next steps
• EMA requirements map:definition of common workflows
• EMA toolkit:• Feedback hub: feasibility
study• Systems integration:
support resources
A tour around the EMA landscape23
![Page 24: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/24.jpg)
24
Highlights of the itinerary
• Educational principles: Hertfordshire, Queen’s Belfast
• Curriculum Design: Ulster• Feedback: Dundee, Institute of
Education• Employability: Exeter• EMA: Huddersfield• Reflection: Westminster• Student support: Manchester Met• Students as agents of change:
Bath Spa; WinchesterCC BY-SA 2.0 Steve Cadman
A tour around the EMA landscape24
![Page 25: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/25.jpg)
25
Souvenir shop
• A&F Baseline review: http://www.webarchive.org.uk/wayback/archive/20140614114153/http://www.jisc.ac.uk/media/documents/programmes/elearning/Assessment/JISCAFBaselineReportMay2012.pdf
• A&F Final report:http://repository.jisc.ac.uk/5450/4/Jisc_AF_Final_Synthesis_Report_Oct_2013_v2.pdf
• EMA Landscape review: http://repository.jisc.ac.uk/5599/
• Jisc Design Studio: http://jiscdesignstudio.pbworks.com
• Jisc EMA blog: http://ema.jiscinvolve.org/wp/
CC BY-NC-ND-SA 2.0 ericalaspada
A tour around the EMA landscape25
![Page 26: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/26.jpg)
26
Stay in touch
• Contact me:[email protected]
• Contact Jisc EMA lead:[email protected]
• Contribute to the blog• Get involved with the
projects• Join the mailing list:
CC BY-NC-SA 2.0 robin kaspar
A tour around the EMA landscape26
![Page 27: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/27.jpg)
27
Join us in Dundee
CC BY-NC-SA 2.0 William Murphy
Free one-day workshop
Electronic Management of Assessment
and Assessment Analytics
Tues 9th JuneUniversity of Abertay
Contact [email protected] for details
A tour around the EMA landscape27
![Page 28: 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape](https://reader037.vdocument.in/reader037/viewer/2022110320/56649cb65503460f9497bce6/html5/thumbnails/28.jpg)
28
Thanks and over to you…
CC BY –NC 2.0 yuzu
A tour around the EMA landscape28