electronic management of assessment: challenges to solutions
TRANSCRIPT
19/11/2014 Electronic Management of Assessment: moving onElectronic management of assessment: challenges to solutions
22/01/2015
Lisa Gray, senior co-design manager, Jisc
Hello
Project team
» Lisa Gray, senior co-design manager, Jisc
» Gill Ferrell, consultant, Jisc EMA project
» Marianne Sheppard, account manager, Jisc
» Wilbert Kraan, assistant director, CETIS
» Heather Price, senior co-design manager, Jisc
» Alex Nisbett, project lead, Livework
» Marta Ferreira De Sa, service designer, Livework
3Introduction - Electronic Management of Assessment (EMA) project
Background and context
Recently completed – a 3 year programme exploring technology-enhanced assessment and feedback
4 main themes:
»Feedback and feed forward
»Enhancing student employability
»Strategies for change
»Electronic management of assessment (EMA)
Introduction - Electronic Management of Assessment (EMA) project 4
http://bit.ly/jisc-assess and http://bit.ly/jiscdsaf
Background and context
»EMA - benefits and drivers are
clear
»Challenges surfacing relating to
process, practice and technology
»Working in collaboration with
the Heads of e-Learning Forum
(HeLF) and UCISA to maximise
the benefits technology can
offer in the management of
assessment
Introduction - Electronic Management of Assessment (EMA) project 5
CC BY-NC-SA 2.0 ©comedynose via Flickr
Project overview
Introduction - Electronic Management of Assessment (EMA) project 6
Phase 1March – July 2014
Landscape review providing initial identification of challenges and outline of the state of play with regards to EMA
Phase 2.1Oct –Aug 2015
Second phase of consultation, refining and prioritising challenges (speaking as a ‘single voice’)
Moving from challenges to solutions (Oct – Jan)
Solution development (Feb – July)
Phase 2.2Oct –Aug 2015
Ongoing development of resources for the ‘toolkit’ based on the assessment and feedback
Where are we now?
» Produced a review of the EMA
landscape across UK HE and FE.
Gathered examples of practices,
policies & process as well as
implementation approaches
»Identified and prioritised the
challenges around EMA, in terms
of pedagogy/culture, process and
technology
»In December we ran a workshop
to explore possible solutions to
these prioritised challenges
Introduction - Electronic Management of Assessment (EMA) project 7
»Today – is about working these
ideas up into concrete, realistic
and detailed proposals
http://ema.jiscinvolve.org/
What’s next?
»Ideas will be shared publically for
comment and prioritisation
w/c 2 Feb
»These ideas will go forward for
discussion within Jisc and
decisions made on which to take
forward
»Advice and Guide Toolkit already
in train…
Introduction - Electronic Management of Assessment (EMA) project 8
CC BY-NC-SA 2.0 ©comedynose via Flickr
Participants today - welcome
» Anglia Ruskin University
» University of Birmingham
» Birmingham City University
» Cardiff University
» Edge Hill University
» University of Gloucestershire
» University of Huddersfield
» University of Hull
» Institute of Education
» King’s College, London
» Royal Veterinary College
Title of presentation 00/00/2013 9
Universities
» University of Leicester
» University College London
» University of Manchester
» Manchester Metropolitan University
» University of Northampton
» The University of Nottingham
» Plymouth University
» Queen’s University, Belfast
» University of Salford
» Sheffield Hallam University
» University of Southampton
Participants today - welcome
» eAssignment
» Hedtek Ltd (Mark it Quickly)
» iParadigms (Turnitin)
» LiveText
» MyKnowledgeMap
» PebblePad (Atlas)
» TAG Assessment
» ULCC (Moodle and Mahara)
» CETIS, and the IMS Global Learning Consortium
Title of presentation 00/00/2013 10
Assessment system suppliers
»Not able to make today, but
continuing to engagement with:
› Blackboard
› Canvas (Joe Berry)
› Desire2Learn
› Questionark Perception
Today
Project timeline
Challenges to solutions - Electronic Management of Assessment (EMA) project 12
Our objectives
»To share the solution areas developed in the first ‘imagine’ workshop and develop, validate and prioritise the propositions
» In collaboration with users, experts and suppliers to develop a clear picture of what these solution ideas look like at a sector level for decisions to be made in the next stage about whether or not they should proceed to development
»To better understand the implications of these developments for all stakeholders
»To identify potential supporters, owners and partners in the development of these solutions
Challenges to solutions - Electronic Management of Assessment (EMA) project 13
The aim of today
Generate a detailed view on five potential solutions so that we can then prioritise.
Challenges to solutions - Electronic Management of Assessment (EMA) project 14
Today’s schedule
» Project introduction
» Present solutions
» Solution validation
» Lunch 12.30 – 13.15
» Solution validation
» Playback
» Discussion / prioritise
» Summary & close 15.30
15Challenges to solutions - Electronic Management of Assessment (EMA) project
What we’re going to do
1. Present the solutions
Challenges to solutions - Electronic Management of Assessment (EMA) project 16
3. Discuss and prioritise
2. Define and validate solutions
The solutions
The solutions
18Challenges to solutions - Electronic Management of Assessment (EMA) project
1. Specifying workflows
2. Feedback hub
3. Reliable submissions
4. Systems integration
5. Assessment and feedback toolkit
19Challenges to solutions - Electronic Management of Assessment (EMA) project
20Challenges to solutions - Electronic Management of Assessment (EMA) project
21Challenges to solutions - Electronic Management of Assessment (EMA) project
22Challenges to solutions - Electronic Management of Assessment (EMA) project
23Challenges to solutions - Electronic Management of Assessment (EMA) project
24Challenges to solutions - Electronic Management of Assessment (EMA) project
Team ASpecifying workflows
Simon Grundy
Jason Bell
Ian Barrett
Joel Mills
Anthony Lewis
James Trueman
Mira Vogel
Gill Ferrell
Team BFeedback hub
Richard Havinga
Joseph Berry
Calum Thompson
Duncan Greenhill
Emma Purnell
Chris Turnock
Lisa Gray
Team CReliable submissions
Stuart Blacklock
Stuart Hepplestone
Gill Kelly
Fran Morton
Peter Rayment
Justin Steele-Davis
Heather Price
Team DSystems integration
John Couperthwaite
Mark Van Harmelen
Adel Gordon
John Hill
Nigel Owen
Colin Smythe
Bill Warburton
Wilbert Kraan
Team EA+F toolkit
Steve Sidaway
Stefanie Anyadi
David Callaghan
Lynette Lall
Cheryl Reynolds
Alistair Spark
Marianne Sheppard
Introductions
Solution validation
How we’re going to validate
» In your teams, sequentially address your
solution with the questions
» Discuss, then capture on the cards
» This framework should catch everything
which is significant
» In addition, capture any new ideas or
observations on blanks
Challenges to solutions - Electronic Management of Assessment (EMA) project 27
Seven questions to explore
1. Understand and critique
2. Develop and describe the solution
3. Define the key benefits
4. Define the risks
5. Who’s your development dream team?
6. Required resources
7. Implications for the service.
28Challenges to solutions - Electronic Management of Assessment (EMA) project
75 mins
Some guidelines
» Build upon your collective knowledge, together
» You’ll need a scribe, someone to capture your thoughts
» Keep responses clear, concise and understandable by anyone
» Answer all the questions!
29Challenges to solutions - Electronic Management of Assessment (EMA) project
Lunch, 45 mins
Seven questions to explore
1. Understand and critique
2. Develop and define the solution
3. Define the key benefits 5-10 min
4. Define the risks 5 min
5. Who’s your development dream team? 5 min
6. Required resources 5 min
7. Implications for the service 20 min
31Challenges to solutions - Electronic Management of Assessment (EMA) project
50 mins
Playback, vote and prioritise
Summary, next steps and close
Keeping in touch:
»Lisa Gray [email protected]
»Landscape report available from: bit.ly/jisc-ema
»Join the conversation on the blog: ema.jiscinvolve.org/
and on twitter #jiscassess
»Join the mailing list: www.jiscmail.ac.uk/tech-enhanced-assessment
»Guides, case studies, videos and other resources on assessment and feedback: bit.ly/jisc-assess
34Challenges to solutions - Electronic Management of Assessment (EMA) project
Thank you