#altc “systems are arcane, forced to work, unreliable and convoluted”
TRANSCRIPT
![Page 1: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/1.jpg)
@elearninglpool
“Systems are arcane, forced to work, unreliable and convoluted”
The long and winding road of Electronic Management of Assessment
Dan Roberts, Alex Spiers & Tunde Varga-Atkins Centre for Innovation in Education
Annual Conference of the Association for Learning Technology September 2017 University of Liverpool, UK
@elearninglpool
![Page 2: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/2.jpg)
![Page 3: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/3.jpg)
Click to edit Master title style
Photo by Inha Leex Hale - Creative Commons Attribution License https://www.flickr.com/photos/46835425@N00 Created with Haiku Deck
ContextToolsResearchInteractivityCommunity Created Solutions!
![Page 4: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/4.jpg)
Photo by Marc Wathieu - Creative Commons Attribution-NonCommercial License https://www.flickr.com/photos/88133570@N00 Created with Haiku Deck
( EMA ) is increasingly being used to describe the way in which technology is used across the assessment life cycle to support the electronic submission of assignments, as well as marking and feedback. (JISC 2014)
![Page 5: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/5.jpg)
@elearninglpool
Photo by Pulpolux !!! - Creative Commons Attribution-NonCommercial License https://www.flickr.com/photos/46425925@N00 Created with Haiku Deck
Purpose of this session
2016 Survey of Technology Enhanced Learning for higher education in the UK
Benchmarking and review
![Page 6: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/6.jpg)
@elearninglpool
Created with Haiku DeckPhoto by UCL IOE - Creative Commons Attribution-NonCommercial License https://www.flickr.com/photos/43313941@N06
EMA Policy Project Board 2016
APVC Helen O Sullivan
Academic Staff (Faculty Rep)Professional ServicesCSD (IT Services)CIE (Centre for Innovation in Education)Project Manager (CSD)
Works StreamsPilotsProcessesEquipmentSystemsExternal examinationCommunication
![Page 7: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/7.jpg)
Click to edit Master title style
Photo by falequin - Creative Commons Attribution-ShareAlike License https://www.flickr.com/photos/61314442@N03 Created with Haiku Deck
1 Think 3 Pair 3 Share
![Page 8: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/8.jpg)
@elearninglpool
What tools are used?
![Page 9: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/9.jpg)
![Page 10: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/10.jpg)
@elearninglpool
• Insert the stats from the Craig Goacher
![Page 11: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/11.jpg)
@elearninglpool
![Page 12: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/12.jpg)
@elearninglpool
Printing
Fall Down Protocol
Management of technologyLimitations of supported tools
MOBILE DEVICE MANAGEMENT
Return of MarksLanguage
Support
Tablet Annotation FINANCIAL SUSPENSION
Moderation
Blind MarkingDistribution of marking
M O D E R A T I O N
E x t e r n a l E x a m i n e r a c c e s s
Accessibility
![Page 13: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/13.jpg)
@elearninglpool
Photo by falequin - Creative Commons Attribution-ShareAlike License https://www.flickr.com/photos/61314442@N03 Created with Haiku Deck
1 Think 3 Pair 3 Share
![Page 14: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/14.jpg)
@elearninglpool
Photo by Marc Wathieu - Creative Commons Attribution-NonCommercial License https://www.flickr.com/photos/88133570@N00 Created with Haiku Deck
How does your institutions deal with this type of complexity?
![Page 15: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/15.jpg)
@elearninglpool
Photo by Joe The Goat Farmer - Creative Commons Attribution License https://www.flickr.com/photos/132604339@N03 Created with Haiku Deck
Liverpool: Data
![Page 16: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/16.jpg)
@elearninglpool
Data collection methods• Staff survey (n=345)
• Staff interviews eMarking pilots;
• Report from eLearning Unit learning perspective
• Student survey (JISC Digital Tracker) (n=670) responses from LivUni students;
• Student enhancement projects (Guild/SSLC)
• Desk-top research, see benchmarking report.
![Page 17: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/17.jpg)
@elearninglpool
Student more divided on eMarking (n=670)
![Page 18: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/18.jpg)
@elearninglpool
Vignettes• Staff less keen on eMarking: barriers outweighing potential
benefits, or prefer paper-based Marking;
• Staff who would be keen on eMarking but are frustrated by the lack of functionality of systems;
• Staff who have tried hard to make eMarking work but abandoned it, or scaled it back;
• Staff eMarking despite major difficulties through workarounds;
• eMarking enthusiasts who are on board and engaged in eMarking;
• Staff with pedagogical considerations for opting out of eMarking;
• Staff who are impacted by eMarking with respect to physical and health problems or those with accessibility needs;
• Occasional markers – e.g. PGRs. See also external examiners.
![Page 19: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/19.jpg)
@elearninglpool
Recommendations – technical
• Improvements to reliability – some outside of Uni control!
• Lobbying with software providers (long-haul!)
• Support & tools for group assessments
• See also Recommendations around health & safety, equipment in full report & EMA system downtimes.
![Page 20: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/20.jpg)
@elearninglpool
Photo by falequin - Creative Commons Attribution-ShareAlike License https://www.flickr.com/photos/61314442@N03 Created with Haiku Deck
1 Think 3 Pair 3 Share
![Page 21: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/21.jpg)
@elearninglpool
Photo by Marc Wathieu - Creative Commons Attribution-NonCommercial License https://www.flickr.com/photos/88133570@N00 Created with Haiku Deck
Why can’t we come together to build something to fit our needs?What is the ideal system? Is there one?
![Page 22: #ALTC “Systems are arcane, forced to work, unreliable and convoluted”](https://reader030.vdocument.in/reader030/viewer/2022011722/5a6520917f8b9aa2548b7625/html5/thumbnails/22.jpg)
@elearninglpool
Photo by oggin - Creative Commons Attribution-NonCommercial License https://www.flickr.com/photos/85755792@N00 Created with Haiku Deck
FIND OUT MOREGet in touch with us…
@elearninglpool
elearningatliverpool.wordpress.com
Thank you for listening and participating