xmarks xmarks team andy collington aaran cudbard-bell paolo oprandi, carol shergold john williams...

15
XMarks XMarks team • Andy Collington • Aaran Cudbard-Bell • Paolo Oprandi, • Carol Shergold • John Williams Project Manager • Amy Walker Email us [email protected]

Upload: aidan-murphy

Post on 28-Mar-2015

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

XMarks

XMarks team

• Andy Collington

• Aaran Cudbard-Bell

• Paolo Oprandi,

• Carol Shergold

• John Williams

Project Manager

• Amy Walker

Email us

[email protected]

Page 2: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

XMarks background - the portal

Staff use the portal to enter marks and to progressassessments through the Exams SystemStudents use the portal to view their marks and overall Course and Programme results

A shot from our portal showing the assessments for a given course - data from enterprise database.Contributory or non-contributory

Page 3: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

Online assessment activities

Page 4: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

What’s the problem?

Tutor sets up a new activity to provide formative feedback, e.g. MCQ• Details of this activity and its marks are only visible in the LMS, but students

are used to seeing all their activities and marks in the portal

Tutor sets up activity to implement a summative assessment, the details of which are already visible in the portal• The activity is visible in both the portal and the LMS, although crucial details

such as the submission deadline may differ as it has been created twice.• Marks are only visible in the LMS, until the tutor re-keys them into the portal

Page 5: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

What’s the problem?

• Potential for confusion and inaccuracies in the presentation of

assessment and marks data to students

• Duplication of effort by staff

Page 6: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

Two silos

Enrolment data?

Marks data?

Assessment data?

Page 7: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

How MINTED helped

Enrolment data Marks data?Assessment data?

Page 8: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

Where XMarks comes in

Enrolment data Marks data Assessment data

Page 9: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

And it could be more complicated ..

Multiple sources of assessment

• A student record system

• A learning management system/VLE

• Web service providing on-line assessments via a particular external provider such as a text book publisher

• Web service providing a peer review tool

• etc

Page 10: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

Background assumptions

Summative assessments

• defined when course is initially created or reviewed

• there exists a system such as a student records system that can be

identified as the parent system for all assessments

• marks need to end up in the parent system to allow overall course

result to be calculated

Institution? Department? Course?

Formative assessments

• can be created spontaneously at course or teaching group level

• there is no one source or parent for them

Page 11: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

Use cases for student

STUDENT Views a list of all summative (contributory) assessments for a given course, including description, conflation information, submission deadline, hand-in location Views a list of all formative (non-contributory) assessments for a given course, with descriptions and deadline details Finalises and submits assessment within online assessment tool Views results and feedback within online assessment tool Views all summative (contributory) marks where available, along with any penalty point information, appeals information, etc

Views all formative (non-contributory) marks where available

Page 12: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

Use cases for tutor

TUTOR Creates an assessment instance (e.g. a MCQ) Associates an assessment instance with a pre-existing assessment owner record [mandatory for summative optional for formative] Asserts that an assessment instance does not need to be associated with a pre-existing assessment owner record [optional for formative]

Asserts that marks are ready for processing

Page 13: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

Implications

Summative assessments

• the key task is to match assessments created on non-originator system with the id of the originator/parent assessment record

• we always know where the “master” record is

Formative assessments

• the task may be to match existing assessment records between pairs of systems

• the task may be to create an assessment record for one system based on a record originating from another system

• we may not have a “master” record

Page 14: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

An information model for XMarks

“Ask the audience”

Page 15: XMarks XMarks team Andy Collington Aaran Cudbard-Bell Paolo Oprandi, Carol Shergold John Williams Project Manager Amy Walker Email us xmarks@sussex.ac.uk

Questions/comments?

[email protected]

<http://www.sussex.ac.uk/its/xmarks>