enhancing the student journey through matrix-based ... - gcu

Enhancing the Student Journey through Matrix-based Feedback for Academic AdvisingThomas Peschken – GCU London

Workshop Content

� Explore synergies between SCQF characteristics-based online marking and academic advising

� Consistency� Transferability� Accessibility

Workshop JourneySchool / Programme create overarching frameworks à

Module Leaders specify assessment criteria (expected evidence) à

Module Tutor & Students give feedback à

Academic Advising

GCU London SCQF Level 11 Matrix

GCU London PPACT Template

Scottish Credits and Qualifications Framework

Module ACW1 Assessment Criteria

CW1 Assessment CriteriaEX Assessment Criteria

Module B

Digital SummativeFeedback

Peer FormativeFeedback



Academic Advising

Workshop Journey

� Introductions

� Ice breaker activity

� Wearing different hats for different parts of the workshop journey

The GCU London MatrixSchool / Departmental /

Programme Leader’s hat

GCU London MatrixPrinciple 1:

SCQF Characteristics

� Matrix criteria based on SCQF’s five characteristics:

1. Knowledge and Understanding

2. Practice: Applied Knowledge, Skills and Understanding

3. Generic Cognitive Skills

4. Communication, ICT and Numeracy Skills

5. Autonomy, Accountability and Working with Others

� London context is PGT thus the matrix is Level 11 only


Mark Points and BandingD

isti

ncti

on

Mer

it

Goo

d Pa

ss

Pass

Mar

gina

l Pa

ssM

argi

nal

Fail

Fail

100 87 77 72 67 62 57 52 47 42 21 0

� Banding for clarity

� 12 mid-band mark points

� Applied to each characteristic

� TurnItIn Feedback Studio Rubric “ready”


Language

� Banded characteristic summary

� Indicative attribute language for qualifying/ justifying comments

Distinction Distinction … Marginal Pass Marginal Fail …

100 | 87 77 | 72 … 52 47 …

Exceptional

Excellent

Extensive

Outstanding

…

Mostly Competent

Mostly Appropriate

Mostly satisfactory

Minor weaknesses

Unsatisfactory

Lacks ability

Significant

weaknesses

…

Good critical knowledge about relevant principle and specialised theories and concepts in relevant areas informed by developments at the forefront including awareness of current issues.

Knowledge and Understanding | 62

GCU London Matrix

� GCU London matrix used across programmes/ modules

àConsistency of language associated with mark points

à SCQF based consistency between assessments/ modules

� Module leaders tailor matrix to assessments

Module Assessment CriteriaModule Leaders

Module

Assessment

Criteria

� “Expected Evidence” for

each characteristic for each

assessment

� Part of Feedback Studio

Rubric and QuickMarks

Principle 1:

Expected Evidence

Module A

Communication, ICT and Numeracy Skills

CW1 - Presentation CW2 - Report

Communication skills – presentation (eye

contact, stance, ability to speak freely,

timeliness etc.)

ICT skills – presentation (presentation

format adheres to assessment brief: Use of

professional presentation software, etc.)

Communication – report writing (Numbered

subheadings, executive summary, table of

content, table of figures, page numbers,

consistent formatting, etc.)

Numeracy skills (profit and loss account;

consistency of key performance indicators, etc.)

Module B


EX - Essay Question

Communication skills – essay (Proof reading,

clarity of language, balance of paragraphs, etc.)

Module Assessment CriteriaPrinciple 2:

Weighting

� Weighting for each characteristic for each assessment

� Part of Feedback Studio Rubric

Mark Weighting

Module A Module B

CW1 CW2 EXKnowledge and Understanding

47 10% 25% 35%

Practice: Applied Knowledge, Skills and Understanding

52 25% 30% 25%

Generic Cognitive Skills

67 25% 20% 15%


72 25% 15% 10%

Autonomy, Accountability and Working with Others

57 15% 10% 15%

Weighted Mark 61 57 55

GOING LIVE

� Based on the assessment brief as a group formulate “expected evidence” for each of the five characteristics and populate them into the Rubrics as well as two sets of QuickMark templates.

� Assign each characteristic a weighting in the Rubric(needs to add up to 100%)

Module Assessment Criteria

Module Assessment Criteria

� Assessment/ module specific expectations for each characteristic

� Module Leader shares expected evidence:àApplied to Rubric e.g. in Feedback Studioà Populated as QuickMark comments e.g. in Feedback

StudioàAs Excel spreadsheet for Exams or Dissertations

� Used for feedback by Module Tutors and Students

Marking and Giving FeedbackModule Tutors & Students

Marking and Giving Feedback

� Generic assessment-level expected evidence stored as QuickMark comment (ticked box & vertical line)

� Qualifying comment ”edited” using banded indicative language as per GCU London Matrix (circled)

� Linking qualified expected evidence QuickMark comment to corresponding characteristic (tick mark)

Qualifying Feedback

GOING LIVE

� As a group, review ”CW1 - Short Essay Answer” linking the QuickMark templates to specific sections in the text (place it on the margin and draw a line) .

� “Edit” a qualifying comment onto the template using the indicative GCU London Matrix language.

� Either place one QuickMark per characteristic that is exemplary for the level or work or two for upper and lower performance indicators.

� Indicate on the QuickMark template to which SCQF characteristic it links.


Qualifying Feedback


� QuickMark comments linked to each characteristic can be accessed through speech bubble

� Speech bubble indicating the number of comments

� Slider or “tick box” in expanded view to select mark point best corresponding with qualifying commentsClassifying Feedback


� Acknowledge the students work using the associated indicative language as per GCU London Matrix

� Not repeating qualifying and or classifying feedback but to provide an executive summary of:

� Strength(s)� Areas of improvement

Summary Feedback

GOING LIVE

� As a group, review the QuickMark comments by Rubric characteristic and choose (tick/ circle) the mark point best corresponding with the QuickMark comments.

� Calculate the weighted mark (Feedback Studio would do this for you).

� Write an executive summary style Summary Feedback.


Classifying Feedback

Summary Feedback


� Summative tutor marked feedback through Excel spreadsheets for exams or dissertations, etc. using the same GCU London Matrix

� Formative tutor and/ or student generated feedback using the same expected evidence rubric as per TurnItInFeedback Studio

Other Feedback


� Easily transferable and comparable classifying feedbackacross modules and assessments against the same GCU London Matrix

� Tailored criteria qualifying feedback for each assessment:

� Expected evidence applied to Rubric� Populated as QuickMark comments

� Individual student-level feedback through edited QuickMark comments and Summary feedback

� Other feedback by tutors and students alike e.g. formative feedback

à Spectrum of unique to highly comparable feedback that is easily accessed and compiled for Academic Advising

Academic AdvisingStudents & Academic Advisors

Academic Advising

� Same standard principles but adapted to PGT journey at GCU London

� 4x 30 minute meetings:� 1st Meeting – Gauging your ‘Masterness’ and

Development Needs; 2nd and 3rd Meetings – Feedback from Summative Assessments; 4th Meeting – “Fleeing the Nest”: Assessing your career readiness

� Template aligned to SCQF characteristics for:� Ease in compiling feedback� For meaningfulness of forward actions

GCU London PPACT

GOING LIVE

� Review the feedback that you gave as a group plus the other two assessment feedbacks.

� Compile the feedback against at least one of the characteristics on the abridged GCU London PPACT template for 2nd and 3rd meetings.

� Agree between the Academic Advisors and Students in the group priority areas of development and develop forward actions.

Academic Advising

Enhancing the Student Journey through Matrix-based Feedback for Academic AdvisingConsistency, Transferability, Accessibility through two interventions

GCU London SCQF Level 11 Matrix

GCU London PPACT Template

Scottish Credits and Qualifications Framework

Module ACW1 Assessment Criteria

CW1 Assessment Criteria

EX Assessment Criteria

Module B


Peer FormativeFeedback



Academic Advising

Thank you for Participating!

Questions?Thomas Peschken

[email protected]

enhancing the student journey through matrix-based ... - gcu

Documents