nss 2013 strategic meeting of senate 11 september 2013 dr veena o’halloran director of student...
TRANSCRIPT
NSS 2013
Strategic Meeting of Senate
11 September 2013
Dr Veena O’Halloran
Director of Student Experience and Enhancement Services
Presentation
• What the NSS survey is telling us• Themes• How we compare with the sector • Discussion on means of addressing issues
Strategic theme:“Outstanding teaching and student experience”
What we want to achieve:- •An outstanding and distinctive student experience•Personalised student support•Satisfied, skilled and successful graduates
Are we achieving these objectives?
NSS 2013 tells us we are not.
Positive feedback
42%
26%
5%4%5%
5%9%
4%
Staff
Course content & structure
Assessment & feedback
Organisation and man-agement
Facilities and Resources
General positive comments
Personal and professional development
Environment
Negative feedback
20%
22%
20%
31%
7%
1%
StaffCourse contentAssessment & FeedbackCourse Organisation & AdministrationFacilities and ResourcesGeneral Negatives
Positive vs Negative feedback
42%
26%
5%
4%
5%
5%
9%4%
Positive
Staff
Course content & structure
Assessment & feedback
Organisation and man-agement
Facilities and Resources
General positive comments
Personal and professional development
Environment
20%
22%
20%
31%
7%
1%
Negative
Negative Themes
• Organisation and Management– General organisation of courses– Organisation of the timetable– Clashes– Communication of changes
• Course Content- Workload
• Assessment and Feedback– Inadequate– Late
• Some Staff- Unsupportive and unhelpful
Not new:Outcomes over recent years
2009 2010 2011 2012 201355
60
65
70
75
80
85
90
95
Organisation & ManagementAssessment & FeedbackAcademic SupportTeaching on my courseLearning ResourcesPersonal DevelopmentOverall Satisfaction
Teaching on my course
Bath (U
niversi
ty of)
Glasgo
w (Unive
rsity
of)
Surre
y (Unive
rsity
of)
Sheffi
eld (U
niversi
ty of)
Imperi
al Colleg
e London
Southam
pton (Unive
rsity
of)
Aston Unive
rsity
Heriot-W
att Unive
rsity
Lough
borough Unive
rsity
Manch
ester
(Unive
rsity
of)
Warwick
(Unive
rsity
of)
Strath
clyde (
Universi
ty of)
Brunel Unive
rsity
80
82
84
86
88
90
92
94
12 benchmarking institutions
St Andrew
s (Unive
rsity
of)
Glasgo
w (Unive
rsity
of)
Aberdee
n (Unive
rsity
of)
Dundee (U
niversi
ty of)
Queen M
argare
t Unive
rsity
Edinburgh
Stirli
ng (Unive
rsity
of)
Universi
ty of th
e High
lands a
nd Islan
ds
Edinburgh
Napier
Universi
ty
Heriot-W
att Unive
rsity
Royal C
onserva
toire
of Sco
tland
Strath
clyde (
Universi
ty of)
Universi
ty of A
bertay
Dundee
Edinburgh
(Unive
rsity
of)
Robert Gord
on Universi
ty
Glasgo
w Caledonian
Universi
ty
Universi
ty of th
e West
of Sco
tland
Glasgo
w School o
f Art
76
78
80
82
84
86
88
90
92
94
96
Scottish institutions
Institute
of Educati
on
East A
nglia (U
niversi
ty of)
Goldsmith
s, Unive
rsity
of London
Lancas
ter Unive
rsity
Royal Hollo
way, Unive
rsity
of London
Essex
(Unive
rsity
of)
Leices
ter (U
niversi
ty of)
School o
f Orie
ntal an
d African
Studies
Birkbeck
College
Susse
x (Unive
rsity
of)
Lough
borough Unive
rsity
Strath
clyde (
Universi
ty of)
80828486889092949698
100
1994 group
Assessment & feedback
Institute
of Educati
on
Essex
(Unive
rsity
of)
East A
nglia (U
niversi
ty of)
Lough
borough Unive
rsity
Leices
ter (U
niversi
ty of)
Royal Hollo
way, Unive
rsity
of London
Birkbeck
College
Lancas
ter Unive
rsity
Goldsmith
s, Unive
rsity
of London
School o
f Orie
ntal an
d African
Studies
Susse
x (Unive
rsity
of)
Strath
clyde (
Universi
ty of)
50556065707580859095
1994 group
Heriot-W
att Unive
rsity
Aston Unive
rsity
Bath (U
niversi
ty of)
Surre
y (Unive
rsity
of)
Brunel Unive
rsity
Lough
borough Unive
rsity
Sheffi
eld (U
niversi
ty of)
Glasgo
w (Unive
rsity
of)
Manch
ester
(Unive
rsity
of)
Southam
pton (Unive
rsity
of)
Imperi
al Colleg
e London
Warwick
(Unive
rsity
of)
Strath
clyde (
Universi
ty of)
404550556065707580
12 benchmarking institutions
Universi
ty of th
e High
lands a
nd Islan
ds
St Andrew
s (Unive
rsity
of)
Heriot-W
att Unive
rsity
Robert Gord
on Universi
ty
Edinburgh
Napier
Universi
ty
Glasgo
w School o
f Art
Glasgo
w (Unive
rsity
of)
Stirli
ng (Unive
rsity
of)
Dundee (U
niversi
ty of)
Universi
ty of th
e West
of Sco
tland
Aberdee
n (Unive
rsity
of)
Glasgo
w Caledonian
Universi
ty
Queen M
argare
t Unive
rsity
Edinburgh
Strath
clyde (
Universi
ty of)
Universi
ty of A
bertay
Dundee
Royal C
onserva
toire
of Sco
tland
Edinburgh
(Unive
rsity
of) 40
45
50
55
60
65
70
75
80
85
Scottish institutions
Academic support
St Andrew
s (Unive
rsity
of)
Heriot-W
att Unive
rsity
Universi
ty of A
bertay
Dundee
Universi
ty of th
e High
lands a
nd Islan
ds
Dundee (U
niversi
ty of)
Royal C
onserva
toire
of Sco
tland
Glasgo
w (Unive
rsity
of)
Robert Gord
on Universi
ty
Queen M
argare
t Unive
rsity
Edinburgh
Strath
clyde (
Universi
ty of)
Aberdee
n (Unive
rsity
of)
Edinburgh
Napier
Universi
ty
Glasgo
w Caledonian
Universi
ty
Universi
ty of th
e West
of Sco
tland
Stirli
ng (Unive
rsity
of)
Glasgo
w School o
f Art
Edinburgh
(Unive
rsity
of) 65
70
75
80
85
90
Scottish institutions
Institute
of Educati
on
East A
nglia (U
niversi
ty of)
Essex
(Unive
rsity
of)
Leices
ter (U
niversi
ty of)
Lough
borough Unive
rsity
Susse
x (Unive
rsity
of)
Goldsmith
s, Unive
rsity
of London
Lancas
ter Unive
rsity
Royal Hollo
way, Unive
rsity
of London
Strath
clyde (
Universi
ty of)
School o
f Orie
ntal an
d African
Studies
Birkbeck
College
50556065707580859095
1994 group
Bath (U
niversi
ty of)
Surre
y (Unive
rsity
of)
Aston Unive
rsity
Brunel Unive
rsity
Heriot-W
att Unive
rsity
Sheffi
eld (U
niversi
ty of)
Lough
borough Unive
rsity
Glasgo
w (Unive
rsity
of)
Strath
clyde (
Universi
ty of)
Imperi
al Colleg
e London
Manch
ester
(Unive
rsity
of)
Southam
pton (Unive
rsity
of)
Warwick
(Unive
rsity
of) 74
76
78
80
82
84
86
88
12 benchmarking institutions
Organisation & managementBath
(Unive
rsity
of)
Aston Unive
rsity
Lough
borough Unive
rsity
Sheffi
eld (U
niversi
ty of)
Heriot-W
att Unive
rsity
Southam
pton (Unive
rsity
of)
Surre
y (Unive
rsity
of)
Brunel Unive
rsity
Imperi
al Colleg
e London
Warwick
(Unive
rsity
of)
Manch
ester
(Unive
rsity
of)
Glasgo
w (Unive
rsity
of)
Strath
clyde (
Universi
ty of)
50556065707580859095
12 benchmarking institutions
St Andrew
s (Unive
rsity
of)
Heriot-W
att Unive
rsity
Aberdee
n (Unive
rsity
of)
Glasgo
w (Unive
rsity
of)
Stirli
ng (Unive
rsity
of)
Edinburgh
(Unive
rsity
of)
Robert Gord
on Universi
ty
Universi
ty of th
e West
of Sco
tland
Universi
ty of A
bertay
Dundee
Dundee (U
niversi
ty of)
Edinburgh
Napier
Universi
ty
Glasgo
w Caledonian
Universi
ty
Queen M
argare
t Unive
rsity
Edinburgh
Strath
clyde (
Universi
ty of)
Universi
ty of th
e High
lands a
nd Islan
ds
Glasgo
w School o
f Art
Royal C
onserva
toire
of Sco
tland
50
55
60
65
70
75
80
85
90
Scottish institutions
Institute
of Educati
on
Essex
(Unive
rsity
of)
East A
nglia (U
niversi
ty of)
Lough
borough Unive
rsity
Royal Hollo
way, Unive
rsity
of London
Lancas
ter Unive
rsity
Susse
x (Unive
rsity
of)
Leices
ter (U
niversi
ty of)
Goldsmith
s, Unive
rsity
of London
Birkbeck
College
School o
f Orie
ntal an
d African
Studies
Strath
clyde (
Universi
ty of)
50556065707580859095
100
1994 group
Learning resources
East A
nglia (U
niversi
ty of)
Institute
of Educati
on
Leices
ter (U
niversi
ty of)
Strath
clyde (
Universi
ty of)
Lough
borough Unive
rsity
Lancas
ter Unive
rsity
Susse
x (Unive
rsity
of)
School o
f Orie
ntal an
d African
Studies
Essex
(Unive
rsity
of)
Goldsmith
s, Unive
rsity
of London
Royal Hollo
way, Unive
rsity
of London
Birkbeck
College
7274767880828486889092
1994 group
Imperi
al Colleg
e London
Bath (U
niversi
ty of)
Brunel Unive
rsity
Sheffi
eld (U
niversi
ty of)
Surre
y (Unive
rsity
of)
Glasgo
w (Unive
rsity
of)
Manch
ester
(Unive
rsity
of)
Southam
pton (Unive
rsity
of)
Strath
clyde (
Universi
ty of)
Lough
borough Unive
rsity
Warwick
(Unive
rsity
of)
Aston Unive
rsity
Heriot-W
att Unive
rsity
808284868890929496
12 benchmarking institutions
Royal C
onserva
toire
of Sco
tland
Aberdee
n (Unive
rsity
of)
Glasgo
w (Unive
rsity
of)
Strath
clyde (
Universi
ty of)
Dundee (U
niversi
ty of)
Edinburgh
Napier
Universi
ty
Edinburgh
(Unive
rsity
of)
Glasgo
w School o
f Art
Robert Gord
on Universi
ty
Glasgo
w Caledonian
Universi
ty
Heriot-W
att Unive
rsity
Queen M
argare
t Unive
rsity
Edinburgh
St Andrew
s (Unive
rsity
of)
Stirli
ng (Unive
rsity
of)
Universi
ty of A
bertay
Dundee
Universi
ty of th
e West
of Sco
tland
Universi
ty of th
e High
lands a
nd Islan
ds 70
75
80
85
90
95
Scottish institutions
Personal development
Dundee (U
niversi
ty of)
Robert Gord
on Universi
ty
Royal C
onserva
toire
of Sco
tland
Glasgo
w (Unive
rsity
of)
Heriot-W
att Unive
rsity
St Andrew
s (Unive
rsity
of)
Strath
clyde (
Universi
ty of)
Queen M
argare
t Unive
rsity
Edinburgh
Universi
ty of th
e High
lands a
nd Islan
ds
Glasgo
w Caledonian
Universi
ty
Glasgo
w School o
f Art
Aberdee
n (Unive
rsity
of)
Edinburgh
Napier
Universi
ty
Stirli
ng (Unive
rsity
of)
Universi
ty of th
e West
of Sco
tland
Universi
ty of A
bertay
Dundee
Edinburgh
(Unive
rsity
of) 70
72
74
76
78
80
82
84
86
88
Scottish institutions
East A
nglia (U
niversi
ty of)
Strath
clyde (
Universi
ty of)
Essex
(Unive
rsity
of)
Lancas
ter Unive
rsity
Leices
ter (U
niversi
ty of)
Institute
of Educati
on
Lough
borough Unive
rsity
Susse
x (Unive
rsity
of)
Goldsmith
s, Unive
rsity
of London
Royal Hollo
way, Unive
rsity
of London
Birkbeck
College
School o
f Orie
ntal an
d African
Studies
65
70
75
80
85
90
95
1994 group
Bath (U
niversi
ty of)
Surre
y (Unive
rsity
of)
Aston Unive
rsity
Glasgo
w (Unive
rsity
of)
Heriot-W
att Unive
rsity
Strath
clyde (
Universi
ty of)
Imperi
al Colleg
e London
Sheffi
eld (U
niversi
ty of)
Brunel Unive
rsity
Lough
borough Unive
rsity
Southam
pton (Unive
rsity
of)
Warwick
(Unive
rsity
of)
Manch
ester
(Unive
rsity
of) 76
78
80
82
84
86
88
90
12 benchmarking institutions
Overall satisfaction
Bath (U
niversi
ty of)
Surre
y (Unive
rsity
of)
Aston Unive
rsity
Heriot-W
att Unive
rsity
Sheffi
eld (U
niversi
ty of)
Glasgo
w (Unive
rsity
of)
Lough
borough Unive
rsity
Southam
pton (Unive
rsity
of)
Brunel Unive
rsity
Imperi
al Colleg
e London
Strath
clyde (
Universi
ty of)
Warwick
(Unive
rsity
of)
Manch
ester
(Unive
rsity
of) 808284868890929496
12 benchmarking institutions
St Andrew
s (Unive
rsity
of)
Heriot-W
att Unive
rsity
Glasgo
w (Unive
rsity
of)
Dundee (U
niversi
ty of)
Aberdee
n (Unive
rsity
of)
Robert Gord
on Universi
ty
Stirli
ng (Unive
rsity
of)
Strath
clyde (
Universi
ty of)
Edinburgh
Napier
Universi
ty
Glasgo
w Caledonian
Universi
ty
Royal C
onserva
toire
of Sco
tland
Universi
ty of A
bertay
Dundee
Universi
ty of th
e High
lands a
nd Islan
ds
Universi
ty of th
e West
of Sco
tland
Queen M
argare
t Unive
rsity
Edinburgh
Edinburgh
(Unive
rsity
of)
Glasgo
w School o
f Art
70
75
80
85
90
95
Scottish institutions
Institute
of Educati
on
East A
nglia (U
niversi
ty of)
Essex
(Unive
rsity
of)
Lancas
ter Unive
rsity
Leices
ter (U
niversi
ty of)
Royal Hollo
way, Unive
rsity
of London
Susse
x (Unive
rsity
of)
Goldsmith
s, Unive
rsity
of London
Lough
borough Unive
rsity
School o
f Orie
ntal an
d African
Studies
Birkbeck
College
Strath
clyde (
Universi
ty of)
80828486889092949698
1994 group
Students’ Union
Lough
borough Unive
rsity
East A
nglia (U
niversi
ty of)
Leices
ter (U
niversi
ty of)
Essex
(Unive
rsity
of)
Strath
clyde (
Universi
ty of)
School o
f Orie
ntal an
d African
Studies
Lancas
ter Unive
rsity
Susse
x (Unive
rsity
of)
Goldsmith
s, Unive
rsity
of London
Birkbeck
College
Royal Hollo
way, Unive
rsity
of London
Institute
of Educati
on50
55
60
65
70
75
80
85
90
1994 group
Sheffi
eld (U
niversi
ty of)
Lough
borough Unive
rsity
Bath (U
niversi
ty of)
Surre
y (Unive
rsity
of)
Brunel Unive
rsity
Imperi
al Colleg
e London
Glasgo
w (Unive
rsity
of)
Warwick
(Unive
rsity
of)
Southam
pton (Unive
rsity
of)
Strath
clyde (
Universi
ty of)
Manch
ester
(Unive
rsity
of)
Heriot-W
att Unive
rsity
Aston Unive
rsity
50556065707580859095
100
12 benchmarking institutions
Dundee (U
niversi
ty of)
Glasgo
w (Unive
rsity
of)
Glasgo
w School o
f Art
St Andrew
s (Unive
rsity
of)
Strath
clyde (
Universi
ty of)
Universi
ty of A
bertay
Dundee
Robert Gord
on Universi
ty
Heriot-W
att Unive
rsity
Royal C
onserva
toire
of Sco
tland
Aberdee
n (Unive
rsity
of)
Universi
ty of th
e West
of Sco
tland
Glasgo
w Caledonian
Universi
ty
Edinburgh
(Unive
rsity
of)
Stirli
ng (Unive
rsity
of)
Edinburgh
Napier
Universi
ty
Universi
ty of th
e High
lands a
nd Islan
ds
Queen M
argare
t Unive
rsity
Edinburgh
40
45
50
55
60
65
70
75
80
85
Scottish institutions
What do we need to address?
•Culture•Leadership, roles and responsibilities •Communication – what, when and how?•Consistency across depts./schools, across each and between faculties•Transparency through monitoring
Strategic FocusAlready in hand:
Assessment and Feedback Champion, Dr Lizann Bonnar:
a) New institutional Assessment & Feedback policy (Target: Nov Senate);
b) Wider scoping of Assessment and Feedback issues - Consistency of practice: institution-wide agreed turnaround time for feedback on assessmentsUniversity-wide staff network for assessment and feedback focus.
Quality Assurance and performance monitoring:
c) QAC – best practice, policy, consistency of practice and turnaround times implementationd) Departments/schools to report to QAC on how they are performing against thesee) HR Policies; and role recognition; ADR; CPE framework
EEF Project: “Engaging Students in Delivering High Quality, Consistent, University Wide Student Assessment and Feedback”
f) Liaison with 30 staff and 300 studentsg) Identifying key departmental contacts to carry work forwardh) Common set of guidelines for staff and students
Myplace development & support:a) Scope use of Myplace to implement consistent and more effective use of tools for assessment and
feedback;
b) Scoping Gradebook development; Assessment Schedule tool (for cross class comparison).
Communications strategy:c) Service Level Agreement on different types of communication;d) Technologies in use to support communication (Myplace, Pegasus, mPegagus, Twitter, Text, local tech) and
identify consistent approaches for different types of communication.c) Communication through MyPlace and pop-ups on mobile devices
LEF Workshops and Events:e) External sector-wide viewpoint; f) Sharing good practice; g) Research; h) Learning from others; i) Staff development – eg Masterclasses
And being scoped . . .
Some thoughts for department/schools:for discussion
Communications• Involve students and their reps in solving issues • Assign a go-to student and staff member• Ensure communication-loop is closed• Provide immediate explanation when arrangements for courses/classes change
Assessment and feedback• Achieve common understanding between staff and students on what feedback
means and involves• Ensure all students receive some form of feedback relatively early in a class to
enable them to improve• Ensure students know when to expect feedback and that agreed deadlines are met• Agree university-wide turnaround time for feedback • Give particular attention to feedback on semester 1 exams
Student support• Hold 1-to-1 meetings with final year students at a best time to facilitate
improvement in their performance• Provide targeted support for underperforming students
Some thoughts for department/schools:for discussion
• Sharing and implementing good practice
• Learn from external peers – e.g. through research; role as External Examiners at other HEIs; Externals from elsewhere coming here
• Address staff behavioural issues of lack of engagement (collective and individual)
Discussion