ukoln is supported by: evidence, impact, metrics institutional and social web services: evidence for...
TRANSCRIPT
UKOLN is supported by:
Evidence, Impact, Metrics
Institutional and Social Web Services: Evidence for Their Value
WelcomeBrian Kelly
UKOLN
University of Bath
Bath, UK
http://www.ukoln.ac.uk/web-focus/events/workshops/eim-2010-12/http://www.ukoln.ac.uk/web-focus/events/workshops/eim-2010-12/
This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence (but note caveat)
Acceptable Use PolicyRecording this talk, taking photographs, discussing the talk using Twitter, IM, etc. is permitted if distractions to others are minimised.
Acceptable Use PolicyRecording this talk, taking photographs, discussing the talk using Twitter, IM, etc. is permitted if distractions to others are minimised.
Twitter:#ukolneim
Blogs: Twitter:http://ukwebfocus.wordpress.com/ @briankellyhttp://blogs.ukoln.ac.uk/evidence-impact-metrics/ @ukwebfocus
2
About Me
Brian Kelly:• UK Web Focus: a national advisory post• Long-standing Web evangelist • Established Institutional Web Management
Workshop (IWMW) in 1997• Based at UKOLN at the University of Bath
UKOLN:• A national centre of expertise in digital
information management• Funded by the JISC• A JISC Innovation Support Centre
Intr
od
uct
ion
Evidence, Impact, Metrics
Evidence, Impact, Metrics (EIM):• UKOLN activity funded by the JISC
Aims to:• Explore ways of gathering evidence which
can demonstrate the impact of services and devise appropriate metrics to support such work
By:• A number of events• The EIM Blog
3
Evidence, Impact, Metrics
Areas of Work• Institutional Web services (November):
How can we demonstrate the effectiveness and impact of institutional Web services? What metrics are relevant? What concerns may there be?
• The Social Web (December):How can we demonstrate the effectiveness and impact of Social Web services? What metrics are relevant? What concerns may there be?
• ….4
Intr
od
uct
ion
5
Workshop Aims
By the end of the workshop we should have:• Discussed ways of gathering evidence to
demonstrate the value and impact of Social Web services.
• Identified ways that the value and impact can be measured and articulated to third parties
• Explored ways in which such measures can be standardised in order to provide level of consistency, whilst acknowledging institutional diversity
We should also:• Be in a position to develop and/or commission
work to gather and interpret evidence
Intr
od
uct
ion
The Context •The need to demonstrate value in light of Government cuts
6
Why?Why do we need to do this?
• (Respond to criticisms from others)
• Be able to demonstrate our value
• Be able to identify & address deficiencies
• …
7
Using Freedom of Information legislation the Telegraph discovered eight examples of universities spending between £100,000 and £280,000 on one-off website redesigns, as much as five times higher than the average spending.The average annual spending on the maintenance of a university website is £60,375. That figure excludes additional spending on one-off redesigns, for which the average spending is £60,882.The most expensive university website is the University of xxxx, which spent £278,094 on a redesign by Precedent Communications and Straker UK, completed in May 2008. The university also employs staff whose salaries cost £221,500 every year, in addition to £14,500 each year for software support.
Prisoner’s DilemmaWe can all benefit by:
• Sharing best practices• Sharing examples of flawed
approaches• Agreeing on ways forward
But concerns that:• We might be seen to be doing
badly• We want to learnt from others,
but not share our experiences
8
The aim is to demonstrate the value of institutional Web services across UK HE. That is a clear unambiguous message to sell (to e.g. THE)
Concerns
ProgrammeTime Content
10.00-10.20 Introduction
10.20-10.40 Case Study: What We’re Doing at the University of Bath. Alison Kerwin, University of Bath
10.40-11.00 Case Study: Should We Outsource? Assessing Costs and ROI. Stephen Emmott, LSE
11.00-11.20 Coffee
11.20-11.40 Impact and Revenue: Dashboard Approaches to Measuring Value: Ranjit Sidhu
11.40-12.30 Breakout Groups: Reviewing the Approach
12.30-13.30 Lunch
13.30-13.45 Beyond the Institution: Value of Cloud Services & the Social Web
13.45-14.25 Case Studies: Jeremy Speller & Sarah Sherman
14.25-15.00 Group Exercise
15.00-15.15 Coffee
15.15-15.50 Report Back & Action Plans
15.50-16.00 Conclusions 9
About You
In small groups cover:• Where you work• What you do• Your areas of interest• Specific issues would you like to see
addressed• Expertise you can contribute
10
E
11
Questions
Any questions or comments?
Reviewing Approaches
You have heard about:• Two case studies• A institutional dashboard approach to
monitoring value based on institutional priorities
You will now:• Identify the relevance of such approaches
for your institution• Explore limitations and benefits• Make recommendations for further work
12
13
Questions
Any questions or comments?
Action Plans
What Next? Building on Today’s Work• What will you do next?• What should your institution do next?• What related work needs to be done at a
regional or national level?
What Next? Additional Areas of Work• What additional areas could the EIM
activity address?
14 15.15-15.45
D