![Page 1: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/1.jpg)
Evaluating digital learning resources
University of Leicester Museum Studies7 March 2017
Martin Bazley
Digital Heritage Consultant
![Page 2: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/2.jpg)
Martin Bazley
Previously:
• Teaching (7 yrs)
• Science Museum, London, Internet Projects (7yrs)
• E-Learning Officer, Museums,Libraries and Archives (MLA) South East (3yrs)
• Founder: Digital Learning Network DLNET
Slides: www.slideshare.net/martinbazley
![Page 3: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/3.jpg)
Martin Bazley
Now:
• Developing online resources, websites, user testing, evaluation, training, consultancy…
• HLF digital projects Mentor and Monitor
• Martin Bazley & Associateswww.martinbazley.com
Slides: www.slideshare.net/martinbazley
![Page 4: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/4.jpg)
Why do we need to evaluate and research our online audiences?
Why not just ‘user-centred design’ and'design things for users'?
![Page 5: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/5.jpg)
Sometimes people don't 'get' what we want them to – even when
it’s been designed ‘for them’
![Page 6: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/6.jpg)
In a conflict between visual affordance
(meaning “what it looks like you should do”)…
…and written instructions
visual affordance usually wins
![Page 7: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/7.jpg)
Digital users also sometimes don’t 'get it‘ –or rather we don’t get it right for them
![Page 8: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/8.jpg)
People use the web (mobile, desktop etc) differently…
![Page 9: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/9.jpg)
… from the way they access printed material books, object labels in galleries,
magazines, newspapers, information screens, etc
![Page 10: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/10.jpg)
For most people the web is a predominantly
visual medium
![Page 11: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/11.jpg)
Don't Make Me Think by Steve Krug
Classic, entertaining introduction to improving website usability
![Page 13: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/13.jpg)
User test early
Testing one user early on in the project…
…is better than testing 50 near the end
Source: completely made up out of thin air,
with an added ‘grain of truth’
![Page 14: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/14.jpg)
Two usability testing techniques
“Get it” testing
- do they understand the purpose, how it works, etc
Key task testing
- ask the user to do something, watch how well they do
Ideally, do a bit of each, in that order
![Page 15: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/15.jpg)
![Page 16: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/16.jpg)
User testing – who should do it?
• The worst person to conduct (or interpret)
user testing of your own site is…
– you!
• Beware of hearing what you want to
hear…
• Useful to have an external viewpoint
• First 5mins in a genuine setting tells you
80% of what’s wrong with the site
![Page 17: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/17.jpg)
About learning
Learning involves active engagement
You can’t ‘deliver learning’ over the Internet
Don’t just think what you want to ‘convey’ - think what people will dowith your digital learning resources
![Page 19: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/19.jpg)
About learning
http://bitly.com/MGS_online_resources
Rather old now but plenty of useful guidance
![Page 20: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/20.jpg)
![Page 21: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/21.jpg)
![Page 22: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/22.jpg)
![Page 23: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/23.jpg)
![Page 24: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/24.jpg)
![Page 26: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/26.jpg)
http://www.artscouncil.org.uk/media/uploads/pdf/ACE_Education_Resources_Phase_one_report_Jan_20151.pdf
![Page 27: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/27.jpg)
Examples of teacher feedback• Vimeo videos
• http://vimeo.com/18888798 Key ideas
• http://vimeo.com/18892401 Lesson starter
• http://vimeo.com/18867252 Timesaver
![Page 28: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/28.jpg)
![Page 29: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/29.jpg)
Developing learning resources: iterative review
Your content Curriculum(find a match)
Ch
eck
Does it look right for your audience’s specific needs?
If so TEST - and then amend
Learning activities Learning outcomes (find a match)
![Page 30: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/30.jpg)
Elements of online learning resources*
Image(s) + caption(s)
Key question(s) / short activities
Background notes, activity sheets
Short videos
Zoomable images
Interactive
More complex functionality
Increasin
g cost an
d co
mp
lexity Mo
st u
sefu
l fo
r te
ach
ers
These are the first
things to provide, and
do not require high
levels of IT expertise or
investment
First few can be done quite easily
The others will mean investment
of money and /or expert time
* mainly for schools and other formal learning situations
![Page 31: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/31.jpg)
How not to present online collections
to non-specialists
![Page 32: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/32.jpg)
A museum/archive website
Search our collections Go
Let’s assume(a) you know what we have(b) you know what you are looking for
Here’s the search box:
Online collections
![Page 33: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/33.jpg)
A museum/archive website
Online collections
In this introduction to our online collections we present all the points we feel we ought to mention to show that we know our collections well and that they are important collections. All the
points we feel we ought to mention to show that we know our
collections well and that they are important collections. All the points we
feel we ought to mention to show that we know our collections well and that they are
important collections. All the points we feel we ought to mention to show that we know
our collections well and that they are important collections. All the points we feel we
ought to mention to show that we know our collections well and that they are important
collections. All the points we feel we ought to mention to show that we know our
collections well and that they are important collections. All the points we feel we ought
to mention to show that we know our collections well and that they are important
collections. All the points we feel we ought to mention to show that we know our
collections well and that they are important collections …..
![Page 34: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/34.jpg)
A museum/archive website
Both of the above examples might work well for researchers or those with close connections to the museum.
But they are less likely to engage a wider audience.
Bear in mind also that only a small proportion of your web users actually use online collections. sSe e.g. London Museums Hub research
Is the amount of money spent on it justified?
![Page 35: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/35.jpg)
Zoe Hendon, Museum of Domestic Design & Architecture
How users use online collecctions
![Page 36: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/36.jpg)
Ways people use online collectionsBrowsers - Followers - Searchers - Researchers
(MHM)
To engage Browsers you need a few strong 'jewels' / in-your-face interesting stories
Followers: accessible narrative content
Searchers: may search for family name or pet topic - offer suggestions for onward links / structured searches
Researchers: just leave them to it - they will put up with anything!
For all: good search + presentation of results
![Page 37: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/37.jpg)
Fix your site not your users
'Educating' people on how to use your existing website and catalogue is an uphill struggle. They don't have to use your site.
A better approach is to help them want to.
![Page 38: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/38.jpg)
Crit room
![Page 39: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/39.jpg)
Crit room
Simulated user testing
- Learn how user testing works
- Get feedback on specifics of websites
Remember this is just a simulation of real user testing!
![Page 40: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/40.jpg)
Crit room protocol
Simulating user testing – usually one-to-one in quiet room (except when in classroom!)
No one (especially site stakeholders) other than tester say anything for first part of session
In this simulation we will focus on
Look and feel of site
Usability
Content
![Page 41: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/41.jpg)
Testing is an iterative process
Testing isn’t something you do once
Make something
=> test it
=> refine it
=> test it again
Remember the blue arrow
![Page 42: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/42.jpg)
Planning audience research
![Page 43: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/43.jpg)
Define audience
research goal
Analyse data
Collect data Use results to guide
changes
Plan methodology
![Page 44: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/44.jpg)
Define audience research
goal
Analyse data
Collect data Use results to guide
changes
Plan methodology
![Page 45: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/45.jpg)
Define audience research
goal
Analyse data
Collect data Use results to guide
changes
Plan methodology
![Page 46: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/46.jpg)
Define audience research
goal
Analyse data
Collect data Use results to guide
changes
Plan methodology
![Page 47: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/47.jpg)
Define audience research
goal
Analyse data
Collect data Use results to guide
changes
Plan methodology
![Page 48: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/48.jpg)
Define audience
research goal
Analyse data
Collect data Use results to guide
changes
Plan methodology
![Page 49: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/49.jpg)
SCA guidancehttp://sca.jiscinvolve.org/wp/audience-publications/
Good overview
Step by step approach
Lots of sources of information:
Culture 24 Let’s Get Realhttp://weareculture24.org.uk/projects/action-research/
![Page 50: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/50.jpg)
![Page 51: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/51.jpg)
SCA guidancehttp://sca.jiscinvolve.org/wp/audience-publications/
Good overview
Step by step approach
Lots of sources of information:
Culture 24 Let’s Get Realhttp://weareculture24.org.uk/projects/action-research/
![Page 52: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/52.jpg)
What tools are there for gathering data?
![Page 53: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/53.jpg)
Data gathering tools
• Qualitative: focus groups, “free text”
questions in surveys, interviews
• Quantitative: web statistics, “multiple
choice” questions in surveys, visitor
tracking
• Observational: user testing, ethnographic
![Page 57: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/57.jpg)
Web stats: Focus on trends rather than absolute values
![Page 58: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/58.jpg)
Be clear about purpose:
Diagnostics
– making a project or service better
Reporting
– to funders, or for advocacy
![Page 59: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/59.jpg)
When to do what
User testing
- beta version and fully working version
Online questionnaires
– current version, new version
Focus groups
- concept testing near beginning of
project, or at redevelopment stage
![Page 60: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/60.jpg)
Visitor surveys
- compare online and real visits
Web stats
- long term trends, events, journeys
![Page 61: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/61.jpg)
Activity:
Planning an audience research project
![Page 62: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/62.jpg)
Trimptonshire Archives is a small local authority record office.
A small number of items across various collections have been digitised on an ad hoc basis and some have been available online for just over a year. There is a searchable online catalogue.
As part of a funding bid, target audiences identified were:
• Schools
• Higher Education courses
• Specialists
• Interested individuals
• Family researchers
Online Audiences workshop activity
![Page 63: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/63.jpg)
Online Audiences workshop activity
Overall aim: improve online provision for users
Suggested objective for this research: assess user satisfaction of current website and identify options for improvement
Activity – small groups
Decide on a project manager (surname first in alphabet).
They moderate discussion, and also present research approach at the end.
Refine research objectives, identify info you need and choose data-collection methods.
Agree an audience research plan
![Page 64: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/64.jpg)
Data gathering activity Staff time (days)
Timescale (weeks)
Costs
(£)
Online survey (in-house) 6 8 200
Online survey (consultant) 2 8 800
Phone survey (in-house) 6 3 200
Phone survey (consultant) 3 3 1200
Focus groups (in-house) 7 5 200
Focus groups (consultant) 2 5 1500
Web analytics (consultant) 1 2 500
User testing (in-house) 4 3 200
User testing (consultant) 1 3 900
Analysis (in-house) 5 2 0
Analysis (consultant) 2 2 1200
Not more than: 15 days 16 weeks £4500
(These are not real values, and anyway are highly variable.)
Don’t spend too long on the figures – focus on the rationale for using each data collection method, and overall objectives.
Remember to consider what you will actually do with the data once you have it.
![Page 65: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/65.jpg)
Online questionnaires
(+) once set up they gather numerical and qualitative data with no further effort –given time can build up large datasets
(+) the datasets can be easily exported and manipulated, can be sampled at various times, and structured queries can yield useful results
(–) respondents are self-selected and this will skew results – best to compare with similar data from other sources, like visitor surveys
(–) the number and nature of responses may depend on how the online questionnaire is displayed and promoted on the website
![Page 66: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/66.jpg)
Focus groups
(+) can explore specific issues in more depth, yielding rich feedback
(+) possible to control participant composition to ensure representative
(–) comparatively time-consuming (expensive) to organise and analyse
(–) yield qualitative data only - small numbers mean numerical comparisons are unreliable
![Page 67: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/67.jpg)
Visitor surveys
(+) possible to control participant composition to ensure representative
(–) comparatively time-consuming (expensive) to organise and analyse
(–) responses can be affected by various factors including interviewer, weather on the day, day of the week, etc, reducing validity of numerical comparisons between museums
![Page 68: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/68.jpg)
Web stats
(+) Easy to gather data – can decide what to do with it later
(+) Person-independent data generated - it is the interpretation, rather than the data themselves, which is subjective. This means others can review the same data and verify or amend initial conclusions reached
![Page 69: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/69.jpg)
Web stats
(–) Different systems generate different data for the same web activity – for example no of unique visits measured via Google Analytics is generally lower than that derived via server log files
(–) Metrics are complicated and require specialist knowledge to appreciate them fully
![Page 70: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/70.jpg)
Web stats
(–) As the amount of off-website web activity increases (e.g. Web 2.0 style interactions) the validity of website stats decreases, especially for reporting purposes, but also for diagnostics
(–) Agreeing a common format for presentation of data and analysis requires collaborative working to be meaningful
![Page 71: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/71.jpg)
When to evaluate or test and why
• Before funding approval – project planning
• Post-funding - project development
• Post-project – summative evaluation
![Page 72: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/72.jpg)
Testing is an iterative process
Testing isn’t something you do once
Make something
=> test it
=> refine it
=> test it again
![Page 73: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/73.jpg)
Before funding – project planning
• *Evaluation of other websites
– Who for? What for? How use it? etc
– awareness raising: issues, opportunities
– contributes to market research
– possible elements, graphic feel etc
• *Concept testing
– check idea makes sense with audience
– reshape project based on user feedbackFocus group
Research
![Page 74: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/74.jpg)
![Page 75: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/75.jpg)
Post-funding - project development
• *Concept testing
– refine project outcomes based on
feedback from intended users
• Refine website structure
– does it work for users?
• *Evaluate initial look and feel
– graphics,navigation etc
Focus group
Focus group
One-to-one tasks
![Page 76: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/76.jpg)
![Page 77: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/77.jpg)
![Page 78: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/78.jpg)
Card sorting - get various people to try out the
website structure before you build it
![Page 79: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/79.jpg)
![Page 80: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/80.jpg)
Post-funding - project development 2
• *Full evaluation of a draft working
version
– usability AND content: do activities work, how
engaging is it, what else could be offered, etc
Observation of actual use of website
by intended users,
using it for intended purpose,
in intended context – workplace, classroom, library, home, etc
![Page 81: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/81.jpg)
![Page 82: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/82.jpg)
![Page 83: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/83.jpg)
![Page 84: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/84.jpg)
![Page 85: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/85.jpg)
![Page 86: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/86.jpg)
![Page 87: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/87.jpg)
Post-funding - project development 3
• Acceptance testing of ‘finished’ website
– last minute check, minor corrections only
– often offered by web developers
• Summative evaluation
– report for funders, etc
– learn lessons at project level for next time
![Page 88: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/88.jpg)
Website evaluation and testing
Need to think ahead a bit:
– what are you trying to find out?
– how do you intend to test it?
– why? what will do you do as a result?
The Why? should drive this process
![Page 89: Martin bazley evaluating digital learning resources leicester reduced for uploading](https://reader031.vdocument.in/reader031/viewer/2022022205/58d0f85b1a28abc00b8b586f/html5/thumbnails/89.jpg)
Happy to help - phone number on site:
Martin Bazley
0780 3580 737
www.martinbazley.com
More information / advice /
ideas