evidence-based librarianship for all
DESCRIPTION
Slides from a workshop held at the Ontario Library Association Super Conference in Toronto, January 29, 2014TRANSCRIPT
![Page 1: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/1.jpg)
EBLIP for all: Using an evidence based approach in your library
Lorie Kloda McGill University
![Page 2: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/2.jpg)
Introductions
1. Your name 2. Your city, insDtuDon
![Page 3: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/3.jpg)
Course objectives
• introduce the process of eblip • demonstrate tools and strategies for applying evidence in pracDce in the real-‐world
• parDcipants will: o learn strategies to incorporate different types of evidence into their decision making
o have opportuniDes to work through their own pracDce quesDons and determine an approach to take back to their workplace
![Page 4: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/4.jpg)
What we will cover today
9:00 IntroducDons and overview
9:15 The EBLIP process
9:30 FormulaDng quesDons
10:15 Break
10:30 Sources of evidence
11:00 CriDcal appraisal
11:40 Applying evidence in pracDce
11:50 Wrap up
![Page 5: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/5.jpg)
AcDvity 1
what are your "burning" quesDons?
![Page 6: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/6.jpg)
The EBLIP Process
![Page 7: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/7.jpg)
What is EBLIP?
“an approach to informaDon science that promotes the collecDon, interpretaDon and integraDon of valid, important and applicable user-‐reported, librarian observed, and research-‐derived evidence. The best available evidence, moderated by user needs and preferences, is applied to improve the quality of professional judgements”
(Booth, 2000)
![Page 8: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/8.jpg)
Why should you care?
Wisdom means acDng with knowledge while doubDng what you know.
Jeffrey Pfeffer and Robert I. Su^on
![Page 9: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/9.jpg)
A brief history
1997 Hypothesis arDcle by Jon Eldredge 2000 MLA Research SecDon created an Evidence-‐Based Librarianship ImplementaDon Commi^ee
2000 Eldredge publishes papers that provide the framework for EBL
2001 First Evidence Based Librarianship conference held in Sheffield, UK
2004 Booth and Brice book on EBIP 2006 EBLIP journal launches
![Page 10: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/10.jpg)
The 5 A's of EBLIP
1) Formulate a focused quesDon (Ask) 2) Find the best evidence to help answer that quesDon (Acquire) 3) CriDcally appraise what you have found to ensure the quality of the evidence (Appraise) 4) Apply what you have learned to your pracDce (Apply) 5) Evaluate your performance (Assess)
![Page 11: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/11.jpg)
5 A's process
Hayward, 2007, http://www.cche.net/info.asp
![Page 12: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/12.jpg)
Is the EBLIP model used?
• The ideal vs reality • CriDcisms of EBLIP
• Barriers to pracDcing in an evidence based manner
![Page 13: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/13.jpg)
Barriers to evidence use
• OrganizaDonal dynamics
• Lack of Dme/compeDng demands on Dme
• Personal outlook / lack of confidence • EducaDon and training gaps • InformaDon needs not being met
• Financial limits
![Page 14: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/14.jpg)
Determinants by level of control
![Page 15: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/15.jpg)
FormulaDng an answerable quesDon
Ask
![Page 16: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/16.jpg)
Ques+ons drive the en+re EBL process.
[…] The wording and content of the ques+ons will determine what kinds of research designs are needed
to secure answers.
(J. Eldredge, 2000)
![Page 17: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/17.jpg)
Burning question example
What do university professors think of informaDon literacy
instrucDon?
![Page 18: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/18.jpg)
SPICE question structure Se6ng the context (e.g., university library, academic
health center, K-‐12 school)
Perspec<ve the stakeholder(s) (e.g., graduate students, managers, reference librarians, parents, teachers)
Interven<on the service being offered (e.g., chat reference, RefWorks workshops, discovery layer)
Comparison the service to which it is being compared (opDonal)
Evalua<on the measure used to determine change/success/impact (e.g., usage staDsDcs, course grade)
![Page 19: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/19.jpg)
SPICE example Se6ng Research university
Perspec<ve Librarians Professors
Interven<on Survey quesDonnaire to determine ahtudes, percepDons, experiences
Comparison Not applicable
Evalua<on RaDngs of informaDon literacy competencies Inclusion of IL in courses Disciplinary differences
![Page 20: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/20.jpg)
Librarianship domains Reference/Enquiries—providing service and access to informaDon that meets the
needs of library users. Educa<on— IncorporaDng teaching methods and strategies to educate users about
library resources and how to improve research skills. LIS Educa+on subset – Specifically pertaining to the professional educaDon of librarians.
Collec<ons—Building a high-‐quality collecDon of print and electronic materials that is useful, cost-‐effecDve and meets the users’ needs.
Management—managing people and resources within an organizaDon. This includes markeDng and promoDon as well as human resources.
Informa<on access and retrieval—creaDng be^er systems and methods for informaDon retrieval and access.
Professional Issues—exploring issues that affect librarians as a profession. (Koufogiannakis, Crumley, and Slater, 2004)
![Page 21: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/21.jpg)
Librarianship domains
• InformaDon access & retrieval • CollecDons • Management • EducaDon • Reference • Professional issues • [Scholarly communicaDons]
![Page 22: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/22.jpg)
AcDvity 3
formulate your burning quesDon using SPICE
![Page 23: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/23.jpg)
What counts as evidence?
![Page 24: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/24.jpg)
Definition
“the available body of facts or informa+on indica+ng whether a belief or proposi+on is
true or valid”
(Oxford English DicDonary, 2011).
![Page 25: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/25.jpg)
AcDvity 4
What are some possible evidence sources we use to make
decisions libraries?
![Page 26: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/26.jpg)
Evidence Sources Hard evidence SoK evidence
Published literature Input from colleagues
StaDsDcs Tacit knowledge
Local research and evaluaDon Feedback from users
Other documents Anecdotal evidence
Facts
![Page 27: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/27.jpg)
Sources for locaDng and creaDng evidence
Acquire
![Page 28: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/28.jpg)
Loca<ng
Published research
• Databases • Books, bibliographies • Mail lists, blogs, word
of mouth • Conferences • SystemaDc reviews,
Evidence summaries
![Page 29: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/29.jpg)
Crea<ng
Local evidence
• Usage data • TransacDon data • EvaluaDon results • Survey, interview,
focus group findings • Inputs, outputs,
outcomes, impact
![Page 30: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/30.jpg)
Locating published evidence
Databases • Library and informaDon studies • Management • EducaDon • Social sciences • Health sciences, psychology
![Page 31: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/31.jpg)
h^p://libvalue.cci.utk.edu/
h^p://www.informedlibrarian.com/
h^p://eprints.rclis.org/
![Page 32: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/32.jpg)
Locating published evidence
Conferences • EBLIP (1-‐7) • Assessment, e.g., Northumbria Conference,
Library Assessment Conference • Academic, e.g., ACRL • InformaDon literacy, e.g., LOEX, WILU, LILAC • LIS Research, e.g., ASIS&T, ALISE, CAIS, IIiX,
ISIC • Subject librarianship (health, music)
![Page 33: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/33.jpg)
Locating published evidence
SystemaDc reviews
h^p://lis-‐systemaDc-‐reviews.wikispaces.com
![Page 34: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/34.jpg)
Locating published evidence
Evidence summaries
h^p://ejournals.library.ualberta.ca/index.php/EBLIP
Evidence Based Library and Informa+on Prac+ce journal, 2006-‐
>250 evidence summaries
![Page 35: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/35.jpg)
Creating evidence
Data and findings • Usage data • TransacDon data • EvaluaDon results • Survey, interview, focus group findings
![Page 36: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/36.jpg)
Creating evidence
Sources for local evidence already available • Library assessment department • University planning and insDtuDonal analysis • Annual reports • Internal reports • "Stats"
![Page 37: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/37.jpg)
Creating evidence
Dudden, R. F. (2007). Using benchmarking, needs assessment, quality improvement, outcome measurement, and library standards. New York: Neal Schuman.
![Page 38: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/38.jpg)
Evidence for example
LocaDng evidence • Databases: LISA • SystemaDc Review Wiki • Journals: Communica+ons in IL, J of IL, J of
Academic Librarianship • Conferences: LILAC, LOEX, WILU • EBLIP Evidence Summary CreaDng evidence • survey quesDonnaire
![Page 39: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/39.jpg)
AcDvity 6
1. idenDfy 2-‐3 sources for locaDng evidence to answer your quesDon
2. consider 1 potenDal source of local
evidence to look into
![Page 40: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/40.jpg)
CriDcal appraisal
Appraise
![Page 41: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/41.jpg)
Critical appraisal
Weigh up the evidence • Reliable • Valid • Applicable Checklists help with criDcal appraisal process
Language is different for interpreDve (qualitaDve) research
![Page 42: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/42.jpg)
Reliability
1. Results clearly explained 2. Response rate 3. Useful analysis 4. appropriate analysis 5. Results address research quesDon(s) 6. LimitaDons 7. Conclusions based on actual results
![Page 43: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/43.jpg)
Validity
1. Focused issue/quesDon 2. Conflict of interest 3. Appropriate and replicable method 4. PopulaDon and representaDve sample 5. Validated instrument
![Page 44: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/44.jpg)
Applicability
1. ImplicaDons reported in original study 2. Applicability to other populaDons 3. More informaDon required
![Page 45: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/45.jpg)
CRiSTAL Checklist
For appraising research on user studies
Focuses on: • Study design • Results • Relevance Developed by Andrew Booth and Anne Brice. Available from: h^p://nehngtheevidence.pbworks.com/w/page/
11403006/CriDcal%20Appraisal%20Checklists
![Page 46: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/46.jpg)
AcDvity 7
criDcally appraise Bury study using the Cristal checklist
![Page 47: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/47.jpg)
Critical appraisal: the shortcut
![Page 48: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/48.jpg)
Other elements to consider when following the EBLIP
process
![Page 49: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/49.jpg)
Other considerations
• individual vs group decision making
• influences / biases • impact of work environment
![Page 50: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/50.jpg)
Widening the model
A revised process: 1. Ar+culate – come to an understanding of the problem and
arDculate it. 2. Assemble – assemble evidence from mulDple sources that are
most appropriate to the problem at hand. 3. Assess – place the evidence against all components of the
wider overarching problem. Assess the evidence for its quanDty and quality.
4. Agree – determine the best way forward and if working with a group, try to achieve consensus based on the evidence and organisaDonal goals.
5. Adapt –revisit goals and needs. Reflect on the success of the implementaDon.
![Page 51: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/51.jpg)
Bringing the components together
![Page 52: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/52.jpg)
Questions to ask yourself
![Page 53: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/53.jpg)
Applying evidence in pracDce
Apply
![Page 54: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/54.jpg)
Ways to apply evidence
1) The evidence is directly applicable
2) The evidence needs to be locally validated
3) The evidence improves understanding
ReflecDon
![Page 55: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/55.jpg)
AcDvity 8
ReflecDon on applying evidence to your pracDce quesDon
![Page 56: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/56.jpg)
Wrap up
Assess
![Page 57: Evidence-based Librarianship for All](https://reader034.vdocument.in/reader034/viewer/2022051210/54c682de4a7959a2128b4587/html5/thumbnails/57.jpg)
AcDvity 9
3 things you will take home and act upon