what do we want to know: completing an action-oriented...

18
What do we want to know: Completing an Action-Oriented Research Agenda Lynn Silipigni Connaway, PhD, OCLC Research Alan Carbery, Champlain College

Upload: others

Post on 19-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

What do we want to know: Completing an Action-Oriented Research

Agenda

Lynn Silipigni Connaway, PhD, OCLC Research

Alan Carbery, Champlain College

Page 2: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

The Value of Academic Libraries

• ACRL Goal-area committee

– Part of association’s Plan for Excellence

• Goal: Academic libraries demonstrate alignment with & impact on institutional outcomes

– Promote impact & value of academic & research libraries to higher education community

Page 3: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

What’s come before…

2010 – The Value of Academic Libraries: A comprehensive research review and report published, written by Megan Oakleaf for ACRL.

• Review of quantitative & qualitative

literature, methodologies & best practices for demonstrating value of academic libraries

Page 4: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

Followed by 2012 whitepaper, Connect, collaborate, and communicate: a report from the Value of Academic Libraries Summits by Karen Brown & Kara Malenfant

• Introduced 5 recommendations for Academic Librarians to help demonstrate value of libraries

In 2015, the VAL committee conducted gap analysis of work based on recommendations of 2010 Value report & 2012 Summit whitepaper

Page 5: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

Research Agenda

• The Value of Academic Libraries Committee recommended that ACRL seek a consultant to lead a research agenda development process with the assistance of a committee with members from the VAL Committee as well as other ACRL individuals and representatives from interested groups/sections/committees

Page 6: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

Research Agenda

• Spring 2016 – call for proposal for research & delivery of a new ACRL “Action-Oriented Research Agenda on Library Contributions to Student Learning and Success” – Provides update on progress since 2010 publication of

Value of Academic Libraries Report

– Examines important questions calling for more research in areas critical to higher education sector

– Focuses on institutional priorities for improved student learning & success (i.e., retention, persistence, degree completion)

Page 7: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

Timeline

• June/July 2016

– Review of proposals

• August 2016

– Award of contract to OCLC Research project team

• Spring 2017

– Research Agenda publication completed

Page 8: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

Along the way

• VAL Committee & OCLC Research project team to engage community in updates & progress at various stages throughout the next 6-9 months

– Including today!

Page 9: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

PROGRESS TO DATE

Page 10: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

Research process

Overview current literature

Collect and analyze interview data

Facilitate further research via RQs and visualization tool

Page 11: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

Initial codebook development Higher education

trend

Trend defined Example of library

responses to trend

Learning in college

(and beyond)

Less objective concepts of

learning. Usually not tied to

a specific graded

assignment or graduation.

Space: Collaborative

working space for students

Research support Outcome tied to research

outside of a class.

Service: Teach data

management

Teaching support Outcome viewed from an

instructor perspective and

deals with a specific course.

Collection: Online

repository of syllabi

Response to Students

Response to Students/Faculty

Response to Faculty

Page 12: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

Content analysis of literature

Literature Reviewed • N=194 documents from LIS and Higher Ed. databases

• 2010-present, US-centric • NVivo and Excel for

analysis • 100% agreement on

coding schemes among three raters

Other study n=60

Key thematic n=53

Other thematic n=43

Key study n=38

Page 13: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning
Page 14: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Accreditation

Inclusivity/Diversity

Provision of tech

Communication

Teaching support

Space

Collaboration

Collection

Research support

Success in college

Assessment

Learning in college

Service

Percent difference between thematic codes by reading type

Thematic (%) (n=96) Studies (%) (n=98)

Page 15: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

'10 (%) '11 (%) '12 (%) '13 (%) '14 (%) '15 (%) '16 (%) Sparkline

Accreditation 24 21 7 17 9 18 11

Assessment 52 53 50 43 38 51 44

Collaboration 38 26 37 33 56 64 50

Communication 33 32 20 37 26 36 33

Inclusivity/Diversity 38 16 17 20 18 28 44

Learning in college 43 53 30 40 47 59 61

Provision of tech 33 26 33 33 35 31 22

Research support 43 47 53 60 47 44 28

Success in college 52 32 40 63 35 74 67

Teaching support 24 32 30 50 35 38 61

Collection 43 53 67 60 44 26 44

Service 76 84 73 80 71 56 56

Space 43 16 47 47 35 46 44

Table 2. Thematic coding changes over time

Page 16: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

0 20 40 60 80 100 120

Accreditation

Inclusivity/Diversity

Communication

Provision of tech

Assessment

Teaching support

Space

Learning in college

Collaboration

Research support

Collection

Success in college

Service

Number of studies by study methods

Quant Qual Mixed

Page 17: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

Discussion

• Librarians not focusing on same thematic topics as higher ed. administrators

• Provision of technology and communication are two promising themes

• Minimal amount of empirical methods associated with assessment and communication

• Minimal use of mixed methods • BUT… Librarians have identified many topical higher

ed. themes

Page 18: What do we want to know: Completing an Action-Oriented ...old.libraryassessment.org/bm~doc/connaway-what-do-we-want-to-kn… · Agenda on Library Contributions to Student Learning

Questions & Discussion

Lynn Silipigni Connaway, PhD, OCLC Research

Alan Carbery, Champlain College