learning 20 post mortem

44
Learning 2.0 Post-Mortem Abigail Elder Martha Flotten Mike Larsen June 4, 2008

Upload: abigail-librarian

Post on 19-May-2015

2.533 views

Category:

Technology


1 download

DESCRIPTION

An analysis of the Learning 2.0 program at Multnomah County Library, 2008. This powerpoint was created by Mike Larsen, Learning Systems Manager.

TRANSCRIPT

Page 1: Learning 20 Post Mortem

Learning 2.0 Post-Mortem

Abigail Elder

Martha Flotten

Mike Larsen

June 4, 2008

Page 2: Learning 20 Post Mortem

2

Performance vs. Goals

Program Objective #1: Create a safe and encouraging environment

for staff to explore web 2.0 technologies

Objective Achieved: 78% of eligible employees participated

Page 3: Learning 20 Post Mortem

3

Performance vs. Goals

Program Objective #2: Provide staff with tools to support MCL

Mission (diverse opportunities to read, learn, connect)

Objective Achieved: 2.0 tools (blogs, wikis, online docs, etc.)

already being used to help patrons

Page 4: Learning 20 Post Mortem

4

Performance vs. Goals

Program Objective #3: Prepare staff to meet public expectations

regarding technical competency with web 2.0 tools

Objective Achieved: Increased staff comfort level with web 2.0

technologies (74% “Yes”)

Page 5: Learning 20 Post Mortem

5

Performance vs. Goals

Program Objective #4: Reward staff for initiative in completing self-

discovery exercises

Objective Achieved: 172 flash drives and

66 MP3 players distributed

Page 6: Learning 20 Post Mortem

Ruth Allen, Donald Allgeier, Kassten Alonso, Rachel Altmann, Scott Anderson, Gloria Anger, Diana Armstrong, Carolyn Baer, Margaret Bagg, Renee Bashor, Shandra Bauer, Adam Bentley, Francie Berg, Nicole Bilyeu, Nancy Booher, Carey Boucher, Erika Bury, Mary Bush, Donna Cain, Cathy Camper, Lisa Canavan, Lee Catalano, Sharon Chalem, Kitty Chartier, Lori Chester, John Church, Wendy Clark, Jacob Coleman, Jason Colomby, Paul Connelly, Michelle Conrad, Michael Constan, Vickie Costello, William Coutant, Ben Craig, Constance Cramer, Chris Cuttone, Kristine Dale, Mary Davis, Emily-Jane Dawson, May Dea, Troy Deal, Jane Denunzio, Gail Des Granges, Sean Dixon, Jan Durant, Luci Dorocher, Karen Eichler, Dulsanna Eliason, Terri Elledge, Stephen Ellis, Angie Fisher, Helen Flack-Jacobs, Betsy Fontenot, Peter Ford, Natasha Forrester, Jennifer Fort, Mark Foster, Felicia Fulks, Alan Gabriell, Carolyn Garcia, Lee Garfiield, Beverly Gilbertson, Thia Gilpin, Deborah Gitlitz, Daryl Hardin, Peter Harrington, Ann Harrison, Kari Hauge, Leslie Hemstreet, Ken Hoesch, Heidi Hoogstra, Ross Huffmann-Kerr, Ross Betzer, Tara Hughes, Haley Isleib, Chris Jakel, Shelly Jarman, David Jensen, Alicia Jimenez, Nick Kalastro, Alison Kastner, Arlene Keller, John Keller, Katrina Kendrix, Sharon Kerns, Michael Kindley, Amy Know, Ann Knutson, Shannon Kraft, Bill Kramer, Nina Kramer, Aaron Kyle, Erin Lakin, Susan Larimer, Angie Larson, Marty Leisure, Jorden Leonard, Colleen Lester, Larry Lillvik, Vida Lohnes, Laura Lonac, Shanon Long, Stephan Mahoney, Darcee Maloney, Moira McAuliffe, Shauna McKain-Storey, Sarah Mead, Andrea Milano, Joanna Milner, Carson Mischel, Kristopher Newburg, Kiri Nielsen, Sean O’Brien, Katie O’Hara, Hesther O’Neill, Victoria Oglesbee, Gail Parker, Jackie Partch, Nicoal Price, Patrick Provant, Sinead Pullen, Sam Pumpelly, Lin Rainier, Larry Randall, Beth Read, Rod Richards, Cyndi Rosene, Steve Roskoski, Terry Roskoski, Rebecca Roth, Elizabeth Roghery, Jennifer Ryan, Susan Scharbach, Heidi Schaub, Lorna Schilling, Denise Schmitt, Sharon Schriver, Kristen Schroeder, Baron Schuyler, Kate Schwab, Tiffany Scott, Arden Shelton, Rachael Short, Carol Silva, Dale Smith, Arlen Snyder, Carolyn Sparling, Kate Swabey Grant Swanson, Maryanne Tarter, David Townsend, Anne Tran, Carol Uhte, John Vassallo, Daniel Wade, Becky Warren, Catherine Watanabe, Shane Wavra, Daphne Weiner, Jere White, Larry Will, Desiree Wolcott-Cushman, Keli Yeats, Eugene Lam, Maria Lowe, Lynda Pumpelly, Kristen Schlafer, Pauline Baughman, Eric Gregory, Laura Tyger = 172 total staff members!

Program Participation

How Many?How Many? Who?Who? How Much?How Much? Why / Why Not?Why / Why Not? Where?Where? Enough Time?Enough Time?

People Who Completed the Learning 2.0 Activities

Page 7: Learning 20 Post Mortem

7

Learning 2.0 Program Participation

257 employees made at least one blog entry, but did not

complete the activities (47%)

172 employees completed all eleven

learning activities (31%)

124 employees did not make any blog

entries (22%)

553 total employees at project start date, January 8, 2008

Page 8: Learning 20 Post Mortem

8

Reasons for Not Participating

Data from Survey.

Only 22% of employees (19% of survey respondents) did not participate.

6%

24%

68%

2% Did not apply to job

Didn't want to

Couldn't find time

Supervisor didn'tgive time

Page 9: Learning 20 Post Mortem

9

Motivation: The Role of “Tech Tools”

Huge7%

Some48%

None45%

Q: How big a role

did the possibility of

receiving one of the

tech tools play in

your decision to

participate in the

Learning 2.0

Program?

Page 10: Learning 20 Post Mortem

10

Completion: How Far Did People Get?

185 people (42%) made 11 or more blog entries

(172 completed program)

33 people (8%) made8, 9, or 10 blog entries

55 people (13%) made5. 6. or 7 blog entries

93 people (22%) made2, 3, or 4 blog entries

63 people (15% of participants) madeonly 1 blog entry

as of 3/29/2008

Page 11: Learning 20 Post Mortem

11

Reasons for Not Completing

19%

81%

0%

Lost interest

No time

Supervisordidn't give time

Data from Survey.

Only 38% of survey respondents did not complete.

No respondents indicated supervisor as a reason for not completing.

Page 12: Learning 20 Post Mortem

12

Did we allow them enough time?

Time Allowed vs. Time Needed

36%

26%

26%

5%24%

44%

26%

3%

6%

1%

As much as needed

Up to 90 min./week

About 60 min./week

About 30 min./week

Less than 30 min./week

Time Needed (outer ring)

TimeAllowed

(inner ring)

Page 13: Learning 20 Post Mortem

13

L2.0 Program Completion by Location

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

ADM ALB BEL CAP FRV GRH GSM HLS HGT HWD MID NPO NWL ROC STJ SEL WOD CEN

Page 14: Learning 20 Post Mortem

14

Completion vs. Participation (by Location)

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

ADM ALB BEL CAP FRV GRH GSM HGT HLS HWD MID NPO NWL ROC SEL STJ WOD CEN

completed participated

Page 15: Learning 20 Post Mortem

Project Planning & Execution

Plans we made How they worked out

Page 16: Learning 20 Post Mortem

16

Project Management / Planning

Planned Committee Committee made up of IT rep, plus seven staff

members representing different classifications, locations, work groups, and skill levels

Nominated by Supervisors, selected by Martha, Mike, Abigail, and Vailey

Actual Committee As envisioned, expanded to eight for extra inclusion

Lesson: Should have included a Branch Leader

Page 17: Learning 20 Post Mortem

17

General Outline of Project Plan

Follow PLCMC model, adapt it for MCL Investigate web tools; choose best for us Decisions by consensus whenever possible

Used blog & wiki to develop program content Each member given primary

responsibility for a “week” of thematically linked activities

Subcommittees for program communication, resources/personnel, implementation, and incentives Result: Positive

Page 18: Learning 20 Post Mortem

18

Schedule / Timeline

Planned Timeline: Initial plan was to begin on Staff Day (end of

Feb) and conclude by June 1st

Actual Timeline: Program ran Jan 8 – March 29, “winners”

announced at Staff Day

(ahead of original schedule)

Jan Feb Mar Apr May Jun

Page 19: Learning 20 Post Mortem

19

Budget

Planned Budget: Committee time (development) up to 3hrs./mo. X 8 mo.

Staff time (for participation) up to 90min./wk x 12 weeks

Friends of the Library purchase “incentives” for staff

Actual Budget Result: Committee time averaged approximately 2 hrs/mo.

Staff participation time avg. __ (< 90 min planned)

Friends of the Library donated $5000 for “tech tools” 68 unused flash drives returned for sale in the store at CEN.

Page 20: Learning 20 Post Mortem

20

Marketing / Communications

Both 2.0 and traditional methods used: AA memos and e-mails Animoto and Molly’s YouTube

videos Presentations to managers & work groups Update emails highlighting Blog of the Week “Word of mouth” through network of Guides Project Blog FAQ Comments on participants’ blogs

Result: Positive

Page 21: Learning 20 Post Mortem

21

Planned Learning Support

Initial Model All support delivered through online resources; self-

directed learning activities

As Modified for MCL (Additional Support) Recruited and trained Learning Guides for onsite,

in-person assistance

Scheduled dedicated computer lab sessions

February Reference Forum

Weekly e-mail updates

Page 22: Learning 20 Post Mortem

22

Participant Feedback on Support

Did participants get the help they needed?

No18%

Yes 82%

2%

43%

48%

6% 1%from supervisor

from lead worker

from L2.0 Guides

from coworker

from someoneelse

Page 23: Learning 20 Post Mortem

23

Supervisor Opinion of Support

Did supervisors

feel supported

by the Learning

2.0 Committee?

Page 24: Learning 20 Post Mortem

24

IT Support

Planned IT Rep on Committee Head off or fix problems before “go live”

Planned 2 week test period Use Roller as in-house blogging platform

Minimal involvement because activities based on free online resources

Actual No test period. Program blog not ready until January 7,

one day before “go live” date

Initial problems with Roller usability, video players, help desk communications, server downtime

Page 25: Learning 20 Post Mortem

Direct Impact of Program

How we’re using web 2.0 tools since the start of the Learning 2.0 program How we feel about Learning 2.0

Page 26: Learning 20 Post Mortem

26

L2.0 Tools Used to Help Patrons

19% of survey respondents do not interact with patrons. 36% have not used one of the Learning 2.0 tools to help a patron.

0%

5%

10%

15%

20%

25%

% o

f Res

pond

ents

Page 27: Learning 20 Post Mortem

27

Staff Non-Public Use of L2.0 Tools

Only 25% of staff have not yet used one of the Learning 2.0 tools

in some facet of their work duties other than helping patrons.

0%

10%

20%

30%

40%

50%

60%

Blogs

Wiki

s

Podca

sts

Online

Doc

s

Taggin

g, e

tc.

Photo

Sha

ring

RSS feed

s

Social

Net

works

Book-

relat

ed si

tes

Lang

uage

site

s

“Fun

” res

ourc

es

Other

tools

% o

f R

es

po

nd

en

ts

Page 28: Learning 20 Post Mortem

28

Usage Comparison: Public vs. Internal

Greater staff internal usage for all Learning 2.0 tools

0%

10%

20%

30%

40%

50%

60%

% o

f R

esp

on

de

nts

to Help Patrons Staff Internal Use

Page 29: Learning 20 Post Mortem

29

Work Group Implementation of L2.0 Tools

75% of supervisors either have already implemented, or have plans to implement the usage of 2.0 tools for their workgroups!

graph from supervisor survey data

Page 30: Learning 20 Post Mortem

30

Examples of 2.0 In Use at MCL

Everybody Reads Blog Fairview Branch Wiki PELIC Wiki Ref Blog More Coming Soon!

Page 31: Learning 20 Post Mortem

31

Supervisor Opinion of L2.0 Program

Supervisors who feel the Learning 2.0 program was worth the time and effort

Page 32: Learning 20 Post Mortem

Key Lessons

Page 33: Learning 20 Post Mortem

33

What Went Right

Learning Guides Opportunity for fun & break from routine Bringing people together “Blog of the Week” helped encourage

participation Walked the talk (used 2.0 tools to develop and

deliver program content) “Opt out” (where applied) Library work still got done

Page 34: Learning 20 Post Mortem

34

Lessons Learned

The value of social engagement!Open labs not usedRoller problematicalConnectivity/PC configuration issuesPrivacy concerns persistPeople don’t read instructionsSchedule most applicable activities first

Page 35: Learning 20 Post Mortem

Where do we go from here?

Page 36: Learning 20 Post Mortem

36

Supervisor Support

Do supervisors support future training on the same delivery model as the Learning 2.0 program?

Page 37: Learning 20 Post Mortem

37

Survey Says…

Skills/tools employees want to see in a future program

Page 38: Learning 20 Post Mortem

38

Recommendations: #1

Implement Learning 2.1-- a program for continued learning of new technologiesA new activity/tool each month

Posted to a new central blog, similar to Learning 2.0

Rotate responsibility for posting (between Mike/Martha/Abigail/others?)

Highlight what other libraries are doing

Participation optional

Page 39: Learning 20 Post Mortem

39

Recommendations: #2

Centralize system-wide 2.0 tools Avoid duplication of initiatives

List MCL blogs, wikis, etc., in one place (like Hennepin’s extranet)

Consolidate & standardize tools (e.g. Roller is shared, “official” blogging platform)

Especially need standardized wiki platform

Provide list of people to be contacted for info on specific 2.0 tools.

Page 40: Learning 20 Post Mortem

40

Recommendations: #3

Implications for future e-learning programs2.0 tools are here to stay; usage will

continue to growStaff will require training as tools &

technologies are developed and gain widespread use and acceptance

Self-paced online e-learning a valuable and necessary, but not a sufficient means of delivering training for most employees

Page 41: Learning 20 Post Mortem

41

Recommendations: #4

Serve as a resource for other county departments and work groups interested in similar training programs or in using web 2.0 tools.Point of contact: MCL Learning Systems

Page 42: Learning 20 Post Mortem

42

Recommendations: #5

Highlight applicable 2.0 tools on new public blog

Page 43: Learning 20 Post Mortem

43

Recommendations: #6

Require/encourage newbies to complete Learning 2.0 activitiesReference staff

Technohost volunteers

Page 44: Learning 20 Post Mortem

Questions & Comments