Upload File

lessons learned - ferris state university...lessons learned –part one •definite need to...

  • Home
  • Documents
  • Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost
22
Lessons Learned A mandatory tutorial for online learning prepares students to ‘hit the ground running’ Spencer Tower – Associate Professor – College of Business Deb Thalner – Executive Director Online Learning, Extended and International Operations Melissa Nuckles – Faculty/Advisor – College of Business & Extended and International Operations

Upload: others

Post on 25-Sep-2020

0 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Lessons Learned

A mandatory tutorial for

online learning prepares

students to ‘hit the

ground running’

Spencer Tower – Associate Professor – College of BusinessDeb Thalner – Executive Director Online Learning, Extended and International OperationsMelissa Nuckles – Faculty/Advisor – College of Business & Extended and International Operations

Page 2: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Impetus for Change2011 Survey of Online Faculty

• Student Capabilities– Require an orientation before

students can begin an online course

81.8% agree/strongly agree.

– A student orientation should be standard across the university

78.5% agree/strongly agree.

• Policy created and approved by faculty senate, deans

296177

473 Online Faculty Surveyed

Faculty who responded37.4 % response rate

Page 3: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Pilot Development

• Requirements: Flexibility (waivers); not for credit; no cost to student, not too time consuming; do not hold up student progression.

– Within the LMS system, instructor facilitated, authentic assessments

– Inclusion of LMS specific skills most often used (uploading documents, discussion board use, etc).

– Inclusion of vendor-developed self assessment (life factors, technology, personal attributes, learning styles, reading skills, typing skills)

Page 4: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Pilot

Pilot Demographics812 students asked to participate –178 participated

11563

Participated in pilot (21.9%)

Participated in pilot and respondedto survey (35.4% of participants)

Declined to participate

• 18 – 24 years old (56%)

• Female (67%)

• Seniors (34.8%) and Freshman (24.7%)

• 3.5-4.0 gpa (45%)

Post Pilot Survey Demographics

• 65% had at least one prior online course

Page 5: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Pilot Survey Findings

What to include?

• All sections considered somewhat to very helpful

• Sections considered ‘very important’ to include:– Discussion boards (75%)

– Uploading attachments (66%)

– Grades area (56%)

• Some sections not included due to limited audiences (journaling, etc)

Student Feedback

87.30%

12.70%

Is an orientation needed for students who have not had an

online course?

yes

no

Page 6: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Lessons Learned – Part One

• Definite need to implement an orientation for the campus• Issues:

– Cost of faculty facilitation– Cost of vendor-provided self-assessment– Technical issues with LMS use

• Integration of student information system and LMS would require a manual registration process

• Adding/Purging of student data• “Grading” and completion status• Students needed tutorial to get into LMS

– Interest in use of orientation for non-students

Change from Pilot: web-based program, self-paced tutorial with quiz, free self-assessment

Page 7: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

What Does It Look Like Now?

• Self-paced tutorial– Web-based– Use of LMS-designed videos/help (ondemand.blackboard.com)– Some videos / captivate videos created at Ferris (point and click

interaction)– Multiple choice test at completion - 7/10 is passing– ~ one hour to complete tutorial

• Online course sections – Readiness ‘test score’ is a pre-requisite

• Completion is manually entered into Banner as a ‘test score’• Ability to Opt Out:

– Departments/faculty choice– Student waiver

Page 8: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

The Launch

• Lots of communication on the change– emails, targeted portal announcements, articles, etc.

• Summer 2013 first ‘live’ semester

• WHOOPS– Not all students ‘caught’ by pre-requisite

– Class sections had students who• Completed waiver

• Completed tutorial

• Did not do either

– Great time for a survey!

Page 9: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey of Summer 2013 Faculty

38

70

Online Faculty Surveyed

responded (35%)

did not respond

Page 10: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey of Summer 2013 Faculty

02468

1012141618

LessSkilled

Same MoreSkilled

Overall Comparison to Prior Year

Overall

Page 11: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey Results – Up Close: t-Tests

• Tutorial vs. Waiver vs. Neither

– Mean skill level of students in each group

– using composite variables Cronbach’s alpha >=.90

• Neither (2.37)

• Tutorial (2.73)

• Waiver (2.66)

Neither vs. Tutorial: .000 significance

Page 12: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey Results – Up Close: t-Tests

• Tutorial vs. Waiver vs. Neither

– Mean skill level of students in each group

– using composite variables Cronbach’s alpha >=.90

• Neither (2.37)

• Tutorial (2.73)

• Waiver (2.66)

Neither vs. Tutorial: .000 significance

Neither vs. Waiver: .001 significance

Page 13: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey Results – Up Close: t-Tests

• Tutorial vs. Waiver vs. Neither

– Mean skill level of students in each group

– using composite variables Cronbach’s alpha >=.90

• Neither (2.37)

• Tutorial (2.73)

• Waiver (2.66)

Neither vs. Tutorial: .000 significance

Neither vs. Waiver: .001 significance

Tutorial vs. Waiver: .186 significance

Page 14: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey Results – Up Close: t-Tests

• Tutorial vs. Waiver vs. Neither

– Mean skill level of students in each group

– using composite variables Cronbach’s alpha >=.90

• Neither (2.37)

• Tutorial (2.73)

• Waiver (2.66)

Neither vs. Tutorial: .000 significance

Neither vs. Waiver: .001 significance

Tutorial vs. Waiver: .186 significance

Page 15: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey Results – Up Close

Comparing faculty ‘beneficial’ scores

Median split

Mean “Beneficial” Score

1 = not beneficial

4 = very beneficial

Orientation (=0)

Below Median

Orientation (=1)

Above Median

Waiver (= 0)

Below Median

Waiver (= 1)

Above Median

Page 16: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey Results – Up Close

Comparing faculty ‘beneficial’ scores

Median split

Mean “Beneficial” Score

1 = not beneficial

4 = very beneficial

Orientation (=0)

Below Median

Orientation (=1)

Above Median

Waiver (= 0)

Below Median 3.09 3.60Waiver (= 1)

Above Median 2.67 3.09

Page 17: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey Results – Up Close

Comparing faculty ‘beneficial’ scores

Median split

Mean “Beneficial” Score

1 = not beneficial

4 = very beneficial

Orientation (=0)

Below Median

Orientation (=1)

Above Median

Neither (= 0)

Below Median 3.71 3.40

Neither (= 1)

Above Median 2.75 3.10

Page 18: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey Results – Up Close

Comparing faculty ‘beneficial’ scores . . . .

1 to 4 scale

Page 19: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Survey Results – Up Close

Comparing faculty ‘beneficial’ scores

Median split

Mean “Beneficial” Score

1 = not beneficial

4 = very beneficial

Neither (=0)

Below Median

Neither (=1)

Above Median

Waiver (= 0)

Below Median 3.86 3.20

Waiver (= 1)

Above Median 3.25 2.89

Page 20: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Limitations

• Did not differentiate survey results – by course level

– by student level

– by instructor history

• Survey response rate

• Only one semester

• Results may be influenced by new LMS

• Difficult for faculty to differentiate within a group

• Recency bias in survey

Page 21: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Lessons Learned

• Faculty support critical• Build in flexibility to the process (waivers, departmental

flexibility)• Have a champion to keep it moving• Be willing to adapt• Spend time training staff• Over communicate• Include staff who understand Banner, Blackboard, IT• Designate time/resources

– Development– Ongoing changes– Ongoing test entry

Page 22: Lessons Learned - Ferris State University...Lessons Learned –Part One •Definite need to implement an orientation for the campus •Issues: –Cost of faculty facilitation –Cost

Questions?

• You can try our orientation as a guest at

• www.ferris.edu/online

• (you will not get the test as a guest)

Spence Tower [email protected] Thalner [email protected] Nuckles [email protected]

http://www.ferris.edu/online

Lessons Learned in Transit Efficiencies, Revenue Generation, and Cost Reductions

Software cost estimation and control : lessons learned COST ESTIMATION AND CONTROL ; LESSONS LEARNED 1 Introduction Dr.ir. Fred J. Heemstra Dr. Rob J. Kusters University …

LEARNED LESSONS:

Lessons Learned Globally - Campaign for Tobacco-Free Kids...Process lessons learned 2. Content lessons learned See next page for lists of these lessons learned. 7 | Lessons Learned

Lessons Learned Handbook · 2011-10-12 · • Lessons Learned, an adjective, describes anything related to a Lessons Learned procedure. E.g. Lessons Learned process, Lessons Learned

Lessons Learned:

Launch Vehicle Propulsion Life Cycle Cost Lessons Learned · Launch Vehicle Propulsion Life Cycle Cost Lessons Learned ... establl.hing JPl proJ-d total (ost and s(h4tdula bKau.a

Lessons learned from accident investigation Seminar/IHS - Day 2... · LESSONS LEARNED FROM OTHERS LESSONS LEARNED FROM UAE ... Lessons Learned . ... Dealing with survivors and bereaved

Lessons learned: Implementing a low-cost structure Health Information Exchange

Lessons Learned: Cloud Computing and Cost Savings - Leahy-Lessons Learned on...Lessons Learned: Cloud Computing and Cost Savings ... Depending on nature of agency different paths to

Launch Vehicle Propulsion Life Cycle Cost Lessons Learned · 2020. 8. 6. · Launch Vehicle Propulsion Life Cycle Cost Lessons Learned Edgar Zapata I and Russel E. Rhodes2 National

Developing a Community- Engaged Low-cost Air Monitoring ... · Limitations and Lessons Learned Limitations Lessons Learned Time commitment of ... • Strategies in building relationships

Lessons Learned

Aws cost optimization: lessons learned, strategies, tips and tools

1. FP7 : Lessons learned - APRE€¦ · 1. FP7 : Lessons learned 2. H2020: Model Grant Agreement 3. Cost Categories and Reporting Issues a. Personnel cost calculation b. Additional

Lessons Learned on Estimate Classifications - … Learned on Estimate... · Lessons Learned on Estimate Classifications ... capital cost estimators can work under ... problems with

Lower Cost Country Sourcing A Collection of Lessons Learned

TxDOT PPP Lessons Learned Draft - IBTTA · Lessons Learned Previous and Current Projects I-35 Corridor Advisory Committee Four I-35 Corridor Segment Committees Project Capital Cost*

Lessons learned

Leed Lessons Learned - US Department of Energy · PDF fileLEED Lessons Learned ... Design Elements with no cost added • 16 Points • LEED Version 2.2 ... • IEQ4.1, 4.2, 4.3&4.4

Lessons Learned and Lessons to Be Learned: Investment Law & … · 2014. 4. 30. · 1 Lessons Learned and Lessons to Be Learned: Investment Law & Development for Developed Countries

LESSONS LEARNED AND GOOD PRACTICES...Lessons Learned Lessons are learned for sharing and applying to similar projects. Project lessons are learned from experiences, both inspiring

Biomass Gasification CHP Pilot Project Lessons Learned...Pilot Project –Lessons Learned 27 Evaluate internal structure for suitability for research type project. Look for cost drivers

Lessons Learned 7. Other - Johns Hopkins Hospital...Lessons Learned 7. Other (cont) 2. Student health insurance cost element not including IDC. To remedy, save your budget, delete

Lessons Learned In Production Cost Management · Lessons Learned in Production Cost Management . ... Block Erection ... deferring a task like welding will require

Lessons Learned from “Lessons Learned” · 2 LESSONS LEARNED FROM “LESSONS LEARNED” 2. The NRC set safety goals in its Safety Goal Policy Statement, initiated not long after

Lessons Learned Events at SLAC · 2012-09-14 · Lessons Learned Events: Summary Comments . Important to identify and communicate lessons learned! Lessons learned and near misses