the proof is in the pudding: showing that learning ...the proof is in the pudding: showing that...

32
De Anza Research, Sept 21, 2006 1 The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening Day 2006 Andrew LaManque, Ph.D. De Anza Research Thanks to Marcy Betlach and Edwina Stoll

Upload: others

Post on 04-Oct-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 1

The Proof is in the Pudding: Showing that Learning Communities Work from

Five Years of Institutional Research

District Opening Day 2006

Andrew LaManque, Ph.D.De Anza Research

Thanks to Marcy Betlach and Edwina Stoll

Page 2: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 2

•Describe Learning Communities

•Discuss methodology

•Highlight findings

Agenda

Page 3: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 3

Definition of Learning Communities

A variety of approaches that link or clusterclasses during a given term around an interdisciplinary theme and enroll a common cohort of students. This represents an intentional restructuring of student’s time, credit and learning experiences to build community and to foster more explicit connections among students, among students and their teachers, and among disciplines.

Page 4: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 4

Types of Courses inLearning Communities

Foundational English or ESL Reading and Writing courses.Foundational English, ESL or Math courses with GE transfer-level courses.Foundational English or Math with College Success.GE transfer-level courses with other GE transfer-level courses.

Page 5: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 5

Effective Learning Communities

Give a sense of purpose.Help overcome the isolation of faculty members from one another and from their students.Encourage continuity and integration in the curriculum.

Page 6: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 6

Effective Learning Communities

Encourage faculty members to relate to one another both as specialists and as educators.Help build a sense of group identity, cohesion and “specialness.”

Page 7: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 7

Essential Characteristics of Learning Communities

The same students enroll in the same classes together.The academic work of each course’s subject matter is enhanced by interdisciplinary study in which students and faculty build connections between subject matters, disciplines and ideas.

Page 8: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 8

Essential Characteristics of Learning Communities

Courses are team-designed and team-taught.To facilitate inter-disciplinarity, the community focuses on a central theme.Multicultural thinking is encouraged and developed to promote inclusive perspectives.Collaborative learning and experiential learning methods are keystones of the pedagogy.

Page 9: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 9

Assess an important goal of the program:

To improve student learning by highlighting the connections between disciplines and interesting topics, thereby strengthening students’intellectual curiosity and experiences.

Research Question

Page 10: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 10

•Use grades as a proxy measure of student learning

•Should expect higher course success rates for Learning Communities students, on average, than those in comparable non-Learning Community courses, ceteris paribus

Methodology

Page 11: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 11

Methodology

•Student grades in learning community sections were compared with non-learning community sections of the same or related courses for that term

•Did not control for different class sizes

•Did not attempt to account for differences in classroom teaching; grading; motivation

Page 12: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 12

Methodology

•Grades grouped as: •Success - A, B, C, or P•Withdrawal - W •Non-Success - D, F, NP, I

•The grade percents were based on all the grades for the section, including W’s

Page 13: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 13

Whose Country Is This Anyway? 2002F LinC ESL 005.01D HIST017A01D Non-LinC ESL 005.REL HIST017AREL

LinC 236 84% 23 8% 23 8% 282 100%Non-LinC 3,288 66% 819 16% 869 17% 4,976 100%

# % # % # % # %Success Non-Success Withdrew Total

Methodology

Page 14: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 14

•Groups similar in terms of•Gender•Initial Goal•Where they live

•Differ in terms of•Age – LinC students are younger•Ethnicity – LinC students are more likely to be Asian (Vietnamese)

Demographics

Page 15: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 15

•In a typical quarter•more than 200 students •10 to 15 LinC sections•five or six “Learning Communities”

•2,635 students have participated in LinC courses over the last five years

Demographics

Page 16: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 16

Demographics

Unduplicated Count of Students Enrolled in LinC and NonLinC Sections by Age Group, 2002F-2006S

78%

22%

71%

29%

0%10%20%30%40%50%60%70%80%90%

100%

Less than 25 More than 25

For the 22 terms from 2000F-2006S, there were 2,635 students enrolled in at least one LinC section and 25,132 students in NonLinC related sections.

LinC NonLinC

Page 17: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 17

Demographics

Unduplicated Count of Students Enrolled in LinC and NonLinC Sections by Ethnicity, 2002F-2006S

6% 6%

16%8%7%

45%

4%

16%

4%

36%

14%

4%

13%23%

0%10%20%30%40%50%60%70%80%90%

100%

AfricanAmerican

Asian Filipino Hispanic Other White Unrecorded

For the 22 terms from 2000F-2006S, there were 2,635 students enrolled in at least one LinC section and 25,132 students in NonLinC related sections.

LinC NonLinC

Page 18: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 18

Demographics

Number of LinC Sections by EthnicityDe Anza College, 2000F-2006S

0%

20%

40%

60%

80%

100%

AfricanAmerican

Asian Filipino Hispanic Other Non-White

PacificIslander

White, Non-Hispanic

For the 22 terms from 2000F-2006S, there were 2,635 students enrolled in 4,523 LinC sections (including repeats). 59% of students enrolled in two ore more sections over the period.

2 + LinCs 1 LinC

Page 19: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 19

•Overall, the course success rates were higher for LinC than similar courses

•LinC course success rates appear to vary by curriculum content

Results

Page 20: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 20

Results

Students Success LinC and NonLinC SectionsDe Anza College, 2000F-2006S

84%

16%

76%

24%

0%10%20%30%40%50%60%70%80%90%

100%

Pass Did Not Pass

For the 22 terms from 2000F-2006S, there were 4,523 enrollments in LinC sections and 63,018 enrollments in NonLinC related sections (including repeats).Difference statistically significant using a 2x2 Chi Square.

LinC NonLinC

Page 21: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 21

Results

Mean Course GPA LinC and NonLinC SectionsDe Anza College, 2000F-2006S

2.662.36

0.000.50

1.001.502.00

2.503.00

3.504.00

LinC NonLinC

For the 22 terms from 2000F-2006S, there were 4,523 enrollments in LinC sections and 63,018 enrollments in NonLinC related sections (including repeats).Difference statistically significant at .05 using two tailed T test.

LinC NonLinC

Page 22: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 22

ResultsLinC Course Enrollments

De Anza College, 2000F-2006S

EWRT 1A, 310, 7%

ESL 72, 228, 5%

HIST 17A, 249, 6%

All Other Courses*,

1,240, 27%

LART100, 1,247, 28%

LART200, 777, 17%

ESL 5, 243, 5%

ESL 24, 229, 5%

* Other LinC courses include: ARTS001A, BUS 010, COUN057, COUN080X, ELIT039, ELIT 721, ELIT 173, EWRT100B, HIST17B, HIST17C, HUMA010, HUMA020, HUMA001, ICS 007, LART170, MATH010, MAH105, PHIL001, PSYC001, SOC 001, SPCH007, SPCH010

Page 23: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 23

Results - Example

Whose Country is this Anyway?Spring 2006

Page 24: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 24

Results - Example

Love and Heroes: Looking at Social Issues in AmericaFall 2005

Page 25: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 25

Results - Example

LART 100Winter 2005

Page 26: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 26

Results

De Anza College 2002-03 Cohort of New Entering Students Tracked from LART 100 and EWRT 100B

thru EWRT 1A to EWRT 1B or 2

0%10%20%30%40%50%60%70%80%90%

100%

Start 100

Succeed100

Start 1A

Succeed1A

Start 1B or 2

Succeed1B or 2

These counts track unduplicated individuals in the initial cohort; these individuals may have attempted the courses in the sequence several times before passing; only one attempt and one pass is counted. SOURCE: District Research.

LART100 EWRT100B

CourseCohort

Enr Total EnrCohort /

Total EnrLART100 198 255 78%EWRT100B 1,427 2081 69%

De Anza College 2002-03Cohort and Total Enrollment

Page 27: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 27

•On-line in Winter 2006

•Positive responses on group work

•Less positive on work with counselors and student services

•(new grant focuses on this work)

End of Term Assessment

Page 28: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 28

End of Class Survey

What benefits have you gotten by your experience in this learning community?

I learn more effectively.

0%

10%

20%

30%

40%

50%

very much much some very little not at all

Winter 2006 End of Class Survey N = 105

Page 29: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 29

End of Class Survey

What benefits have you gotten by your experience in this learning community?

I work more effectively with others.

0%

10%

20%

30%

40%

50%

very much much some very little not at all

Winter 2006 End of Class Survey N = 105

Page 30: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 30

End of Class Survey

What benefits have you gotten by your experience in this learning community?

I am better at using counseling and other student services.

0%

10%

20%

30%

40%

50%

very much much some very little not at all

Winter 2006 End of Class Survey N = 105

Page 31: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 31

End of Class Survey

Would you recommend this learning community to a friend or family member?

No2%

Yes98%Winter 2006 End of Class Survey N = 105

Page 32: The Proof is in the Pudding: Showing that Learning ...The Proof is in the Pudding: Showing that Learning Communities Work from Five Years of Institutional Research District Opening

De Anza Research, Sept 21, 2006 32

Questions?

•Suggestions?

•Other ways to measure success?