impact of class size on student engagement: literature review and preliminary data analysis

Impact of class size on student engagement: literature review and preliminary data analysis

Advantages of a small class• Knowing your students• Easier to have discussion rather than lecture• Number of assignments• Exam type• Larger classes may have lower attendance• Easier to not respond in a large class

Literature review

The impact of class size on grades• Small better: Small class size has a positive effect on

odds of getting a good grade (Scheck et al., 1994; Westerlund, 2006; Gibbs et al., 1996; Johnson, 2010)

• No impact on grade due to class size (Hancock, 1996)

• Large better: Students performed better in a large mega-section (150 students) than a small section (30 students)– the mega-section had additional technology tools, and

an additional hour of small group meeting to cover problem solving and study skills (Brusi et al., 2013)

• Effect of class size flattens as class size increases and almost ceases to exist when class reaches 50 for some disciplines. (Johnson, 2010)

Exam scores, standardized test scores• Small better: Better final exam score for

students in smaller course (Schattke and McAllister, 1962)

• No impact of size (Arias and Walker, 2004; Baldwin, 1993; Bowling et al., 2008)

• Large better: Students in large class outperformed small when attendance and GPA were taken into account (Hill, 1998)

• Large better: Students in larger classes scored better on a standardized economics test (TUCE III) (Lopus and Maxwell, 1995)

Long term retention, grades in future courses• Small better Students in a larger macroeconomics

classed had lower grades in the second course than students in the small intro course (Raimondo et al., 1990)

• No impact: Class size had no impact on the long term retention of material (Siegel et al., 1960; Siegfried and Kennedy, 1995), no impact on the proportion of students who changes majors (Baldwin, 1993), no impact on the grades in the next course or an intermediate level course (Baldwin, 1993), and no impact on the grade in a microeconomics sequence (Raimondo et al., 1990)

• Large better: A larger proportion of accounting students in the large class continued into the next two classes (Baldwin, 1993)

Experimental design

What is the relationship between class size and student engagement

in classes with greater than 30 students at Juniata College?

Benefits of engagement• A pathway to success in college (Hu, 2011) for

both performance and persistence (Gasiewski et al., 2012)

• May have a more significant impact on lower achieving students, students of color (Kuh et al., 2008) and non-traditional students (Gilardi and Guglielmetti, 2011)

• The lowest-ability students benefit more from engagement (Carini et al., 2006).

• Positive (but weak) linkages between engagement, critical thinking and grades (Carini et al., 2006)

Engagement• Behavioral engagement: participation in the

classroom (attending class, paying attention, asking questions), extracurricular events, or social activities (Fredricks et al., 2004; Gasiewski et al., 2012).

• Emotional engagement: a student’s feelings (positive or negative) to faculty, classmates, school (Fredricks et

al., 2004), and their feelings of boredom, anxiety or excitement in class (Gasiewski et al., 2012).

• Cognitive engagement: the student’s level of commitment to learning, including willingness to work hard to master the material (Fredricks et al., 2004).

Study design• Survey students in classes of 30 and up.• List of courses generated by registrar,

volunteers solicited.• Six different departments, all 100 or 200 level

classes (THANK YOU!!)• Faculty provided information on teaching

practices and perceptions of engagement• On-line survey given to students in that class

between 11/1 and 11/21

Results: classes

Number of students enrolled in course

Num

ber o

f cou

rses 25 courses total surveyed

Results: students

Number of students enrolled in course

Num

ber o

f stu

dent

s

986 responses

Results: graduation year

Num

ber o

f stu

dent

s

Graduation year

Fres

hman

Soph

omor

e

Juni

or

Seni

or

Distribution within FSHN

Disclaimers• Small sample size by class• No indication of cause and effect• Avoid over generalization

Is this course required?

≥80

<40 students 40-49 50-59

60-79

Perc

enta

ge o

f stu

dent

s in

th

at s

ize

grou

p

Requ

ired

for m

y PO

E

Requ

ired

for 2

ndar

y

Elec

tive

in P

OE

Elec

tive

for

dist

ributi

on

Requ

ired

for m

y PO

E

Requ

ired

for 2

ndar

y

Elec

tive

in P

OE

Elec

tive

for

dist

ributi

on Requ

ired

for m

y PO

E

Requ

ired

for 2

ndar

y

Elec

tive

in P

OE

Elec

tive

for

dist

ributi

on

Engagement• Behavioral engagement: participation in the

classroom (attending class, paying attention, asking questions), extracurricular events, or social activities (Fredricks et al., 2004; Gasiewski et al., 2012).

• Emotional engagement: a student’s feelings (positive or negative) to faculty, classmates, school (Fredricks et

al., 2004), and their feelings of boredom, anxiety or excitement in class (Gasiewski et al., 2012).

• Cognitive engagement: the student’s level of commitment to learning, including willingness to work hard to master the material (Fredricks et al., 2004).

Behavioral engagementI attend all the class sessions

Strongly agree

Strongly disagree

Is there are relationship between class size and the amount of texting?

Almost every class period

Often

Sometimes

Never

Similar pattern for e-mail, social media, and paying attention in class

Behavioral engagementHow often do you ANSWER questions posed by the

instructor in class?Almost every class period

Often

Sometimes

Never

Behavioral engagementHow often do you ASK the instructor a question in class?

Almost every class period

Often

Sometimes

Never

Engagement• Behavioral engagement: participation in the

classroom (attending class, paying attention, asking questions), extracurricular events, or social activities (Fredricks et al., 2004; Gasiewski et al., 2012).

• Emotional engagement: a student’s feelings (positive or negative) to faculty, classmates, school (Fredricks et

al., 2004), and their feelings of boredom, anxiety or excitement in class (Gasiewski et al., 2012).

• Cognitive engagement: the student’s level of commitment to learning, including willingness to work hard to master the material (Fredricks et al., 2004).

Emotional engagementI feel like the instructor cares about and supports my

efforts to learnStrongly agree

Strongly disagree

Emotional engagementMy instructor knows who I am (e.g., knows my name,

recognizes me)Strongly agree

Strongly disagree

Emotional engagementI like my instructor

Strongly agree

Strongly disagree

Emotional engagementStrongly agree

Instructor cares about my learning

Strongly disagree

strongly stronglydisagree agree

Emotional engagementStrongly agree

Instructor cares about my learning

Strongly disagree

strongly stronglydisagree agree

Emotional engagement

Strongly agree

I feel anxious or nervous about this class

Strongly disagree

I feel anxious or nervous about this class

In this class, how often so you…feel bored? feel angry?

laugh?

Nev

er

Som

e

Oft

en

Ever

y

Never, Sometimes, Often, Almost every class

Nev

er

Som

e

Oft

en

Ever

y

Nev

er

Som

e Oft

en

Ever

yNum

ber o

f stu

dent

s

Nev

er

Som

e Oft

en

Ever

y

feel frustrated?

Emotional engagementHow often do you feel BORED in this class?

Almost every class period

Often

Sometimes

Never

Emotional engagementHow often do you feel ANGRY in this class?

Almost every class period

Often

Sometimes

Never

Emotional engagementHow often do you LAUGH in this class?

Almost every class period

Often

Sometimes

Never

Emotional engagementHow often do you feel FRUSTRATED in this class?

Almost every class period

Often

Sometimes

Never

Emotions: relationshipsAlmost every class period

Often

Sometimes

Never strongly stronglydisagree agree

Emotions: relationshipsAlmost every class period

Often

Sometimes

Never Never Almost every

class period

Engagement• Behavioral engagement: participation in the

classroom (attending class, paying attention, asking questions), extracurricular events, or social activities (Fredricks et al., 2004; Gasiewski et al., 2012).

• Emotional engagement: a student’s feelings (positive or negative) to faculty, classmates, school (Fredricks et

al., 2004), and their feelings of boredom, anxiety or excitement in class (Gasiewski et al., 2012).

• Cognitive engagement: the student’s level of commitment to learning, including willingness to work hard to master the material (Fredricks et al., 2004).

Cognitive engagement• I see the value in learning the material

covered in this course• I consider myself a motivated student in this

course• I attempted all assigned course work• I completed the required readings or

preparatory assignments prior to class.

Cognitive engagementI completed the required readings or preparatory assignments prior to class.

Strongly agree

Strongly disagree

Does class size impact future interest in subject?

Summary: relationship to class sizeNo relationship

•Amount of texting, social media and e-mail•Attendance •Boredom, anger, frustration•Cognitive engagement•Future interest in subject

Relationship•Answer questions (- upper limit)•Ask questions (-)•Instructor cares – limit on largest classes?•Knows my name (-)•I like my instructor (- upper limit)•Anxiety (+ lower limit)

Does class size influence teaching

style?

Teaching style and class sizeHow often do you discuss questions with your peers in class?

Almost every class period

Often

Sometimes

Never

Teaching style and class sizeHow often do you discuss questions with your peers in class?

Almost every class period

Often

Sometimes

Never

How often do you interact with your peers to solve problems?How often do you discuss class related topics with your classmates DURING class?

Time in lecture vs class size91-100%81-90%71-80%61-70%51-60%41-50%31-40%21-30%

11-20%0-10%Cl

ass

time

spen

t on

lect

ure

(%)

Estimation by faculty

Is lecture boring?Almost every class period

Often

Sometimes

Never How

oft

en d

o yo

u fe

el b

ored

in th

is c

lass

?

0-10% 91-100%

Summary: teaching style related to class size

• There appears to be a limit to the amount of non-lecture used in large classes compared to medium classes.

What’s next?More analysis of collected data•At risk individuals•Untangling relationships•Impact of fieldWhat mitigates potential negative effects of large classes?Collect more data?•Smaller class sizes•Spring classes•Additional years (replicates)

Many thanks…The James J. Lakso Center for the Scholarship of

Teaching & Learning

Faculty who participated in the project

Arias, J.J., Walker, D.M., 2004. Additional Evidence on the Relationship between Class Size and Student Performance. J. Econ. Educ. 35, 311–329.Baldwin, B.A., 1993. Teaching Introductory Financial Accounting in Mass-Lecture Sections: Longitudinal Evidence. Issues Account. Educ. 8, 97–111.Bowling, B.V., Huether, C.A., Wang, L., Myers, M.F., Markle, G.C., Dean, G.E., Acra, E.E., Wray, Jacob, G.A., 2008. Genetic Literacy of Undergraduate Non–Science Majors and the Impact of Introductory Biology and Genetics Courses. BioScience 58, 654–660.Brusi, R., Portnoy, A., Toro, N., 2013. Student Engagement and Completion in Precalculus Precalculus Mega Section: Efficiently Assisting Student Engagement and Completion with Communications and Information Technology. J. Stem Educ. Innov. Res. 14, 20–25.Carini, R.M., Kuh, G.D., Klein, S.P., 2006. Student Engagement and Student Learning: Testing the Linkages*. Res. High. Educ. 47, 1–32.Fredricks, J.A., Blumenfeld, P.C., Paris, A.H., 2004. School Engagement: Potential of the Concept, State of the Evidence. Rev. Educ. Res. 74, 59–109.Gasiewski, J., Eagan, M., Garcia, G., Hurtado, S., Chang, M., 2012. From Gatekeeping to Engagement: A Multicontextual, Mixed Method Study of Student Academic Engagement in Introductory STEM Courses. Res. High. Educ. 53, 229–261.Gibbs, G., Lucas, L., Simonite, V., 1996. Class size and student performance: 1984-94. Stud. High. Educ. 21, 261.Gilardi, S., Guglielmetti, C., 2011. University Life of Non-Traditional Students: Engagement Styles and Impact on Attrition. J. High. Educ. 82, 33–53.Hancock, T.M., 1996. Effects of class size on college student achievement. Coll. Stud. J. 30, 479.Hill, M.C., 1998. Class size and student performance in introductory accounting courses: Further evidence. Issues Account. Educ. 13, 47–64.Hu, S., 2011. Reconsidering the Relationship Between Student Engagement and Persistence in College. Innov. High. Educ. 36, 97–106.Johnson, I.Y., 2010. Class Size and Student Performance at a Public Research University: A Cross-Classified Model. Res. High. Educ. 51, 701–723.Kuh, G.D., Cruce, T.M., Shoup, R., Kinzie, J., Gonyea, R.M., 2008. Unmasking the Effects of Student Engagement on First-Year College Grades and Persistence. J. High. Educ. 79, 540–563.Lopus, J.S., Maxwell, N.L., 1995. Teaching tools: Should we teach microeconomic principles bef. Econ. Inq. 33, 336.Raimondo, H.J., Esposito, L., Gershenberg, I., 1990. Research in Economic Education Introductory Class Size and Student Performance in Intermediate Theory Courses. J. Econ. Educ. 1986-1998 21.Schattke, R., McAllister, L., 1962. Large Versus Small Classes in Elementary Accounting. Account. Rev. 37, 557.Scheck, C.L., Kinicki, A.J., Webster, J.L., 1994. The effect of class size on student performance: Development and assessment of a process model. J. Educ. Bus. 70, 104.Siegel, L., Adams, J.F., Macomber, F.G., 1960. Retention of subject matter as a function of large group instructional procedures. J. Educ. Psychol. 51, 9–13.Siegfried, J.J., Kennedy, P.E., 1995. Does Pedagogy Vary with Class Size in Introductory Economics? Am. Econ. Rev. 85, 347–351.Toth, L.S., Montagna, L.G., 2002. Class Size and Achievement in Higher Education: A Summary of Current Research. Coll. Stud. J. 36, 253.Westerlund, J., 2006. Class Size and Student Evaluations in Sweden. Ssrn Work. Pap. Ser.

Behavioral engagementHow often do you text during class time?

Num

ber o

f stu

dent

s

Never Sometimes Often Almost every class period

Behavioral engagementHow often have you checked e-mail during class time?

Num

ber o

f stu

dent

s

Never Sometimes Often Almost every class period

Behavioral engagementN

umbe

r of s

tude

nts

Never Sometimes Often Almost every class period

How often have you checked social media (Facebook, Twitter, etc.) during class?

RelationshipsAlmost every class period

Often

Sometimes

Never

Never Sometimes Often Almost every class period

RelationshipsAlmost every class period

Often

Sometimes

Never

Never Sometimes Often Almost every class period

Behavioral engagementI attend all the class sessions

Strongly Strongly disagree agree

Num

ber o

f stu

dent

s

Higher level learning skills• Theoretically, students were better trained

higher level thinking skills in the smaller class size. Conclusion is based on significant difference in grade in upper level course dependent on class size for the macroeconomic sequence but not the microeconomic sequence. (Raimondo et al., 1990)