the interactive effects of powerpoint and note-taking as a function of lecture pace among uw-eau...

1
The Interactive Effects of PowerPoint and Note-taking as a Function of Lecture Pace Among UW-Eau Claire Students Ashley S. Zellhoefer 1 , Nathaniel B. Murken 1 , Benjamin D. Hustedt 1 , Andrew P.Clemens 2 , Daniel P. Walenski 2 , Kathryn L. Hamilton 2 , and Allen H. Keniston 1 1 Department of Psychology, University of Wisconsin Eau-Claire, 2 Department of Psychology of University of Wisconsin Stout Results Effects of PowerPoint, lecture speed, and note-taking on retention Neither PowerPoint nor lecture speed influenced retention test scores (p> .05 for both main effects in the ANOVA). Note-taking exerted only a marginal effect on retention, F(1, 78) = 3.17, p = .08. Participants who took notes had an average test score of 17.74 (SE = 0.85) compared an average score of 19.65 (SE = 0.85) for those who did not. Possible suppression of effects by previous knowledge of the lecture topic The correlation of retention with previous knowledge was significant (r = .23, p< .04). An ANCOVA using previous knowledge as a covariate to control for the possibility that previous knowledge suppressed the impacts of the manipulated variables simply eliminated the marginal note-taking effect. In other words, the marginal note-taking effect appears to have been an artifact of previous knowledge. Correlation of retention and comprehension The zero-order correlation of retention and comprehension was .53 (p< .001) Effects of PowerPoint, lecture speed, and note-taking on comprehension Figure 1 •Figure 1 displays the breakdown of comprehension scores by lecture pace, PowerPoint, and note-taking conditions. •The ANOVA for comprehension revealed only a marginal 3-way interaction among the independent variables, F(1, 78) = 2.93, p=09. The interaction appears in Figure 1. •Because the zero-order correlation between comprehension and retention is .53 (p< .001), and we conducted an ANCOVA using retention as a covariate to test for the possibility that retention acts as a suppressor of the manipulated variables effects. In this analysis, there was a significant interaction of lecture speed with note-taking, F(1, 77) = 4.62, p< .04 The three-way interaction depicted in Figure 1 is also significant, F(1, 77) = 7.52, p< .01. •The three-way interaction qualifies the interpretation of the two-way interaction. Thus, when the lecture ran at a normal pace, note-taking produced higher comprehension scores when there were no PowerPoint slides, but reduced the comprehension scores when there were PowerPoint slides. However, during a fast-paced lecture, note-taking produces lower comprehension scores in both PowerPoint conditions, although the reduction appears to be smaller when the lecture is accompanied by Introduction •PowerPoint is a widely-used but little researched lecture aid. •A few previous studies have suggested that PowerPoint may facilitate comprehension of lecture material because of its abilities to free cognitive load. 3,4 •Other studies have also argued that PowerPoint will interfere with a lecture because it will overload cognitive space with its redundancy. 3,4 •We have previously manipulated variables such as lecture pace, level of detail of the PowerPoint slides and the use of systematic breaks within the lecture. 2 •However, none of our previous studies have yielded clear effects or supplied a clear picture of PowerPoint’s effectiveness. 2 •Still, theory suggests that pace mediates multimedia effects. 6 •To date pace has not been a topic of research. •However, many studies have found note-taking to have a positive effect on student’s retention and comprehension of lecture material. 5 •Research has found that a lecture at a fast pace can hinder note-taking. 6 •Likewise, PowerPoint may interfere with a students’ comprehension of lecture material at a fast pace. 7, 8 Hypotheses • We expected PowerPoint use, a normal lecture pace and students’ note-taking to enhance retention and comprehension of a short lecture. • We also hypothesized that note-taking benefits would be augmented by PowerPoint when students heard a normally paced lecture, but PowerPoint would interfere with note- taking benefits at a fast pace. Methods Participants •86 Students from UWEC invited to participate via a research signup board •50% of sample were freshmen, 27% were sophomores, 11% were juniors, 13% were seniors (Total is larger than 100% due to rounding error.) Materials •Informed consent form •University PC computers using Qualtrics software and headphones •Test of previous knowledge of neuron communication •Four previously recorded10 minute lectures (one with PowerPoint slides and one without) presented at the normal and fast paces •28 item multiple-choice retention test •24 item true and false comprehension test •Debriefing form •Evidence of participation form Procedure •Participants read and completed the informed consent form. •Students were asked to log onto their University computer and then into the Qualtrics program. •Students first completed the test of previous knowledge. •After completing the first test Qualtrics then randomly assigned participants to one of the 8 conditions. •Participants viewed either the normal of fast paced lecture, with or without the accompanying PowerPoint slides. •Depending on the condition participants were randomly assigned they were encouraged to take notes. •After the lecture students completed the retention and Discussion •Our data supported none of our hypotheses. •Finding that note-taking marginally impaired retention is unusual. Typically the reverse occurs. 5 However, that the effect was marginal and eliminated under control for previous knowledge leads us to discount the finding. •The marginal three-way interaction of lecture pace, use of PowerPoint, note-taking on comprehension became significant under control for lecture retention. Note- taking had different effects in combination with PowerPoint use depending on lecture speed. In general, note-taking reduced comprehension with or without PowerPoint slides when the lecture was fast. But when the lecture pace was normal, note-taking enhanced comprehension when there were no accompanying PowerPoint slides, but reduced comprehension scores when there were accompanying PowerPoint slides. •Given that the effect size for the three-way interaction was small (η 2 = 0.10), and the fragility of three-way interactions, we are cautious about interpreting our main finding about the effects of our variables on lecture comprehension. Nevertheless, we suggest that PowerPoint’s effects are complex. In the present case they are a function of two aspects of the presentation, one participant activity, and one person variable. We suspect that there are many other variables that may be influential, including the conceptual organization of the materialand its representation in the organization of PowerPoint slides 10,13 , student characteristics such as learning style, ability, and motivation, and the degree to which PowerPoint slide design implements the principles of multimedia design. 11 •Our research will continue to explore the interactions of PowerPoint slide design and lecture material, but will attend more closely to principles for the use of multimedia in the design of research materials. •We encourage users of PowerPoint to think carefully about the construction of their PowerPoint slides. The combined impact of our studies is that simply using PowerPoint slides as a lecture outline produces no beneficial effects in terms of students’ memory or understanding of lectures. However, developments in research on other forms of multimedia indicate promise for PowerPoint applications. References 1. Craig, R. J., &Amernic, J. H., (2006). PowerPoint presentation technology and the dynamics of teaching. Innovative Higher Education, 31, 147-160. 2. Hamilton, K. L. et al., (2008, November). PowerPoint as a lecture aid in the instruction of neuron communication. Society for Neuroscience Meeting, Washington, D.C. 3. Kalyuga, S. et al., (1999). Managing split attention and redundancy in multimedia instruction. Applied Cognitive Psychology, 13, 351-371. 4. Mayer, R. E., & Moreno, R., (1998). A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of Educational Psychology, 90, 312-320. 5. Kiewra, K. A., (1985). Investigating note-taking and review: A depth of processing alternative. Educational Psychologist, 20, 23-32. 6. Peper, R. J. & Mayer, R. E., (1986). Generative effects of note- taking during science lectures. Journal of Educational Psychology, 78, 34-38. 7. Mayer, R. E. et al., (2001). Cognitive constraints on multimedia learning: When presenting more material results in less understanding. Journal of Educational Psychology, 93, 187-198. 8. Kalyuga, S. et al., (2004). When redundant on-screen text in multimedia technical instruction can interfere with learning. Human Factors, 46, 567-580. 9. Kinchin, I. M., & Cabot, L. B. (2007). Using concept mapping principles in PowerPoint. European Journal of Dental Education, 11, 194- 199. 10. Tufte, E. R. (2006). The Cognitive Style of PowerPoint: Pitching Out Corrupts from Within (2 nd Ed.). Cheshire, CT: Graphics Press. 11. Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38, 43- 52. 12. Schwebel, M. (1975). Formal operations in first-year college students. Journal of Psychology, 91, 133-141. 13. Garner, J. K. et al. (2009). Common use of PowerPoint versus the assertion-evidence structure: A cognitive perspective. Technical Communication, 56, 331-345. Acknowledgements This research was sponsored by University of Wisconsin-Eau Claire Differential Tuition and University of Wisconsin- Eau Claire Faculty-Student Collaborative Research Grant 0 4 8 12 16 20 No notes Notes No PowerPoint PowerPoint 0 4 8 12 16 20 No notes Notes No PowerPoint PowerPoint

Upload: norman-oneal

Post on 16-Dec-2015

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Interactive Effects of PowerPoint and Note-taking as a Function of Lecture Pace Among UW-Eau Claire Students Ashley S. Zellhoefer 1, Nathaniel B. Murken

The Interactive Effects of PowerPoint and Note-taking as a Function of Lecture Pace Among UW-Eau Claire Students

Ashley S. Zellhoefer1, Nathaniel B. Murken1, Benjamin D. Hustedt1, Andrew P.Clemens2, Daniel P. Walenski2, Kathryn L. Hamilton2, and Allen H. Keniston1

1Department of Psychology, University of Wisconsin Eau-Claire, 2Department of Psychology of University of Wisconsin Stout

ResultsEffects of PowerPoint, lecture speed, and note-taking on retention

Neither PowerPoint nor lecture speed influenced retention test scores (p> .05 for both main effects in the ANOVA). Note-taking exerted only a marginal effect on retention, F(1, 78) = 3.17, p = .08. Participants who took notes had an average test score of 17.74 (SE = 0.85) compared an average score of 19.65 (SE = 0.85) for those who did not.

Possible suppression of effects by previous knowledge of the lecture topic

The correlation of retention with previous knowledge was significant (r = .23, p< .04). An ANCOVA using previous knowledge as a covariate to control for the possibility that previous knowledge suppressed the impacts of the manipulated variables simply eliminated the marginal note-taking effect. In other words, the marginal note-taking effect appears to have been an artifact of previous knowledge.

Correlation of retention and comprehension

The zero-order correlation of retention and comprehension was .53 (p< .001)

Effects of PowerPoint, lecture speed, and note-taking on comprehension

Figure 1

• Figure 1 displays the breakdown of comprehension scores by lecture pace, PowerPoint, and note-taking conditions.

• The ANOVA for comprehension revealed only a marginal 3-way interaction among the independent variables, F(1, 78) = 2.93, p=09. The interaction appears in Figure 1.

• Because the zero-order correlation between comprehension and retention is .53 (p< .001), and we conducted an ANCOVA using retention as a covariate to test for the possibility that retention acts as a suppressor of the manipulated variables effects. In this analysis, there was a significant interaction of lecture speed with note-taking, F(1, 77) = 4.62, p< .04 The three-way interaction depicted in Figure 1 is also significant, F(1, 77) = 7.52, p< .01.

• The three-way interaction qualifies the interpretation of the two-way interaction. Thus, when the lecture ran at a normal pace, note-taking produced higher comprehension scores when there were no PowerPoint slides, but reduced the comprehension scores when there were PowerPoint slides. However, during a fast-paced lecture, note-taking produces lower comprehension scores in both PowerPoint conditions, although the reduction appears to be smaller when the lecture is accompanied by PowerPoint than

when it is not.

Introduction• PowerPoint is a widely-used but little researched lecture aid.• A few previous studies have suggested that PowerPoint may facilitate

comprehension of lecture material because of its abilities to free cognitive load.3,4

• Other studies have also argued that PowerPoint will interfere with a lecture because it will overload cognitive space with its redundancy.3,4

• We have previously manipulated variables such as lecture pace, level of detail of the PowerPoint slides and the use of systematic breaks within the lecture.2

• However, none of our previous studies have yielded clear effects or supplied a clear picture of PowerPoint’s effectiveness.2

• Still, theory suggests that pace mediates multimedia effects.6

• To date pace has not been a topic of research.• However, many studies have found note-taking to have a positive effect on

student’s retention and comprehension of lecture material.5

• Research has found that a lecture at a fast pace can hinder note-taking.6

• Likewise, PowerPoint may interfere with a students’ comprehension of lecture material at a fast pace. 7, 8

Hypotheses• We expected PowerPoint use, a normal lecture pace and students’ note-

taking to enhance retention and comprehension of a short lecture.

• We also hypothesized that note-taking benefits would be augmented by PowerPoint when students heard a normally paced lecture, but PowerPoint would interfere with note-taking benefits at a fast pace.

MethodsParticipants• 86 Students from UWEC invited to participate via a research signup board• 50% of sample were freshmen, 27% were sophomores, 11% were juniors,

13% were seniors (Total is larger than 100% due to rounding error.)

Materials• Informed consent form• University PC computers using Qualtrics software and headphones• Test of previous knowledge of neuron communication• Four previously recorded10 minute lectures (one with PowerPoint slides and

one without) presented at the normal and fast paces• 28 item multiple-choice retention test• 24 item true and false comprehension test• Debriefing form• Evidence of participation form

Procedure• Participants read and completed the informed consent form.• Students were asked to log onto their University computer and then into the

Qualtrics program. • Students first completed the test of previous knowledge.• After completing the first test Qualtrics then randomly assigned participants

to one of the 8 conditions. • Participants viewed either the normal of fast paced lecture, with or without

the accompanying PowerPoint slides.• Depending on the condition participants were randomly assigned they were

encouraged to take notes.• After the lecture students completed the retention and comprehension tests.• When finished the participants then received an evidence of participation and

debriefing form.

Discussion• Our data supported none of our hypotheses.• Finding that note-taking marginally impaired retention is unusual. Typically

the reverse occurs.5 However, that the effect was marginal and eliminated under control for previous knowledge leads us to discount the finding.

• The marginal three-way interaction of lecture pace, use of PowerPoint, note-taking on comprehension became significant under control for lecture retention. Note-taking had different effects in combination with PowerPoint use depending on lecture speed. In general, note-taking reduced comprehension with or without PowerPoint slides when the lecture was fast. But when the lecture pace was normal, note-taking enhanced comprehension when there were no accompanying PowerPoint slides, but reduced comprehension scores when there were accompanying PowerPoint slides.

• Given that the effect size for the three-way interaction was small (η2 = 0.10), and the fragility of three-way interactions, we are cautious about interpreting our main finding about the effects of our variables on lecture comprehension. Nevertheless, we suggest that PowerPoint’s effects are complex. In the present case they are a function of two aspects of the presentation, one participant activity, and one person variable. We suspect that there are many other variables that may be influential, including the conceptual organization of the materialand its representation in the organization of PowerPoint slides10,13, student characteristics such as learning style, ability, and motivation, and the degree to which PowerPoint slide design implements the principles of multimedia design.11

• Our research will continue to explore the interactions of PowerPoint slide design and lecture material, but will attend more closely to principles for the use of multimedia in the design of research materials.

• We encourage users of PowerPoint to think carefully about the construction of their PowerPoint slides. The combined impact of our studies is that simply using PowerPoint slides as a lecture outline produces no beneficial effects in terms of students’ memory or understanding of lectures. However, developments in research on other forms of multimedia indicate promise for PowerPoint applications.

References1. Craig, R. J., &Amernic, J. H., (2006). PowerPoint presentation technology and the

dynamics of teaching. Innovative Higher Education, 31, 147-160.2. Hamilton, K. L. et al., (2008, November). PowerPoint as a lecture aid in the instruction of

neuron communication. Society for Neuroscience Meeting, Washington, D.C. 3. Kalyuga, S. et al., (1999). Managing split attention and redundancy in multimedia

instruction. Applied Cognitive Psychology, 13, 351-371.4. Mayer, R. E., & Moreno, R., (1998). A split-attention effect in multimedia learning:

Evidence for dual processing systems in working memory. Journal of Educational Psychology, 90, 312-320.

5. Kiewra, K. A., (1985). Investigating note-taking and review: A depth of processing alternative. Educational Psychologist, 20, 23-32.

6. Peper, R. J. & Mayer, R. E., (1986). Generative effects of note-taking during science lectures. Journal of Educational Psychology, 78, 34-38.

7. Mayer, R. E. et al., (2001). Cognitive constraints on multimedia learning: When presenting more material results in less understanding. Journal of Educational Psychology, 93, 187-198.

8. Kalyuga, S. et al., (2004). When redundant on-screen text in multimedia technical instruction can interfere with learning. Human Factors, 46, 567-580.

9. Kinchin, I. M., & Cabot, L. B. (2007). Using concept mapping principles in PowerPoint. European Journal of Dental Education, 11, 194-199.

10. Tufte, E. R. (2006). The Cognitive Style of PowerPoint: Pitching Out Corrupts from Within (2nd Ed.). Cheshire, CT: Graphics Press.

11. Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38, 43-52.

12. Schwebel, M. (1975). Formal operations in first-year college students. Journal of Psychology, 91, 133-141.

13. Garner, J. K. et al. (2009). Common use of PowerPoint versus the assertion-evidence structure: A cognitive perspective. Technical Communication, 56, 331-345.

AcknowledgementsThis research was sponsored by University of Wisconsin-Eau Claire Differential Tuition and University of Wisconsin-Eau Claire Faculty-Student Collaborative Research Grant

02468

101214161820

No notes Notes

No PowerPoint PowerPoint

0

4

8

12

16

20

No notesNotes

No PowerPoint PowerPoint