the implications of generative learning strategies for ... papers/0108_b.pdf · the implications of...

32
The implications of generative learning strategies for integrating cognitive load and self- regulation theory into educational innovations Paper presented at 24 th International Congress of School Effectiveness and Improvement Limassol, Cyprus Gary Morrison, Professor Instructional Design and Technology Old Dominion University John Nunnery, Executive Director The Center for Educational Partnerships and Associate Professor of Educational Research Old Dominion University January 2011

Upload: ngominh

Post on 07-Feb-2018

219 views

Category:

Documents


1 download

TRANSCRIPT

The implications of generative learning strategies for integrating cognitive load and self-

regulation theory into educational innovations

Paper presented at 24th International Congress of School Effectiveness and Improvement

Limassol, Cyprus

Gary Morrison, Professor

Instructional Design and Technology

Old Dominion University

John Nunnery, Executive Director

The Center for Educational Partnerships

and Associate Professor of Educational Research

Old Dominion University

January 2011

The typical textbook used in American classrooms, whether first grade or in college, have

not significantly changed in format or design since the invention of the Gutenberg press over 500

years ago. Moreover, traditional textbooks are not interactive or adaptive to students’ needs,

despite research which suggests that these features may be beneficial for learning (Lee & Park,

2008; Mayer et al., 2003; Park, 1996). In this paper we presented a research and development

paradigm (AdapText Interactive) that responds to the need for improved textbook design and

support for student comprehension. It expands previous research by creating larger portions of

experimental text than has typically been done before, in a domain area (Earth science) that has

been infrequently used in this type of research. As interest moves from printed books to

electronic books, there is an opportunity to design a new generation of interactive textbooks and

to move far beyond the first generation of ‘soft’ versions of the printed books. The first project

we are undertaking project will take the first steps in the design of an innovative teaching

technology that is based on research in instructional technology and educational psychology, to

develop and test interactive i-textbook chapters that can be used as a model for the development

of second generation i-textbooks.

The goals of the project arise from considering several areas of need in STEM education

and textbook design. It is imperative that K-12 students have STEM education experiences

which allow them to form a deep understanding of scientific principles and content. Such

experiences promote the level of science literacy necessary for informed and responsible

citizenship. They also allow students to begin pursuit of STEM-related career training. The focus

of the project is middle school Earth science. In particular, the pedagogical resource to be

developed will support students as they construct and reason with mental models of complex

geologic structures and processes. Mental models are defined as simplified representations of

connected system components or causal mechanisms, that allow the learner to make predictions,

simulate outcomes and solve problems (Greca 2000, Mayer, 2008; Mayer & Chandlger, 2001;

Mayer & Moreno, 2003). The development of this level of understanding is critical for the

individual and their role in society. For example, as a society we need students to pursue science-

related careers in order to address and further understand these and other issues. A the same time,

in order to participate in public discourse about issues such as global warming and the strategies

that might be taken to counter it, the connections between marine and atmospheric conditions,

and how global warming may impact the resources that sustain life, students need to understand

Earth’s geological systems.

We believe that significant opportunities for progress towards meeting these needs exist at the

middle and high school levels. From a developmental perspective, middle and high school is a

critical period for building a knowledge base and deepening students’ appreciation for the

scientific worldview. It is also a time when students’ cognitive development is such that for

some, formal operations are achieved (Brown & Carniff, 2007). Hypothetical reasoning and

abstract thinking are possible, and students can create and utilize simulations to help themselves

understand relationships among system components. Thus, middle and high school students are

able to develop relatively sophisticated causal models of complex phenomena. From a curricular

perspective, students are expected to grasp complex ideas at a more sophisticated level than at

elementary school. Students are, for example, expected to understand that “chemical pollution

and sedimentation are great threats to the chemical and biological well-being of estuaries and

oceans” (Virginia Earth Science Standard of Learning 11b,e). Mastering this idea requires the

student to build a mental representation of factors which affect water quality and marine life and

to be able to simulate causes and consequences of changes in the chemical and biological

makeup of waterways.

From a pedagogical perspective, students are expected to be able to learn effectively from

informational text. While students in middle school science can and do engage with hands-on

materials, textbooks remain the predominant form of instructional resource to the extent that

Heinich (1984) refers to a symbiotic relationship between the teacher and the textbook that

requires the teacher to translate the textbook into instruction. For students with effective reading

comprehension skills and self-regulated learning strategies, informational text provides a way of

deepening and consolidating curricular concepts. There are many ways, however, in which

students can be deficient in their use of comprehension strategies and often times they fail to

adequately comprehend informational text (Winograd & Johnston, 1982). In a science lesson,

time is often devoted to supporting and promoting students’ comprehension skills. This presents

a significant challenge for teachers of diverse groups of learners.

The goals of the first AdapText Interactive: i-EARTH project are to:

1. Re-design selected chapters of Earth science textbooks in order to reduce extraneous

cognitive load

2. Assess learning outcomes associated with electronic versus paper Earth science textbook

formats

3. Demonstrate the learning outcomes associated with interactive animation and simulation

components in electronic Earth science textbook materials

4. Incorporate and assess the effect of adaptive support for students’ use of learning

strategies and comprehension monitoring processes when using i-textbook materials

5. Identify and account for key learner variables that influence the effectiveness of i-

textbook features such as animations, simulations, strategy prompts and feedback.

Research and Development Design

Hypothesis. The hypothesis guiding the project is that middle school students’ learning of

Earth science topics can be enhanced with the use of adaptive, interactive textbook materials

designed in accordance with cognitive load, multimedia learning and self-regulated learning

theories. We plan to explore this hypothesis through a series of pilot studies, factorial

experiments in ecologically valid settings, and focus group opportunities that ultimately will

result in the development of an innovative technological resource – the interactive, adaptive,

supportive middle school science i-textbook. In addition, prototypes of the materials will be

tested in a controlled lab setting where physiological measures (e.g., eye tracking and

electroencephalogram (EEG) data are collected to help us understand how students process text

and pictures. These features are represented in the title of the project: AdapText Interactive

signifies the adaptive and interactive nature of the text. i-EARTH stands for Interactive

Electronic Adaptive Resources That Heighten science mastery.

Theoretical background. We will carefully, and with empirical data to support decision making

throughout, merge cognitive load theory with principles of multimedia learning, self-regulated

and generative learning theories with recent technological innovations. Through the use of a

cross platform development package, we will create a platform which allows assessment of the

effect of integrated graphics, animations, and simulations. However, optimizing learning in this

environment also depends on consideration of the learner’s unique psychological attributes

(Greene, Costa, Robertson, Pan, & Deekens, 2010 ). Specifically, learner processing of

multimedia components of electronically-enhanced learning materials varies according to prior

knowledge, generative learning strategy use, self-regulated learning skills, and particularly

spatial ability (Azevedo, Cromley & Seibert, 2004; Butcher, 2006; Grabowski, 2004; Wittrock

1974a, 1974b, 1974c, 1989, 1992; Mayer & Sims, 1994). In seeking to develop a flexible and

adaptive instructional resource that facilitates the development of mental models we need to

understand how learner variables interact with interactive and multimedia features of the

textbook and how these influence extraneous and germane cognitive load. Before outlining the

planned studies we present the theoretical background that guides the development of the

interactive textbook materials, and describe the learner variables known to influence the usage

and effectiveness of multimedia features.

Cognitive Load Theory. Prior to the past 20 years, researchers interpreted the magic

number seven plus or minus 2 (Miller, 1956) as a measure of how many items a participant could

hold in working memory at one time. It was not until Sweller’s (1988) subsequent research that

researchers began to understand the effect of the design of the instructional materials on mental

model (or schema) development as a result of limited working memory. For example,

memorizing the six Noble gases and their chemical symbols is a relatively easy task. Similarly,

memorizing all the metals and their symbols is a relatively easy task although it would take more

time to learn than the six Noble gases. In contrast, learning to solve a typical time-distance

problem is much more difficult. The basis for the difficulty lies in the content. When memorizing

parts (or all) of the periodic table of elements, each element is learned independently. That is,

argon is not dependent upon learning helium. The difference between these two learning tasks is

described in terms of element interactivity (Schnotz & Kurschner, 2007; Sweller & Chandler,

1994). The memorization of parts of the periodic table is a task of low element interactivity,

which is to say that learning one element is not dependent upon the other. Learning to solve a

time-distance problem is characterized as having high element interactivity. A typical time-

distance problem can have 11 more elements that must be kept in working memory

simultaneously to solve the problem. Thus, this type of task can overwhelm the learner’s

working memory capacity and prevent the development of an appropriate mental model that can

be used to solve future problems.

Cognitive load is defined as the load placed on the cognitive system by a task. This load

is defined by two dimensions. The first is the load from the task which is labeled mental load and

the second is the learner’s cognitive capacity or resources, mental effort, brought to bear on the

task (Sweller, van Merriënboer, & Paas, 1998). There are three types of cognitive load. First is

intrinsic cognitive load that is determined by the level of interactivity between elements of the

task. Second is extraneous cognitive load which is the load imposed or created by the design of

the materials. For the studies, our interests focus on the management of two causes of

extraneous load. The first is the split-attention effect that occurs in most printed materials that

incorporate pictures (Bobis, Sweller, & Cooper, 1993; Chandler & Sweller, 1991). The learner

typically first reads a description of one part of the illustration in the narrative and then must

locate that part of the illustration, maybe on another page, then reads the next phrase or

description, then switches to the illustration. Switching between the illustration and narrative

requires the learner to use working memory resources for administrative purposes of keeping

locations in the text and illustration and maintaining or rehearsing information during location

switching. The second cause of extraneous load is due to redundancy of information between the

text and illustration (Mayer & Moreno, 2002; Reder & Anderson, 1980, 1982). The learner could

achieve understanding from either source, but must now reconcile the differences between the

illustration and narration to determine if they are equivalent.

The third type of cognitive load is germane load. Germane load refers to the working

memory resources available after accounting for intrinsic and extraneous load (see Figure 1) and

is used to engage in generative processing. The three types of cognitive load are additive. The

example on the left in Figure 1 has overwhelmed working memory and the learner will not

develop an appropriate mental model due to the lack of germane cognitive load. The example on

the right of Figure 1 illustrates a reduction in extraneous cognitive load which frees working

memory resources to develop a mental model, that is, increased germane cognitive load.

Research suggests that judicious application of message design, cognitive load theory, and

multimedia learning principles can reduce extraneous cognitive load. Effective scaffolding and

support of cognitive and metacognitive processes can maximize the benefits associated with

germane cognitive load (Anglin & Morrison, 2001; Pociask & Morrison, 2008; Sweller, 1999).

Optimal and efficient learning from technologically-enhanced text results from effective

management of limited working memory resources (Sweller, van Merriënboer, & Paas, 1998).

Research suggests that judicious application of message design, cognitive load theory, and

multimedia learning principles can reduce cognitive load. Effective scaffolding and support of

cognitive and metacognitive processes can maximize the benefits associated with germane

cognitive load (Anglin & Morrison, 2001; Pociask & Morrison, 2008; Sweller, 1999). Therefore,

the first step in our project will be to re-design textbook sections in accordance with cognitive

load theory and to assess the impact of these changes on cognitive load and student performance.

In particular, we will reduce the split attention and redundancy effects.

Figure 1. Additive effect of cognitive load

Learner Variables, Generative Strategies and the Application of Multimedia Learning

Theory to i-textbook design. Over the past decade, Mayer and colleagues (e.g. Mayer et al.,

2003) have conducted a number of experiments using short multimedia presentations about

scientific and technical systems. These experiments have led to the articulation of multimedia

learning principles, including the coherence and interactivity principles. The coherence principle

clearly supports research on cognitive load. Studies have shown that individuals learn better

when extraneous details are removed from informational material (Mayer, 2001, Butcher, 2006).

The interactivity principle states that individuals learn better if they are able to proactively

respond to and exert control over both the pace and the sequence of instruction (Mayer &

Moreno, 2003). However, the results of these types of experiments present a challenge to

instructional designers because conclusions cannot be equivocally drawn. Learner variables such

as prior knowledge and self-regulated learning skills interact with features such as animation,

complexity and interactivity to predict learning outcomes. Such individual differences have not

typically been systematically addressed in studies that have been seeking to manipulate

interactivity or animations.

Because individual difference variables are influential, and because middle school

students require support and prompting to use generative learning strategies and execute self-

Extraneous

Intrinsic

Germane

regulated learning skills (Pressley, 2000), we will assess students’ prior knowledge, generative

and self-regulated learning strategies, and incorporate metacognitive support into the i-textbook

pages as multimedia features are added. In spite of a wealth of research on learning from

multimedia presentations, relatively few details have emerged about how students use generative

learning strategies during extended, interactive multimedia learning episodes. According to

Jonassen (1988), generative learning strategies “are those that require learners consciously and

deliberately to relate new information to existing knowledge” (p.114). Cognitive learning

strategies – techniques that support effective encoding – are included under this general heading

and for our purposes include elaborative rehearsal and organizational strategies (Weinstein &

Mayer, 1986). Successful strategies in multimedia learning environments and in traditional

textbooks have involved prompting to use strategies such as elaborative interrogation (asking

“why” questions; Smith, Holliday & Austin, 2010); the use of self-explanations during a multi-

step or multi-component sequence (Chi, et al., 1989; Renckl, 2002); the use of worked examples

with gradual fading of the completeness of the steps provided (Renckl, Atkinson & Groβe,

2000); directed re-reading of portions of text; help tools to reveal information (Renckl, 2002);

summary writing; paraphrasing; and feedback regarding the degree to which a strategy was used

successfully (Azevedo, 1995). When strategy prompts are integrated into the i-textbook platform

and behaviors are recorded, we have the potential for students to demonstrate not only superior

learning outcomes at posttest but also to demonstrate the processes that lead to successively more

sophisticated levels of understanding and learning through the quality of their responses to and

the need for activating these prompts.

Our approach will be to build in prompts that will facilitate strategy use. Of particular

interest is the identification of when and how often these prompts should be incorporated. Some

insights may be gained from Azevedo, Greene and colleagues, (Azevedo, Moos, Greene,

Winters, & Cromley, 2008; Greene et al., 2010), who documented differences in the strategic

processes used by students with high or low domain knowledge. Specifically, even for students

with effective self-regulated learning skills, low prior knowledge hampered learning outcomes

(Greene et al., 2010). Students with both low prior knowledge and poor self-regulated learning

skills may require a great deal of support. Furthermore, this support may need to be fixed rather

than under the learner’s control, especially for less skilled learners.

Self-regulated learning (SRL) involves the metacognitive, motivational and behavioral

control of learning (Zimmerman, 2000) and consists of three phases that are cyclical in nature.

Here, we are most concerned with the metacognitive guidance of learning, which entails

students’ ability to monitor and reflect upon their knowledge and the quality of their learning

processes. In the Forethought stage of SRL learning goals are set, plans are formulated, and

strategies are selected. In the Performance or Volitional Control stages, the learning task is

embarked on through self-instruction, and comprehension and progress are monitored

throughout. In the Self-Reflection performance is judged and feedback is reviewed in order to

improve future learning episodes. Thus, prompting and scaffolding that is integral to the learning

materials could conceivably support both the Forethought and Performance stages of SRL. It

would benefit the learner who both lacks the metacognitive self-regulation to begin the SRL

process, as well as supporting the learner who was aware of the need to be strategic but who

lacked the specific knowledge to execute a particular strategy at an optimal point in time.

Contemporary research findings have highlighted the role played by SRL skills in accounting for

variance in learning outcomes for multimedia environments (Azevedo, Guthrie & Seibert, 2004).

Specifically, learning in multimedia and hypermedia settings allows the learner such great

control over navigation that metacognitive skills must be used very effectively. These findings

will provide a foundation for designing a new type of interaction in the interactive textbook. We

will focus our prompts in the interactive textbook during the Performance phase, in order to

maximize the opportunity for students to engage in generative processing. In addition to

assessing self-regulated learning skill as an independent variable, we will examine the possibility

of interaction effects for different levels of SRL skill when learning from interactive i-textbook

pages. We will also examine whether the expert-reversal effect can be applied from the

perspective of students with high versus low SRL skills (Young, 1996). The learning outcomes

of students with very good SRL skills may actually be hampered by a high degree of rigid

metacognitive support. Likewise, students with very poor SRL skills may be hindered by the

condition in which they have full control over their navigation and processing of the material

(McManus, 2000), or they may demonstrate the ability to select the best strategy for their skill

level (Ross, Morrison, & O’Dell, 1988).

Materials and measures

In addition to the rubric used to assess the textbook and i-textbook pages, individual

measures of cognitive load, cognitive abilities, self-regulated learning, domain knowledge,

domain attitudes, time on task, and process will be collected.

Cognitive Load. The most common measure of cognitive load is a subjective rating scale.

Prior research has found that participants are capable of providing a numeric indicator of how

they perceive their mental burden (Gopher & Braune, 1984; Paas, 1992). Moreover, deLeeuw &

Mayer, (2008) presented evidence that questions about task difficulty versus effort could

distinguish between extrinsic and intrinsic cognitive load. Although we will not only use self-

report data, we will seek to establish whether or not it is possible to assess cognitive load in

middle and high school students using questions that parallel those asked by deLeeuw and

Mayer.

The most commonly used approach to measuring cognitive load is subjective measures

(Paas, Tuovinen, Tabbers, & Van Gerven, 2003; van Gog, Kester, Nievelstein, Giesbers, & Paas,

2009) consisting of multiple times or a single item. In contrast are physiological measures that

can offer a continuous assessment of cognition and cognitive load. However, the use of

physiological measures to assess cognitive load and cognition has the potential to a) verify

subjective measures of cognitive load and b) provide important continuous indicators of

cognition that can be recorded and eventually adapted as the learner interacts with the material

(van Gog, Pass, & Sweller, 2010). Some measures such as heart rate and hormone levels do not

appear to be as sensitive as other measures to changes in mental effort (Atonenko, Paas, Grabner,

& van Gog, 2010). Other physiological measures such as eye tracking and electroencephalogram

(EEG) provide continuous measures of cognition and cognitive load that are more sensitive to

changes. For example, May, Kennedy, Williams, Dunlap, and Brannan (1990) reported four

studies where eye tracking was successfully used to measure cognitive load. Similarly, Paas

(2003) and van Gog et al. (2009) summarize additional studies that have successfully used eye

tracking to measure cognitive load. The laboratory studies will use a heads-free eye tracking

system and a 24-channel wireless EEG acquisition system to continuously track a learner’s

visual attention while interacting with the instructional material. The eye tracker will be used to

measure number and duration of fixations, along with visual search and navigation behaviors.

Similar eye tracking measures have been used successfully to track cognitive processes and

processing demand (Amadieu, van Gog, Paas, Ticot, & Marine, 2009; Rayner, 1998), cueing and

complexity of animations (Boucheix and Lowe, 2010; de Koning, Tabbers, Rikers, & Paas,

2010), and multimedia learning (Jamet, Gavota, & Quaireau, 2008; Hyona, 2010) in prior

studies.

More recently, EEG has been used to measure of cognitive load (Atonenko, et al. 2010).

The use of EEGs provides researchers with a continuous rating of cognitive load that can provide

a more accurate assessment of instructional interventions than a single subjective measure

(Atonenko, et al. 2010). Of particular interest are the P3 measures of attention (Debener, Makeig,

Delorme, & Engle, 2005). For example, various P3 measures from an EEG can provide insights

into involuntary, stimulus directed attention mechanisms as well as events that cause updating of

stimuli in working memory. Eye tracking will be correlated with simultaneous tracking of

electrical activity in the brain using an EEG machine to measure cognition. Specifically,

predominant signal peaks called event-related potential (ERP) in the P300 region will be linked

to measure the presence, absence, and amount of cognition associated with each of the areas in

the learning environments (Hillyard, 2009; Makeig, 2009; van Gog, Pass, & Sweller, 2010). By

adding EEG and eye-tracking measures with the more traditional self-reports of cognitive load,

we believe that we can obtain reliable measures of changes in mental effort. Using these data, we

can then determine when we need to include prompts for either generative strategies or self-

regulated learning prompts to help the learner develop a relevant mental model before the

learner’s working memory is overwhelmed. For classroom-based studies, physiological measures

are not feasible as they are designed for collection in a controlled lab environment. However, the

use of physiological measures to assess cognitive load and cognition has the potential to a) verify

subjective measures of cognitive load and b) provide important indicators of cognition. Eye

tracking and EEG data, for example might reveal areas of the page that students reach before

returning to a previous section, or otherwise dwell upon. These data could be triangulated with

think aloud data and may reveal an area of the text that is difficult. Subsequent iterations of the i-

textbook could target this section for prompting and strategy use, such as re-reading,

paraphrasing, or elaborative interrogation.

Cognitive abilities. Participants will be individually assessed on their verbal and

nonverbal working memory, to provide an estimate of their working memory capacity. A

modified version of Daneman and Carpenter’s listening span task (Daneman and Carpenter,

1980) will be used for verbal working memory. A modified version of the Wide Range

Assessment of Memory and Learning subtest Finger Windows (Sheslow & Adams, 2004) will be

used to assess nonverbal working memory. Students will be assessed on their spatial ability using

a composite version of Shepard and Metzler’s mental rotation task (Shepard & Metzler, 1971).

Self-regulated learning. Self-regulated learning and generative strategy use will be

measured using self-report, think aloud, and behavioral trace data. Students will take the

Motivated Strategies for Learning Questionnaire (MSLQ; Pintrich, Smith, Garcia & McKeachie,

1991), which is a self-report measure of self-regulated learning strategies that has been

effectively modified for use in junior high and middle school as well as college level populations

(Liu, 2003; Wolters, 2004). It is domain specific in the sense that individuals report on their use

of generative strategies and motivational preferences for a particular course. In selected studies,

students will also complete a think-aloud protocol in which they will be prompted to talk out

loud about what they are doing as they are doing it. Think aloud protocols have been

successfully used to capture self-regulated learning data in middle school and high school

students (Azevedo et al., 2008; McManus, 2000). Finally, trace data will be gathered from the

iPad1 software. The usage of prompts, highlighting and note-taking, and navigational behaviors

of students will be recorded. This will provide valuable feedback regarding actual usage of the

interactive features of the App, and will enable triangulation with learning outcomes.

Domain knowledge and attitudes. A pre-test will be given to students ahead of each

experimental study. The pre-test will consist of a prompt to write a short essay, followed by

multiple choice questions. Posttests will include comprehension questions that draw from

different levels of Bloom’s taxonomy, and will include text-explicit, text-implicit, and inference-

based questions (Morrison, Ross, Gopalakrishnan, & Casey, 1995). Questions requiring

simulation of a process will also be included in order to reveal the sophistication of students’

mental models for the relationships between components of specific geologic systems and

processes. A short survey will also be administered to students to assess their attitudes towards

learning Earth science content.

Time on task and process measures. Total time on task will be recorded from each iPad.

This is for formative evaluation reasons as well as pedagogical considerations. In addition, this

measure is of interest because research has mixed results regarding the effect of adding

interactivity (Tabbers & deKoeijer, 2010) and prompting (Atkinson & Renkl, 2007) on time on

task. For the paper version of the textbook pages, classroom behavioral observations will be

conducted to assess time on task for a random subsample of students in each class. Process

measures of usage (e.g. page turning, highlighting, clicking on graphics, and note-taking.) will be

recorded from the iPad.

Data Analysis. Qualitative and quantitative data analytic techniques will be used as

appropriate for each study. For the process data studies, think aloud data will be coded according

1 The term iPad is used as a generic term for any current or future pad type device that can be used in this study.

to a rubric that will establish processes and sub-processes in each phase of the self-regulated

learning cycle. Students’ pre-test essays will also be coded according to a rubric to establish the

sophistication of their mental model and comprehension of a particular phenomenon. Self-report

survey data will be processed in order to generate total scores for particular aspects of self-

regulated learning (e.g. cognitive versus metacognitive strategy use). Behavioral traces will be

coded according to strategy use. Behavioral measures taken during the learning task will be

recorded and in some cases (e.g. time on task) may be used as a dependent variable. For

experimental studies, multivariate analysis of variance and covariance will be used (MANOVA,

MANCOVA) to determine the effects of the independent variables on outcome variables such as

comprehension. Additional measures and assessments will be incorporated as part of the ongoing

formative and summative evaluation (see Evaluation section).

Procedure: Sequence of studies (Figure 2).

Year 1. The outcome of Year 1 will be the re-design of sections of middle school Earth

science textbook chapters. Potential topics might include earthquakes and volcanoes, erosion and

deposition, solar system, ocean water and ocean life, running water and ground water, and

moisture, clouds and precipitation. Specific topics will be determined in consultation with

teachers and partners to identify units with appropriate difficulty and that fit the classrooms’

schedules, that is, selecting topics that have not been addressed in earlier assignments. In order to

achieve this goal, we will undertake three studies. In study 1a we will gather samples of 5-7

existing Earth science textbooks, randomly select pages and illustrations using a protocol and,

using a rubric code features which increase extraneous cognitive load and decrease

comprehension because of split-attention and redundancy effects. Graphics will be classified

according to purpose and function (Carney, & Levin, 2002; Levin, Anglin, & Carney, 1987). The

primary hypothesis in study 1a is that existing middle school science textbooks contain features

which contribute to split-attention and redundancy effects. A second hypothesis is that a high

proportion of the images and graphics used in these textbooks are decorative, rather than

representational, organizational, interpretational, or transformational in function. Levin, Anglin,

& Carney (1987) reported effect sizes of .50 and higher for four of the five picture categories all

categories but decorative pictures. Thus, a secondary question is whether textbooks are using

pictures in a manner that supports learning (Carney & Levin, 2002).

In study 1b, N=120 middle school students in an Earth science course will review the

redesigned pages in a pilot test of the revised version. This version will incorporate Integrated

Graphics and no redundancy. Independent variables will include prior knowledge and self-

reported self-regulated learning. Dependent variables will include self-assessments of different

types of cognitive load (DeLeeuw & Mayer, 2008), time on task (Paas, Tuovinen, Tabbers, &

Van Gerven, 2003), and students’ understanding of key principles via a posttest of

comprehension and problem solving. Because this study is a pilot study, data will be collected

with a view to making further revisions of the materials.

Study 1c will be a 2x2 factorial experiment for study 1c. With 120 middle school

students, we will compare the effect of the original format textbook pages versus the Integrated

Graphic textbook pages, and the effect of reading these pages on paper versus reading them

electronically via an iPad2. Students in the electronic reading conditions will be provided with

the iPad ahead of time in order to reduce novelty effects. Students will engage in the reading task

during a regular class period, complete a short distractor task, and then a posttest. Independent

2 We will use the term iPad to refer to both the iPad and other similar pad type devices

measures will mirror those in study 1b. Additional dependent variables will include time on task

and an assessment of cognitive load. Hypotheses are that students in both paper and electronic

Integrated Graphics conditions will experience lower assessments of cognitive load, and superior

performance on the comprehension posttest. We do not expect to observe performance

differences for the manipulation of electronic versus paper medium. One research question of

interest is if there are any differences in time-on-task with the two different media (Shepperd,

Grace, & Koch, 2008). With a 2 X 2 balanced factorial design and 30 students per cell, a power

of 0.82 is obtained for detecting a moderately large effect size.

Year 2. Year 2 begins with a study in which process data are gathered. It continues with

studies which examine the effects of bringing interactive and adaptive features to the electronic

learning materials, as well as the effect of including prompts for generative strategy use, and the

effect of providing feedback following strategy use. Four smaller subsamples of students will

participate in Study 2a, the goal of which is to gather data describing the processes used as

students read the text. Eye tracking and EEG data will be collected for two groups of students as

they read either the electronic original format text (n=20) or the electronic Integrated Graphics

text (n=20). Think aloud data will be collected for two more groups of students as they read

either the original format (n=20) or Integrated Graphics text (n=20). We hypothesize that eye

tracking and EEG data will reveal evidence of lower cognitive load in the Integrated Graphics

text format conditions. We hypothesize that analyses of think aloud data will reveal fewer

instances of comprehension breakdown in the Integrated Graphics text condition. The data will

also be analyzed to determine specific points in the text that are difficult to understand. These

results will be used to identify when to add supports (prompts) in later studies.

After closely reviewing the results of study 1c and 2a, in Study 2b we will pilot test

refined versions of the electronic pages. Student and teacher surveys and focus groups with 10-

15 science teachers will also be conducted. The objective is to increase the richness of

information about strengths and weaknesses in students’ generative learning strategies and

science reasoning/critical thinking skills. We will use the resulting information to select a small

number of critical generative learning strategies that will be incorporated as prompts in the Year

2 version of the materials. Prior research suggests that both pictures (Anglin, Vaez, &

Cunningham, 2004; Levie & Lentz, 1982) and generative strategies (Johnsey, Morrison, & Ross,

1992; Rigney, 1978) need appropriate prompts and training in use for effectiveness. In addition,

consultation with science teachers and science experts will facilitate the design of interactive

elements into the textbook graphics. Interactive features will include learner-controlled labeling

within the graphic.

Data from Study 2a and 2b will be used to inform the nature and position of the prompts

in the final version of the learning materials for Study 2c. Study 2c will be a 2x2x2 factorial

design involving (n=120) students in classroom settings. Independent variables will mirror study

1b with regard to learner differences. For the i-textbook pages, independent variables will

include static versus interactive graphics, prompted strategy use versus no prompted strategy use,

and feedback versus no feedback following strategy use. Feedback is expected to be beneficial.

For example, Azevedo (1995) found that immediate feedback raised performance by an average

effect size of .80. Static graphics will be of the Integrated Graphic type, with labels included as

part of the graphic. Interactive graphics will have labels which can be viewed by touching a hot

area within the image. In the prompted strategy use conditions, students will be prompted by the

application to engage in a strategy prior to moving to the next section of the text. In the feedback

conditions, students will be prompted to engage in the strategy, review the product of an ‘expert’

using the strategy, and will then be prompted to compare their own work to that of the expert.

Students will complete the textbook reading task during class time, will be provided with a short

distractor task, and then will take a posttest. The posttest will parallel those in the previous

studies but students’ notes and other physical traces of strategy use will be collected and

examined. Additional measures of time on task and cognitive load will be gathered. Our

hypotheses are that there will be main effects for graphic type, prompting and feedback.

Interaction effects may be present, such that students who experience the interactive graphics

with prompted support for strategy use and feedback, outperform students in other conditions.

One research question of interest in this study is whether there is evidence of cutting and pasting

for the generative strategy (Shepperd et al., 2008).

Year 3. Study 3a will explore the impact of incorporating animations and simulations

into the textbook pages (Mayer, 2001). Animations can help the learner develop conceptual

models of how the phenomena interacts (Mayer & Moreno, 2002). Similarly, simulations allow

the learner to explore complex and dynamic relationships and to formulate and test hypotheses

about the outcomes if parameters of a simulation were to be changed (Lee, Plass & Homer,

2006). Recent research, however, by Mayer, Hegarty, Mayer, and Campbell (2005) suggests that

static pictures are more effective than animations. Animations may be more effective for learners

with limited spatial ability (Bartholome & Bromme, 2009; Huk, 2006) or to animate processes

that cannot be seen such as the movement of air or evaporation of water. This strategy can be

seen as an extension of the congruence principle (Tversky, Morrison & Betrancourt, 2002),

which states that effective animations and graphics must parallel the structural elements and

causal behavior of the individual’s mental model during simulations. Thus, if the quality of the

learner’s mental model will be enhanced by the animation or simulation then they should be

included (Reed, 2010). However, if the learner’s lack of prior knowledge is such that they would

attend to irrelevant information then animations may not be the most useful multimedia strategy

(Lowe, 1999). A significant advantage of the static visuals over animations is the lower cost for

development. In this experiment, graphic type (interactive graphics vs animated graphics vs

animation with simulation) will be crossed with explanation modality (text vs narration),

resulting in a 3 x 2 factorial design. As before, we will assess the quality of prior knowledge

using a single essay prompt given prior to the experimental session. These data will allow

analyses to consider low and high domain knowledge as an independent variable. On the

condition that prompting and feedback are beneficial to learning, all conditions will include

prompting and feedback. Dependent variables will parallel those in study 2c. The hypotheses

concern the improvement in learning outcome for animation versus static graphics, and the

further improvement for animation plus simulation. We expect that this effect may depend on the

nature of the posttest, and that students in the simulation condition may outperform other

students on measures of problem solving and transfer only (Lee, Plass & Homer, 2006). We also

suspect that learner variables such as prior knowledge may interact with manipulated i-textbook

features.

In study 3b we pilot test materials for study 4a. A single class of students (n=25) will use

the interactive, adaptive materials in order to ensure that they are sufficiently easy to use, and to

inform the need for any additional prompts. A panel of teachers will provide feedback during the

development of the redesigned materials.

Year 4. In study 4a we manipulate the variables of learner control and adaptive support,

for three levels of self-regulated learning skill. Using self-report data, students will be classified

as having high, medium or low self-regulated learning skills. As before, prior knowledge will be

assessed via a pre-test essay prompt, and will be used to determine if low and high prior

knowledge interacts with the other independent variables. Self-regulated learning skill will be

crossed with one of three types of text. The first will provide strategy-related prompts and

feedback at the end of each section. The second will provide prompting and feedback should the

student’s performance on end-of-section comprehension questions fall below a criterion level.

The third type gives the learner control over whether or not to activate the prompting and

feedback prior to the beginning of each section. Graphic features of the textbook will match

those found to be most effective in study 3a and 3b. Dependent variables will mirror those in

study 2c. We hypothesize that significant interactions will occur. Learners with low SRL skills

will perform the most poorly in the learner control condition and will exhibit the best

performance in the continuous support condition. Learners with high SRL skills may actually

perform better in the learner control condition than in the continuous support condition. This

finding has been documented as a parallel expert reversal effect with self-regulated learning as

the independent variable (Kalyuga, Chandler, & Sweller, 2003; Young, 1996). Dependent

variables will parallel those in studies 1c, 2b and 2c. The results of this experiment will be

compared to research investigating the ability of students to control the pace and sequence of

their learning (the interactivity principle), research on intelligent tutoring systems, and research

on the impact of high and low domain knowledge and self-regulated learning skills on navigation

through and learning from technology-enhanced text.

By the fourth year we will have gathered empirical data that will allow us to draw

conclusions about the types of electronic textbook pages which best promote learning of Earth

science content and the role of learner variables in predicting learning outcomes. We will

conduct a final round of focus groups and classroom observations to gather information about

how i-textbook chapters could best be used in the course of a regular instructional period. We

will assess students’ attitudes towards the final versions of the materials. Our final materials will

include redesigned and empirically tested i-textbook chapter materials suitable for up to one

marking period of an Earth Science course. During Year 4 we will produce the guidelines for

publishers and authors. We will continue to disseminate the results of the project. Importantly,

we will develop and give webinars to convey information about i-textbook redesign, the project’s

findings, and information for teachers regarding how the materials can be used in the classroom.

We will also begin to develop teacher professional development seminars and supporting

materials in order to facilitate teachers’ use of the i-textbooks.

Figure 2. Timeline for the research

Conclusion

Textbooks in the United States have generally been “designed to sell,” not designed to

support student learning. Even existing texts are rife with features that increase extraneous

cognitive load, and make access to higher level content difficult for all students, but particularly

those with special needs. Currently, e-texts do not capitalize on the computing capacity behind

them to integrate well-established principles of learning theory, or to flexibly adapt to learner

needs, whether the learner has executive function of self-regulation difficulties, or is an “expert.”

Through this planned research and development effort, we hope to create the next generation of

interactive expository materials that will increase access to advanced science content for diverse

student populations, and provide a framework for large-scale production of adaptive materials

for major publishers of educational materials.

References

Advisory Committee on Student Turn the page: Making college textbooks more affordable. Washington, DC: Advisory Committee on Student Financial Assistance. Retrieved December 14, 2010 from http://www2.ed.gov/about/bdscomm/list/acsfa/turnthepage.pdf

Amadieu, F., van Gog, T., Paas, F., Tricot, A., & Marine, C. (2009). Effects of prior knowledge and concept-map structure on disorientation, cognitive load, and learning. Learning and Instruction, 19, 376-386.

Anglin, G. J., Vaez, H., & Cunningham, K. L. (2004). Visual representations and learning: The role of static and animated graphics. In D. H. Jonassen (Ed.), Handbook of research for educational communications and technology (2 ed., pp. 865-916): Mahwah, NJ, Lawrence Erlbaum Associates, Publishers.

Anglin, G. J., & Morrison, G. R. (2001). Cognitive load theory: implications for instructional design research and practice. Paper presented at the Annual meeting of the Association of Educational Communications and Technology, Atlanta, GA.

Atkinson, R.K., & Renkl, A. (2007).Interactive example-based learning environments: Using interactive elements to encourage effective processing of worked examples. Educational Psychology Review 19, 375-386.

Atonenko, P., Paas, F., Grabner, R., & Van Gog, T. (2010). Using electroencephalography to measure cognitive load. Educational Psychological Review, 22(425-438). doi: 10.1007/s10648-010-9130-y

Azevedo, R., Cromley, J., & Seibert, D. & Tron, M. (2003). The role of co-regulated learning during students’ understanding of complex systems with hypermedia. Paper presented at the Annual Meeting of the American Educational Research Association, Chicago, IL.

Azevedo, R., Guthrie, J. & Seibert, D. (2004). The role of self-regulated learning in fostering students’ conceptual understanding of complex systems with hypermedia. Journal of Educational Computing Research 30, 87-111.

Azevedo, R. & Hadwin, A. (2005). Scaffolding self-regulated learning and metacognition: Implications for the design of computer-based scaffolds. Instructional Science 33, 367-379.

Azevedo, R., Moos, D.C., Greene, J.A., Winters, F.I., & Cromley, J.G. (2008). Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia? Educational Technology Research and Development 56, 45-72.

Bartholomé, T., & Bromme, R. (2009). Coherence formation when learning from text and pictures: What kind of support for whom? Journal of Educational Psychology 101, 282-293.

Best, R.M., Rowe, M., Ozuru, Y., & McNamara, D. S. (2005). Deep-level comprehension of science texts: The role of the reader and the text. Topics in Language Disorders, 25(1), 65.

Bobis, J., Sweller, J., & Cooper, M. (1993). Cognitive load effects in a primary-school geometry task. Learning & Instruction, 3(1), 1-21.

Boucheix, J.M. & Lowe, R.K. An eye tracking comparison of external pointing cues and internal continuous cues in learning with complex animations. Learning and Instruction, 20, 123-135

Boyd, F., & Thompson, M. (2008). Multimodality and literacy learning: Using multiple texts to enhance content-area reading. In K. A. Hinchman & H. Sheridan-Thomas (Eds), Best practices in adolescent literacy instruction (pp. 151-163). NY: Guilford.

Brown, D.F., & Canniff, M. (2007). Designing curricular experiences that promote young adolescents’ cognitive growth. Middle School Journal 39, 16-23.

Butcher, K.R. (2006). Learning from text with diagrams: Promoting mental model development and inference generation. Journal of Educational Psychology 98, 182-197.

Carney, R. N., & Levin, J. R. (2002). Pictorial illustrations still improve students' learning from text. Educational Psychology Review, 14(1), 5-26.

Chandler, P., & Sweller, J. (1991). Cognitive load theory and the format of instruction. Cognition & Instruction, 8(4), 293-332.

Chandler, P., & Sweller, J. (1992). The split-attention effect as a factor in the design of instruction. British Journal of Educational Psychology 62, 233–246.

Chi, M.T.H., Bassok, M., Lewis, M.W., Reimann, P., & Glaser, R. (1989). Self-explanations: how students study and use examples in learning to solve problems. Cognitive Science 15, 145-182.

Clay, M. M. (1991). Becoming literate: The construction of inner control. Portsmouth, N.H: Heinemann. Cobb, P., Confrey, J., deSessa, A., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32, 9 -13. Daneman, M. & Carpenter, P. (1980). Individual differences in working memory and

reading. Journal of Verbal Learning and Verbal Behavior 19, 450-466. Debener, S., Makeig, S., Delorme, A., & Engle, A. K. (2005). What is novel in the novelty

oddball paradigm? Functional significance of the novelty P3 event-related potential as revealed by independent component analysis. Cognitive Brain Research, 22, 309-321. doi: 10.1016/j.cogbrainres.2004.09.006

De Koning, B. B., Tabbers, H.K., Rikers, R. M.J. P., & Paas, F. (2010). Attention guidance in learning from a complex animation: Seeing is understanding? Learning and Instruction, 20, 111-122

DeLeeuw, K.E., & Mayer, R.E., (2008). A comparison of three measures of cognitive load: Evidence for separable measures of intrinsic, extraneous, and germane load. Journal of Educational Psychology 100, 223-234.

Deouell, L.Y. & Knight, R.T. (XXXX). Executive function and higher-order cognition: EEG studies. In L.R. Squire (Ed.), Encyclopedia of Neuroscience (pp. 105-109). Amsterdam: Elsevier

Fountas, I. C. & Pinnell, G.S. (2005). Leveled books, K–8: Matching texts to readers for effective teaching. Portsmouth, NH: Heinemann. Grabowski, B. J. (2004). Generative learning contributions to the design of instruction and

learning. In D. J. Jonassen (Ed.), Handbook of educational communications and technology (2nd ed., pp. 719-743). Hillsdale, NJ: Lawrence Erlbaum Associates, Publishers.

Greca, I. (2000). Mental models, conceptual models, and modelling. International Journal of Science Education 22, 1-11.

Greene, J.A., Costa, L-J., Robertson, J., Pan, Y. & Deekens, (2010). Exploring relations among college students’ prior knowledge, implicit theories of intelligence, and self-regulated learning in a hypermedia environment. Computers and Education 55, 1027-1043.

Hall, T., Strangman, N., & Meyer, A. (2003). Differentiated instruction and implications for UDL implementation. Wakefield, MA: National Center on Accessing the General Curriculum. Retrieved from http://aim.cast.org/learn/historyarchive/backgroundpapers/differentiated.

Hillyard, S.A. Event-related potentials (ERPs) and cognitive processing. . In L.R. Squire (Ed.), Encyclopedia of Neuroscience (pp. 13-18). Amsterdam: Elsevier Hoffler, T.N., & Lentner, D. (2007). Instructional animation versus static pictures: A meta-analysis. Learning and Instruction 17, 722-738.

Hyona, J. (2010). The use of eye movements in the study of multimedia learning. Learning and Instruction, 20, 172-176.

Jamet, E., Gavota, M., & Quaireau, C. (3008). Attention guiding in multimedia learning. Learning and Instruction, 18, 135-145.

Johnsey, A., Morrison, G. R., & Ross, S. M. (1992). Promoting generative learning in computer-based instrution through the use of elaboration strategies in training. Contemporary Educational Psychology, 17, 125-135.

Jonassen, D.H. (1988). Instructional Designs for Microcomputer Courseware. Heinich, R. M. (1984). The proper study of instructional technology. Educational

Communications and Technology Journal, 32, 67-87. Huk, T. (2006). Who benefits from learning with 3D models? The case of spatial ability.

Journal of Computer Assisted Learning 22, 392–404 Kalyuga, S., Chandler, P., & Sweller, J. (2003). Expertise reversal effect. Educational

Psychologist, 38(1), 23-31. Lee, J., & Park, O. (2008). Adaptive instructional systems. In J. M. Spector, M. D. Merrill, J.

v. Merriënboer & M. P. Driscoll (Eds.), Handbook of research on educational communications and technology (3rd ed., pp. 470-484). New York: Taylor Francis.

Lee, H., Plass, J. & Homer, B. (2006). Optimizing cognitive load for learning from computer-based science simulations. Journal of Educational Psychology 98, 902-913.

Levie, W. H., & Lentz, R. (1982). Effects of text illustrations: A review of research. Educational Communications and Technology Journal, 30(4), 195-232.

Levin, J. R., Anglin, G. J., & Carney, R. N. (1987). On empirically validating functions of pictures in prose. In D. M. Willows & H. A. Houghton (Eds.), The Psychology of illustration, Volume 1: Basic research (pp. 51–80). New York: Springer-Verlag.

Lowe, R. (1999). Extracting information from an animation during complex visual processing. European Journal of the Psychology of Education 14, 225-244.

Makeig, S. (2009). Electrophysiology: EEG and ERP analysis. In L.R. Squire (Ed.), Encyclopedia of Neuroscience (pp. 879-882). Amsterdam: Elsevier

May, J. G., Kennedy, R. S., Williams, M. C., Dunlap, W. P., & Brannan, J. R. (1990). Eye movement indices of mental load. Acta Psychologica, 75, 75-89.

Mayer, R.E. (2001). Multimedia Learning. New York: Cambridge University Press

Mayer, R. E. (2008). Applying the Science of Learning: Evidence-Based Principles for the Design of Multimedia Instruction. American Psychologist, 63(8), 760-769.

Mayer, R. E., & Chandler, P. (2001). When Learning Is Just a Click Away: Does Simple User Interaction Foster Deeper Understanding of Multimedia Messages? Journal of Educational Psychology, 93(2), 390-397.

Mayer, R.E., Dow, G.T., & Mayer, S. (2003). Multimedia learning in an interactive self-explaining environment: What works in the design of agent-based microworlds? Journal of Educational Psychology 95, 806-813.

Mayer, R. E., Hegarty, M., Mayer, S., & Campbell, J. (2005). When static media promote active learning: Annotated illustrations versus narrated animations in multimedia instruction. Journal of Experimental Psychology, 11(4), 256-265. doi: 10.1037/1076-898X.11.4.256

Mayer, R.E., & Moreno, R. (2002). Aids to computer-based multimedia learning. Learning and Instruction 12, 107-119.

Mayer, R.E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist 38, 43-52.

Mayer, R.E. & Sims, V.K. (1994). For whom is a picture worth a thousand words? Extensions of a dual-coding theory of multimedia learning. Journal of Educational Psychology 86, 389-401.

Miller, G. A. (1956). The Magical Number Seven, Plus or Minus two: Some limits on our capacity for processing information. Psychological Review, 63, 81-97.

McManus, T. (2000). Individualizing instruction in a web-based hypermedia learning environment. Nonlinearity, advance organizers, and self-regulated learners. Journal of Interactive Learning Research 11, 219-251.

Moje, E. & Speyer, J. (2008). The reality of challenge texts in high school science and social studies: How teachers can mediate comprehension. In K. A. Hinchman & H. Sheridan-

Thomas, (Eds), Best practices in adolescent literacy instruction (pp151-163). (pp.185-211). NY: Guilford.

Morrison, G. R., Ross, S. M., Gopalakrishnan, M., & Casey, J. (1995). The effects of feedback and incentives on achievement in computer-based instruction. Contemporary Educational Psychology 20, 32-50.

Paas, F., Tuovinen, J.E., Tabbers, H.K., & Van Gerven, P.W.M. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist 38, 63-71.

Park, O., & Lee, J. (1996). Adaptive instructional systems. In D. Jonassen (Ed.), Handbook of research on educational communications and technology (2nd ed., pp. 651-684). Maway, NJ: Lawrence Erlbaum Associates, Publishers.

Pintrich, P.R., Smith, D.A.F., Garcia, T. & McKeachie, W.J. (1991). A manual for the use of the Motivated Strategies for Learning Questionnaire. (Tech. Rep. No. 91-B-004). Ann Arbor: University of Michigan.

Pociask, F. D., & Morrison, G. R. (2008). Controlling split attention and redundancy in physical therapy instruction. Educational Technology Research and Development, 64(4), 379-399.

Pressley, M. (2000). What should comprehension instruction be the instruction of? In M. L. Kamil, P.B. Mosenthal, P.D. Pearson, & R. Barr (Eds.), Handbook of Reading Research,(Vol. 3, pp.545-561). Mahwah: NJ: Lawrence Erlbaum.

Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124, 372-422

Reed, S.K. (2010). Cognitive architectures for multimedia learning. Educational Psychologist 41, 87-98.

Reder, L., & Anderson, J. R. (1980). A comparison of texts and their summaries: Memorial consequences. Journal of verbal learning and verbal behavior, 19, 121-134.

Reder, L., & Anderson, J. R. (1982). Effects of spacing an embellishment on memory for main points of a text. Memory & Cognition, 10, 97-102. Renkl, A., Atkinson, R.K., & Groβe, C.S. (2004). How fading worked solution steps works – a cognitive load perspective. Instructional Science 32, 59-82.

Renckl, A. (2002). Learning from worked-out examples: Instructional explanations supplement self-explanations. Learning and Instruction 12, 149-176. Renkl, A., Atkinson, R.K., & Große, C.S. (2004). How fading worked solution steps works - a cognitive load perspective. Instructional Science 32, 59-62.

Rigney, J. (1978). Learning strategies: A theoretical perspective, pp. 164-205. In H. F. O’Neil (ed.), Learning Strategies. New York: Academic Press.

Ross, S. M., Morrison, G. R., & O'Dell, J. (1988). Obtaining more out of less text in CBI: Effects of varied text density levels as a function of learner characteristics and control strategy. Educational Communications and Technology Journal, 36, 131-142.

Shepard, R. & Metzler, J. (1971). Mental rotation of three dimensional objects. Science 171, 701-703.

Shepperd, J. A., Grace, J. L., & Koch, E. J. (2008). Evaluating the eectronic textbook: Is it time to dispense with paper text? Teaching of Psychology, 35, 2-5.

Sheslow, D., & Adams, W. (2004). The Wide Range Assesment of Memory and Learning. Dallas, TX; Pro-Ed, Inc.

Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257-285.

Sweller, J. (1999). Instructional design in technical areas. Australian Education Review, No. 43 (pp. 168). Australia; Victoria.

Sweller, J. & Chandler, P. (1994). Why some material is difficult to learn. Cognition and Instruction 12, 185-223.

Sweller, J., van Merriënboer, J. J. G., & Pass, F. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251-296.

Schnotz, W., & Kurschner, C. (2007). A reconsideration of cognitive load theory. Educational Psychology Review 19, 469-508.

Tarmizi, R. A., & Sweller, J. (1988). Guidance during mathematical problem solving. Journal of Educational Psychology, 80(4), 424-436.

Tabbers, H.K., & deKoeijer, B. (2010). Learner control in animated multimedia instructions. Instructional Science: An International Journal of the Learning Sciences 38, 441-453. Tran, M. (2009). Arnold Schwarzenegger to scrap school textbooks in favour of ebooks:

Governor of California seeks to cut budget deficit by replacing ‘outdated’ textbooks with electronic reading devices. Retrieved December 14, 2010 from http://www.guardian.co.uk/world/2009/jun/09/arnold-schwarzenegger-school-textbooks-ebooks

Tversky, B., Bauer-Morrison, J., & Betrancourt, M. (2002). Animation: Can it facilitate? International Journal of Human-Computer Studies 57, 247-262.

van Gog, T., Kester, L., Nievelstein, F., Giesbers, B., & Paas, F. (2009). Uncovering

cognitive processes: Different techniques that can contribute of cognitive load research and instruction. Computers in Human Behavior, 25, 325-331. doi: 10.1016/j.chb.2008.12.021

van Gog, T., Paas, F. & Sweller, J. (2010). Cognitive load theory: Advanced in research on worked examples, animations, and cognitive load measurement. Educational Psychological Review, 22, 375-378

Weinstein, C.E., & Mayer, R.E. (1986). The teaching of learning strategies. In M. Wittrock, (Ed.) Handbook of Research on Teaching. New York: MacMillan Publishing. (p.315-327).

Winograd, P. & Johnston, P. (1982). Comprehension monitoring and the error detection paradigm. Journal of Reading Behavior 14, 61-70.

Wittrock, M. C. (1974). A generative model of mathematics education. Journal of Research in Mathematics Education, 5(4), 181-196.

Wittrock, M. C. (1974). Learning as a generative process. Educational Psychologist, 19(2), 87-95.

Wittrock, M. C. (1974). Learning as a generative process. Educational Psychologist, 11, 87-95.

Wittrock, M. C. (1989). Generative processes of comprehension. Educational Psychologist, 24, 345–376.

Wittrock, M. C. (1992). Generative teaching: An enhancement strategy for the learning of economics in cooperative groups. American Educational Research Journal, 29, 861-876.

Young, J.D. (1996). The effect of self-regulated learning strategies on performance in learner controlled computer-based instruction. Educational Technology Research and Development 44, 17-27.

Zimmerman, B. J. (2000). Attaining self-regulation: A social cognitive perspective. In M.Boekaerts & P. R. Pintrich (Eds.). Handbook of self-regulation (pp. 13–39). New York: Academic Press.