chapter11
TRANSCRIPT
![Page 1: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/1.jpg)
Chapter 11Revising instructional materials
By Gerral Pinkston
![Page 2: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/2.jpg)
The Dick and Carey Model
Assess Needs to identify Goal(s)
Conduct Instructional
Analysis
Analyze Learners and
Contexts
Write Performance Objectives
Revise Instruction
Develop Assessment Instruments
Develop Instructio
nal Strategy
Design and Conduct
Formative Evaluation
of Instruction
Design and Conduct
Summative Evaluation
Develop and Select
Instructional Materials
![Page 3: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/3.jpg)
Objectives
Describe various methods for summarizing data obtained from formative evaluation studies.
Summarize data obtained from formative evaluation studies.
Given formative evaluation data for a set of instructional materials, identify problem in the materials, and suggest revisions for the materials.
![Page 4: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/4.jpg)
Two basic types of revisions
The first is changes that are made to the content or substance of the materials to make them more accurate or more effective as a learning tool.
The second type of change is related to the procedures employed in using your materials.
![Page 5: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/5.jpg)
Analyzing data from one-to-one trials
The designer has five kinds of basic information available:
1. Learner characteristics and entry behaviors2. Direct responses to the instruction3. Learning time4. Posttest performance5. Responses to an attitude questionnaire.
![Page 6: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/6.jpg)
Analyzing data from one-to-one trials
The steps of analyzing data1. The first step is to describe the learners and
to indicate their performance on any entry-behavior measures.
2. Next, the designer should bring together all the comments and suggestions about the instruction that resulted from going through it with each learner.
3. Begin by obtaining individual item performance and then combine item scores for each objective and for a total score.
![Page 7: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/7.jpg)
Analyzing data from one-to-one trials
Revise the instruction:Try to determine, based in learner performance,whether your rubric or test items are fault. If flawed, then changes should be made to make them consistent with the objectives and the intent of the instruction. If the items are satisfactory, and the learners performed poorly, then the instruction must be changed.
![Page 8: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/8.jpg)
Analyzing data from one-to-one trials
You have three sources of suggestions for change: learner suggestions, learner performance, and your own reactions to the instruction.
![Page 9: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/9.jpg)
Analyzing data from small-group and field trials
The available data typically include the following:
1. item performance on the pretest, 2. posttest, 3. responses to an attitude questionnaire; 4. learning and testing time;5. comments made directly in the materials.
![Page 10: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/10.jpg)
Analyzing data from small-group and field trials
The purpose for the item-by-objective analysis is threefold:
1. To determine the difficulty of each item for the group
2. To determine the difficulty of each objective for the group3. To determine the consistency with which
the set of items within an objective measures learners’ performance on the objective.
![Page 11: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/11.jpg)
Analyzing data from small-group and field trials
Learners’ item–by-objective performance
From these data the designer could infer that:
1. The group selected was appropriate for the evaluation
2. The instruction covered skills not previously mastered by the group, and
3. The instruction was effective in improving learners’ skills.
![Page 12: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/12.jpg)
Why the individual item information is required?
Item information can be useful in deciding whether there are particular problems with the item or whether it is effectively measuring the performance described in its corresponding objective.
Individual item information can be used to identify the nature of the difficulties learners are having with the instruction.
Individual item data can be combined to indicate learner performance on an objective, and eventually, on the entire test.
![Page 13: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/13.jpg)
Graphing learners’ performances
Another way to display data is through various graphing techniques.
Another graphic technique for summarizing formative evaluation data involves the instructional analysis chart.
![Page 14: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/14.jpg)
Other types of data
It has been found that a good way to summarize data from an attitude questionnaire .
Another important type of data is the comments obtained from learners, from other instructors involved in the formative evaluation, and from subject-matter-experts who react to the materials.
The final type of data summary you may wish to prepare is related to any alternative approaches you may have used during either the small-group or field-trial evaluations.
![Page 15: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/15.jpg)
Sequence for examining data
Entry behaviorsPretests and posttestsInstructional strategyLearning timeInstructional procedures
![Page 16: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/16.jpg)
Revision process
We suggest that as you begin the revision process ,you summarize your data as suggested in this chapter.
Given all the data from a small-group or fields-trial evaluation, the designer must make decisions about how to make the revisions.
Otherwise, the strategies suggested for revising instruction following the one-to-one evaluations also apply at this point-namely, use the data , your experience, and sound learning principles as the bases for your revisions.
![Page 17: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/17.jpg)
Revising selected materials
When working with selected materials, however, there is little opportunity to revise the materials directly ,especially if they are commercially produced and copyrighted. with copyrighted materials, the instructor can consider the following adaptations for future trials:
(1) omit portions of the instruction, (2) include other available materials, or (3) simply develop supplementary instruction.
![Page 18: Chapter11](https://reader036.vdocument.in/reader036/viewer/2022082921/5560ceb0d8b42a3c158b4d1e/html5/thumbnails/18.jpg)
Revising instructor-led instruction
Instructors working from an instructor’s guide have the same flexibility as the developer for changing instruction.
The instructor’s notes from the guide should reflect questions raised by learners and responses to those questions.
Unlike using written instructional materials, the instructor can revise the presentation during its implementation and note the reasons for the change.