document resume - eric · document resume fd 337 709 ce 059 507 author haggett, connie d.; banski,...

48
DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist in Evaluating Handicapped Vocational Students for IEPs. Final Report. INSTITUTION Pennsylvania State Univ., University Park. Dept. of Agricultural and Extension Education. SPONS AGENCY Pennsylvania State Dept. of Education, Harrisburg. Bureau of V(Lational and Adult Education. PUB DATE Oct 88 CONTRACT PDE-94-8006 NOTE 48p. PUB TYPE Reports - Research/Technical (143) EDRS PRICE MF01/PCO2 Plus Postage. DESCRIPTORS Academic Ability; Aptitude Tests; *Computer System Design; Diagnostic Tests; *Disabilities; *Disadvantaged; Examiners; *Expert Systems; High Schoolai *Individualized Education Programs; Intelligence Quotient; Interest Inventories; Scores; *Special Needs Students; Test Interpretation; Vocational High Schools IDENTIFIERS Pennsylvania ABSTRACT The development of individualized educational programs (IEPs) has become a burden for many secondary school systems. The primary objective of the project described in this report was to develop a computer system that would help in the development of IEPs for all 15,000 handicapped and/or disadvantaged students enrolled in Pennsylvania's vocational programs. Collection of tests and their criteria used in IEP development was the method used to obtain data, using a 10% sampling of school districts. The Singer Vocational Evaluative System and the Vocationa Interest Assessment Survey were incorpora,_ed in the program. Information was put in the proper computer syntax, and logic sequence models for data usage were constructed. The instrument was tested using data appropriate for handicapped students enrolled in the programs. The system performs the following operations: (1) locates discrepancies and results of intelligence quotient (IQ) tests; (2) classifies the IQ score; (3) clmpares achievement and IQ standardized results; (4) classifies isolated IQ results into educational terms; and (5) offers some guidelines related to a student's probable ecademic abilities. The following factors may affect the results offerbd by the program: physical limitations of the student; basing decision on aptitude or interest results as isolated test scores; and evaluator errora--these may be eliminated by reviewing test procedures. (Five appendices forming the bulk of the document are: (1) list of professional contacts and organizations; (2) sampling of special needs students' assessment instruments; (3) users' guide--IEP assessment aid; (4) sample computer assessment output; and (5) computer programmed information.) (NLA)

Upload: others

Post on 16-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

DOCUMENT RESUME

FD 337 709 CE 059 507

AUTHOR Haggett, Connie D.; Banski, KathleenTITLE Development and Testing of an Expert System To Assist

in Evaluating Handicapped Vocational Students forIEPs. Final Report.

INSTITUTION Pennsylvania State Univ., University Park. Dept. ofAgricultural and Extension Education.

SPONS AGENCY Pennsylvania State Dept. of Education, Harrisburg.Bureau of V(Lational and Adult Education.

PUB DATE Oct 88CONTRACT PDE-94-8006NOTE 48p.

PUB TYPE Reports - Research/Technical (143)

EDRS PRICE MF01/PCO2 Plus Postage.DESCRIPTORS Academic Ability; Aptitude Tests; *Computer System

Design; Diagnostic Tests; *Disabilities;*Disadvantaged; Examiners; *Expert Systems; HighSchoolai *Individualized Education Programs;Intelligence Quotient; Interest Inventories; Scores;*Special Needs Students; Test Interpretation;Vocational High Schools

IDENTIFIERS Pennsylvania

ABSTRACTThe development of individualized educational

programs (IEPs) has become a burden for many secondary schoolsystems. The primary objective of the project described in thisreport was to develop a computer system that would help in thedevelopment of IEPs for all 15,000 handicapped and/or disadvantagedstudents enrolled in Pennsylvania's vocational programs. Collectionof tests and their criteria used in IEP development was the methodused to obtain data, using a 10% sampling of school districts. TheSinger Vocational Evaluative System and the Vocationa InterestAssessment Survey were incorpora,_ed in the program. Information wasput in the proper computer syntax, and logic sequence models for datausage were constructed. The instrument was tested using dataappropriate for handicapped students enrolled in the programs. Thesystem performs the following operations: (1) locates discrepanciesand results of intelligence quotient (IQ) tests; (2) classifies theIQ score; (3) clmpares achievement and IQ standardized results; (4)classifies isolated IQ results into educational terms; and (5) offerssome guidelines related to a student's probable ecademic abilities.The following factors may affect the results offerbd by the program:physical limitations of the student; basing decision on aptitude orinterest results as isolated test scores; and evaluator errora--thesemay be eliminated by reviewing test procedures. (Five appendicesforming the bulk of the document are: (1) list of professionalcontacts and organizations; (2) sampling of special needs students'assessment instruments; (3) users' guide--IEP assessment aid; (4)sample computer assessment output; and (5) computer programmedinformation.) (NLA)

Page 2: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

FINAL REPORT

Development and Testing of an Expert System to Assist inEvaluating Handicapped Vocational StudentF, for DM

(PDE Project Contract # 94-8006)

submitted by

Connie D. Baggett, Assistant ProfessorDepartment of Agricultural and Extension Education

The Pennsylvania State University

and

Kathleen Banski, Graduate AssistantDepartment of Agricultural and Extension Education

The Pennsylvania Stat: University

submitted to

The Bureau of Adult and Vocational EducationThe Pennsylvania Department of Eduattion

Harrisburg, Pennsylvania

11 l SPANTNENT OF ODUCAT1ONot eduatoonol Rawer tend Improtromont

TIMM, RESOURCES INFORMATTONCENTER fERIC)

Tine document OP boon HOW odueod itsmoved from Ow Dome of emendationongmetsild et

0 Moot charcoo Noo OW mods to flown*reproduction quality

Points of wow of optvons stator, in the docv-mord do not neceseenN rodritnnt *MoatOEM pooshoo of pokey

October 1988

2BEST COPY MILANI

"PERMISSION TO REPRODUCE THISMATERIAL HAS BEEN GRANTED BY

TO THE EDUCATIONAL. RESOURCESINFORMATION CENTER (ERIC)."

Page 3: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

a

:

CONTENTS

Introduction 1

Rational 2

Using an Expert System 3

Objectives 1.,

Procedures 4

The Singer Vocational Evaluation System 5

Vocational Interest Assessment Survey 6

Interpretation of Results 7

Output Description

Acheivement Results 8

Intelligence Results 9

Vocational Results 10

Assumptions 10

Levels of Adaptive Behavior for the Mentally Retarded 11

Appendices

List of Contacts 12

Sampling of Assessment Instruments 14

User GuideIEP Assessment Ad for Special Needs Students 16

Sample Computer Output in Assessment for Special Needs Students 18

Computer Programmed Information 31

Page 4: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

Development and Testing of an Expert System to Assist inEvaluating Handicapped Vocational Students for IEPs

jtajumucrum

"Mainstr' earning" and "normal 'on" are terms frequently used throughout our

educational system. They refer to program planning and implementation for the special

..xds student .

Frequently, special needs students are placed in a mainstream classroom in order to

meet normalization criteria. Mainstream placement occurs to achieve the most appropriate

and least restrictive educational environment. Unfortunately, the mainstream classroom

teacher is often inadequately prepared to meet the educational requirements of the special

needs student. Learning how to identify, appropriately assess and program for the student

requires additional time and training, not often provided the normal classroom teacher.

In the high school setting in particular, guidance counselors are often busy attempting

to assist the college bound student with placement ideas. School psychologists, who often

have adequate training and background information related to the special needs student,

spend hours attempting to appmpriately assess students and interpret their standardized test

results to determine appropriate student placement within dm system. Because of these

factors, both of these resources become unavailable to assist the classroom teacher with

development of an appropriate educational strategy, tailored to meet the needs of the special

needs student.

Breakdowns in educational background and support services for the classroom

teacher often result in the development of a meaningless court manaatee individualized

educational program (MP ) for the student. Flans are often developed purely to meet

regulations, but offer no true meaning related to the student's progress and educational

needs.

Page 5: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

RATIONAL

The development of individualized educational programs has become a real bunien

and task for many secondary school systems. Such special care and consideration for our

special needs population was mandated by law many years ago. The impact of this federal

legislation is being felt in all grade levels. Prior to the passage of legislation dealing with

the education of the handicapped, school officials had little trouble working with the

"regule students. IEP teams did not exist and therefore no man-hours were required.

With the passage of Public Law 94-142, The Education of All Children Act 1975), special

care had to be taken in providing services to this population. Specifically, P.L. 94-142

required that an IEP be developed for each and every handicapped student and that these

individuals will be educated in a least restrictive environment.

With the passage of The Carl D. Perkins Act of 1984, the requirements of an IEP for

all handicapped students was reiterated Additionally, this new act required that las be

completed for disadvantaged students as necessary. It is not uncommon to fmd schools

where the process of writing IEPs takes the entire year. School officials, especially those

concerned with IEP development, are s\vamped with meetings and pwerwork dealing with

developing appropriate and effective IEPs for handicapped students.

Conversations with school officials throughout the Commonwealth have revealed

complaints about the time consuming task of writing IEPs. This was especially Me in the

Philadelphia area. There, school officials indicated that the process of writing appropriate

IEPs is a year-rund activir. Officials in the Harrisburg area had similar kinds of

comments. In the 1985-86 academic school year, then were more than 15,8401

handicapped students in vocational programs alone that required TEPs. Another 1,952

1 N,-...-86 Vocational Education Management Information System, Pennsylvania Department ofEducation.

Page 6: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

handicapped students wen enrolled in specially funded programs. Governcw Casey2 stated

that "we must be certain that our schools meet these students' needs or we will doom many

our young people to lives of limited opportunity"(p. 27).

Using an Expert System

An Expert system is a method of using the expertise of professionals to solve

problems, similar to how we use consultants. Expert systems go a step further by adding

the knowledge of experts to a computer system and utilizing that knowledge in the same

way as the expert does. Thus, it is possible to use this knowledge and make the same

det isions as if the one were conversing with the consulting expert. J. R. Quinlar (1986)

stated that the technology of building Imowledge-based systems by inductive inference

from examples has been demonstrated successfully in several practical applications. Expert

system has been very effective in climatology especially in the hurricane season to predict

hunicane incidents. Quinlan advocates more extensive use of this technology in other areas

as well. Expert system and artificial intelligence are sometimes used interchangeably.

Machines that think or machines who think have been a topic of reflection and debate

according to Kurzweil (1985). However, artificial intelligence differs in that expert system

uses a knowle-fge based from which conclusions are made and does not generate or attempt

to generate -w information as does the former. Rulemaster4 provides the most

appropriate shell for the development of an expert system in education. It is easily used

and is available on the Cooperative Extension Computer Network.

OBJECTIVES

The primary objective of this project was to develop an computer system that would

aid in the development of IEPs for handicapped and/or disadvantaged students. This

ituemSgThe Casey-Singel Eclucatigp Pip for Penosylvania, 1986.3 J. R. QuinIaL. Centre for Advanced Computing Science, New South Wales Institute ofTechnology, Sydney, Australia4 Radian Corporation, Austin Texas

Page 7: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

computer system used the same information, clues, and patterns used by experts in the

field. It is anticipated that this system would benefit all (15,000) handicapped students

enrolled in vocational programs in the Commonwealth.

PROCEDURES

A . An advisory committee mas be established to provide guidance for this project.

The committee was composed of persons responsible for 1EP development throughout the

Commonwealth and special efforts was made to include at least one representative from a

large urban area. This committee met amroximate five times through the span of this

project. The committee met every two months starting August 1987.

An advisory committee was established to help detemine the most appropriate

assessment tools to be incorporated into this system, and to monitor the ongoing progress

of this project. The committee members, who met throughout the development of this

system, include Dr. John Salvia, Professor of Special Education, Mr. William Moore,

Program Coordinator, IU#8, Ms. Colleen Heally, Psychologist, Mrs. Janet Scanlon,

Teacher and Parent Advocate, and Ms. Kathleen Bansld, Project Assistant.

The advisory committee adopted the following objectives:

I. To identify those students whose standardized achievement and intelligencescores vary markedly from the norm.

2. To identify those students whose standardized achieveme nt and intelligencescores vary markedly based on that particular student's results.

3. To offer general suggestions related to further assessment and programming forthe student, based on standardized scores and academic programming.

4. To identify those areas of a student's vocational aptitude and interest surveyresults are most similar.

B . Collection of tests and their criteria used in 1EP development. A 10% sampling of

school districts throughout the Commonwealth will be accomplished to obtain this data.

This data was summarized and then evaluated by the advisory committee. A graduate

assistantship was gather this materials under the direction of the project director.

Page 8: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

In conjunction with advisory committee members' input, a 10% sampling of school

disuicts (See Appendix A for more details.) throughout the Commonwealth revealed that

the WRAT (Wide Range Achievement Test) and the WISC or WISC-R(Wechsler

Intelligence Scale for Children/Revised) are the most frequently utilized screening

instruments for determining students' general achievement and intelligence abilities (See

Appendix B for other assessment instruments being used). This system utilizes both of

these instuments. Sampling procedures also revealed that assessment tools utilized to

determine students' vocational interest and aptitude abilities vary markedly.

Vocational evaluators often employ non-formal assessment procedures. In addition,

formal vocational assessment tools are infrequently normed for special populations.

Program plans which couple students' vocational interest with their ap.itude results are

considered the most appropriate educational strateu to employ when attempting to guide

students towards reaching their vocational potential. In addition, research indicates that

vocational evaluative tools which utilize work sample procedures appear most effective in

determining students' vocational abilities. For these reasons, this project has incorporated

the use of the Singer Vocational Evaluative System and the Vocational Interest Assessment

Survey into its program.

The Singer Vocational Evaluative System (YES)

The VES is composed of a series of job samples that are individually complete.

Ther: is not a prescribed sequerf^e of administration, nor is it necessary to complete a

specific number of jobs. Selection of the most appropriate set of job samples to be

administered should be based on the individual needs of the participant, availability of jobs

and/or training, and time available for occupational work sampling. The job samples may

be administered in any order, although it is suggested that job samples related to an

individual's vocational interests be employed first. Administration time varies, but

generally requires 2-2112 hours per sample. All forms, equipment and materials are

Page 9: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

furnished within the VES. The VES includes an audiovisual format to ensure a

standardized presentation of job sample& lob samples may be repeated by the subject

Repetitio I may be advantageous when the subject expresses a desire to attempt to improve

his or hex performance. Repetition may also permit an evaluator to measure learning while

concomitantly demonstrating to a subject that he or she can learn new skills. The evaluator

should become familiar with the contents of the VES manual and should complete the job

sample, prior to administering the VES, regardless of the qicills the evaluator may Possess

related to the job sample area.

Vocational Interest Assessment Survey (VIAS)

The WAS is a unique interest assessment devise. The inventory utilizes an audio-

visual format instead of verbal statements and emphasizes affective cognitive as opposed to

verbal processes; it is designed primarily to tap affective responses.

The purpose of the WAS is to help an individual identify areas of potential

occupational exploration and training based on the participanes responses to work scenes.

The WAS attempts to breakdown career stereotyping and is particularly useful when used

by individuals with academic difficulties. It eliminates the need for any specki reading

skills. This is beneficial for use, not only with populations such as the handicapped or

academically disadvantaged, but also those whose native language is not English.

Occupations presented pictorially in the WAS help to minimize the effect of verbal

stereotyping. The WAS is directed towards those individuals whose career decisions are

likely to involve occupational training and attempts to minimize jobs which would require

advanced acadei-rdc skills and training. The occupational clusters presented by the survey

represent careers which training is generally available in most communities. Career clusters

are broad, but are composed of many related occupations.

C . Collection of clues and cues that experts in IEP development used in making

decision about handicapped or disadvantaged students relative to educasional planning.

Page 10: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

This informatioa was be put in the proper syntax for entering into the computer. The

project director with the assistance of the graduate assistant accomplished this procedure.

INTERPRETATION OF RESULTS

A discrepancy of +15 points in any tested area, indicated the need for further review

of students' test scores and evaluative procedures. Disczepancies may be auxibuted to

student performance or an error made by the evaluator at the time of testing.

A discrepancy of ±30 points in any tested area indicates the need for further review of

scores and testing procedures. ±30 points indicates a significant student deviation from

standardized test norms. Therefore a mme thorough and specific evaluation of a student's

abilities is warranted.

It is surested that the vocational evaluator review the mph information presented by

the system. It is recommended that the evaluator further pursue either assessment or

programming procedures in those areas tepresented by the graph, which projects a students

results to be most similar. For example, a student who demonstrates a score of 100%

interest in the area of :

INTEREST RESULTS APTITUDE RESULTS ASSESSMENT AREA

100% 80% Apiculture*

100% 60% Metal

50% 80% Cosmetology

80% 80% Food Services*

A student who demonstrates a score of 100% interest result, with an 80% aptituderesult in Agriculture* might benefit from programming and training related to thiscareer area, as opposed to a Metal area where the aptitude result suggesu a largerdiscrepancy from the interest result.

A student who demonstrates a score of 80% aptitude result, with an 80% interestresult in Food Services* might benefit from programming and training related tothis career area, as opposed to a Cosmetology area where the interest result suggesta larger disarpancy from the aptitude result.

7

1 9

Page 11: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

D. Construction of logic sequence (deductive and inductive models) for data usage

via the computer. The Rulemaster prop= required a spedal sequence of data entry in

order for the evert system to arrive at appropriate outcomes. The advisory committee

decided agaimr the use of Rulemaster because of its lack of availability to schools and MP

teams. The comminee suggested that a more practical method b- used and recommended

the elecrronic spreadsheet.

Initially, the project intended to use an expert system titled Rulemaster. However,

per the advisory committees' recommendations, a system which would be less

cumbersome to use was chosen. This program works via the Apple Macintosh's EXCEL

program and can be loaded into an IBM pasonal computer using Lotus 1-2-3.

E Testing the even system utilizing real data appropriate for handicapped

studems enrolleJ in vocational programs. The output from this procedure was reviewed by

the advisory committee to ascertain the appropriateness and accuracy of the output.

OUTIm7T DESCRIPTIONS

Achievement Results

The system will automatically convert raw score infomiation to a standard score

equivalent Rezommendations of WRAT results are based on sub-tests standardized score

comparisons. The system will locate discrepancies and results will be indicated based on

the following:

+15 points between Spelling or Reading or Math sub-test scores indicates the need

for further review of sub-test results and procedures. Further student assessment in

the specified sub-test areas may be required. A curriculum which incorporates

individualized educational programming may be beneficial.

+30 points between Spelling or Reading or Math sub-test scores indicates a marked

discrepancy in student performance. A review of sub-test results and procedures is

necessary. Further student assessment in the specified sub-test areas may be

Page 12: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

required. A curriculum which incorporates individualized educational programming

is indicated.

btelligence Results

The system performs three operations related to IQ testing results. The 4e axe:

1. The system classifies the IQ score, in isolation, based on standardized

interpretations:

5CORE RANUS CLASSIFICATION

130 and up Very Superior

120-129 Superior

110-119 I-Egh Average

90-109 Average

80-89 Low Average

70-79 Borderline

60 and below Deficient

2. The system compares achievement and IQ standardized results. The system

identifies discrepancies and results are indicated based on the following:

+15 points between any sub-test and IQ score indicates the need to review sub-test

results and IQ testing procedures. Further student evaluation may be required.

Individualized educational programming may be beneficial.

+30 points between any 'sub-test and IQ score indicates the need to review sub-test

and IQ testing procedures. Further student evaluation is required. Individualized

educational pmgramming is indicated.

3. The system classifies isolated IQ results into educational terms and offers some

guidelines related to a student's probable academic abilities. For example, a student

achieving an IQ score of 75 is termed Educationally Mentally Retarded (EMR). It is

suggested that this student can "learn skills to approximately the 6th grade level by late

9

I )

Page 13: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

teens. The student cannot learn general high school subjects, without special programming

or intervention. The student wili need special education, particularly at high school levels."

Vocational Results

This system performs two operations related to vocational interests and aptitude

results. The system converts raw score information of aptitude evaluative information into

a percentile equivalent. The system compares percentile information of aptitude and interest

assessments, and estates an easy to interpret graph representation of the results.

F . Modifications were made as appropriate to she o:pert system program and

retesting took place.

ASSUMPTIONS

Results suggested in this program should be interpreted in consultation with an expert

in the educational programming field. This program is designed only as a guideline in

evaluating student performance based on selected standardized tests. The following facors

may affect the results offered by this program:

1. Physical limitations of the student should be considered (ie auditory or visual

impairments). Limitations my effect the student's ability to effectively respond during

testing procedures. Therefore, a careful review of testing procedures and student

responses is required prior to team decisions regarding individnalized educational

programming strategies.

2. This program offers suggestions based on comparisons and discrepancies

between test results. Therefore, caution should be taken not to base programming

decisions on isolated test score results.

3 . When discrepancies are noted, the program recommends a review of testing

procedures. Reviewing procedures will help to insure that errors were not made on the part

of the evaluator. In addition, reviews may help the evaluator to identify specific problem

I 0

A I

Page 14: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

areas noted through review of the test responses, and thus help to determine the appropriate

follow-up evaluative tool to be used.

4. ","hen making decisions related to vocational programming, evaluators must be

cautious not to put weight on either aptitude or interest results in isolation, but attempt to

offer students guidance in areas where tbd interest and aptitude results are most similar.

LEVELS OF ADAPTIVE BEHAVIOR FOR THE MENTALLY RETARDED

LEVEL EDUCATIONALLABEL

SCHOOL AGE:IO SIDRE 6-21 YEARS

Moderate Retardation EMR 50-75

Moderate Retardation TMR

Severe Retardation SMR

Profound Retardation PMR

Can learn skills to approximately 6thgrade level by late teens. Cannotlearn general high school subjects,without special programming and orintervention. Needs special education,partimlarly at high school levels.

35-49 Can learn functional academic skills toapproximately 4th grade level by lateteens if given special education.

20-34 Can talk and learn to communicate;Can be trained in elemental healthhabits; cannot learn functional academicskillg pmfits from systematic habittraining.

Below Some =tor development present;20 cannot profit from training in self-help

skills; needs total care.

EMR - Educationally Mentally RetardedTMR - Trainable Mentally RetardedSMR - Severely Mentally RetardedPMR -Profoundly Mentally Retarded

I l

1 -1

Page 15: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

APPENDIX AList of Contacts Professional and Organizations

Page 16: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

Project Contacts

Information from the following professionals were instrumental in the completion of thispizject. Many thanks and much appreciation is extended to these individuals andorganizations.

Thomas KippenyAppalachian hie:mediate Unit

Stout Vocational Training ManualMid-Nebraska MR ServicesHastings, Nebraska

David WebbWest Virginia Research Training CenterOne Dunbar Plaza Suite E.Dunbar, West Virginia

Lloyd PindellWisconsin Vocational Studies CenterMadison, Wisconsin

Research and Training CenterUniversity of Wisconsin-StoutMenomonee, Wisconsin

Joe ColemanAsst Supervisor of Special EducationChester County

Dr. PasquelShippensburg State University

Zolten KristofPinsbrigh Area(412) 665-2286

Clark LloydPsychologistThe Office of Curriculum(814) 622-3500

Mr. BauerCapital Area I.U.(717) 564-4841

Special Education DivisionNortheast L U.(717) 344-9200

Andrea RosseNorthwest Area I. U.(814) 734-5610

Regional Resource CenterKing of Prussia(215) 265-7321

Regional Resource CenterHarrisburg(717) 657-5840

Regional Resource CenterGibsonia(412) 443-7021

Lionel LauerPhiladelphia(215) 299-7823

Iris LeFeverLancaster(717) 569-7331

School District of PittsburghDivision of Curriculum Development341 South Benefield AvePittsburgh

Page 17: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

APPENDIX B

Sampling of Assessment Instruments Used With Special Needs Students

1 4

Page 18: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

St ipling of Assessment Instruments Used With Special Needs Students

Briggance

Kauffman Assessment Battery

Metropolitan Achievement Test Primer

Peabody Individual Achievement Test

Stanford-Binet Intelligence Scale

Vineland Social Maturity Scale

Wechsler Intelligence Scale Children-Revised

Wide Range Achievement Test

Woodcock-Johnson Mastery Test, The Reading Passage Comprehension Sub-test

1 5

1.3

Page 19: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

Appendix C

USERS GUIDEIEP ASSESSMENT AID FOR SPECIAL NEEDS STUDENTS

1 6

19

Page 20: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

USERS GUIDEMP ASSESSMENT AID FOR SPECIAL NEEDS

STUDENTS

OVERVIEW

"Mainstreaming" and "normalization" are term fiLquently used throughout our

educational system. They refer to program planning and implementation for the special

needs student. Ftequently the special needs students is placed in a mainstream classrom.

in order to meet normalization criteria. Mainstream placement occurs in order to achieve the

most appropriate and least restrictive classroom environment Unfortunately, the

mainstrean3 classroom teacher is often inadequately prepared to meet the educational

requirements of the special needs student. Learning how to identify, appropriately assess

and program for the student requires additional time and training, not often provided the

normal classroom teacher.

RECOMMENDED USE

This program will be utilized by school psychologists as a screening devise of

standardized score results. Its purpose is to compare a student's achievement and

intelligence scores in an attempt to identify those students who may benefit from further

assessment and possibly a more individualized education program. The program will

screen achievement sub-test scores to determine if there exists a marked discrepancy

between spelling, reading and mathematics areas. Discrepancies in these areas will

influence program planning for the vocational-agriculmral student in regards to academic as

well as vocational training.

In addition, this program will screen vocational aptimde and interest survey results of

the student. Its purpose is to compare the student's percentile ranking results in vocational

1 7

2 9

Page 21: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

areas, in an attempt to identify those vocational areas a student is most likely to succl in,

given the proper instruction and guidance.

It is proposed that by reducing the time factor required by die school psychologist to

compare and interpret standardized score., the school psychologist will be more readily

available to offer the classroom teacher assistance with appropriate individualized

assessment and program development.

OBJECTIVES

1. To identify those students whose standardized achievement and intelligencescores vary markedly from the norm.

2 . To identify those students whose standardized achievement and intelligencescores vary markedly based on that particular student's results.

3. To offer general suggestions related to further assessment and programming forthe student, based on standardized scores and academic programmhig.

4. To identify those areas of a student's vocational aptitude and interest surveyresults are most similar.

5. To offer general suggestions related to further assessment and programming forthe student related to vocational training.

Description of Vocational Assessment Tools

The Singer Vocational Evaluative System(VES)

The VES is composed of a series of job samples that are individually complete.

There is not a prescribed sequence of administration, nor is it necessary to complete a

specific number of jobs. Selection of the most appropriate set of job samples to be

administered should be based on the individual needs of the participant, availability of jobs

and/or training, and time available for occupational work sampling. The job samples may

be administered in any order, although it is suggested that job samples related to an

individual's vocational interests be employed first. Administration time varies, but

generally requires 2-2112 hours per sample. All forms, equipment and materials are

furnished within the VES. The VES includes an audiovisual format to ensure a

1 8

Page 22: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

standardized presentation of job samples. Jot samples may be repeated by the subject

Repetition may be advantageous when the subject expresses a desire to attempt to improve

his or her performance. Repetition may also permit an evaluator to measure learning while

concomitantly demonstrating to a subject that he or she can learn new skills. The evaluator

should become familiar with the contents of the VES manual and should complete the job

sample, prior to administering the VES, regardless of the skills the evaluator may possess

related to the job sample area.

Vocational Interest Assessment Survey (VIAS)

The VIAS is a unique interest assessment devise. The inventory utilizes an audio-

visual format instead of verbal statements and emphasizes affective cognitive as opposed to

verbal processes; it is designed primarily to tap affective responses.

The purpose of the VIAS is to help an individual identify areas of potential

occupational exploration and training based on the participant's responses to work scenes.

The WAS attempts to breakdown career stereotyping and is particularly useful when used

by individuals with academic difficulties.

WAS eliminates the need for any special reading skills. This is beneficial for use, not

only with populations such as the handicapped or academically disadvantaged, but also

those whose native language is not English.

Occupations presented pictorially in the WAS help to minimize the effect of verbal

stereotyping. The VIAS is directed towards those individuals whose career decisions are

likely to involve occupational training and attempts to minimize jobs which would require

advanced academic skills and training. The occupational clusters presented by the survey

represent careers which training is generally available in most communities. Career clusters

are broad, but are composed of many related occupations.

1 9

2 2

Page 23: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

SYSTEM REQUIREMENTS

You will need the following:

1. An Apple Macintosh computer (Mac Plus recommended) with two disk

drives. (one disk drive if Microsoft Excel is loaded on a hard disk.

2. An Imagewriter or LaserWriter printer.

3. Microsoft Excel.rrogram

4. The Interpretation of PDE Project Disk and instructions (available through

the Agricultural and Exten&ion Education Department, PSU).

SUPPPORT CONTACTS

If you have any questions or problems, please contact one of the following for help:

TechnicaLtSuittapce

Dr. Connie D. Baggen Ms. Kathleen BanskiDepartment of Agricultural Education and Extension

The Pennsylvania State University(814) 863-3824

MANAGEMENT PROCEDURE

1. Make a backup copy of the original PDE Project IEP Disk before starting.

See Appendix for backup instructions. List the backup copy for entering data.

Keep the original disk in a safe location-do not put any data on it.

2. Insert the disk labeled PDE Project IEP Disk in the internal drive. Then

insert the Microsoft Excel Program Disk in the external drive.

3. Double-click on the icon named PDE Project IEP Disk to open it.

4. Double-click on the icon named Special Student Evaluation to open it.

5. Enta Inputs (This program is automatically calculated).

INPUT DESCRIPTIONS

1. Go to cell AU3

2 0

Page 24: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

2. Enter student's name, press the RETURN key and enter address.

3. Enter student's age in years and months (use whole numbers) in cell AV6 and 7.

4. Enter student's WRAT raw scores far each subtest area (use whole numbers).

. Enter student's IQ score (use whole numbers) in the labeled cells.

6. Enter student's Vocational Interest Survey Results in the labeled cells,

7 . Enter student's Vocational Aptitude scores in the labeled cells.

OUTPUT DESCRIPTIONS

Achievement Results

The system will automatically convert raw score information to a standard score

equivalent. Recommendations of WRAT results ate based on subtests standardized score

comparisons. The system will locate discrepancies and results will be indicated based on

the following:

+15 whits between Spelling or Reading or Math subtest scores indicates the need

for further review of subtest results and procedures. Further student assessment in

the specified subtest areas may be required. A curriculum which incorporates

individualized educational programming may be beneficial.

+30 points between Spelling or Reading or Math subtest scores indicates a marked

discrepancy in student performance. A review of subtest results and procedures is

necessary. Further student assessment in the specified subtest areas may be

required. A curriculum Which incorporates individualized educational programming

is indicated.

Intelligence Results

The system performs three operations related to IQ testing results. These are:

1 . The system classifies the IQ sane, in isolation, based on standardized

2 I

2

Page 25: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

..

interpretations:

EQUalbrai CLASSEICAngli

130 and up Very Superior

120-129 Superior

110-119 I-ligh Average

90-109 Average

80-89 Low Average

70-79 Borderline

60 and below Deficient

2. The system compares achievement and IQ standardized results. The system

identifies discrepancies and results are indicated based on the following:

+15 points between any subtest and IQ score indicates the need to review subtest

results and IQ testing procedures. Further student evaluation may be required.

individualized educational programming may be beneficial.

+30 points between any subtest and IQ score indicates the need to review subtest

and IQ testing procedures. Further student evaluation is required. Individualized

educational programming is indicate&

3. The system classifies isolated IQ results into educational terms and offers some

guidelines related to a student's probable academic abilities. For example, a student

achieving an IQ score of 75 is termed Educationally Mentally Retarded (EMR). It is

suggested that this student can "learn skills to approximately the 6th grade level by late

teens. The student cannot learn general high school subjects, without special programming

or intervention. The student will need special education, particularly at high school levels."

Vocational Results

This system performs two operations related to vocational interests and aptitude

results. The system converts raw score information of aptitude evaluative information into

2 2

Page 26: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

a percentile Nuivalent. The system compares percentile information of aptitude and interest

assessments, and creates an easy to interpret graph representation of the results.

INTERPRETATION OF RESULTS

A discrepancy of +15 points in any tested area, indicated the need for further review

of students' test scores and evaluative procedures. Discrepancies may be attributed to

student performance or an error made by the evaluator at the time of testing.

A discrepancy of +30 points in any tested area indicates the need for further review of

scores and testing procedures. ±30 points indicates a significant student deviation from

standardized test norms. Therefore a more thorough and specific evaluation of a student's

abilities is warranted.

It is suggested that the vocational evaluator review the graph information presented by

the system. It is recommended that the evaluator further pursue either assessment or

programming procedures in those areas represented by the graph, which projects a students

results to be most similar. For example, a swdent who demonstrates a score of 100%

interest in the area of :

ASSESSMENT AREAINTEREST RESULTS APTITUDE RESULTS

100% 80% Agriculture*

100% 60% Metal

50% 80% Cosmetology

80% 80% Food Services*

A student who demonstrates a score of 100% inwrest result, with an 80% aptitude result

in Agriculture* might benefit from programming and training related to this career arta, as

opposed to a Metal area where the aptitude result suggests a larger discrepancy from the

interest result.

2 3

2

Page 27: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

A student who demonstrates a score of 80% aptitude result, with an 80% intvrest result in

Food Services* might benefit from programming and training related to this career area, as

opposed to a Cosmetology area where the interest result suggest a larger discrepancy from

the aptitude result

ASSUMPTIONS

Results suggested in this program should be interpreted in consultation with an expert

in the educational programming field. This program is designed only as a guideline in

evaluating student performance based on selected sttndardized tests. The following factors

may affect the results offered by this program:

1. Physical limitations of the student should be considered (ie auditory or visual

impaimients). Limitations my effect the student's ability to effectively respond during

testing procedures. Therefore, a cl..eful review of testing procedures and student

responses is required prior tt.) team decisions regarding individualized educational

programming strategies.

2. This program offers suggestions basen on comparisons and discrevancies

between test results. Therefore, caution should be taken not to base programming

decisions on isolated test score results.

3. When discrepancies are noted, the program recommends a review of testing

procedures. Reviewing procedures will help to insure that errors were not made on the pan

of the evaluator. In addition, reviews may help the evaluator to identify specific problem

areas noted throueh review of the teit responses, and thus help to determine the appropriate

follow-up evaluative tool to be used.

4. When maldng decisions related to vocational programming, evaluators must be

cautious not to put weight on either aptitude or interest results in isolation, but attempt to

offer students guidance in areas where their interest and aptitude results are most similar.

2 4

Page 28: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

APPENDIX

Using Microsoft Excel Software

Backup Instructions

To make a backup copy of an Excel program, you must copy the entire contents of the

original (startup) disk to another disk. To backur the original disk:

I. Insert the disk containing the Master program into the internal disk drive. The disk

icon is usually labeled with an abbreviated form of the program title. Example: Sp Ed Eval

for the Special Student Evaluation pmgram.

2. Insert a blank or "to-be-copied-over" disk into the external drive. Initialize it if

necessary.

3. Select and drag the Master disk icon over the top of the new disk icon until the new

disk icon turns black.

Example: Start-up (internal drive) disk icon- "PDE MP Project".

New Disk (external drive) disk icon-"Blank".

An alert box will ask: Completely replace contents of "Blank" (external drive) disk

with contents of "PDE IEP Project" (internal drive)? Click on the OK button.

4. When done copying, eject the original disk and store it in a safe place. Type in a new

name for the backup disk icon (if desired). Use the backup copy for entering data.

Saving Data

1. Decide if you will save data on disk before you start.

It is recommended that you do not save data on this disk, rather you should save a

printout of the calculated program with input data. If you desire to save the data to be

inputted on the disk, make a copy of the entire disk before you start to input data. Ifis

necessaty to make a copy of the entire disk because each Excel program consists of

2 5

Page 29: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

1

multiple documents, all of which are necessaxy for the operation of the program in the

manner outlined in the MANAGEMENT PROCEDURE of the user guide,

2. Do not use "Save As"

The Excel program has two unique characteristics: The "Save As" command under

the pull down menu "FILE" will allow you to change the name of your document and/or

save the document to a different location, i.e. to the external drive.

3. Use the "Save" or "Quit" commands.

If you use the "Quit" commands from the Excel File menu, the computer will ask if

you wish to save changes before quitting. If answer yes, it will save changes to the file

you have been working with. If you wish to save changes to another file name, you must

answer no and the click on then follow procedure two above.

4. Properly identify disks with saved day.

Mark the external (paper) label of the disk to indicate the exact contents. For

example: Special Student Evaluation

Miss Smith - 4123/88

Excel startup Disk

You may also change the name of the disk icon. The name of the disk icon can be an

abbreviation of the name of the original disk, may have client identification, date nin, etc.

For example, Special Student Evaluation..-Smith, Sp Ed Eval-Smith-4/88, Scores-Smith-

1988.

Changing Print Quality

Excel programs print at medium speed and quality, if you are using a dot matrix

printer, i.e.ImageWriter U. If you should desire to change the quality of printing, use the

following procedure:

I . Go to the Excel File menu and choose Print command. Click on the print quality

button that you desire. Click on the OK button.

2 6

2 )

Page 30: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

2. The printer will begin, so as soon as you see the dialog box displaying the message

"To cancel printing hold down the Command key and type a period (.)," do so.

3. When quitting do not save this print quality change since others that use the disk may

not prefer the speed andlor quality that you have chosen.

Interrupting the Printing Process

If you wish to intemipt a printing process started with the use of an Option-

Command-letter combination, use the following procedure:

1. As soon as you see the dialog box displaying the message "To cancel printing hold

down the command key and type a period (.)", do sc.

2. Click on the halt button.

2 7

Page 31: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

APPENDIX D

Sample Computer Ouvut in Assessing Special Needs Students

2 8

Page 32: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

SPECIAL STUDENT EVALUATION

STUDENT INFORMATION

STUDENT NAME >>> MARY GOODSTUDENTADDRESS >> R. D. 1. ANYTOWN. PA

DATE: 3-19-89 TIME:STUDENT AGE YEARS 2.).>

MONTHS

ACHIEVEMENT SCORES: I SUB-TESTBASED UPON THE: SPELLING >

WIDE RANGE ACHIEVEMENT TEST (WRAT) MATH >READING >

INTELLIGENCE SCORE:BASED UPON THE:

12

5RAW

SCORE27

<C <

10:02 PM<

< <STANDARD

SCORE106111

1

3217

IQ SCORE4 69 j«TYPE CALCULATED

VOCATIONAL INFORMATION TYPE IN IN RAW PERCENTILEINTEREST SURVEY RESULTS TEST # SCORE SCORE

I 95 <=:ENTER 1 FOR "BUSINESS SECRETARY:I 1 26

ENTER 2 FOR "ELECTRICAL/ELECTRONICS:1i 2 26

ENTER 3 FOR "TRADE & INDUSTRY; CONSTRUCTION:"1 3 26

ENTER 4 FOR "SERVICE; BARBERING/COSMETOLOGY:1 4 26

ENTER 5 FOR "BUSINESS; DATA FROCESSING1 5 26

ENTER 6 FOR "AGRICUL11JRE/ENVIRONMENT:1 6 26

ENTER 7 FOR "COMMUNICATIONS; AR1'SMRAPHICS:1 7 26

ENTER 8 FOR "FOOD SERVICESri 8 26

ENTER 9 FOR "TRADE & INDUSTRY; MECHANICAL:"7 9 26

ENTER 10 FOR "HEALTH SERVICESI 10 26

ENTER 11 FOR "CRIMINAL JUSTICE:"1 11 26

ENTER 12 FOR "BUSINESS; RETAIL SALES:"1 12 26

ENTER 13 FOR "ENGINEERING TECHNOLOGY:1 13 26

I 9 0

1 8 0

1. 8 S

1. 85

1 7 5

I 8 5

I 9 0

1 8 5

1 7 5

1 80

9

8 5

ENTER 14 FOR "SCIENCE & LABORATORY:"La_j_26_

ENTER 15 FOR "SERVICE-PERSONALM 15

ENTER 16 FOR "TRADE & INDUSTRY; METAL TRADES:I 16

ENTER 17 FOR "SERVICE; FIRE SCIENCE:1 17

PROGRAMS WITH SCORES OF 9 5

1 26

1 26 I 8 5

1 26

S S

1 S S

ARE RECOMMENDEDCHECK PROGRAMS INDICATED BY AN <=== AS POSSIBILITIES.

<=2

<=:

C=:

Page 33: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

SPECIAL STUDENT EVALUATION

SINGER APTITUDE CHART-APTITUDE RESULTS ENTER ENTER77M I ERRORS PERCENTILE

CARPENTRY 5,

5 100PLUMBING, 4 5 96

ELECTRICAL., 5 3 6 0

ACHIEVEMENT RESULTSUSE RECOMMENDATIONS BELOW FOR: MARY GOODSTUDENT

REVIEW MATH AND READING SUBTESTSINDIVIDUALIZED PROGRAMMING IS INDICATED

REVIEW READING AND SPELLING SUBTESTSINDIVIDUAL= PROGRAMMING IS INDICATED

INTELLIGENCE RESULTSCLASSIFICATION FOR: MARY GOODSTUDENT

IQ CLASSIFIES STUDENT AS:I DEFICIILVT I

SUGGESTIONS FOR EDUCATIONAL PROGRAMMING:

REVIEW SPELLING AND IQ TESTING PROCEDURES. INDIVIDUALIZED PROGRAMMING IS INDICATEDREVIEW MATH AND IQ TESTING PROCEDURES. INDIVIDUALIZED PROGRAMMING IS INDICATED

EDUCATIONAL CLASSIFICATIONS FOR STUDENT IS:

EDUCABLY MENTALLY RETARDED (EMR)

CAN LEARN TO APPROXIMATELY SIXTH GRADE LEVEL BY LATE TEENS.CANNOT LEARN GENERAL HIGH SCHOOL SUBJECTS, WITHOUT SPECIALPROGRAMMING OR INTERVENTION. REQUIRES SPECIAL EDUCATIONPARTICULARILY AT HIGH SCHOOL LEVELS

Page 34: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

APPENDIX E

Computer Programmed Information

3 1

Page 35: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

HM

I 11111811:111311111811181:01811M101111110111111111:11

11111121111111C11111111111111

111111011111111111

ELIE

CO

MM

OC

Cs" 1111111P

ES

SIN

RE

SI 101 11111111101111110

111011111111111110111111"

NE

1181111111 i18111111811111111:1P

EM

I NIM

ME

NIIIC

IEM

IRIM

IEM

MI

1111111=

voca monum

unnimm

unclenIIE

UR

ER

ISH

INE

elnisl"- 1811113111:111:11

:1111111101101IN

IMIIIN

I1IIMIN

I11111111111111ii

Maill+

11111+11111111111111111110

ME

MO

111111101111111MA

IIIIMM

INIM

MIA

II1104111111 1111100111

IMM

IIIMM

UN

GE

IRE

I"

Page 36: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

SPECIAL STUDENT EVALUATION

1111IMILIMICIIIINIIIIIETIO149 82

107 IMIMMAIMMIIIIMII108 149 149 78109

MININEE1 47 IN 47

110 WM 48":.I 48 "80 MI IIII 83111 MAI, 44 111EI 44 1155; 51

112 Igaill1111/1111 NrAll Inall 48KmMIMI

11449 IIIMIIIIIIIIITM 49 MN

4581 orrmme

IIIMIIIIIIII 86115 111111161111111MMimommxr..k c044.1.4t

NM17

116 etKlarpijainii!ilatiral-5, 12.40117 ma JpaclztoiRD-Timminz

MIEN11111111w1110111WEIIIIKE111111111111111111141111M

izi_k11-.102_,L.ui.rin119

RAW 27 32i 106 111 MUM 0 0 0 OM 0 0120 10

Page 37: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

ICE

INH

INC

ICH

C11:11111*C

allSain:

NE

ILINH

OM

EIG

HIG

IIIMP

INIIH

MA

IMM

INN

*111111H

EM

ME

N O

WE

1111111811111111111111111111E

CIM

ME

MO

LM

EG

:=1111311011:11M

INS

INill11111101111111111111

111111111111111111111111111111

IgE111+

111q111101111"11111111:1111118111131111111P

EE

EN

EC

IMIN

I112131101111111111111Alailliallg

2

EE

O 11111111111111181110111111111111111

aiglIC

ER

ION

AIE

NC

11111111111111111:::CgC

S111111110101111111111111111101111111111111111111111110la]

111111:11:1111101111:01111131111111111q10EM

EM

I

1111111111111111N1111111111111131111111111:1113

IMM

O IU

IliN

IEE

GN

IZE

CE

: 412 " "AN

N11

1111::

NE

IESE

EN

IME

ZE

MM

EIH

IMM

EN

ISME

ME

ME

ME

IME

ME

S

Page 38: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

INIP

INN

ER

Ell

911

7:11

1W31

1131

SW

IIII

IIM

EG

II49

T

1111

11K

al

u 96

MII

IIIM

MIA

IIII

DE

WII

IIII

NIM

PIII

IIII

IIIV

AIW

AIS

TII

IIII

IMIN

IMIN

FAII

IMII

WIE

NN

INII

IIII

IIII

PAI

IIFT

IIM

INN

IIII

IIIM

IN

A

zII

IIII

IIM

INIV

IM

WM

NM

I

la 569

la9

26IF

IAIN

IIII

98M

ilU

MW

E28

1111

1111

1111

115E

1129

UM

ME

511

1C11

1111

1111

1111

1151

NM

MU

NN

9959

100

NM

IM

IN. I

VA

Wai

l/gal

MIM

I.00

6010

1O

MII

IMM

IT11

1111

1110

1M

MW

EI

IMIl

l59

6110

2II

MII

IK91

1E

MI

29N

M57

WM

102

3062

103

ME

103

UM

EM

EM

103M

M.

6063

104

Ma

104

INN

UM

W:M

UM

6410

511

1111

Mal

105

3134

5910

532

MM

E61

6511

7111

111M

156

106

ilia

601M

106

/MIM

Iea

6610

711

111.

1MM

NI

107

ME

NII

MII

IIL

IO11

1111

111E

FAII

IMIl

l63

EllIn

v31

3457

108

IMM

il10

868

KM

1111

1111

1111

111

5810

911

3111

1111

111F

INf.

UM

38N

rAl

69N

um32

IN

M63

IMM

EM

Era

NM

6570

KM

IIT

IIII

ILM

illN

iMM

TM

111

3539

6671

INT

EM

IIII

IIM

IIII

6011

2M

EN

NE

6411

2M

ilE

aIM

IM

NM

EM

35M

EI

65M

1111

111:

0136

MI

6773

114

OE

M36

,11

437

11r1

1111

1111

1E11

1140

6874

115

=11

is'

NM

36IM

1111

1111

1111

1111

Fffi

llnal

l111

169

lia11

635

116

6711

641

Mill

76M

IMI

3763

117

MII

IIII

II68

1111

1111

1011

1MIN

70E

l11

836

64N

EM

=II

IIII

IIIE

NT

rim

m6

119

911

17al

lE.

71In

119

=11

1111

1111

=11

111M

119

Ma/

WM

7912

037

3865

120

NM

I70

120

40SO

121

IIII

II66

EM

I WM

39M

I71

121

4373

ri 1:91

inM

IME

=67

122

4040

1111

1111

1111

1111

glif

frE

7412

339

IIII

II12

3M

EIN

/72

123

MI

Mil

ro12

439

6811

1133

1141

7312

442

8411

M11

1111

1W

AN

125

MM

EM

II12

5W

Mra

126

4040

=II

I12

642

IIII

IIII

IIII

I12

6W

M77

3612

7IM

O70

1111

3411

.111

175

127

78ni

128

4111

111 M

Nm

ai43

4276

128

44II

IIII

BS

129

IIII

IMM

II11

.112

9II

=12

911

1111

4679

8913

042

MIN

IM13

0M

EN

IMII

MM

AII

IIM

130

MIT

EM

IN80

9013

1M

IM

E11

1111

1111

1111

4378

EIT

IIM

IIE

MI

46N

rinu

ms

8191

132

MiN

4213

2W

M=

7993

133

EM

I74

NE

EM

1111

EM

1111

1111

1111

113

382

9313

444

1.11

1111

MII

M13

446

44so

IMII

IEE

I111

1111

8394

ME

NE

M43

soom

mar

rim

mus

nair

rnim

8495

136

4576

Mill

136

Iffi

RE

IMII

IIII

IIIM

IIM

I13

6M

ill96

NM

IIM

IIIM

ME

IIII

I13

7E

MI

137

4949

Mill

97II

FIII

MII

INE

EI

7813

8W

EIN

.83

MIN

IIIF

FIN

8690

NE

M11

110.

1.13

949

46M

UM

=1

950

50M

E99

140

anam

'slim

s14

0IM

E14

010

014

11.

1.11

E11

180

141

WM

arm

141

5188

101

142

48M

I111

1111

1M

N86

1111

1111

1511

111M

1189

102

143

IIIM

INII

MIN

IIII

IIII

MIM

E51

1.11

MM

INE

MI

103

EIM

I49

NM

I82

EM

IIill

n111

111M

114

4II

I111

0111

1.11

1

1.11

1111

1111

1.1

104

145

MU

MM

1511

I48

WV

89M

illIl

iall1

1111

111=

1=11

146

105

146

SOiii

i83

146

MIN

IIII

IIII

106

MIN

AM

IIII

IIII

MI

8414

7M

INII

IIII

IMIN

147

1111

153

Ell.

Page 39: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

SPECIAL STUDENT EVALUATION

P Q RIS T UIV W,XIY Z 1 AAIAB AC107 14 51 . 148 49 148108 1 ' 85 , 149 149 54109 150 48

1

86 150 50 150,.110 15 I, , 151

.151

,

111 1 2 87 152 152 55.

112 1 kg 49 153 51 153113 154 154

.114 NMI 50 89 155

,

155115 MST 04,0.14.0 ( 5.045.9i)116

i. 1

- -

117 Ili RE CONVERS1 N RAW SCCRE CONVERSION RAW SCORE CONVERS11118 27 32 17 32 17 27 32 17119 0 0 0 0 0 0 0 0

,120

Page 40: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

OIL

IER

CE

EM

ME

MIN

FINE

NH

VIM

MO

8G-I

11111111111131E

PIE E

IME

IMM

OlIC

UM

NI11031111111111A

MIN

SINSO

MIN

EC

Os M

EM

1111111F1:1314100

011111111111111

11 11110111 111111011111111111111

ICE

11111:111118111133111111111HE

INC

E1111111011111

HE

EM

IMIN

IMA

NIN

I NI

HIR

IUM

:13111113s

EL

ICE

ME

INISE

C+

PAIO

NIC

HIE

NN

OR

ME

:r'1111111111111111111111111111111MM

IMIN

IMM

IMIN

IM

EN

PIEN

I1111113110180*1=1110118111:1

1111101MA

INIC

IMIN

ME

NIM

EN

0 CE

EIH

Min

11118111111111RE

NE

EM

AIM

U

SIMIR

EL

ER

LIE

LE

ME

M

Page 41: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

alliA

FA

GE

MI

Al

si. v

wilim

monsw

as

-

AN

AO

AP

ilA

R6254 Iff AM

ai...Mil

9Igri

WM

INIIIIIK

IMW

INI

El 96

raW

/A1

57 111rAM

MIN

NE

WM

Eil

9959 N

ME

MM

EIM

ME

M/M

.60

101

1111MIM

AII

6

59

INT

.62

..1111111111M

96N

MW

INW

Miiral

9761

ME

M97

UM

W. irai

1.11198 W

M.990 iW

N0

III91111FA

I6

WM

IFIN

I65

99W

E66

,.N

E7111171111111111

101IIIIIIIF

ZIN

.61

IcaN

M63

10234

MIIIIIN

NI

EM

ME

N68

62103

MIM

I64

$

34N

M64=

II10

3866

10336

WM

6935

1111M=

1111117A

35=

111W"A

llMittM

MIIIM

7065M

I105

.3668

ME

I105

3771

65k!

66107

638

66106 II=

106=.

3967

10737

69107

NE

M111011

67108

39K

ral40

70108

NM

ao73

68109

=ii

109W

E71

10939

IMM

i74

69110

3840

69110

WIIIIIE

Rno

111101111111M75

io MR

MU

M=

II70

EM

I39

MI

111MI

7639

MI

ME

M112

4142

ME

Mla 113

Miiii

El=

aoM

EIIIIIIIII1U

111IIIM

INII

114M

INIM

WE

ME

M7879

73114

40IM

O72

11441

74IFIB

I41

42W

iliW

MM

N76

115E

3 116M

I.IM

O116

4277

11643

8076

117

116111111:11111111178

119

WE

EIM

INE

MIN

-

1171111111

1112E44

81N

MI

43M

E78

:M

IMI

8276

119111111W

EE

79119

4545

79120

.-

Mii

12044

orm120

11/111M

Bso

121M

E78

12145

=11

81W

TE

4646

EM

I81

122M

EM

79122

461111111/.1

122M

I.85

En 123

4545

MiiM

12346

82123

47M.

86ra

124

84 WI

85126

86 InE1111.11M

111M

4647

ME

Mso

124IIM

INE

ll48

4787

4681.

1111=125

126 IlrEN

1: IM

MI

12649M

I88

12748

87128

.:

.128

MIN

12850

UM

88129

IE.

12949

4987

11111129

89130

4948

:130

50M

N88

13051

50M

EM

=M

I90 M

R86

11111=111

5089

131

ill1111111111191

13250

49111M

13251M

IMI

1111111111111111111111351132

92133

93 NM

ME

E:

MI

51IM:+

;IllilnignIM

EM

134E

EO

94F

ri.

MIM

IM

EM

5089

135111M

EM

ME

N136

MIM

E.

mom

ME

136Ell/

in 137M

I51

MIN

=ilN

MN

tamom

mm

iusm

ums=

97138

138M

E98

13952

ME

M139

MI

INU

M54

"140

1011111111111M

1M

11.1

ER

MIN

EM

IIIIIIIIMM

IIIIMM

Ill142

143=

ME

MN

MI

11011111111141

142

IFE

EM

IIIIIIMM

E111

144 =M

EM

=M

IMI

56

100141 111M

101142

102 NM

103 11171154

MIIIIIM

INIIIIIIIIM

104145

los146

106147 ii=IN

IIIIIMIM

INIIIIK

Ell

.11..=M

EM

14556

KM

146M

M.

MIM

E146iii/

57147

MIN

Page 42: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

SPECIAL STUDENT EVALUATION

AE AF AG AH1AI 14 1 AK AL AM AN i AO AP I AO I AR107 148 148 57 148 58

149 56 149 149109 150 58 150 59110 IMI _151

152 59151152111 El Ill112

113 154153 153

Ell 154155 60

154155 61114 IBM

115 6.0-17. (18.0-19. 1 (0.0-24. )116117 W SCORE CO w SION RAW S RE CONVERSION RAW SCORE CONVERSI118 27 32 17 27 32 17 27 32 17119 0 0 0 0 0 0 0 0 0120

Page 43: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

SPECIAL STUDENT EVALUATION

D G H KLIMJN121

_I4122 1 it,111 G GRRECT VALVES123,5512 0 106,124 MATH 11112.5 _MAD , G 51126127 AGE128 MO. CONVERT129130 0 0. I

131 1 0.1'132 2 0.10133 3 0.134 4135 0.40136 6 0.50137 7 0..138 8 0 60139 9 0.70140 10 0.80141 11 0 90142143144 I*.A 1 ) St GGESTIONS

_

_____,145146

.

147148149 1 ' i SPELLING AND I. IL_ 1 PROCEDURES. INDIVIDU rzED OGRAMMINCI IS IND CA 6

150 RE I MATH AND CI TESTING PROCEDURES. IVID1fALIZEID PROGRAMMING IS MICA D151 1 1 ,

Page 44: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

11

MIM

ME

EM

E19

ME

M

M11

1141

1trld

r-M

ER

IME

,I

IMM

O IR

1111

1111

U1

I !V

W-1

mill

:11

1111

1111

,11

.

!MIN

IM I

II11

1111

1111

ItW

1-11

111M

1:1

in IM

MIll

r V

I*

iiIH

hiIIl

IIIIL

IiiIH

JIIIl

iIII

tile

Page 45: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

,

1

0A

11

1

R. g

i.

.,. ,

galdl

ii!ng

-nta

'*;ggiqk_r0

. h

W t

'4;161.1-

ccEIV-wh;01.

BglIna

a

v,

5

P

5

tnSjMa'

gI ilM_

uvgannrnampapaanvn

/

z ti RUITIMPVRM a mvm

'ME51.E1414AtiMeitarillagriHAAAggAngAAgAAnnAg

Page 46: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

1IIE

III I

1- IP

TE

mm

11 U

RI

1

1101

11+

1101

0111

0101

1010

1111

1011

1110

1101

11M

MoM

ME

IMII0

101

1101

1111

1111

0111

1NO

R II

I01

1111

1101

1111

1111

1111

1111

1111

1111

1111

1011

1:11

11

1111

1311

1101

1111

111M

+11

1811

1ME

Eli

HE

I111

0111

1101

1111

1011

1181

1181

1111

IHIC

HN

IIIM

MIN

ICH

IMIC

HN

IF I

.

1110

1111

E10

1101

1811

3111

1111

1181

1111

8118

1111

H

MN

+ II

IHM

3131

1Ii

1111

1MIL

:IM

M+

1111

1111

1111

1511

1111

1111

ME

M 1

1111

11

1118

1111

1111

MC

IEN

UIN

EC

CIC

IED

1111

11

Page 47: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

SPE

CIA

L M

ON

T E

VA

LU

AT

ION

0IN

GIII

IM11

1111

7.:.o

riiik

iala

i_v_

,..i?

,-,2

41-z

ziT

itisi

i.:=

:imili

NN

ME

NN

IIIM

IIIN

IINsT

u

1=)4

rrif:

ika:

1M

inai

n:a

iiIll

iall1

1111

16M

MIN

NIEiz

NM

IA

B22

7M

OM

ns 229N

MN

M23

0M

IM

EM

ION

EM

INN

IME

nE

BB

M MIN

IME

alin

illF3

1123

6

NM

Mil

ii.17

NM

1920

21n

2324

111F

RIE

MIN

Fall

282

955

65iir

r.70

7580

EM

ME

N90

liM95

995

95IIM

IIIIM

IIIIII

IIIIM

6570

7575

ini

808S

9095

9598

98N

MI=

ER

MM

IIII

IIIM

IIII

IIII

IIIM

NM

45IM

MO

5565

6570

WM

8080

8590

9595

239

1111

1111

111=

MIN

IMIN

NII

IIM

MI1

1111

1111

1111

1.24

0II

IIM

../.1

11.

9598

241W

M65

7070

7575

8080

1173

1113

1I90

9024

2N

EM

/111

/M

ilM

UN

NO

M55

6570

7075

7580

8585

8590

9590

9524

4

MU

MM

IMI

=II

NM

IE

ri35

4555

KM

6565

7075

8085

KM

9824

6II

MIN

IIIIM

EN

M24

7II

MIM

IM

IM

IME

30W

M45

Mal

WE

6570

7580

KM

9011

1111

1111

11=

M11

1111

1190

95

MrA

IMA

I

9595 95

249

MIM

II

Mil

250

7070

7580

80W

AII

IIE

MIV

AII

MI

9025

1M

MM

MIII

UM

MIM

MM

UM

257

MIM

I=

NM

MIN

IM25

365

6565

7070

7575

8080

8585

9095

95N

MI=

255

45IIM

I55

55W

M65

6570

7075

8085

90M

rAi

256M

.IM

EM

EM

MIM

IllM

N=

ME

M.=

9025

765

6565

6570

7075

7575

8095

9525

8III

MM

INIM

O11

1=1=

1111

1111

M25

9M

EM

INIM

IMM

EM

INIM

INIE

IME

260

4555

WM

6570

8085

9095

9595

9899

9926

111

1111

1111

1111

1=11

111M

1M

1111

MI1

1111

1111

1111

1190

9526

211

1311

1E11

55W

il65

6570

Will

8085

9085

263

MA

IMIII

IIME

MIM

I11

1111

1111

1111

111

264IM

IMII

IIIM

I65

6570

EM

ME

N80

8085

9090

7526

5IM

MO

NM

Mil

266

3535

MU

ME

MIll

4555

5555

1111

3111

111M

5565

7595

267

1111

1111

M11

1111

1111

11=

NM

268w

llM

il11

1111

111=

11=

MN

9595

269

7070

Mill

iEgn

8080

8080

85 MIM

N90

1111

1111

1111

1111

1111

1111

=

9527

0

ligal

INIM

INN

IE

ag

1111

1111

1111

111

3535

1111

1111

1=11

1111

1111

1111

1111

1111

11M

MN

gra

4040

40 K

M 5

511

1731

5565

7080

95

4'

Page 48: DOCUMENT RESUME - ERIC · DOCUMENT RESUME FD 337 709 CE 059 507 AUTHOR Haggett, Connie D.; Banski, Kathleen TITLE Development and Testing of an Expert System To Assist. in Evaluating

SPECIAL STUDENT EVALUATION

AC AD I AE AF AG227 kt. 4_...._

228 A229 PERCENTILE ABLE230 part #3231

-

232 31,

32 33 34 35233 9$ 99 99 99 99234235 99 99 99 99236237238 95 ?5 ) 98 99 99239 .240241 98 98 9$ 99 99242243 95 95 98 98 99244

4245 99 99 99 99246247248 95 98 99 99249 ,250 95 95 98 98 99251252253 95 95 98 98 99254255 95 95 98 V 99256257 95 95 95 95 99258259266 99 99 99 99261262 98 98 99 99 99263264 95

,

98 98 99 99 .

265266 80 80 85 85 95267268269 95 -9-8 98 99 99,

4

270271 ,272 ,.. 95 90 90 95 98