1 2006 -2007 training workshop september 12, 2006 michigan merit examination (mme)

1

2006 -2007 Training Workshop

September 12, 2006

Michigan Merit Examination (MME)

2

Welcome and Introductions

3

Welcome and Introductions

Edward Roeber Office of Educational Assessment & Accountability

Pat King Office of Educational Assessment & Accountability

Brian Strauss Pearson Educational Measurement

Craig Walker ACT

4

Introducing the Michigan Merit Exam (MME)

5

MEAP or MME?

Use of the MME has not been approved yetMDE has applied for permission to use MMEUSED Peer Review is now under wayDeadline for approval is November 1

Proceeding on the assumption that MME will occur in Spring 2007

Will notify schools later if MME will NOT occur this spring

6

Fall MEAP High School Test

Fall MEAP retesting (late October-early November, 2006) for high school seniors ONLY

English Language Arts (Reading and Writing), Mathematics, and Science for the Merit AwardSocial Studies also assessed but does not count for the Merit Award

NO MEAP assessment for sophomores or juniors

Dual enrollment candidates need to take the PLAN or PSAT to seek dual enrollment

7

2006-07 High School Assessment

2006-2007 (Assuming Federal Approval)Tenth Graders - PLAN or PSAT for dual enrollment

Local district selects test; state sets qualification score(s)Student or school district pays the testing cost (no state reimbursement)

Eleventh GradersMME in the Spring only

Twelfth GradersMEAP HST to complete Merit Award (Fall and/or Spring)

8

MME Assessment Design

English Language ArtsACT Reading, Writing, and English WorkKeys Reading for Information test Michigan Social Studies constructed response item

MathematicsACT Mathematics Selected ACT Science items WorkKeys Applied Mathematics testMichigan items

ScienceACT Science Michigan items

Social StudiesAll Michigan items

9

Michigan Merit Examination Components and Score Contributions

Assessments Administered

Contributes to an English

Language Arts Score

Contributes to a Mathematics

ScoreContributes to

a Science Score

Contributes to a Social Studies

Score

•ACT Plus Writing

•WorkKeys Applied Mathematics & Reading for Information, plus Michigan Mathematics

•Michigan Science and Social Studies

Total ELA Score

Reading•ACT Reading (MC)•WorkKeys Reading for Information items (MC)

Writing•ACT English (MC)•ACT Writing (CR)•Michigan Social Studies CR item -writing score

•ACT Mathematics (MC)

•WorkKeys Applied Mathematics (MC)

•Selected ACT Science items (MC)

•Michigan items (Approximately 13 MC)

•ACT Science (MC)

•Michigan Science (53 MC)

•Michigan Social Studies (57 MC and 2 CR - social studies score)

Note: The number of Michigan items shown includes field-test items to replace those released annually.

10

Today’s Agenda

11

Today’s Agenda

How to conduct a successful test administrationReview of the MME schedule and critical datesReview of the test site establishment processReview of testing requirements (facilities & staffing)Training workshops – what to expect, who must attendStudents testing with accommodationsHome school students

12

Today’s Agenda - continued

Non-public school studentsEnrollment & materials orders Helping students prepare for the MMESources of InformationQuestions and Answers

13

How to Conduct a Successful Test Administration

Become familiar with MME procedures and calendarAssign responsibilities Manage the test day scheduleRead all training materials and supervisor manualsDON’T Wait until it’s too lateDON’T miss DUE DATESAsk Questions – Don’t assumeSTATE TESTING is NOT ACT National Testing or MEAP

14

Review of the MME Schedule and Critical Dates

15

MME Assessment Administration

Initial Testing (Spring 2007)March 13: ACT Plus WritingMarch 14: WorkKeys + Michigan MathematicsMarch 14, 15, or 16: Michigan Science and Social Studies

Makeup Testing (Spring 2007)March 27: ACT Plus WritingMarch 28: WorkKeys + Michigan MathematicsMarch 28, 29, or 30: Michigan Science and Social Studies

Accommodations Testing Windows (Spring 2007)Day 1 - March 13 – March 27Day 2 - March 14 – March 28Day 2, 3, or 4 - March 14 – March 30

Reminder: Only for high school juniors

16

MME Assessment Administration

Grade 12 - Retest Administration (Fall 2007) Saturday, October 27, 2007 (ACT National Test Date) ACT Plus WritingTuesday, October 30, 2007 - WorkKeys + Michigan MathOctober 30, 31, or November 1 - Michigan Science and Social Studies

Accommodations Testing Windows (Fall 2007)

ACT Plus Writing Oct 27 – Nov 10WorkKeys + Michigan Math Oct 30 – Nov 13Michigan Science and SS Oct 30 – Nov 15

17

Future Administration Dates

Session

Component 2008 2009 2010

Initial ACT Plus WritingWorkKeys+MathScience & SS

3/113/123/12-14

3/103/113/11-13

3/93/103/10-12

Makeup ACT Plus WritingWorkKeys+MathScience & SS

3/253/263/26-28

3/243/253/25-27

3/233/243/24-26

18

Major Fall (2006) MME Activities

Establish Michigan high schools as test sitesIdentify key staff

Test SupervisorBack-up Test SupervisorTest Accommodations Coordinator

Apply for testing accommodationsTrain key staff

Test SupervisorBack-up Test SupervisorTest Accommodations Coordinator

19

MME Fall (2006) Schedule

Week of August 28

Test Site Establishment Packets sent to high school principals

September 12 MME 2007 Video Conference

September 29 Test Site Establishment Packets due back to ACT - Staff and facilities

October 2-13 Required Administrator Training Workshop invitations mailed

20

MME Fall (2006)Schedule

October 18 Accommodations Training – Video Conference (for TACs)

October 20 Administrator Training Workshop reservations due to ACT

Beginning Week of October 23

Administrator Workshop Training confirmations sent via e-mail

November - December

Testing Staff Workshop Training conducted at 12 sites statewide

21

MME (2006-2007)Schedule

November 17 Day 2 and Day 2,3,or 4 materials orders due

December 1 Off-site testing requests due to ACT

December 1 Receipt deadline for applying for ACT-approved accommodations

January 10 Receipt deadline for applying for state-approved accommodations

22

Review of the Test Site Establishment Process

23

MME Test Center Establishment

Establishment Packets sent to high schools just before Labor Day

Sent to HS principalsCourtesy copy sent to ISD & District Assessment Coordinators

Principals – select your school’s Test Supervisor, Back-up Test Supervisor, and Test Accommodations Coordinator. Then complete the MME Appointment of Testing Staff & School Information form.

Deadline for return of Principal’s materials September 29

24


Review key documentsStandard Testing RequirementsSchool Schedule and Site Options for Administration of the 2007 Michigan Merit ExaminationSummary of Test Administration PoliciesQualifications and Responsibilities for Test Supervisors and Back-up Test SupervisorsQualifications for Test Accommodations Coordinators

25


Documents to be returned by September 29, 2006:

Principals – MME Appointment of Testing Staff & School Information form. Test Supervisors - ACT State Testing 2007 Test Supervisor and Facilities ProfileBack-up Test Supervisors - ACT State Testing 2007 Back-up Test Supervisor ProfileTest Accommodations Coordinators - Michigan (MME) ACT State Testing 2007 Test Accommodations Coordinator Profile

26

Review of Testing Requirements –Facilities and Staffing

27

Assessment Sites

Preferred site is in a quiet wing of the high school

School in session for all students, orSchool for juniors only

Off-site administrationCommunity CollegeISD/RESAOther public facilityOther private facility

Each site must be approved by ACT

28

Assessment Facilities

Choice of testing rooms for standard time administration

Uncrowded seating – prefer classrooms with 25-30 examineesManageable security – prefer no more than 100 examinees in one room Good lighting, comfortable temperature, quiet atmosphere

Adequate writing surfacesNo lapboards permitted; temporary surfaces resting on chair arms or back of chair in front must be reviewed and approved by ACTMust accommodate both test booklet and answer document

29


Seating arrangements (Applies Equally to Desks and Tables)

Seats must be assigned by testing staff as students enter room Minimum of 3 feet apart side-to-side (measured shoulder-to-shoulder)Minimum of 3 feet apart front-to-back (measured head-to-head)All students must face the same direction, directly behind one another

30


Freedom from distractions

No one not involved in testing may be in the roomUninterrupted testing period required for all days of testingNo unnecessary noises (bells, public address systems, etc. must be turned off)Testing rooms must be separated from regular school activities

31

Required MME Personnel

Test SupervisorResponsible for all MME assessment activitiesResponsible for all testing materials

Back-up Test SupervisorResponsible to serve if Test Supervisor unable to do soWill assist the Test Supervisor

Test Accommodations CoordinatorAssures that each student requiring accommodations applies for them - ACT-approved or state-allowedCoordinates all Accommodations Testing for your school

These personnel needed in each high schoolNamed by September 29

32

Avoiding Conflicts of Interest

Test (and Back-up) Test Supervisors have access to secure test materials prior to testing.To avoid the appearance of a conflict of interest, and to protect relatives (siblings, children, step-children, grandchildren, nieces, nephews) and wards from allegations of impropriety:

Test (and Backup) Supervisors may not be related to any examinee taking the ACT/WorkKeys in 2006-2007 anywhere in Michigan.Room supervisors and proctors may not assist in a room where any relative is being tested

33

Avoiding Conflicts of Interest

TACs – May not be related to or guardian of any examinee participating in MME accommodations testing anywhere in Michigan this year. (see list of relatives / guardians on prior slide)

Testing staff supporting accommodations – May not be involved in coaching high school athletics or college athletics (applicable only if student testing with accommodations participates in athletics)

34

Other Assessment Personnel

Required number of qualified assistants per room

1 room supervisor required for each room,Plus 1 proctor for every 25 examinees in the room after the first 25 (i.e., 26-50=1; 51-75=2; 76-100=3)

Testing staff may not beInvolved in test preparation for commercial gain outside of normal teaching responsibilities

Enrolled in high school

35

Other Test Administration Requirements

36

Assessment Administration

Test Supervisors and TACs are responsible for training the staff that will assist them during the testing (e.g., room supervisor, proctors, readers)

Assessment administration staff will need to review procedures at least 30 minutes prior to the start of testing.

Students assigned seating

37

Assessment Administration

No food or drink are permitted in testing room(s) – this applies to both staff and examinees.

Schedule adjustments will be necessary for students with different schedules (e.g., night classes)

All test sites must test on the designated test days with testing as the first activity of the morning, starting no later than 9 am.

38

Security

Receipt, check-in, and verification of test booklets by serial numbers

Restricted access at all times from moment of receipt to return (documented “chain of custody”)

Answer documents not returned to students after test responses are gridded

Immediate and complete return of all Day 1 materials to ACT and all Day 2 (2, 3, or 4) materials to Pearson Educational Measurement as outlined in “return of materials” procedures

39

Security

Identification of examinees at check in (personal recognition or photo ID)

Direct consultation with ACT to handle testing irregularities for Day 1

Direct consultation with Pearson Educational Measurement to handle testing irregularities for Day 2 & Day 2,3, or 4

Unannounced observation of assessment administration in selected schools

40

Exact Timing of the Tests

More than one timepiece must be used in each room to ensure back-up

Time remaining may not be posted

All timing instructions must be read verbatim from the supervisor’s manuals

41

Documentation of Test Day Procedures

Testing Staff List returned with answer documents

Roster, Seating Diagram, Test Book Count Form, and Testing Time Verification Form returned for each room

Testing Irregularity Report Form(s) returned with answer documents

Scanable - Supervisor’s Report Form (Day 1) and School ID Sheet (Day 2 & Day 2,3,or 4) completed accurately

42

Training Workshops

43

Training Workshops – what to expect, who must attend

Half – Day Training Sessions

Workshop materials available at each session

ONLY for “Named” Test Staff -- ALL Test Supervisors, Back-up Test Supervisors, and Test Accommodations Coordinators are Required to Attend. Ideally, testing staff from each school will attend the same workshop session.

44


What will be covered:

Testing Requirements – before, during, and after testingProcedures for Day 1, Day 2, and Days 2, 3, or 4Ordering materialsReturning materialsAvoiding the PitfallsTesting with AccommodationsIn-school training – room supervisors and proctorsQuestion and Answers

45


Arrive Early – All Attendees must sign-in

THIS TRAINING IS ONLY FOR TS, Backup TS, Test Accommodations Coordinators, and District Coordinators.

A portion of the training will be via video – you will have the opportunity to take a copy of the video with you following your training.

If your school staff has not been trained – YOUR School will NOT be allowed to participate in MME.

46

Training Dates and Locations

Training will be conducted:

November - 2006

Nov 7 – Marquette Nov 7 – Alpena Nov 8 – Escanaba Nov 8 – Mt Pleasant Nov 9 – Traverse City Nov 13 – Kent CountyNov 13 – Oakland County Nov 14 – Kalamazoo Nov 14 – Macomb County

47

Training Dates and Locations

December 2006:

Dec 6 – Wayne County Dec 14 – Lansing

48

Following the Training

Testing staff must read and be familiar with both the Day 1 and Days 2 (2-4) supervisor’s manuals (included with training materials)

The Test Supervisor must organize an in-school (before test day) completion of all Day 1 pre-test information sections of the ACT Plus Writing and ensure ID labels are correctly affixed to each Day 1 answer folder.

49

Following the Training

The Test Supervisor must organize a separate in-school (before test day) completion of Day 2 and Day 2, 3, or 4 Answer Folder demographic information and ensure ID labels are correctly affixed to each Day 2 and Day 2,3,or 4 answer folder.

A local training session for all staff is required before testing (conducted by the Test Supervisor at each school) A separate training session is required for all staff who will be supporting students testing with accommodations (conducted by the TAC at each school).

Plan ahead!

50

Students testing with accommodations

51

Students testing with accommodations

For the MME two types of Accommodations will be available:

ACT Approved Accommodations

State – Allowed Accommodations

52

Training for TACs

October 18, 2006 – MME Accommodations Training Workshop

Training video conference from Wayne RESA2:30 – 4:00 PMInformation about the session will be available shortlyEspecially for Test Accommodations Coordinators (TAC)Does not replace the required workshops in Nov & DecPrincipals – ensure your TACs attend this training

53

Before the October 18th TAC Training

Review materials on the MME website – www.michigan.gov/mme

MME Accommodations Summary Table, Spring 2007Procedures for Requesting ACT Test Accommodations for Day 1 of the Michigan Merit Examination (MME) – March 2007March 2007 Michigan Merit Examination (MME) Day 1 – Request for ACT-Approved Test AccommodationsApplication for State Allowed – Accommodations – March 2007 Michigan Merit Examination (MME) – Day 1Test Accommodations Coordinator Header (for 2007 ACT State Testing)

54

Home School and Non-Public School Students

55

Home School Students

Home School students wishing to participate in the MME will test at their local public high school

The home school community has been notified of this opportunity

Local Public Schools – will need to work with local home school students wishing to take the MME

56

Non-Public School Students

Non-Public Schools may participate in MME

Participation Model #1 – fully participate in all facets of MME to support your students and establish your school as an MME test site

Participation Model #2 – allow your students who are interested in taking the MME to test at one of 8 auxiliary test sites throughout the state on the designated weekday test dates. If any of your interested students require accommodations, agree to submit the necessary documentation and administer the accommodated testing in your school on the designated testing dates.

Complete the appropriate test site establishment and testing staff forms and return to ACT by Sept 29

57

Enrollment and Materials Ordering

58

On Line Enrollment

Log into the state site:www.Michigan.gov/oeaa-secureNew users will need to obtain a user ID and password from their school district administrator of the OEAA secure site.OEAA Secure Site user manual is located on OEAA-login screen. Provides step by step instruction on how to maneuver through the site.Email [email protected] with any questions or concerns with the OEAA site.

59

Select Additional Orders & Shipment Tracking

60

Select Appropriate Tab

61

Select Profile Tab

62

Profile Tab

Verify that the MME Test Supervisor, Back up Test Supervisor and Test Accommodation Coordinator information is accurate.Changes can NOT be made to this screen. Contact ACT if updates are needed.

63

Enrollment Tab

Select MME Test Cycle

64

Enrollment Tab

The Enrollment Screen has links:Detail InstructionsEnrollmentSupplemental Enrollment

Please read detailed instructions then select the enrollment link.

65

Select Enrollment Link

66

Enrollment Link

Test Supervisor will need to update the enrollment screen.

Enrollment window Nov 1 -17, 2006.Validate the number of students taking assessment. Update if necessary.Enter the number and type of accommodation materials needed per subject for WorkKeys and Michigan components.

67

Select Supplemental Enrollment Link

68

Supplemental Enrollment Link

Provide Spring Break dates for your school.

Identify your school’s hours of operation for materials delivery and pickup.

69

Next Steps

Obtain a user ID and password for the OEAA secure site if you don’t currently have one.Validate the MME Test Supervisor, Back Up Test Supervisor and Test Accommodations Coordinator information is accurate

Enrollment window of November 1-17Verify student enrollment Order accommodation materials

70

Helping Students Prepare for the MME

71

Helping Students Prepare for MME

Assure that the high school’s curriculum is aligned to state standards and benchmarks, the new high school content expectations, and ACT-assessed standards

Assure that course content matches course titles

Encourage students to enroll in rigorous college preparatory classes (or equivalent ones that address the same content with the similar rigor)

72

Helping Students Prepare for MME

Have students participate in reasonable ACT prep activities

Use ACT or commercial products to practice taking a timed testBecome comfortable with the test formats

Focus on learning the skills defined in the standards and benchmarks rather than just practicing test-taking skills

73

Getting Started Now

Review past ACT high school reportsWhat percent of students take the ACT?What percent of students take recommended college core courses?What is the performance of students taking college core versus those who did not?What are the trends over time?

What are the implications of ACT results?For counselors - better course-taking advice?For academic departments - improved rigor of courses?For districts - More rigorous graduations requirements?

74

Sources of Information

75

Key Resources

March 6, 2006 - Video conference on MME assessment accommodations (DVD/videotape available from Wayne RESA; videostreamed as well: http://www.mistreamnet.com, click on 'Archived Stream.’

April 27, 2006 - Video conference on 2006-2007 MME plans (DVD/videotape available from Wayne RESA; videostreamed as well: http://www.mistreamnet.com, click on 'Archived Stream.’

www.michigan.gov/mme - website has considerable resources; check it periodically

76

For Questions and Comments

Edward Roeber(517) 373-0739 [email protected]

Pat King (517) 335-6780 voice

[email protected]

Michigan Department of EducationOffice of Educational Assessment & AccountabilityP.O. Box 30008Lansing, MI 48909

www.michigan.gov/mme

77

For Questions and CommentsRegarding Accommodations

Peggy Dutcher (for questions regarding accommodations for student with disabilities) (517) 335-0471 voice

[email protected]

Marilyn Roberts (for questions regarding accommodations for English Language Learners (ELL)) (517) 335-0567 voice

[email protected]

78

For More Information

For more information on MMEwww.michigan.gov/mme

For MDE assessment questions(877) 560-TEST (8378)

For ACT specific questionsACT State Testing (800) 553-6244 x 2800ACT State Testing Accommodations (800) 553-6244 x [email protected]

For Pearson Educational Measurement(800) 204-4109

79

Questions and Answers