comprehensive 21f training

21f

&

Online Course Reviewer Training

Highlights of 21f

7 STATES HAVE CHOICE AT THE COURSE LEVEL

MICHIGAN’S POLICY FRAMEWORK (SEC. 21F)

• Unprecedented statewide choice at the course level

• Expands district-based online learning options

• Key role for schools in determining quality & rigor

• Schools decide if they want to be providers

Per 21f:“Online course” means a course of study that is capable of generating a credit or a grade, that is provided in an interactive internet-connected learning environment, in which pupils are separated from their teachers by time or location, or both, and in which a teacher who holds a valid Michigan teaching certificate is responsible for determining appropriate instructional methods for each pupil, diagnosing learning needs, assessing pupil learning, prescribing intervention strategies, reporting outcomes, and evaluating the effects of instruction and support strategies.

21F HAS A NARROW DEFINITION OF AN ONLINE COURSE

21F ALSO HAS ADDITIONAL RESTRICTIONSOnly students in grades 5-12 are eligible to enroll in online courses.

With parent consent, a district shall enroll a pupil in up to 2 online courses as requested by the pupil during an academic term.

Select online courses from the educating district’s catalog or from the statewide catalog.


With parent consent, a district shall enroll a pupil in up to 2 online courses per academic term.

Select online courses from the educating district’s catalog or from the statewide catalog.



Online courses must be selected from the educating district’s catalog or from the statewide catalog.



Online courses must be selected from the educating district’s catalog or from the statewide catalog.

All 21f syllabi must be provided to MVU in a form and method described by the department.

LocalCatalog

21F SYLLABI MUST BE ENTERED INTO MICOURSES.ORG

Educating District (resident)

LocalCatalog

Educating Districts (remote)

www.micourses.org

DISTRICT WEBSITES MUST LINK TO MICOURSES

Educating District (resident)

LocalCatalog

Educating Districts (remote)

www.micourses.org

DISTRICT WEBSITES CAN PROMOTE LOCAL OFFERINGS

Educating Districts

DISTRICTS CAN CREATE THEIR OWN ONLINE COURSES

Educating Districts Online Providers

DISTRICTS CAN CONTRACT FOR CONTENT AND SERVICES

Course Payment Ceiling

Semester-Length Course Trimester-Length Course

ONLINE COURSE COSTS ARE CAPPED

20% Completion*

*As determined by the enrolling district

COURSE PAYMENT FOLLOWS THE 80/20 RULE

80%(Enrollment)

PUPIL COUNT CANNOT EXCEED 1.0 FTE

1. Pupil has already earned credits for the course.

SCHOOLS CAN DENY 21F REQUEST IF:

1. Pupil has already earned credits for the course.2. Online course cannot generate academic credit.


1. Pupil has already earned credits for the course.2. Online course cannot generate academic credit.3. Online course is inconsistent with pupil’s remaining graduation

requirements or career interests.


1. Pupil has already earned credits for the course.2. Online course cannot generate academic credit.3. Online course is inconsistent with pupil’s remaining graduation

requirements or career interests.4. The pupil does not possess the prerequisite knowledge and skills to be

successful in the online course or has demonstrated failure in previous online coursework in the same subject.


1. Pupil has already earned credits for the course2. Online course cannot generate academic credit3. Online course is inconsistent with pupil’s remaining graduation

requirements or career interests4. The pupil does not possess the prerequisite knowledge and skills to be


5. The online course is of insufficient quality or rigor.


1. Pupil has already earned credits for the course2. Online course cannot generate academic credit3. Online course is inconsistent with pupil’s remaining graduation

requirements or career interests4. The pupil does not possess the prerequisite knowledge and skills to be


5. The online course is of insufficient quality or rigor. A district that denies a pupil enrollment for this reason shall make a reasonable effort to assist the pupil to find an alternative course in the same or a similar subject that is of acceptable rigor and quality.

SCHOOLS MUST ASSIST WITH FINDING AN ALTERNATIVE

WHAT IS PERMISSIVE DIFFERS FROM WHAT IS REQUIRED

COUNT 21F COURSES UNDER 5-O-D

MENTORS UNDER 5-O-A MUST BE CERTIFICATED

Per 5-O-A: An on-site mentor must be assigned and available for assistance to the pupil. The on-site mentor will monitor the pupil’s progress in the course. The on-site mentor must be a certified teacher employed by the school district. The on-site mentor may also be the teacher of record for the course.

MENTORS UNDER 5-O-D MUST BE EMPLOYEES

Per 5-O-D:A teacher who holds a valid Michigan teaching certificate must be identified and assigned to the course. The teacher is responsible for determining appropriate instructional methods for each pupil, diagnosing learning needs, assessing pupil learning, prescribing intervention strategies, reporting outcomes, and evaluating the effects of instruction and support strategies. An on-site mentor employed by the district must also be assigned to the pupil.

SEAT TIME WAIVER MENTORS MUST BE CERTIFICATED

Per 5-O-B:The district will assign an On-Site Mentor who will also serve as the Teacher of Record. The on-site mentor shall monitor the pupil’s progress and be available for assistance. The on-site mentor shall be a certified Michigan teacher employed by the district.

21f Tool KitResources include:

• Sample Letters and Forms • Draft Policies• Online Learner Readiness Rubric • Parent Guide• Sample Counselor Checklist• Sample Online Learner Agreement Form

Input from MDE, MASSP, MEMSPA, MASA, MAISA, MASB, MACUL, Michigan ASCD and the REMC Association of Michigan

MICOURSES WEBSITE HAS A 21F TOOL KIT

Micourses Website

Finding Help Resources

Difference between Local District and Statewide Catalog Functionality

1 = Online Courses Offered by Local District to Local Students Only

1

1


= Online Courses Offered by Local District to Local and Statewide Students2

1

2

2

1



1

2

2

2 = Online Courses by Other Districts to Students Statewide

2

2

2

21


= Online Courses Offered by Other Districts Statewide3


1

2

3

2

3


2

2

2

21

Registering a User Account

Creating Course Syllabi

Inactive

1.)

2.)

Prerequisite

Important:

Catalog Searches Display Course Offerings

Not

Course Syllabi Without Offerings

Find 3rd Party Syllabi

The selected course syllabi were added to your entity.

The imported course syllabi will appear in the search results grid along with all other syllabi for your entity

Managing Terms & Pricing

Creating Course Offerings

Managing 3rd Party Offerings

Searching Catalogs

1

2

3

2

3

2

2

22

1

Required Fields

Required Fields

Suggestion: If your search does not yield results, try removing non-mandatory search criteria one at a time

Suggestions for Conducting Course Reviews

Review Oversight• Appoint a Review Manager

SUGGESTIONS FOR CONDUCTING COURSE REVIEWS

Review Oversight• Appoint a Review Manager• Where possible, include additional individuals on Oversight Committee


Review Oversight• Appoint a Review Manager• Where possible, include additional individuals on Oversight Committee• Select Review Team members• Train Review Team members• Make sure reviews are completed on schedule


Review Team Composition• 3-5 member teams – minimum of 2


Review Team Composition• 3-5 member teams – minimum of 2• Minimize conflicts of interest that can bias review


Review Team Composition• 3-5 member teams – minimum of 2• Minimize conflicts of interest that can bias review• Who created the course content?• District-Created – Include external reviewers on team• Third-Party – No external reviewers necessary


Review Team Composition• 3-5 member teams – minimum of 2• Minimize conflicts of interest that can bias review• Who created the course content?• District-Created – Include external reviewers on team• Third-Party – No external reviewers necessary

• Assemble a range of experts on team• Subject matter experts• Online course design experts• Instruction experts


Training Review Team• Introduce iNACOL National Standards for Quality Online Courses v2


iNACOL National Standards for Quality Online Courses

5 iNACOL Standard Sections• Section A: Content: The course provides online learners with multiple ways of engaging

with learning experiences that promote their mastery of content and are aligned with state or national content standards.

INACOL STANDARDS ARE DIVIDED INTO 5 SECTIONS


with learning experiences that promote their mastery of content and are aligned with state or national content standards.• Section B: Instructional Design: The course uses learning activities that engage students

in active learning; provides students with multiple learning paths to master; the content is based on student needs; and provides ample opportunities for interaction and communication – student to student, student to instructor, and instructor to student.



with learning experiences that promote their mastery of content and are aligned with state or national content standards.• Section B: Instructional Design: The course uses learning activities that engage students

in active learning; provides students with multiple learning paths to master; the content is based on student needs; and provides ample opportunities for interaction and communication – student to student, student to instructor, and instructor to student.• Section C: Student Assessment: The course uses multiple strategies and activities to

assess student readiness for and progress in course content and provides students with feedback on their progress.


5 iNACOL Standard Sections• Section D: Technology: The course takes full advantage of a variety of technology tools,

has a user-friendly interface and meets accessibility standards for interoperability and access for learners with special needs.


5 iNACOL Standard Sections• Section D: Technology: The course takes full advantage of a variety of technology tools,

has a user-friendly interface and meets accessibility standards for interoperability and access for learners with special needs.• Section E: Course Evaluation and Support: The course is evaluated regularly for

effectiveness, using a variety of assessment strategies, and the findings are used as a basis for improvement. The course is kept up to date, both in content and in the application of new research on course design and technologies. Online instructors and their students are prepared to teach and learn in an online environment and are provided support during the course.


Suggested Content Focal Standards• A2. The course content and assignments are aligned with the state’s content standards,

common core curriculum, or other accepted content standards set for Advanced Placement® courses, technology, computer science, or other courses whose content is not included in the state standards.

SUGGESTED FOCAL STANDARDS


common core curriculum, or other accepted content standards set for Advanced Placement® courses, technology, computer science, or other courses whose content is not included in the state standards. • A3. The course content and assignments are of sufficient rigor, depth and breadth to

teach the standards being addressed.



common core curriculum, or other accepted content standards set for Advanced Placement® courses, technology, computer science, or other courses whose content is not included in the state standards. • A3. The course content and assignments are of sufficient rigor, depth and breadth to

teach the standards being addressed.• A9. The course reflects multicultural education, and the content is accurate, current and

free of bias or advertising.


Suggested Instructional Design Focal Standards• B1. Course design reflects a clear understanding of all students’ needs and incorporates

varied ways to learn and master the curriculum.



varied ways to learn and master the curriculum. • B2. The course is organized by units and lessons that fall into a logical sequence. Each unit

and lesson includes an overview describing objectives, activities, assignments, assessments, and resources to provide multiple learning opportunities for students to master the content.




and lesson includes an overview describing objectives, activities, assignments, assessments, and resources to provide multiple learning opportunities for students to master the content. • B3. The course instruction includes activities that engage students in active learning.




and lesson includes an overview describing objectives, activities, assignments, assessments, and resources to provide multiple learning opportunities for students to master the content. • B3. The course instruction includes activities that engage students in active learning. • B4. The course and course instructor provide students with multiple learning paths, based

on student needs that engage students in a variety of ways.


Suggested Instructional Design Focal Standards• B5. The course provides opportunities for students to engage in higher-order thinking,

critical reasoning activities and thinking in increasingly complex ways.


Suggested Instructional Design Focal Standards• B5. The course provides opportunities for students to engage in higher-order thinking,

critical reasoning activities and thinking in increasingly complex ways. • B10. The course provides opportunities for appropriate instructor-student and student-

student interaction to foster mastery and application of the material.


Suggested Assessment Focal Standards• C2. The course structure includes adequate and appropriate methods and procedures to

assess students’ mastery of content.


Suggested Assessment Focal Standards• C2. The course structure includes adequate and appropriate methods and procedures to

assess students’ mastery of content.• C3. Ongoing, varied, and frequent assessments are conducted throughout the course to

inform instruction.


Suggested Technology Focal Standards• D4. Rich media are provided in multiple formats for ease of use and access in order to

address diverse student needs.


Suggested Technology Focal Standards• D4. Rich media are provided in multiple formats for ease of use and access in order to

address diverse student needs.• D10. Course materials and activities are designed to provide appropriate access to all

students. The course, developed with universal design principles in mind, conforms to the U.S. Sections 504 & 508 provisions for electronic and information technology as well as the W3C’s Web Content Accessibility Guidelines (WCAG 2.0).


Suggestions for Conducting Course Reviews (Continued)

Training Review Team• Introduce iNACOL National Standards for Quality Online Courses v2• Share 3-Point Rubric created by MVU• Reduced from iNACOL 5-point scale for simplicity


Training Review Team• Introduce iNACOL National Standards for Quality Online Courses v2• Share 3-Point Rubric created by MVU• Reduced from iNACOL 5-point scale for simplicity• Review purpose of Provider Course Review Documentation form (+)


Training Review Team• Introduce iNACOL National Standards for Quality Online Courses v2• Share 3-Point Rubric created by MVU• Reduced from iNACOL 5-point scale for simplicity• Review purpose of Provider Course Review Documentation form (+)• Identify standards you want the team to focus more review time on (*)


Training Review Team• Establish protocol for submitting review ratings• MS Word template• Excel template



• Set up realistic expectations for:• Amount of time on review• Due dates



• Set up realistic expectations for:• Amount of time on review• Due dates

• If possible, conduct a mini-review


Tasks to Address before Conducting Course Review• Get URL of website for reviewing the online course (No student data!)


Tasks to Address before Conducting Course Review• Get URL of website for reviewing the online course (No student data!)• Get both instructor and student login credentials


Tasks to Address before Conducting Course Review• Get URL of website for reviewing the online course (No student data!)• Get both instructor and student login credentials• Gradebook views• Unit/lesson views• Adaptive release can restrict student views



• Get any additional logins for e-texts and other third-party materials



• Get any additional logins for e-texts and other third-party materials• Send and receive the Provider Course Review Documentation Form



• Get any additional logins for e-texts and other third-party materials• Send and receive the Provider Course Review Documentation Form• Identify 2-3 key units/lessons to focus on in-depth


Goal: Provide the Single Most Accurate Rating for Each Standard• Each standard must receive a final rating – not an average of ratings


Goal: Provide the Single Most Accurate Rating for Each Standard• Each standard must receive a final rating – not an average of ratings• In times of disagreement:• Lean on the experts• Use the comments field to elaborate about a rating including

mentioning doubt or hesitancy about the final rating


Adding Course Review Results to the Micourses Website

Review in Catalog

Course Review Template

Course Review Results

Course Review Experience

COURSE REVIEW EXPERIENCE

Create no more than 10 review teams.

When you have your review team, please raise your hand to receive your review team number.


As a team, go to http://bb.mivu.org


Click on the “Login” link at the top of the screen.


Enter your username and password and click the “Login” button.

MVS Course LoginsStudent Logins Teacher Logins

Review-Stu1Review-Stu2Review-Stu3. . . Review-Stu10

Review-Ins1Review-Ins2Review-Ins3. . . Review-Ins10

PW = Password*UN and PW are case-sensitive

Use your team number as the number in your logins

Focal Standards*B2. The course is organized by units and lessons that fall into a logical sequence. Each unit and lesson include an overview describing objectives, activities, assignments, assessments, and resources to provide multiple learning opportunities for students to master the content.


Focal Standards*B2. The course is organized by units and lessons that fall into a logical sequence. Each unit and lesson include an overview describing objectives, activities, assignments, assessments, and resources to provide multiple learning opportunities for students to master the content.

*A3. The course content and assignments are of sufficient rigor, depth and breadth to teach the standards being addressed.

*B5. The course provides opportunities for students to engage in higher-order thinking, critical reasoning activities and thinking in increasingly complex ways.


Suggestions for ConsumingCourse Reviews

Come up with a plan for dealing with the rigor and quality issue

From Section 21f(5) A district may deny a pupil enrollment in an online course if any of the following apply, as determined by the district:

(e)The online course is of insufficient quality or rigor. A district that denies a pupil enrollment for this reason shall make a reasonable effort to assist the pupil to find an alternative course in the same or a similar subject that is of acceptable rigor and quality.

SUGGESTIONS FOR CONSUMING COURSE REVIEWS

How might you assess this without going into the course?



1. Michigan-certified teacher does not necessarily mean highly qualified. If you require a highly-qualified teacher to teach it in your building, use the same standard for online courses.




2. Identify a subset of the 52 standards that matter most to you and set up guidelines for acceptable ratings for that subset.





3. Stay informed. Talk to colleagues in other districts. Look at previous results from providers.





3. Stay informed. Talk to colleagues in other districts. Look at previous results from providers.

4. Display the course offerings from providers that you want to steer students to in your Local District Catalog.



= Online Courses Offered by Other Districts Statewide3


1

2

2

3


2

2

21

3

2

Thank You!

comprehensive 21f training

Education

pupil learning

course of study

course level

learning needs

support strategies

narrow definition

effects of instruction

quality rigor schools