i nacol
DESCRIPTION
TRANSCRIPT
Preparing For and Administering High Stakes, State-Mandated
Tests, in the Cyber Environment
Russell A. Gallagher, Ed.D.
Heather Gowton
2
Purpose
• Cyber programs in US are growing• NCLB mandates state level
assessments• Testing in cyber environment presents
unique challenges• Will discuss how 21CCCS plans,
prepares, and trains for administering the test
3
States with State Virtual Schools and State-led Online Initiatives
Figure 1: Watson, J. (2010). Keeping pace with K-12 online learning: an annual review of state-level policy and practice.
4
States With Full-time, Statewide Online Schools
Figure 2: Watson, J. (2010). Keeping pace with K-12 online learning: an annual review of state-level policy and practice.
5
Cyber School Enrollment Changes 2009-10
Figure 4: Watson, J. (2010). Keeping pace with K-12 online learning: an annual review of state-level policy and practice.
6
Pennsylvania Cyber Charter Schools
• 2009-10: 11 cyber charter schools• 12th opened in 2010
– Bilingual
• Serving 24,000+ students• Most located in or near major cities– Philadelphia, Harrisburg, Pittsburgh
• Some have multiple locations• Draw students from across the state
7
Characteristics and Attributes of On-Line Programs
Figure 5: Watson, J. (2009). Keeping pace with k-12 online learning: an annual review of state-level policy and practice.
8
Characteristics and Attributes of the21st Century Cyber Charter School
9
21st Century Cyber Charter School
• Public, Tuition-Free, Diploma Granting Charter School
• Asynchronous Learning Network (ALN)• Serves Pennsylvania students in grades 6 through 12
• Made AYP for five consecutive years• Highest state test scores of all cyber PA cyber
charter schools• 21CCCS teacher-developed curriculum based on
state standards
10
Key Terms• Moodle - Learning Management System (lessons, resources,
assignments)• Elluminate - Virtual Classroom, where students come to learn
– Virtual Office - Subject area specific– Lectures
• Intermediate Unit - Regional education service agencies in Pennsylvania
• Pennsylvania System of School Assessment (PSSA) - Pennsylvania high-stakes test (Reading/Math, Writing, Science)
• Study Island - Provider of web-based standards mastery products
11
NCLB Requirement
Each State plan shall demonstrate that the State educational agency, in consultation with local educational agencies, has implemented a set of high quality, yearly student academic assessments that include, at a minimum, academic assessments in mathematics, reading or language arts, and science that will be used as the primary means of determining the yearly performance of the State and of each local educational agency…
12
Why High Stakes Testing?• 2001 No Child Left Behind (NCLB)
– State defined– Schools must show Adequate Yearly Progress
(AYP)– All students must pass by 2014
• Why we test?– Motivation for teachers and schools– Curriculum alignment– Information from students
• Data provided to teachers• Adjust instruction
– Symbolism• Public awareness
13
Challenges for Cyber Schools
• Students test state-wide – Geographically dispersed sites
• No direct or daily interface with students:– Anonymity– Preparation– Selecting and coordinating test sites
• Wide range of student backgrounds
14
Testing Sites
PALO
21st Century Cyber
15
Challenges for Students and Parents
• 21CCCS used 34 testing locations:– 21CCCS: 8 – PA Learners Online: 6 – Local Districts: 20
• Getting students to the test– Travel Time– Parent/Student work schedules
• Location– Distance from home – Environment/Distractions
• Exam Fatigue– All testing in four days
16
• Researchers have demonstrated a positive relationship between test-taking motivation and test performance.
• […] students can raise their scores on aptitude and achievement tests by taking practice forms of the tests.
Test Taking Success: Preparation and Motivation
17
Preparation: 2009-10 School Year
• Study Island• Blue Ribbon Challenge
– 6th, 7th , 8th, and 11th grades– Targeted “At Risk” students
•Previous state test scores•Math and reading grades
– 4 benchmark exams– Extra credit winter and spring break challenges
– Tutorial videos for preparation
18
Motivation: 2009-10 School Year
• Prior to Testing– Motivational Videos
• 3 words (created by students, parents, and staff)• Jib Jab
– Teacher Captains• Competition• Communication
• During Testing– Daily contest– Break activity– Individual activity– Group photo– Nutritional snacks– Tokens and souvenirs
• Met with limited success
19
Preparation: 2010-11 School Year
• Started as soon as students returned to school
• Comprehensive preparation plan• Superpowers Class• Reading/Writing Preparation Program
• Learning Coaches– Communication– Rewards system
20
Comprehensive Testing Preparation and Execution Plan
20 steps including:
• Performance improvement team• 3-step procedure
– Assess, Analyze, & Act
• School-wide data calendar• Integration of intervention tool• Real-world problems• Problem solving process
21
Comprehensive Testing Preparation and Execution Plan (Continued)
• Dedicated Math teaching assistant• Tutoring• Teacher professional development
– Some asynchronous
• Motivation program• Parental involvement• Restructure cohort seating
22
Superpowers Class• Separate High School and Middle School• Benchmarks• Weekly assignments
– Study Island – Supported by Moodle – Adjusted based upon previous weeks and BM results– Grades 6th - 11th
• 4 Benchmark exams • Targets all students• Weekly Blue Ribbon exam
23
English Superpowers• Comic Book
– 5 Themes: Focus, Content, Organization, Style, Conventions
– Mini Lessons
• Targeted Intervention– BM scores– Current/Previous English grades and performance
• In classes– Specific Feedback– Positive Reinforcement
• Writing exam taken on computer– Transcribed by staff
24
Incentives
• Positive:– Incentive Awards Program– Positive calls/emails to parents
• Negative:– Restrictions to computer use– Negative calls to parents– Automatic emails– Mandated study session– Truancy/Suspension
25
Rewards Plan
26
Teacher Training
• Study Island training
• Weekly assignment training
• Coordination team training
• MS Math certification classes for all non-Math teachers and TAs
• Test administration training
27
Test Administration
• Selection of locations
• Ensuring proper test environment
• Coordinating staff
• Travel for proctors
• Impact on classes
28
Questions?
29
Contact Information
• 21st Century Cyber Charter School– 484-875-5400– [email protected]
• Russ Gallagher– 484-875-5459– [email protected]
• Heather Gowton– 484-875-5446– [email protected]
30
ReferencesArvey, R. D., Strickland, W., Drauden, G., & Martin, C. (1990). Motivational components of
test taking. Personnel Psychology, 43(4), 695-716.
Hoover, J.P. (2010) Cyber school students have disadvantage with PSSA tests. The Morning Call. Retrieved on Oct 21, 2010 <http://articles.mcall.com/2010-09-02/opinion/mc-james-hoover-charter-schools-yv-20100902_1_cyber-schools-ayp-school-assessment-tests/2>
Kulik, J.A. . (1984). Effect of practice on aptitude and achievement test scores. American Eduational Research Journal, 21(2), Retrieved from http://aer.sagepub.com/content/21/2/435.short doi: 10.3102/00028312021002435
Supovitz, J. (2010) Is high-stakes testing working? PennGSE Digital Edition. Retrieved on Oct 22, 2010 < http://www.gse.upenn.edu/review/feature/supovitz>
Watson, J. (2010). Keeping pace with K-12 online learning: an annual review of state-level policy and practice. Proceedings of the iNACOL conference (pp. 6-21).