naep national assessment of educational progress alaska
TRANSCRIPT
NAEPNational Assessment of Educational Progress
Alaska
What is NAEP?
• NAEP is the only nationally representative and continuing assessment of what America’s students know and can do in various subject areas. It is the most comprehensive national measure of student’s learning outcomes at critical junctures in their school experience.
Who heads NAEP?
• NAEP is an assessment conducted by the National Center for Education Statistics (NCES) for the United States Department of Education.
• Governed by the National Assessment Governing Board (NAGB)
2003 NAEP
• The No Child Left Behind Act mandates that any state wishing to receive a Title 1 grant must include an assurance beginning in 2002-2003 the state will participate in the biennial state-level NAEP in reading and math at grades 4 and 8. – Federal government will pay for administration– The state gives permission for NCES to release results and
data– State participation in other NAEP assessments are voluntary– There will be not rewards or sanctions to states or LEAs on
state NAEP results– Participation is not a substitute for the state’s own
assessment
NAEP Provides
• State and National performance results
• National student results
• Trends in national student performance for the last 30 years
• Comparisons in student performance based on such factors as race/ethnicity, gender, public and private schools, level of parental education, prior course taking, and classroom and school conditions and practices.
Available NAEP Information
• National and State report cards on student performance
• Sample test questions, sample student answers, and scoring rubrics
• Assessment subject-area frameworks
• On-line data tool that allows users to analyze and download data from NAEP assessments
National average geography scale score results grades 4,8,12
National geography achievement level results
* Significant change
How does NAEP plan to obtain data for both subjects and grades?
• Assessing an equal sample size for each state’s public schools
• About 100 schools for each grade (4 and 8) and subject (math and reading 2003)
• About 2,500 to 3,000 assessed students for each grade and subject
• Administering background questions to students, teachers, and principals in order to examine the relationship between performance on the assessment and a variety of important demographic, instructional, and school variables
• Alaska has 289 schools selected
• 64 students will be randomly selected from each school.
• The assessment will be administered between January 27th and February 28th.
NAEP 2003
MySchool
School Registration Procedure
This document illustrates how Dr. Rosalee Smith, of the fictitious Hamilton
Elementary/Middle school registers for her school’s MySchool web site. First, she goes to the MyNAEP
login screen using the URL www.mynaep.com.
My NAEP Login Screen
Dr. Smith knows from the letter she received from her NAEP state coordinator that her User
Name is her NAEP school ID and the password is “guest”. So, she enters 2410170 (the NAEP ID printed
in her letter) in the User Name field and the password, which is displayed as a series of asterisks for
security reasons.
Hamilton Elementary/Middle555 School RdHamilton TS 99222
After clicking on the Login button, she is asked to verify her school information:
School Confirmation ScreenTo ensure that the correct ID was entered, the screen displays the school name and address matching the NAEP ID number that Dr. Smith entered. If she selects “No”, she will be taken back to the MyNAEP log in screen so she can enter the correct school ID.
If she selects “Yes”, she is taken to a screen with the registration form.
Registration FormHere, Dr. Smith enters her name, title, phone number, a password that she has created, and her email address. The user is asked to enter the email address twice to be sure that it is entered correctly. If the same email information is not
entered in the confirmation field, when the user clicks the Continue button, he/she receives this notice. Clicking on the OK button returns the user to the form so that the correct the conformation can be entered.
Dr. Smith clicks on the Continue button (with her email address entered correctly), and she is asked to confirm all of her entries in the next screen.
Confirm Information ScreenIf she notices a mistake, she can return to the registration screen to correct it by selecting “Modify your information”.
If everything is OK, she selects the Submit button and is shown her new User Name and reminded of her password.
“Registration Complete” screen.The text on this screen directs her to write down her new User Name and her password for future reference and to click on the “MyNAEP Login page” hyperlink to go to the MyNAEP login screen.
Logging In With Personal Information
After selecting the login page hyperlink, Dr. Smith enters her User Name and Password to go to her school’s MySchool site.
MySchool Step 1 ScreenThe Log Off button is available in the upper right corner of the screen at all times.
For: Alyeska Central School
You are here
Agree to Participate
Send NAEP Your List of Students
NAEP Representative Conducts the Preassessment Call with the School Coordinator
NAEP Staff Conducts the Assessment
After the Assessment
Principal agrees to participate and assigns a school coordinator to work with the NAEP staff on assessment arrangements.
Schools generate a list of students in the selected grade according to the "NAEP Instructions for Preparing Student Lists." The student list is either mailed, faxed, or sent via E-File to NAEP.
Your NAEP representative selects a sample of students to be assessed. The list of students, along with other assessment information, is sent to the school coordinator at least 2 weeks before the assessment.
The preassessment package will be sent to the school coordinator at least 2 weeks before the assessment. The NAEP representative will contact the school coordinator soon after the package has been received to do the following:
Confirm the receipt of the preassessment packet;
Review the contents of the preassessment packet and finalize assessment arrangements; and
Answer any questions the school coordinator may have about the preassessment materials on the assessment day.
The NAEP staff will bring assessment materials to your school, conduct the assessment, complete the paperwork, and pick up all questionnaires not completed online.
After the assessment, the NAEP representative will conduct a short interview with the school coordinator to get any comments about NAEP in his/her school.
At the end of the school year, you should destroy the materials in your NAEP Storage Envelope and mail the postcard to NAEP confirming that you have destroyed the sampled students' names.**** INSERT NOSCRIPT SECTION HERE!! ****
Once you register for MySchool you will be able to access everything you will need to understand the NAEP process receive technical assistance.
A typical assessment dayBefore the Assessment
• AA arrives one hour before assessment.• AC retrieves NAEP storage envelope from
school coordinator• AC assigns any accommodation booklets if
necessary• AA receives materials needed for sessions• AA prepares bundles by affixing removable
student ID labels • AA and AC prepares room and sets out
materials for session• AA checks role and advise AC and school
coordinator of missing students• AC assists school coordinator with getting
missing students to sessions
AC =Assessment Coordinator
AA =Assessment Administrator
A typical assessment dayDuring the session
• AA follows the script to distribute materials
• AA monitors session, using classroom management strategies
• AA follows guidelines for assessing SD and LEP
• AA collects materials accounting for all of them
• AA dismisses students according to school’s preference
• AC monitors the sessions and assists AA with any problems
AA = Assessment Administrator
AC = Assessment Coordinator
A typical assessment day Activities after the assessment
• NAEP staff determine reasons for absences
• NAEP staff record Administration codes on schedule
• NAEP staff completes summary information on schedule
• NAEP staff prepares materials to be left at school
• AC collects questionnaires from school coordinator
• AC schedules makeup session if necessary
• AC conducts debriefing interview
AA =Assessment Administrator
AC =Assessment Coordinator
Background QuestionnairesStudent, Teacher, Principal
Teachers• Years of teaching• Type of certificate• Undergraduate and
Graduate work• Professional
Development• Classroom Organization
Students• Ethnic background• Newspaper at home• Magazines at home• Books at home• Computer at home• Pages read a day• Watching TV• Days absent• Parent’s education level
Questions Tool
Type of Question
Relate a Fraction to 1
Identify Instruments of Measurement
Write an Expression Using N
Use Data from a Pictograph
Choose Number Sentence
Count Cubes in Solid
“Solve Word Problem Involving Division & Remainder”
Relate Perimeter to Side Length
Determine a Probability
Compare Two Geometric Shapes
Compare Geometric Shapes
“USING AN INQUIRY OF MATHEMATICS IN THE FOURTH GRADE”
7.
Ms. Hernandez formed teams of 8 students each from the 34 students in her class. She formed as many teams as possible, and the students left over were substitutes. How many students were substitutes?
Answer:____________________
Question
Performance Data
Content Classification
Scoring Guide/Key
Student Responses
More Data
Description:Solve Word Problem Involving Division & Remainder
Question 7 of 117
Subject: MathGrade: 4
Block: 1996-4M9
No.: 07
1996 National Performance Results
Note: •These results are for public and nonpublic school students. •Percentage may not add to 100 due to rounding.
Score Percentage of Students
Correct
Incorrect
Omitted Item
Off Task
39%
53%
8%
0%
Subject: Math
Grade: 4
No.: 07
Mathematical Content Area
Number sense, properties, and operations
This question measures number sense, properties, and operations. This content area focuses on students' understanding of numbers (whole numbers, fractions, decimals, integers, real numbers, and complex numbers), operations, estimation, and applications to real-world situations. Students are expected to demonstrate an understanding of numerical relationships as expressed in ratios, proportions, and percents. Students are also expected to understand properties of numbers and operations, generalize from numerical patterns, and verify results. Number sense includes questions that address a student's understanding of relative size, equivalent forms of numbers, and use of numbers to represent attributes of real-world objects and quantities.
This question also focuses on the subtopic of using computation and estimation in applications.
Mathematical Ability
Problem solving
This question measures students' problem solving ability. Students demonstrate problem solving in mathematics when they recognize and formulate problems; determine the consistency of data; use strategies, data, models; generate, extend, and modify procedures; use reasoning in new settings; and judge the reasonableness and correctness of solutions. Problem solving situations require students to connect all of their mathematical knowledge of concepts, procedures, reasoning, and communication skills to solve problems.
NAEP Data Tool
• SUBJECT Math• GRADE 4th• STATE/JURISDICTION Alaska• CATEGORY
– MAJOR REPORTING GROUPS– STUDENT FACTORS– FACTORS BEYOND SCHOOL– INSTRUCTIONAL CONTENT AND PRACTICE– TEACHER FACTORS– SCHOOL FACTORS– COMMUNITY FACTORS– GOVERNMENT FACTORS
Student Factors
All can do well in math if they try
Below, at, or above age of most students in grade
Days of school missed
Difficulty of this math test
Effort on this math test
Gender
Good at math
Hispanic background
Importance of success on this math test
Language other than English spoken in home
Length of time lived in United States
Like math
Math is mostly memorization
Math is useful for everyday problems
Number of grades attended in this state
Only one correct way to solve math problems
Questions correct on this math test
Race/ethnicity used for NAEP reporting
Alaska/Mathematics Composite/Accommodations Not Permitted/Grade 4/1996How much do you agree with the statement? Everyone can do well in mathematics if they try. (student-reported) [M811110]Average Scale Score and Row Percentage (with Standard Errors in Parentheses)
OVERALL
Agree Undecided Disagree
N
Avg. Score ( S.E. )
RowPct. ( S.E. )
Avg. Score ( S.E. )
RowPct. ( S.E. )
Avg. Score ( S.E. )
RowPct. ( S.E. )
Total 2181 226 ( 1.2) 87% ( 1.0) 225 ( 3.9) 9% ( 0.8) 209 ( 7.9) 4% ( 0.5)
NAEP Data Tools
Alaska 1996
NAEP Reading Framework
Reading Framework
To Gain Information To Perform a Task For Literacy
To enlarge on experienceOf Human Events
AdventureScience Fiction
Folktales
Applying information orDirection to complete task
Classified AdsDirections to complete
Tax Forms
Focus on specific information
Primary and Secondary articlesSections of textbook chapters
Essays and speeches
Math Framework
Number Sense,Properties, and
Operations
Measurement
Geometry andSpatial Sense
Data Analysis,Statistics, and
Probability
AlgebraAnd
Functions
State Department WebsiteNATIONAL ASSSESSMENT OF EDUCATIONAL PROGRESS (NAEP)
• Data Collection Forms •Instructions for Preparing a List of 4th Grade Students •Instructions for Preparing a List of 8th Grade Students •School Data Collection Form
• Resources •NAEP Homepage •NCES Homepage •Question Tools for Teachers •School Responsibilities for NAEP •NAEP State Assessment Information
• Especially for Parents •Parent Notification Letter •Parent Notification Letter (Spanish) •Parent Information for School Newsletter
• Especially for Principals •Letter to Principals
• Personnel/Questions
Websites that will help explain NAEP
NAEP Homepage
• http://nces.ed.gov/nationsreportcard/Kids Quiz page w/NAEP questions
• http://nces.ed.gov.nceskids/kidsquiz/index.asp?flash=trueNCES Homepage
• http://nces.ed.gov/nationsreportcard/sitemap.asp Questions tool for Teachers
• http://nces.ed.gov/nationsreportcard/itmlrs/NAEP State assessment information
• http://nces.ed.gov/nationsreportcard/about/state.asp
School responsibilities for NAEP
• http://nces.ed.gov/nationsreportcard/about/stateactivities.asp
National Assessment of Educational Progress (NAEP)
Form NumberForm Name Date Due
05-03-020
Instructions for Preparing a List of 8th Grade Students
05-03-021
Instructions for Preparing a List of 4th Grade Students
Nov. 15
05-03-022
School Data Collection Form
Nov. 15
Nov. 15
State Department Assessment Website “Forms and Grants”