Online HSAP Reporting System for HSA, HSA-Alt, and EOC Exams

September 19, 20132:30 PM - 3:30 PM HST

For audio, please call 1-800-741-8620

1

Accessing Today’s Webinar Training

2

3

Accessing Today’s Webinar Training

Today’s AgendaPresentation• General Overview• New Features for 2013-2014• Things to Remember

Note: We are recording this webinar training and it will be posted online at www.alohahsap.org.

4

Q & A• You can submit written questions anytime through the “Q & A”

function on your toolbar at the bottom of your screen. We will collect these questions and answer them verbally during the Q & A section.

• You can also ask your questions via phone during the Q & A section after the presentation. The operator will announce when you can ask questions verbally.

Score Reports

Score Reports

Subject Detail Page

5

Roster Page

Student Detail Page

Reporting Categories Detail Page

(only for HSA & EOC)

Trend Page

Benchmarks Page (only for EOC)

Test Management Center

Test Management Center

6

Summary Statistics Retrieve Student Results

Plan and Manage Testing

Status of Students Tested

• Navigation is done with the Exploration Menu.• The Exploration Menu is present wherever you see

a magnifying glass.• Three dimensions of data:

– Who: Which entities do you want to access (e.g., schools, teachers, rosters, students)?

– What: What level of the content area is being investigated (e.g., content area, reporting categories)?

– When: Are you looking at the current test window or a historical trend?

• You can move up and down any one of these dimensions with the Exploration Menu.

7

Navigating the Online Reports

8

Exploration Menu

WhoWhatWhenClick to

move to a higher level of

a dimensi

on

Click to drill

down to details

of a dimensi

on

9

Levels of the Three Dimensions

State

Complex Area

Complex

School

Teacher

Roster

Student

Content Area

Reporting Categories

HCPS III Benchmarks

or CCSS

Testing Window Trend

User Roles and Report AccessUsers

• State Users• Complex Area Superintendents• Complex Staff• Principals• Test Coordinators• Teachers

Drill Down Access• Teachers see their rosters and their students.• Principals and test coordinators see the teachers, rosters, and students in the

school.• Complex staff see the complex, schools in that complex , and the teachers,

rosters, and students in each school.• Complex area superintendents see the complex area, complexes in that

complex area, schools in each complex, and the teachers, rosters, and students in each school.

10

• Online Reporting System shares its password with other secure sites that require login (TIDE, TA Site, TA Certification Course, etc.).

• Data presented are in real time for online tests; reports are updated as students test.

• Score reports are available after testing:– Student-level data (except for Expository Writing I EOC Exam

that requires hand scoring of essays before students’ scores are posted)

– Aggregate data (state, complex area, complex, school, teacher, roster)

• Online Reporting System allows users to view their current students' scores for previous school years.

11

Key Features

• Go to the portal at www.alohahsap.org.

• Click Teachers or Test Coordinators/ Administrators button.

• Click Online Reporting System icon to be directed to the System Login page.

• Enter your username and password.

• Click Log In.12

Logging in to Online Reporting System

Home Page

13

Percentage of Students Proficient Across Grades and Content Areas

13

“Show Scores” category

Select test and administration

Logging in as School User: Exploring

14

Click on the percentage proficient for a particular grade and content area to view more data.

Content Area Detail PageThe title of each table describes the page in detail.

15

Note: “Percent Completed” column does not appear for HSA-Alt.

Content Area-Level Data

All tables can be disaggregated by subgroups and accommodations such as: - Gender - Ethnicity - Language - Text-to-speech

The table shows data for the user’s access level (in this case, AIR Training School).

16

Content Area-Level Data

Higher levels of aggregations for comparison

Subgroups:schools in a complex;teachers in a school; orrosters of a teacher

The graphs show the distribution of students across performance levels.

17

Exploring the Data

18

Click the magnifying glass.

Click View ROSTER button to go to the Roster page.

Roster Page

19

Click the magnifying glass.

Click View STUDENT button to go to the Student Listing page.

Student Listing Page

20

Click the magnifying glass.

Click View STUDENT button to view the selected student’s individual report.

Student Detail Page

Graphical representation of the student’s performance along with performance level descriptors in family friendly language

Performance for each reporting category

Comparison of the student's previous opportunities for a content area assessment

21

Accommodations that the student was provided

Reporting Categories

Click View Reporting Categories to go to the Reporting Categories Detail page.

22

Click the magnifying glass.

Note: Reporting Category reports are NOT available for the HSA-Alt assessments because there are too few items administered within a reporting category to serve as a reliable indicator of student ability.

Reporting Category-Level Data

Data are presented for each reporting category.

The graphs show the distribution of students across performance levels.

23

Note: Reporting Category reports are NOT available for the HSA-Alt assessments because there are too few items administered within a reporting category to serve as a reliable indicator of student ability.

Benchmarks

Click the magnifying glass.

Click View Benchmarks button to go to the Benchmarks Report page.

24

Note: Benchmark reports are only available for the Algebra I, Algebra II, Biology I, and U.S. History EOC Exams. The word "Benchmark" is used in the title of this report for the HCPS III based and CCSS based EOC exams in the Online Reporting System.

Benchmark-Level Data

Relative performance across benchmarks is denoted by +, –, or =.

25

Note: Benchmark reports are only available for the Algebra I, Algebra II, Biology I, and U.S. History EOC Exams.

Trend

Click View Trend to go to the Trend page and view the selected student’s performance over time.

26

Click the magnifying glass.

Note: Trend reports will be available for the HSA-Alt Reading and Mathematics Assessments in Spring 2014. These reports will not be provided for the HSA-Alt Science Assessment because scale scores are not vertically linked across grades.

Trend Page

27

Note: Trend reports will be available for the HSA-Alt Reading and Mathematics Assessments in Spring 2014. These reports will not be provided for the HSA-Alt Science Assessment because scale scores are not vertically linked across grades.

Dashboard shows percentage tested and percent proficient.

Authorized users can create a calendar of school determined testing windows for different opportunities to organize test administrations.

Choose What to include

Click Generate Report

28

Test Management Center: Summary Statistics

• This is an optional feature for school users to create, record, and manage planned testing windows for different opportunities in their school. These testing windows are independent of the official Hawai`i Department of Education testing windows.

29

My Testing Windows

Click Add to add a testing window.

This pop-up window will appear.

Data file has score report and activity/progress report data across content areas. File is available for 30 days. User is alerted by e-mail when the file is ready.

Choose What and Who to include in data file

Click Download Roster

Choose a file format

Download completed data file

30

Test Management Center: Retrieve Student Results

Choose What and Who to include in report, then filter with specific information about student’s activity and progress.

Display onscreen or export to Excel

31

Test Management Center: Plan and Manage Testing

• School, complex, and complex area users can create a file showing the number of students who have started and completed each assessment or exam by school, grade, content area, and opportunity.

32

Test Management Center: Status of Students Tested

• Search by SSIDs, separated by commas (,).• Search by student’s first name or last name

(not both at once).• Search by wildcard (letters or numbers).• Search is conducted by school year, so you can

search students you used to have.

33

Search Students

Student Search Results

Click + to expand the information for a student.

All available reports will display. Click on a report to view the individual student report.

Report will return all of your students that match your search criteria.

34

• Create custom roster for any of your students.• Name the roster and assign it to teacher.• Edit or delete the roster at any time.• The roster will appear in the Online Reporting

System.

35

Manage Rosters

Manage Rosters

36

Name and assign the roster

Select the desired grade(s)

Select from available students and move students in/out of roster

Save or Delete

37

New Features for 2013–2014• Test condition events filter• Batch printing functionality for individual

student reports:– PDF format– Option to print all scores, highest score, or most

recent score for tests that include multiple attempts (i.e., HSA)

• Similar to the breakdown by demographic subgroup filter, users will now be able to disaggregate the score report data by a specific test accommodation (e.g., text-to-speech).

38

Test Condition Events Filter

• Users will now be able to batch print individual student reports in PDF and not in HTML.

39

Batch Printing Functionality

• As a result of this change, users will need to go to their inbox to download and batch print the PDF files.

• For HSA, users will now have the option to print all scores, the highest score, or most recent score.

40

Batch Printing Functionality

• Online Reporting System is designed to help educators answer questions regarding the assessment data to improve teaching and learning.

• The magnifying glass icon indicates what data can be further explored.

• All tables can be printed and exported.• Help (User Guide) button is available for every page. • Manage Rosters tool enables users to report on

specific groups of students.

41

Things to Remember

• Visit www.alohahsap.org.• Call or e-mail the American Institutes for

Research HSAP Help Desk.– Hours: Monday- Friday except holidays,

7:30 a.m. to 4:00 p.m. HST– Phone: 1-866-648-3712– E-mail: HSAPHelpDesk@air.org

42

Need Help or More Information?

Thank you!And now on to Q & A……….

43

For more information, visit:• the HSAP portal at www.alohahsap.org

For assistance, please call or e-mail the HSAP Help Desk:• Hours: Monday- Friday except holidays,

7:30 a.m. to 4:00 p.m. HST• Phone: 1-866-648-3712• E-mail: HSAPHelpDesk@air.org