ASSESSMENT FOR LEARNINGIntroducing the OARS/INSPECT and SCANOARS tools for developing common Formative Assessments

December 8, 2008

TODAYS TASKSOutline a context for Formative AssessmentTouch briefly on a the history of OARSLearn how to Login to OARS SystemLearn how to Build A Quiz using INSPECTLearn how to download and Install SCANOARS softwareDemonstrate how to Scan an INSPECT QuizProvide an introduction to OARS ReportsProvide contacts to call for help*

CONTEXT FOR FORMATIVE ASSESSMENT*

CYCLE OF TEACHINGPlanning of InstructionAssessment Instructional StrategiesReflectionAnalysisPlanning of Instruction*

ASSESSMENT AND LEARNINGTeaching, learning and assessment are all interrelatedUsing assessment can help promote a learning communityDeeper understanding of standards and what they look likeDiscussions about assessments (developing, results, etc) can help define/refine teachingShared understanding of the outcome and discussions about the best approaches for obtaining proficiency*

*Cycle of Teaching

A BRIEF HISTORY OF OARS*

OARS ONLINE ASSESSMENT REPORTING SYSTEMHistory Originally set up to be used for Reading First schools (SCOE) Created by previous classroom teacher Has grown in use and capability Speaks to need for more frequent monitoring and increased capability of assessment usePurpose of adding OARSAccess to INSPECT item bankAccess to reporting features Some tests for purchase can be scanned in the OARS. SCOE, Theme Skills, INSPECT, etc.*

MANY ASSESSMENTS TO LOOK ATInterim assessmentsSCOETheme SkillsINSPECTEtc.

*

LOGIN TO OARS*

LOGIN TO OARSQUICK START GUIDENavigate to http://www.oarsaccess.net/Select Fresno USD in the Select your District windowLog in. Initial log ins areUsername: firstname.lastname, using the Sharepoint format1st Password: birth month and last 2 digits of birth year September 1963 would be 0963Usernames and passwords also handed out todayThis is NOT AiS!!!! The username and password for OARS is different than in AiSProblems with passwords? Call your schools OARS Liaison or Bon Vang in REA at 457-3895Three Download Resources may be helpful for you: OARS in a Nutshell, OARS Users Manual, and ScanOARS Download (when you are ready for scanning)*

LOGIN TO OARS STEP BY STEPGo to www.oarsaccess.net, Choose Fresno USD and Click GO to login*

LOGIN TO OARS STEP BY STEPALLOWING POPUPS*CLICK OK or Close as needed to clear the error messages

LOGIN TO OARS STEP BY STEPALLOWING POPUPS*CLICK Tools Pop-up Blocker Always Allow Pop-ups from This Site

LOGIN TO OARS STEP BY STEPType in UsernameEnter PasswordCLICK Log In*

LOGIN TO OARS STEP BY STEPEXTRA STEP FIRST LOGIN ONLY*Read the Terms and Conditions, then CLICK I am an Authorized User and I Accept All Terms and Conditions Above

LOGIN TO OARS STEP BY STEP FIRST TIME LOGIN AND PASSWORD CHANGES*Complete the Password, Confirm Password, Security Question, and ResponseCLICK Update My Account

LOGIN TO OARS STEP BY STEP FIRST TIME LOGIN AND PASSWORD CHANGES*CLICK here

LOGIN TO OARS*

BUILD A QUIZ USING INSPECT*

BUILD A QUIZ USING INSPECT QUICK START GUIDETo Build a Quiz .Select the INSPECT tab at the top of the main menuSelect the Create a new test buttonNEW: An Automatic Build Feature was reactivated Nov, 2008!Complete the Test Information boxesSelect the Course, Strand and Standard Information Select items for the quiz by choosing the ADD button for each item you select. You can see the directions and the distractor rationales for an item by clicking the boxes below each item.Note: for ELA items, there is an option to look at other items that use the same reading passage. If you are trying to create a one passage quiz, you might select this to identify other items associated with the passage.An Inspect quiz should be short 5-6 items only*

Review the draft of your quizSave the quiz after you click on save, you can still edit/delete, until you .. Print and Lock (when you do this, a print copy will appear in a new window). You can also choose to share the quiz, or keep it just for your classPrint the quiz, and you have several print options available for how youd like the quiz to look Bubbles or letters for the answer choicesAnswers highlighted or notAnswer key accompanyingPrint a copy with distracter rationales

BUILD A QUIZ USING INSPECT QUICK START GUIDE - CONTINUED*

To Print Answer Sheets .Teachers with multiple grade levels, or teaching multiple classes (secondary) will need to select a section of their classes for which to print answer sheets. Click on the Sections tab on the blue strip at the top of the screen, then Click on the program menu, and select Inspect Item BankClick on your nameIf you are selecting a subset of all your students to take the test, select them here, otherwise the whole student list will be uploaded From the Inspect tab, select Print answer sheets and follow the directions there.Have students take the quiz!!

*BUILD A QUIZ USING INSPECT QUICK START GUIDE - CONTINUED

BUILD A QUIZ USING INSPECT STEP-BY-STEP*

STEP 2: Click on Create New Test hereBUILD A QUIZ USING INSPECT STEP-BY-STEP*

BUILD A QUIZ USING INSPECT STEP-BY-STEP*

BUILD A QUIZ USING INSPECT STEP-BY-STEP*

BUILD A QUIZ USING INSPECT STEP-BY-STEPAdd Checked Items*

STEP 2: Click on Create New Test here*

BUILD A QUIZ USING INSPECT STEP-BY-STEP*

BUILD A QUIZ USING INSPECT STEP-BY-STEP*

BUILD A QUIZ USING INSPECT STEP-BY-STEPSTEP 11d (Optional): Or you can simply choose to Remove All ItemsSTEP 11c (Optional): You can also choose the checkboxes for each item and scroll to the bottom of the screen to Remove Checked Items*

BUILD A QUIZ USING INSPECT STEP-BY-STEP*

BUILD A QUIZ USING INSPECTADDITIONAL INFORMATION

Do not quarantine an itemIt might lock others out from using itOr, for some users, the only one locked out is that userSome items are quarantined at the system level for inclusion on a District-wide test (CAHSEE Diagnostic tests)Some questions have an extra version created (e.g., with just a small change to an answer choice). The View Alternate Item button allows you to see all versions of an item, and pick the one you want to use.You can now delete a quiz using Inspect test management Technically the quiz is still there, but if you use the delete option, you will never have to see it again! This can help keep your page of active quizzes well-organized.

*

STEP 13: Print and Lock your quiz hereSTEP 14: Click OKBUILD A QUIZ USING INSPECT STEP-BY-STEP*

BUILD A QUIZ USING INSPECT STEP-BY-STEP*

BUILD A QUIZ USING INSPECT STEP-BY-STEPSTEP 15: Click on File then Print to produce the document*

BUILD A QUIZ USING INSPECT STEP-BY-STEP*

STEP 19: (SECONDARY ONLY) Select your class(es) hereSTEP 18: Select Inspect Item Bank*STEP 17: Click on Sections to produce the Answer SheetsBUILD A QUIZ USING INSPECT STEP-BY-STEP

*BUILD A QUIZ USING INSPECT STEP-BY-STEP

*BUILD A QUIZ USING INSPECT STEP-BY-STEP

DOWNLOAD AND INSTALL SCANOARS SOFTWARE*

DOWNLOAD & INSTALL SCANOARSThis may not be necessary at your school site. To find out whether or not you need to download and install the ScanOARS software, please contact the OARS-INSPECT liaison for your school.

The following represent the two most common situations in terms of setup for scanning using ScanOARSUsing a dedicated computerYour school has set up a computer that stays connected to the scanner all the timeChances are you dont need to download the softwareUsing a docking stationYour school has set up a docking station or USB connection to the scannerEach teacher can connect their own laptop if the station is availableChances are you WILL need to download the software to your laptopNote: You need a PC this is not recommended for MACs*

DOWNLOAD AND INSTALL SCANOARS*

ENTERING STUDENT DATA INTO THE ONLINE ASSESSMENT REPORTING SYSTEM*

ENTERING DATAAssessment information can be entered different waysScanning Using ScanOARSSome implementing nowRequires a certain level of technical expertiseRequires a PC connected to an approved scannerThe District has purchased a scanner for every elementary school and two for each secondary schoolMay be the most efficient way for sites to get data into the OARSCan get data back within minutes with a variety of reports

Hand Entry Using INSPECTScores only; does not allow for response analysis OREntering Individual Responses (allows for response analysis)

Administering the Assessment OnlineRequires all students to take the test at a computerReduces use of paper/printer resources*

Once you have given the assessment using the test booklet and answer sheet, you are now ready to scan your answer documents. *ENTERING DATA - SCANOARSSTEP 1: Start ScanOARS and select Fresno USDSTEP 2: CLICK OK

*ENTERING DATA - SCANOARSSTEP 3: Make sure Default proxy is selected then CLICK OKSTEP 4: Your username and password are the same ones that you used to login to OARS. Once you have typed these in, CLICK OK

*ENTERING DATA - SCANOARSSTEP 5: Put your answer documents on your scanner and click SCANBrother DCP8060: Face Up Top Side FirstSTEP 6: Once your documents are scanned, the Send Data to Server button will turn black. CLICK on Send Data to Server to send your data to OARS. STEP 7: Exit ScanOARS

APPROVING THE SCANNED DATA*

APPROVING THE SCANNED DATA QUICK START GUIDE* If you chose to scan and upload your data, the next time you log in to OARS, you will see a screen asking you to review and approve the new data.

Once reviewed and approved, you will have access to your assessment data using the OARS reports.

APPROVING THE SCANNED DATA*STEP 1: Click on Tools.

APPROVING THE SCANNED DATA*STEP 2: To see results for one student CLICK on Show Responses. To see results for all students CLICK on Expand All.STEP 4: When you have completed your review, CLICK on Approve Data.STEP 3: (Optional) CLICK on a response to change it. Make your changes and CLICK Save or CLICK Cancel if you made a mistake.

APPROVING THE SCANNED DATA*

*ENTERING DATA INSPECT HAND ENTRY

*ENTERING DATA INSPECT HAND ENTRY

ENTERING DATA INSPECT HAND ENTRY*STEP 2: Make sure INSPECT Item Bank is selectedSTEP 4: Select the assessment you want to enter scores forSTEP 5: Select the method of entering the dataSTEP 6: Click GOSTEP 3: Select appropriate options

ENTERING DATA INSPECT HAND ENTRY*STEP 8: Scroll to the bottom of the page and Click Once on the Click ONCE to Save ButtonSTEP 7: Complete the data entry process

ENTERING DATA INSPECT HAND ENTRY*STEP 8: Scroll to the bottom of the page and Click Once on the Click ONCE to Save ButtonSTEP 7: Complete the data entry process

ENTERING DATA INSPECT ONLINE ASSESSMENT (PREVIEW)*

ENTERING DATA INSPECT ONLINE ASSESSMENT (PREVIEW)*

BRIEF INTRODUCTION TO OARS REPORTS*

INTRO TO OARS REPORTSFor TeachersBenchmark Report for Interim Assessments (SCOE, Theme Skills)How many students were at Intensive, Strategic, Benchmark and ChallengeItem AnalysisFor scanned assessments onlyDrill Down Starts at Grade Level/Theme, drills down to teacher, to student, to standard, can create intervention groups by standardINSPECT Questions (can build a test or use questions during lessons to check for understanding)Ability to create and monitor Intervention Groups

*

INTRO TO OARS REPORTSFor AdministratorsSTAR Data (Scale Score, Clusters, Disaggregated, etc.)Benchmark Report for Interim Assessments (SCOE, Theme Skills)By grade levelAbility to compare classroomsAbility to track progress of cohorts of studentsAbility to disaggregate in many waysBy ThemeBy skill (Reading Comp., Vocabulary, Spelling, Grammar)Summary resultsClassroom ResultsDemographic subgroups

*

WHO TO CALL FOR MORE HELP*

PersonCan Help WithPhoneSchool OARS LiaisonTEACHERS: Your liaison should be your first call for help. Liaisons will call REA or Tech Service Staff as needed for additional support.Help Desk or MCSCall the Help Desk or your assigned Microcomputer Specialists (MCS) Hardware problems with your scanner Connecting to the Internet 457-2600Bon Vang, REA Resetting Passwords Creating User Accounts457-3958

PREVIEW OF UPCOMING GUIDES*Check back on http://rea.fresnounified.org/Assessment.cfm Upcoming presentations may include USING OARS-INSPECT ONLINE ASSESSMENTUSING OARS REPORTING FEATURES CREATING YOUR OWN MULTIPLE-CHOICE ITEMS USING THE INSPECT ITEM EDITOR

****************************************************************ACS-MS Test Coordinator Training 2006-07**