Slide 1

Slide 2 Preparing for the Administration of the Spring 2015 Dynamic Learning Maps (DLM) in English Language Arts and Mathematics February 23, 2015 Version PART TWO NJ DLM Winter Training 2015 1 Slide 3 Professional Development Modules DLM developed over forty self-directed professional development modules to help support the transition to the new alternate assessment and Common Core State Standards instruction. Some of the modules include: DLM Claims and Conceptual Areas Composing, Decomposing, and Comparing Numbers Writing: Text Types and Purposes The learning modules provide significant information on the background, purpose, and design of the assessment as well as guidance on providing instruction on the CCSS, the DLM conceptual areas, EEs, and nodes. Viewing the PD modules is optional, though educators will find the information informative. 2 NJ DLM Winter Training 2015 Slide 4 Assessment Coordinator Responsibilities Includes but not limited to : Schedules training for teachers and is the direct liaison for teacher questions Ensures the correct students are assessed Assists in scheduling students for testing Interacts with District Data Steward and Technical Liaison to ensure all tasks are completed Utilizes DLM website, reviews materials, and disseminates information to staff Reviews DLM Manual and any other required documents Contacts DLM help desk when DLM documents do not provide clear answers to district questions District point of contact for test activities 3 NJ DLM Winter Training 2015 Slide 5 Sample of Assessment Coordinator Checklist in Manual 4 NJ DLM Winter Training 2015 Slide 6 Note: This page is from the DLM NJ website and is for the Assessment Coordinator 5 NJ DLM Winter Training 2015 Slide 7 Data Steward Responsibilities Includes but not limited to: Interacts with Assessment Coordinator, Technical Liaison, and Teachers as necessary to ensure successful completion of testing Creates and uploads data files including: the Users file (opens DLM user accounts for testing) Enrollment file Class roster files Assigns roles to users which generates user login IDs Understand and utilize IT/technical expressions contained in the System Start-Up Manual in order to prepare files correctly according to specifications Utilize consistent and appropriate naming conventions and provide clean data for data files in order to successfully upload files as outlined by the DLM User Guide for State and District Staff (Data Steward) Utilizes DLM website, reviews materials, and disseminates information to staff Reviews DLM Manual and other applicable documents (e.g. Data Tips, etc.) Contacts DLM help desk when DLM documents do not provide clear answers to user account issues, data file upload errors, etc. 6 NJ DLM Winter Training 2015 Slide 8 Sample of Data Steward Checklist in Manual 7 NJ DLM Winter Training 2015 Slide 9 Note: This page is from the DLM NJ website and is for the Data Steward 8 NJ DLM Winter Training 2015 Slide 10 Recent DLM Email Update Recent KITE and Educator Portal updates. Looking for the student Username and Password to access KITE? Youll find it in the Test Management area of Educator Portal. See the procedure titled View Student Username and Password in the T EST A DMINISTRATION M ANUAL. Up to 6,000 records may be uploaded at a single time using the Enrollment or Roster templates. Accessibility Profile Data Extract includes new fields for Last Modified Time (with date and time) and Last Modified User. 9 NJ DLM Winter Training 2015 Slide 11 Technical Liaison Responsibilities Includes but not limited to: Is responsible for the infrastructure (network, hardware and devices), software applications and technical support as well as understanding how the hardware, software, policies, and procedures fit together in the big picture of the districts technology implementation. Ensures district technology readiness and implementation (IT staff) Reviews DLM Technical Liaison Manual revised 1/13/2015 and completes all tasks Interacts with Assessment Coordinator, District Data Steward, and Teachers as necessary to ensure successful completion of testing Utilizes DLM website, reviews materials, and disseminates information to staff Contacts DLM help desk when DLM documents do not provide clear answers to technology issues 10 NJ DLM Winter Training 2015 Slide 12 Sample of Technical Liaison Checklist in Manual 11 NJ DLM Winter Training 2015 Slide 13 Note: This page is from the DLM NJ website and is for the Technical Liaison This is from the KITE page 12 NJ DLM Winter Training 2015 Slide 14 Webinars for School and District Staff Who Monitor Assessment Webinars for School and District Staff Who Monitor Assessment 13 NJ DLM Winter Training 2015 Slide 15 Webinars for School and District Staff Who Monitor Assessment Webinars for School and District Staff Who Monitor Assessment Recorded versions of the webinars will be available on the DLM website 2 days after the live session. Staff who could not participate in a live webinar could use the recording to learn about the responsibilities and procedures to monitor assessments. 14 NJ DLM Winter Training 2015 Slide 16 Classroom Teacher/Test Administrator Responsibilities Includes but not limited to: Provide instruction throughout the year related to the CCSS, EEs, nodes, etc. Assist in the completion of the First Contact and PNP surveys. Activate educator portal user ID in KITE Schedule students for testing and gather needed supports such as manipulatives Reviews DLM Manual, reviews the accessibility features of the DLM system, completes required training modules, and reviews DLM website for any other required documents/necessary information Contacts District/School Test Coordinator with any questions or issues 15 NJ DLM Winter Training 2015 Slide 17 Test Administrator Partial Checklist from Manual for Teachers 16 NJ DLM Winter Training 2015 Slide 18 Note: This page is from the DLM NJ website and is for the teacher who administers the DLM 17 NJ DLM Winter Training 2015 Slide 19 TEST ACCESSIBILITY AND OTHER FEATURES 18 NJ DLM Winter Training 2015 Slide 20 Online Student Surveys There are two student surveys that are completed by the students teacher, and who may be assisted by other educators who knows the student well. The First Contact survey asks questions about the students level of skills in ELA and Math. This survey assists in the selection of the level of test items (node linkage levels). The Personal Needs Profile asks questions about the students support and accessibility needs during testing. This survey assists in the selection of the computer accessibility features and other support needs during testing. 19 NJ DLM Winter Training 2015 Slide 21 Online Student Surveys Personal Needs Profile (PNP) PNP online survey must be completed for each individual student being tested for DLM. Once PNP is completed, a summary will be generated. This profile collects information on the students support needs and current level of instruction, and engages computer accessibility features. First Contact Online survey completed by ELA and Math classroom teachers. A copy of the students IEP is needed as a reference when answering the questions. This survey helps identify the students academic levels in order to establish a baseline as the system selects test items. 20 NJ DLM Winter Training 2015 Slide 22 Accessibility Manual This manual was updated on February 16, 2015. If the FC and PNP surveys were completed during field testing, please review them one more time, then hit submit in order to finalize the survey info. 21 NJ DLM Winter Training 2015 Slide 23 Accessibility Features DLM offers a variety of accessibility tools and supports during assessment. Some of these are delivered through the KITE system, which are determined by responses to the First Contact and Personal Needs Profile (PNP) survey. Other supports, such as having the teacher read the test aloud, is provided by the school. 22 NJ DLM Winter Training 2015 Slide 24 Accessibility Features Accessibility Features Six Steps to Customize DLM Accessibility Features for Students Step 1: Include Eligible Students in the DLM Assessment Step 2: Learn About the DLM Accessibility Features: What Does DLM Provide? Step 3: Discuss and Select Appropriate Supports and Tools: Considerations for IEP Teams Step 4: Enter Appropriate Supports into the DLM System Step 5: Prepare for the Assessment: Using the Chosen Accessibility Features Step 6: Evaluate the Accessibility Features Used After the Assessment These six steps are explained in detail in the Accessibility Manual for DLM 2014- 2015. Steps 1 through 3 are intended for full IEP teams to determine the accessibility features for eligible students, and steps 4 through 6 are for the educator or test administrator to enter, use, and evaluate the effectiveness of the selected features. 23 NJ DLM Winter Training 2015 Slide 25 Category 1: Supports provided within DLM via the PNP profile Online supports include magnification, invert color choice, color contrast, and overlay color. Descriptions about how to select supports provided by the PNP are found in Step 4 of the six-step DLM accessibility customization process. Computer synthesized read aloud is no longer available. Teachers will need to provide this support if needed by the student. 24 NJ DLM Winter Training 2015 Slide 26 Category 2: Supports requiring additional tools or materials These supports include Braille, switch system preferences, iPad administration, and use of special equipment and materials. These supports typically require prior planning and setup. These supports are all recorded in the PNP even though two-switch system is the only option actually activated by PNP. 25 NJ DLM Winter Training 2015 Slide 27 Category 3: Supports provided outside the DLM system These supports require actions by the test administrator, such as reading the test, signing or translating, and assisting the student with entering responses. These supports are recorded in the PNP even though they are delivered by the test administrator. 26 NJ DLM Winter Training 2015 Slide 28 Supports: Braille Test Please contact the Office of Assessments if you have a DLM student that needs a Braille test. Final information is not yet available. Elizabeth.Celentano@doe.state.nj.us 27 NJ DLM Winter Training 2015 Slide 29 What Must Be Written in a Students IEP Regarding Accessibility? Specific instructional supports are usually included, such as use of communication board, picture symbols, text read aloud to the student, etc. For DLM the training materials will describe which accessibility features, supports, etc. are available. Select only the DLM accessibility features that are familiar to the student based on instruction. It is not necessary for all test accessibility features and supports be listed in the IEP for DLM. However, it is important to select the features and supports for testing that students need during instruction. An accessibility feature may be used by the student even if it is not explicitly listed in the IEP. 28 NJ DLM Winter Training 2015 Slide 30 General Test Information Practice item testlets are available on the DLM system and should be administered to the students prior to testing. Practice testlets relate to various accessibility features the student may use. Select the practice testlets (demos) based on the PNP features. The purpose of using the practice items are to confirm that the accessibility features engaged are appropriate for the student. If they are not you may revise the PNP before administering the test. give the student experience with the online test experience prior to answering live test questions. This allows the student and teacher to be aware of the computer features, and helps to determine whether the student or teacher would drive (use the computer mouse) during testing. 29 NJ DLM Winter Training 2015 Slide 31 General Test Information Prompting is not allowed in the DLM system. Teachers may repeat a test question and then pause an appropriate amount of time for a student to process the question and select an answer. If a student does not answer a question the teacher will mark no response if listed as one of the student response options. If a student cannot answer the question, and no response is not an option provided by the system, then do not mark a response and continue to the next test item. 30 NJ DLM Winter Training 2015 Slide 32 Clarification Allowed if Needed Some test item directions ask the teacher to say Show me the . If necessary, after stating the phrase Show me the , you may restate the phrase for clarification by saying either of the following: Look at the Point to the Touch the For example, the teacher may say Show me the red marker. Then for clarification say Point to the red marker. 31 NJ DLM Winter Training 2015 Slide 33 Educator Resource Page Review the DLM web page http://www.dynamiclearningmaps.org/cont ent/erp_ye to obtain information on sample testlets, tested Essential Elements, familiar texts, and other important information. http://www.dynamiclearningmaps.org/cont ent/erp_ye The following slide shows an excerpt from the DLM math glossary, a summary of the math terms utilized during testing. 32 NJ DLM Winter Training 2015 Slide 34 Section of the Glossary 33 NJ DLM Winter Training 2015 Slide 35 Manipulatives The list of math manipulatives needed for each grade level is available on the Educator Portal. Teachers can login to the portal and access the list of manipulatives needed for any grade. Once the student ticket is available, click on the Test Management tab in the Educator Portal. This tab is where the TIPS pages are located, as well as the student test tickets. The manipulative list associated with the assigned student testlet will be described in the TIPS page. 34 NJ DLM Winter Training 2015 Slide 36 Testlet Information Page 35 NJ DLM Winter Training 2015 Slide 37 Manipulatives Once a teacher reviews the TIPS page and the recommended manipulative list, he/she may make appropriate substitutions if necessary when the original manipulative is not available in the school/district or if substituting a manipulative is best for the student. Consider the attributes of the required manipulative when selecting a substitute. The substitute manipulative must fulfill the required attributes,. Example: if the original manipulatives were two large red buttons and one small blue button, you may substitute with two large red markers (exact same markers) and one small blue marker. Do not use red markers that are not the same size, and do not use a blue marker that is the same size as the red markers. 36 NJ DLM Winter Training 2015 Slide 38 SECURITY INFORMATION 37 NJ DLM Winter Training 2015 Slide 39 SECURITY PLAN Mandatory Turnkey Training Technology Problems Reporting Breaches & Irregularities Chain of Command Disruptive or Sick Student 38 NJ DLM Winter Training 2015 Slide 40 Security Protocols for Computer Based Testing All computers must have the required software to support computer-based testing. KITE is the site used to access testlets. Educator Portal is used to input and review data, obtain student test tickets, etc. All computers have access to broadband and secure internet connectivity. Consider whether or not proctor caching is necessary in each school. 39 NJ DLM Winter Training 2015 Slide 41 TESTING SITES Testing requires a computer or tablet device with the KITE application Testing may be done in the classroom as long as: The student can hear and respond to directions and test questions without loud background noise or noise at a level that would disturb the testing student. Other students and staff cannot view the test questions. Testing may be done in a computer center, quiet office, or other alternate location that offers a secure and quiet environment. NO Cell Phones, MP3 Players or Any Unauthorized Electronics 40 NJ DLM Winter Training 2015 Slide 42 TEST SECURITY Security is a district wide responsibility. Absolutely NO reproduction or transmittal by any means of test items, passages, prompts, or other secure items or materials. Security breaches may have: Financial consequences for the district Professional consequences for staff Disciplinary consequences for students Inform ALL district & school personnel of security procedures prior to test administration Review the module on test security posted in late March on the DLM NJ webpage. 41 NJ DLM Winter Training 2015 Slide 43 Test Security Information on reporting irregularities and security breaches during testing along with the forms will be posted to the DLM NJ page by the end of March. The test security agreement for all educators involved in DLM will be posted on the DLM NJ page in March. Teachers administering the DLM will electronically sign a test security form found on the KITE Educator Portal. All other educators involved in DLM will sign the New Jersey paper version of the test security agreement and submit it to the District Test Coordinator prior to April 6, 2015. This form will be posted to the DLM NJ page in late March. DLM test results will be included in the state accountability reports produced by the Title I office. 42 NJ DLM Winter Training 2015 Slide 44 MORE INFORMATION 43 NJ DLM Winter Training 2015 Slide 45 Topics Not Included As information becomes available on scoring and reporting of DLM results, it will be posted on the DLM website. Standard setting will occur the week of June 15. Educators who are interested in participating in DLM standard setting should contact Elizabeth.Celentano@doe.state.nj.us DLM test results will be included in the state accountability reports produced by the Title I office. 44 NJ DLM Winter Training 2015 Slide 46 Forms for DLM Forms for documenting teacher administration observations will be available online by end of March. These forms are optional, but will help you collect administration information useful for DLM, Office of Assessments, and your school. Please check the DLM NJ page in late March to review the forms for possible use. 45 NJ DLM Winter Training 2015 Slide 47 District Communication Districts must share information among staff, and ensure that all DLM teachers are prepared for instruction and testing. The Assessment Coordinator must turn key train all administrators involved in testing, and provide copies or web links to the required training materials. Only the District Assessment Coordinator, Data Steward, and Technical Liaison may contact the DLM help desk or DOE with questions. Please ask others to communicate their questions to you clearly with specific error references and/or training material page references so that you might obtain the information. 46 NJ DLM Winter Training 2015 Slide 48 Where To Get More Information? DLM has various customer support contact information depending on the issue. It is imperative that: Only those individuals serving as Assessment Coordinator, Technical Liaison, and Data Steward contact DLM. Contact DLM support only after reviewing all pertinent manuals, handbooks, and modules. Use the specific contact info listed in the applicable manual to ensure your question is directed to the correct individuals. Provide in your email your CDS code (known to DLM as your Organization), your name and which of the three positions above you hold, as well as detail the specific issue/error you encountered. Questions directed to DLM Support, and when necessary NJ DOE, must be from either the Assessment Coordinator, Technical Liaison, or the Data Steward. Questions from other district staff including teachers must be directed to one of the following individuals noted above. 47 NJ DLM Winter Training 2015 Slide 49 Where To Get More Information? Questions regarding DLM please contact the Customer Service Help Desk via PHONE: 1-855-277-9751 (toll free) or Email DLM-support@ku.edu DLM-support@ku.edu Prior to requesting assistance, DLM information must be reviewed. Specific questions related to the training manuals, KITE, educator portal, and other DLM topics should be addressed to the DLM helpline with specific details about the issue. Use manual page references when applicable, and cite the exact system error or issue you are experiencing. DLM and Office of Assessment staff cannot summarize or provide topic information in place of educator review of the training materials. Review all DLM materials prior to contacting the help desk. 48 NJ DLM Winter Training 2015 Slide 50 Where To Get More Information? Assessment Coordinators with general questions about test design, training, accessibility features, scheduling, test administration, etc., contact: Elizabeth Celentano Office of Assessments 609-984-0107 elizabeth.celentano@doe.state.nj.us Data Stewards with questions about APA and DLM student data file uploads, Pre-ID, SDIF, record changes, score interpretation, and other data file issues etc., contact: Jo-Lin Liang Office of Assessments 609-633-6884 dlmnjtechsupport@doe.state.nj.us Please contact DLM support for assistance prior to the Office of Assessments in order to facilitate a timely response. 49 NJ DLM Winter Training 2015 Slide 51 Where To Get More Information? Technical Liaisons with questions about technology readiness issues contact : Linda Carmona-Bell Office of Assessments 609-292-1414 linda.carmona-bell@doe.state.nj.us Joseph Seaman Office of Assessments 609-292-8407 Joseph.seaman@doe.state.nj.us Please contact DLM support for assistance prior to the Office of Assessments in order to facilitate a timely response. 50 NJ DLM Winter Training 2015 Slide 52 Test Coordinators PARCC 3-5 Orlando Vadel609-341-3456 PARCC 6-8 Timothy Steele Dadzie609-777-2087 PARCC HS & HSPA Veronica Orsi609-292-8739 DLM Technology Joseph Seaman 609-292-8407 DLM Technology Linda Carmona-Bell609-292-1414 NJBCT & NJASK Science Michael Luke, Interim 609-292-3226 APA & DLM Elizabeth Celentano609-984-0107 AHSA Faye Ball609-984-1970 NAEP Tabitha McKinley609-984-1540 NJDOE Contact Information www.state.nj.us/education firstname.lastname@doe.state.nj.us 51 NJ DLM Winter Training 2015 Slide 53 Office of Assessment - Fax 609-984-6032 NJDOE Measurement Specialists HSPA & BiologyRob Akins 609-984-1435 DLM/APAJo-Lin Liang 609-633-6884 PARCCDon White 609-777-2051 NJ DLM Winter Training 2015 Slide 54 Where To Get More Information? Office of Special Education (general special education questions; please do not send DLM questions to this office) New Jersey Department of Education 609-292-0147 http://www.nj.gov/education/specialed/ Department of Education website: www.state.nj.us/education 53 NJ DLM Winter Training 2015 Slide 55 Final Notes I hope you have found this information helpful. Please check back to the DLM NJ webpage periodically in March for additional modules. Thank you for your time. NJ DLM Winter Training 2015 54