utips core roll-out fall, 2011
DESCRIPTION
UTIPS Core Roll-Out Fall, 2011. Julie Quinn, Data and Delivery Coordinator Assessment and Accountability Utah State Office of Education. Overview. Web-based, using HTML 5 Browsers Safari, Firefox 4, Google Chrome Internet Explorer (IE) 9 with Chrome plug-in (not preferred) - PowerPoint PPT PresentationTRANSCRIPT
UTIPS Core Roll-Out
Fall, 2011
Julie Quinn, Data and Delivery Coordinator
Assessment and AccountabilityUtah State Office of Education
Fall, 2011 Utah State Office of Education
2
3
Overview• Web-based, using HTML 5 Browsers
– Safari, Firefox 4, Google Chrome– Internet Explorer (IE) 9 with Chrome plug-in
(not preferred)– IE 10 will be supported 2012
• Servers housed at UEN
Fall, 2011 Utah State Office of Education
Development Philosophy• Maintain UTIPS assessment functionality
– If the feature exists in MyUEN, use MyUEN• Design intended to reduce training hours
– Focus on creating quality assessments and using data to improve student learning
• Flexibility for standards and item pool• Improved reports and data access
(coming soon)
Fall, 2011 Utah State Office of Education
4
Common Core
• Common Core State Standards (CCSS)– Math is now in UTIPS Core– ELA (coming soon)
• Math CCSS item alignment now available• New math items written for CCSS (coming
soon)• Educators may align their own items to
CCSS and/or other Utah State StandardsFall, 2011
Utah State Office of Education 5
Support
• Training issues/requests as well as item quality or alignment issues– [email protected] – Emails may be forwarded to LEA trainers
• USOE directly supports LEA trainers
Fall, 2011 Utah State Office of Education
6
UTIPS Core Access
• Each school district has a unique URL – http://districtname.utips.org– Examples:
http://iron.utips.org; http://charter.utips.org
• All users must have an account– Educators AND students– Enrollment Codes place users into
organizations
Fall, 2011 Utah State Office of Education
7
User Structure• Educators
– Unique username and password are selected– CACTUS validation option– After account creation, folders and tests from
the old UTIPS system may be imported • Students
– Username is Student’s LEA ID• Chaters use LEA ID + Students’s ID (e.g., 4G123)
– Password is selected
Fall, 2011 Utah State Office of Education
8
Creating Accounts
• A user is invited to join an organization by being provided with a Enrollment Code– Examples: schools, classes, groups of teachers– Multiple Enrollment Codes may be used per account
• Enrollment codes – assign roles and organizations– are created from within an educator’s account– are time limited
Fall, 2011 Utah State Office of Education
9
Sharing Assessments
• Educators may share assessments by adding others as participants– The test owner selects users to be added as
participants for individual tests– A sub-organization may be created (e.g., CTE
IT, Piute Math Teachers), educators are invited with a passcode
Fall, 2011 Utah State Office of Education
10
Fall, 2011 Utah State Office of Education
11
Predict CRT Scores?
Blueprint tests and item pool questionsare NOT designed
to predict a student’s performance on a CRT.
UTIPS is a screening tool.
12
Flexibility
Educators can build assessments using1. The USOE item pool,
• Blueprint tests (CCSS later)• Individual items by content standards
2. Their own items,or…
A combination of both.
Fall, 2011 Utah State Office of Education
UTIPS Flexibility
• Media can be attached to questions– Images– URLs– Documents (coming soon)– Spreadsheets (coming soon)– Presentations (coming soon)– Audio files (coming soon)
Fall, 2011 Utah State Office of Education
13
14
A Formative Tool• Formative assessment meta analysis:
Black & Wiliam (1998)1
• Information to be used by teachers and students as feedback, to modify teaching and learning activities
Fall, 2011 Utah State Office of Education
Elements Of anAssessment Event
1. Is the assessment high-quality?2. Do teachers have access to the data?3. Do teachers use the data?4. Do students have access to the data?5. Do students use the data?
Fall, 2011 Utah State Office of Education
15
16Fall, 2011 Utah State Office of Education
Fall, 2011 Utah State Office of Education
17
A “Good School”
“…a good school is not a collection of good teachers working independently, but a
team of skilled educators working together to implement a coherent instructional plan,
to identify the learning needs of every student, and to meet those needs” (Boudett, City, & Murnane, 2006).
Ask Questions“Data analysis supports a culture of
improvement by building the habit of inquiry in which you constantly ask questions and find answers not in your preconceived judgments of children, but in observable data. Therefore, it is critical to invest the time and effort needed to identify a meaningful problem that becomes the focus of the improvement process” (Boudett, City, & Murnane, 2006).
Fall, 2011 Utah State Office of Education
18
UTIPS Core Reports
Reports are only as good as the items that are used on the test:
• Do the items reflect the instruction that was presented?
• Are there enough questions asked for each objective to have confidence in the report?
• Are the items accurately aligned to the curriculum?
Fall, 2011 Utah State Office of Education
19
20
Student Feedback
Fall, 2011 Utah State Office of Education
21
UTIPS Reports
• Student Summary
• Score Distribution– % of students reaching performance targets
• Item Performance– # of students getting each question right
• Individual student mastery– By standard and/or objective
Fall, 2011 Utah State Office of Education
Report: Student Summary
Fall, 2011 Utah State Office of Education
22
23
Report: Score Distribution
Fall, 2011 Utah State Office of Education
24
Report: Item Performance
Fall, 2011 Utah State Office of Education
25
Report: Standards Mastery
Fall, 2011 Utah State Office of Education
26
Report: Objectives Mastery
Fall, 2011 Utah State Office of Education
Report: Common Core
Fall, 2011 Utah State Office of Education
27