samigo assessment tool (aka tests and quizzes ) marc brierley, stanford university interaction...
TRANSCRIPT
![Page 1: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/1.jpg)
SAMigo Assessment ToolSAMigo Assessment Tool(aka Tests and Quizzes )(aka Tests and Quizzes )
Marc Brierley, Stanford University Interaction Designerhttp://bugs.sakaiproject.org/confluence/display/SAM
![Page 2: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/2.jpg)
Agenda
• Feature Overview– Focus on pedagogical flexibility using
assessment types
• Short Demo
• Futures
• Q&A
![Page 3: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/3.jpg)
What are T&Q’s features:
• Assessment Authoring• Assessment Publishing• Assessment-Taking Management• Assessment Grading• Question Pools Management• Assessment-Type (formerly Template)
Management
![Page 4: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/4.jpg)
Why “Assessments”?
• More than just test and quizzes
• For Example:– Problem Sets– Formative Assessments– Surveys
• The name “Tests and Quizzes” is a compromise
![Page 5: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/5.jpg)
Organize & Publish Assessments
• Core (pending) Assessments for a course– Starting page for assessment authoring– Can be ex/imported in QTI XML format– When ready, published via Settings
• Published Assessments for student assessment-taking– When students respond, scores link appears– Can change release, due, retract dates
![Page 6: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/6.jpg)
![Page 7: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/7.jpg)
Question Types• Multiple Choice (single and multiple correct)• Multiple Choice Survey• True/False• Matching• Essay/Short Answer• Fill in the Blank• File Upload• Audio Recording** New for Sakai 2.2 release
![Page 8: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/8.jpg)
![Page 9: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/9.jpg)
Rich-Text & Attachments
• In section headers, question texts, selections for responses, and feedback
![Page 10: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/10.jpg)
![Page 11: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/11.jpg)
Pedagogical Flexibility
• Online test
• Self-study questions
• Homework, problem-sets
• Paper, code, or project submission
• Language drills
• Quick knowledge probes
• Surveys
• Others???
![Page 12: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/12.jpg)
Assessment Types
• Create assessment “types” for different disciplines, different uses
• Hide complexity by selecting what which settings are visible to the instructor.
• Pre-set defaults by making setting choices for the type (e.g., Self-study always has immediate feedback)
![Page 13: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/13.jpg)
Assessment Creation Workflow
![Page 14: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/14.jpg)
![Page 15: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/15.jpg)
![Page 16: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/16.jpg)
![Page 17: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/17.jpg)
![Page 18: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/18.jpg)
![Page 19: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/19.jpg)
Online Test
• Unique tests for each student– Randomized order of questions– Randomized draw from question pools
• Timed test-taking during access window– Auto-submit at end of timed period
• One submission only per student• Higher Security
– IP Addresses restricted– Secondary Password (proctored)
• No late submissions accepted• Scores transferred to gradebook
![Page 20: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/20.jpg)
![Page 21: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/21.jpg)
Self-Study Questions
• Immediate feedback
• Random access to Questions – Table of contents– Marked for review list
• No record of score in gradebook
• No due date; always available to student
• Unlimited submissions allowed
![Page 22: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/22.jpg)
![Page 23: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/23.jpg)
Homework/Problem Sets
• Published with multiple release and due dates for different sections
• Multiple methods for handling late submissions• Students can save work during assignment
period.• Auto-grading with methods for diagnosing
learning problems • Quick-reviews of student aggregate performance
by instructors viewing histograms, statistics.• Pools for organizing questions for reuse
![Page 24: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/24.jpg)
Essay and Project Submission
• Use file upload question type for submitting any type of document
• Grader can download assignment; upload marked-up file to return to student
• Grades are recorded in gradebook
![Page 25: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/25.jpg)
Question Pools
• Organize questions into multiple subpools
• Author Questions from within Pool Mgr.
• Randomly draw from pools for an assessment
![Page 26: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/26.jpg)
![Page 27: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/27.jpg)
![Page 28: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/28.jpg)
Demo
![Page 29: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/29.jpg)
![Page 30: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/30.jpg)
![Page 31: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/31.jpg)
![Page 32: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/32.jpg)
![Page 33: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/33.jpg)
![Page 34: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/34.jpg)
![Page 35: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/35.jpg)
![Page 36: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/36.jpg)
![Page 37: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/37.jpg)
![Page 38: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/38.jpg)
![Page 39: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/39.jpg)
![Page 40: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/40.jpg)
![Page 41: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/41.jpg)
![Page 42: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/42.jpg)
![Page 43: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/43.jpg)
![Page 44: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/44.jpg)
![Page 45: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/45.jpg)
![Page 46: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/46.jpg)
![Page 47: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/47.jpg)
![Page 48: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/48.jpg)
![Page 49: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/49.jpg)
![Page 50: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/50.jpg)
![Page 51: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/51.jpg)
![Page 52: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/52.jpg)
![Page 53: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/53.jpg)
![Page 54: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/54.jpg)
![Page 55: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/55.jpg)
![Page 56: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/56.jpg)
![Page 57: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/57.jpg)
![Page 58: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/58.jpg)
2.3 Highlights
• Attachment of files and URLs to• Audio Question Type w/ signed certificate• Bulk download of student files• Filtered view in grading• Page navigator and search capability for the
Grading pages• New question type: Numeric Responses
– By Diego del Blanco Orobitg (Universidad Politécnica de Valencia)
![Page 59: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/59.jpg)
2.4 Roadmap and beyond
• 2.4– email student feedback from grading screens
SAK-7094– performance enhancements to student
assessment taking (delivery)– bug fixes
• Beyond?...stay for the BOF
![Page 60: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/60.jpg)
Questions?
![Page 61: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/61.jpg)
Contacts
Marc Brierley, Stanford University T&Q Lead Designer [email protected]
Lydia Li, Stanford University T&Q Project Manager [email protected]
Homepage:http://bugs.sakaiproject.org/confluence/display/SAM
![Page 62: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/62.jpg)
Where did the design originate?
• Formative Assessment (Homework)– Stanford Assignment Tool for Human Biology– CourseWork CMS with Language Tools
(Andrew W. Mellon Foundation funded)
– OKI Tools Workshop to Specify Functionality(Andrew W. Mellon Foundation funded)
– OKI Formative Assessment Tool(Andrew W. Mellon Foundation funded)
• Summative Assessment (High-Stakes tests)– OnCourse Quiz Tool
![Page 63: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/63.jpg)
Where did the design originate?
• OKI Tools Workshop– Many schools met to define needs for a CMS– One group specified the needs for an
Assessment Tool– Several hundred functional requirements
identified
![Page 64: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/64.jpg)
Where did the design originate?
• Assignment and Assessment Manager – Supports teaching and learning in
large lecture science courses and in language instruction
– This OKI Tool was developed at Stanford– Andrew W. Mellon Foundation funded
![Page 65: SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM](https://reader033.vdocument.in/reader033/viewer/2022061405/5697c00a1a28abf838cc7f1d/html5/thumbnails/65.jpg)
Where did the design originate?
• AAM design combined with OnCourse Quiz tool design “Navigo” (2003)
• Stanford and Indiana join Sakai project, Stanford rewrites tool to Sakai Style Guide TPP, tool renamed SAMigo (2004-present)