project sails: facing the challenges of information literacy assessment
DESCRIPTION
Project SAILS: Facing the Challenges of Information Literacy Assessment. Julie Gedeon Carolyn Radcliff Rick Wiggins Kent State University EDUCAUSE 2004 Conference Denver Colorado. What is information literacy?. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/1.jpg)
Project SAILS: Facing the Challenges of Information
Literacy Assessment
Julie GedeonCarolyn Radcliff
Rick WigginsKent State University
EDUCAUSE 2004 ConferenceDenver Colorado
![Page 2: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/2.jpg)
2
What is information literacy?
• Ability to locate, access, use, and evaluate information efficiently and effectively.
• Guiding document: “Information Competency Standards for Higher Education” – Association of College & Research Libraries
(http://www.ala.org/ala/acrl/acrlstandards/informationliteracycompetency.htm)
![Page 3: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/3.jpg)
3
Our questions
Does information literacy make a difference to student success?
Does the library contribute to information literacy?
How do we know if a student is information literate?
![Page 4: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/4.jpg)
4
The Idea of SAILS
Perceived need – No tool available Project goal – Make a tool:
Program evaluation Valid Reliable Enables cross-institutional comparison Easy to administer for wide delivery Acceptable to university administrators
![Page 5: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/5.jpg)
5
Project parameters
TestSystems design approachMeasurement model – Item
Response TheoryTests cohorts of students (not
individuals)A name
Standardized Assessment of Information Literacy Skills
![Page 6: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/6.jpg)
6
The project structure
Kent State teamOhio Board of Regents collaborative
grant with Bowling Green State University (part for SAILS)
IMLS National Leadership GrantAssociation of Research Libraries
partnershipwww.projectsails.org
![Page 7: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/7.jpg)
7
Technical components
Environment Item builderSurvey builderSurvey generatorReport generationChallenges
![Page 8: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/8.jpg)
8
Environment
Linux (Red Hat)ApacheMySQLPHP
![Page 9: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/9.jpg)
9
Survey process
Create survey questions (items)Create survey for this phaseAdd schools for this phaseSchools create web front-endCollect data
![Page 10: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/10.jpg)
10Item Builder
![Page 11: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/11.jpg)
11
Item maintenance
![Page 12: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/12.jpg)
12
Survey Builder
![Page 13: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/13.jpg)
13
Survey items
![Page 14: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/14.jpg)
14
Random selection of items
![Page 15: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/15.jpg)
15
School information
![Page 16: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/16.jpg)
16SAILS front-end
![Page 17: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/17.jpg)
17
Redirection to SAILS web site
Parameters passed: Unique student identifier School code Authorization code
![Page 18: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/18.jpg)
18
Link test
![Page 19: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/19.jpg)
19
Demographic data
![Page 20: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/20.jpg)
20Survey questions
![Page 21: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/21.jpg)
21
Report process
Send schools unique identifiersUpload demographicsScan & upload paper surveysGenerate entire dataset fileOffline IRT analysisUpload IRT resultsGenerate reports
![Page 22: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/22.jpg)
22
Sample report text
![Page 23: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/23.jpg)
23
Sample report graph
![Page 24: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/24.jpg)
24
Technical challenges
Creation of the front-endCustomizations for schoolsAutomating the data analysisSupporting different languages
![Page 25: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/25.jpg)
25
Data analysis
Item Response Theory Measures ability levels Looks at patterns of responses
For test-takersFor items (questions)
Based on standards and skill setsShow areas of strength and areas of
weakness
![Page 26: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/26.jpg)
26
Status
Instrument 126 items developed, tested, and in use Web-based and paper-based administration
Grant Project - IMLS Phase I complete - 6 institutions Phase II complete - 34 institutions Phase III began June 2004 - 77 institutions
![Page 27: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/27.jpg)
27
Next steps for SAILS
Analyze data and other inputAdministrative challenges
Self reported demographic data Testing environment Report generation
Does the instrument measure what we want it to?
Are institutions getting what they need?
![Page 28: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/28.jpg)
28
Summary
Vision: Standardized, cross-institutional
instrument that measures what we think it does
To answer the questions: Do students gain information literacy
skills? Does information literacy make a
difference to student success?
![Page 29: Project SAILS: Facing the Challenges of Information Literacy Assessment](https://reader036.vdocument.in/reader036/viewer/2022062517/56813f1d550346895da9b918/html5/thumbnails/29.jpg)
29
For more [email protected]
Julie Gedeon, [email protected] Radcliff, [email protected] Wiggins, [email protected]
Mary Thompson, project [email protected]; 330-672-1658