presented by: kerrie fergen wilkes reference and instruction librarian suny college at fredonia
DESCRIPTION
Freshmen Orientation Meets Information Management. Presented by: Kerrie Fergen Wilkes Reference and Instruction Librarian SUNY College At Fredonia SUNY General Education Conference. Information Literacy: A New York State initiative. - PowerPoint PPT PresentationTRANSCRIPT
November 13, 2003 1
Presented by: Kerrie Fergen WilkesReference and Instruction
Librarian SUNY College At Fredonia
SUNY General Education Conference
Freshmen OrientationMeets Information
Management
November 13, 2003 2
Information Literacy: A New York State initiative.Provost’s Advisory Council for General Education Programs.
10 different learning outcomes and 2 competencies
•Information Management is now a competency requirement. •Students will:
1. Perform basic operations of personal computer use
2. Understand and use basic research techniques
3. Locate, evaluate, and synthesize information from a variety of sources.
November 13, 2003 3
Heading the CommitteeFall 2001: I am naïve.The original committee had dissolved.The Information Management component was on our first-year cycle. Results were needed to report at the beginning of the Spring 2003 semester.Spring 2002:The committee now had new leadership.
Other members had been involved with assessment previously.I understood the importance of Information Literacy
November 13, 2003 4
Daniel A. Reed Library’s Philosophy of Library Instruction
Our philosophy is based on the Association of College and Research Libraries (ACRL) Information Literacy Competency Standards for Higher Education. Our philosophy is employed to ensure that the students at SUNY Fredonia gain the skills necessary to create a sophisticated search strategy, determine if they have chosen the appropriate databases, and learn to retrieve scholarly articles published in peer-reviewed or refereed journals.
November 13, 2003 5
ACRL’s Information Literacy Competency Standards For
Higher Education
Standard One: The Information Literate student determines the nature and extent of the information needed.
Standard Two: The information literate student accesses needed information effectively and efficiently.
Standard Three: The information literate student evaluates information and its sources critically and incorporates selected information into his or her knowledge base.
November 13, 2003 6
Outline for evaluating the content of Information Management for any given
applicable CCC course:
1. Identify Sources2. Evaluate Sources3. Search Sources4. Refine the Search5. Organize and store
information6. Format the Information7. Analyze the Information8. Disseminate the
Information
What is the most effective way to assess
all of these components for all
CCC courses?
November 13, 2003 7
Approaching the Assessment of Information Management
Assess outside of a particular discipline.Skills are “across the curriculum”
What do we want to know and who do we assess?What skills do students come to Fredonia withHow do Core courses affect their Information Management SkillsPre/Post testFreshmen at orientation v. Second Semester Sophomores
November 13, 2003 8
Creating the Assessment Tool
Searched for examples from other colleges. Most assessment tools came from Libraries.Consulted:
Cal Poly Pomona University Library “Information Competency Assessment test”Lesley University “Evaluating Web Sites”Weber State University. Stewart Library “Information Literacy Competencies and sample exam questions”ACRL “Information Literacy Competency Standards for Higher Education”
November 13, 2003 9
Composing the Assessment Tool
Individual work v. Multiple Choice
Who would score? What format?Op-Scan, SPSS
The breakdown of the 8 components were used as a skeleton.
Each question correlated with one of the eight components, which are a sub-set of the 3 information management components.
November 13, 2003 10
Composing Continued…
MADNESS
I
TELL
YOU!
November 13, 2003 11
The Assessment Instrument is Born
November 13, 2003 12
General Idea of the Assessment Tool
32 multiple-choice questions.
12 questions do not require the use of the computer.
The remaining questions focused on:Online Catalog
Wilson OmniFile (Online Database)
Evaluating two websites
November 13, 2003 13
Basic Computer Skills Question Example:
Using the tools available through Wilson OmniFile, please e-mail this citation to the following address: [email protected]
Please put your first name and last name in the subject area that is provided.
November 13, 2003 14
Basic Research Question Example
Please use the following citation to answer questions 11 & 12.
Weinoldt, Kirsten. “1968 For Ever”. Brazzil 10 (1998): 14.
11. What is the volume number in the above citation?A. 14B. 1998C. 10D. 1968
12. What is the journal title in the above citation? A. “1968 For Ever”
B. BrazzilC. WeinoldtD. Unable to be determined
November 13, 2003 15
Online Navigation and Interpretation Question Example
After viewing both pages relating to Mankato, Minnesota, which would you use when planning a trip to the city?
A. Mankato, Minnesota Home Page http://lme.mankato.msus.edu/mankato/mankato.html B. City of Mankato, Minnesota
http://www.ci.mankato.mn.us/
November 13, 2003 16
The Three ComponentsBasic Computer Skills
HTML v. PDFUsing Drop-Down menusE-mail an article from a database
Basic Research Skills Boolean PhrasingIdentify citation styles and contentNavigate an Online Catalog
Locating, Evaluating and Synthesizing InformationNavigate and interpret results from a databaseNavigate two web sites and evaluate their contentLocate an online article and evaluate its content
November 13, 2003 17
Early Challenges
Human Subjects:Online Certification
IRB Proposal
NO MINORS: A Waiver is needed
CITI Collaborative IRB Training Initiative
November 13, 2003 18
Let the Collaboration Begin
The Sample TestThe Head Of Circulation
9 Work Study Students
18 year old friend of the family
November 13, 2003 19
Intense Planning
Large pool at our disposal.
Test all incoming Freshmen
Transfer? Drop-outs? Not available for post-test?
Collaboration
November 13, 2003 20
Freshmen Orientation
Four Sessions
Each Session is two days
First Day8:00 a.m arrival
All students are in the same sessions all day
Second Day:8:00 a.m, again
Sessions are in rotation
Where Will Assessment Fit Into this full schedule?
November 13, 2003 21
Academic Advising
Contacted the Associate Dean, and Director of Academic AdvisingA lot of negotiatingWe are given times during the second day
4:30-5:30…6:00 dinner…testing is 40 minutes…rule of thumb.
This makes things more challenging…all of the students will be tested concurrently.
November 13, 2003 22
Really, It will be fun….
Help! Fredonia Needs You!What should college students know
About Information Management? By Soliciting your opinion through computerand online database searching, you’ll help
us develop a better College Core Curriculum. So get
That mouse finger ready and thanks for teaching us about you.
November 13, 2003 23
Academic Information Technology
Director of Academic Information Technology
Jumping ahead of the game.
Identify rooms that will work…can’t interfere with Registrar.
All over campus….proctors are needed for each room (the Library needs two)
Available computers: 25, 30, 25, 38, 18, 21
November 13, 2003 24
Director of Campus Life
Organizes the training of Orientation
Removal of 18 year olds…colored dots
Training session for Assessment.Assure students that this in no way impacts their status at Fredonia.Make sure to take students to the correct areas.No explanation of the test to the studentsStay with the group until the end.
November 13, 2003 25
Coordinator of Disability Services
Visually Impaired Student at the first session
Assessment test needs reformatting
Zoomtext Extra
Assists student with softwareTest scored by hand, then transferred to Op-Scan
November 13, 2003 26
BEGGING
Summer
9 month appointment
2 faculty members
Librarians (we are 12 month)
Graduate students
November 13, 2003 27
Training Instructors
Materials are coming in boxes
Be early to organize rooms
Read the directions to students
Students must stay for length
No helping or further explanation
Watch for Instant Messaging.
Room Assignments
November 13, 2003 28
Room\Date July 2
Fenton 2162
25 Instructions -1 Envelope
25 Major Code List-1 Envelope
25 Tests-1 Envelope
25 Scantron –1 Envelope25 Consent Forms -1 Envelope
Organization Galore
November 13, 2003 29
More Challenges
No air conditioningOrientation Groups are late…proctors leaveMake sure rooms are openReed Library closes at 4:00 Too many students sent to one locationComputer breakdowns.No cell phones/phones don’t workWilson Omnifile doesn’t cooperate.
November 13, 2003 30
Finale
E-mail downloaded and printed
Test scored in an SPSS fileInterpreted by Psychology Faculty
Wrote up pre-test results
November 13, 2003 31
Pre-test Data
On the average, student performed as follows (from Highest to Lowest):
Basic Research
Locating, Evaluating and Synthesizing Information
Basic Operations of a Computer
November 13, 2003 32
Next steps…
Only preliminary data…no recommendations at this time.
Post-test next semester
The committee has begun to discuss recruitment.
Looking for 20-25% post-test with incentives.
Looking forward to working with the same departments to create a successful post-test environment.
November 13, 2003 33
Questions?
Kerrie Fergen Wilkes, MLS
Senior Assistant Librarian
Reference and Bibliographic Instruction
SUNY College at Fredonia
716-673-3199
November 13, 2003 34
BibliographyACRL Information Literacy Competency Standards for Higher Education:
http://www.ala.org/acrl/ilstandardlo.htmlCal Poly Pomona University Library:
http://www.csupomona.edu/~library/InfoComp/instrument.htm Lesley University Evaluating Web Sites:
http://www.lesley.edu/library/guides/research/evaluating_web.html State University of New York Assessment Initiative Report of the Provost’s Advisory Task Force on the Assessment of Student Learning Outcomes:
http://www.cortland.edu/gear/supportdocs.htmlWeber State University, Stewart Library Information Literacy Competencies:
http://library.weber.edu/il/infolit/infolitcomp/default.cfm