metadata quality criteria
DESCRIPTION
Second part of the presentation in "WHY metadata for MY resources" workshop in TELSS 2010!TRANSCRIPT
Metadata quality criteria
WHY metadata for MY resources? Palavitsinis N., Ebner H., Manouselis N.
WHY metadata for MY resources? 2
WHY assess quality?
• Bad metadata “Invisible” resources
• Bad metadata Less “cool” things to do with metadata (explain)
• Bad metadata Mess…
10/6/2010
10/6/2010
Description: 566 words!!!
WHY metadata for MY resources? 4
Metadata Quality Review
• In Organic.Edunet, mainly based on Bruce & Hillman’s framework we’ve chosen some criteria to assess metadata quality
• Produced a grid to review metadata records– Using 5 point scales– Using Yes/No questions– Using free text field for comments
10/6/2010
WHY metadata for MY resources? 6
Selected Criteria (1/2)
• Completeness– Number of elements provided by the annotator,
compared to the total number of elements in AP• Appropriateness– Are the metadata values provided appropriate for
the targeted use?
10/6/2010
WHY metadata for MY resources? 7
Selected Criteria (2/2)
• Accuracy– Do the values correspond to what is annotated?– Do they reflect the actual resource?
• Consistency– Are the values provided consistent with the
standard or the AP used?
10/6/2010
8WHY metadata for MY resources?
Interactive session
metadata quality criteria & interface design
10/6/2010
WHY metadata for MY resources? 9
Setting up
• Divide <total number of participants> with 3
• Create X groups of three• Each group must have only one laptop open• Roles– One person to handle the laptop – One person to keep notes (will be collected)– One person to report back to the plenary
10/6/2010
WHY metadata for MY resources? 10
1st Step
• Which two metadata elements would NOT be useful for describing context specific resources?
• Report back by identifying:– The context – field of interest (as a group)– One element – WHY this is not useful
10/6/2010
Time in groups: 5’ Reporting back: 1’ per group
WHY metadata for MY resources? 11
Getting all laptops involved
• Please open your laptops
• Visit: http://whymetadata.jimdo.com– Under JTEL2010 / Workshop / Workshop resources
10/6/2010
WHY metadata for MY resources? 1210/6/2010
RG
Hi! I am Bruce & Hillman’s “Repository Genie” &
I am here to grant you 3 wishes!
I can make your Learning Object Repository score 100% in only
3 of the criteria presented!
The rest I will leave on the annotators hands…
Choose wisely!!!
WHY metadata for MY resources? 13
• Visit: http://whymetadata.jimdo.com– Under JTEL2010 / Workshop / Workshop resources
• Read the criteria and what they actually mean
• Use the questionnaire to “wish” for 3 of them– Reveal one wish in the end!
10/6/2010
2nd StepTime on your own: 5 minsReporting back: 5 seconds per person!
WHY metadata for MY resources? 14
3rd Step
• Imagine you have a big amount of resources. How would you like to manage them? – Traditional folder structure (Confolio)– Tag-based folders (Google Docs, Flickr)– Search-based folders (Thunderbird)
10/6/2010
Time in groups: 5’
Reporting back: plenary & individually (on paper)
WHY metadata for MY resources? 15
Questions to consider
• Is metadata quality linked to context?
• Do metadata quality criteria apply to all cases?
• Can the interface design ensure “high-quality” metadata?
10/6/2010
WHY metadata for MY resources? 16
Thank you
• For the patience• For your time• For really participating & contributing• One last thing to let us know how we did…– http://whymetadata.jimdo.com– Find Workshop/Questionnaire
10/6/2010
17WHY metadata for MY resources?
End of sessionPost Workshop Exercise
Develop a personalized metadata evaluation framework Evaluate at least 10 LOsProvide a 5 page description (per LO) of your findingsDeadline: Friday 6 pm (there is enough time if you don't go swimming)
10/6/2010