linked jazz 52nd street: a lod crowdsourcing tool to reveal connections among jazz artists
TRANSCRIPT
LINKED JAZZ 52ND STREET: A LOD Crowdsourcing Tool To Reveal Connections Among Jazz Artists Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen Pratt Institute, New York, NY Digital Humanities 2013 � Lincoln, Nebraska � July 17, 2013
THE LINKED JAZZ PROJECT • Linked Open Data technology applied to digital
archives of jazz history • Goal: To reveal the network of relationships among
the jazz artists as described in primary sources.
2 Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
3 Cristina Pattuelli | Pratt Institute
WHY CROWDSOURCING? Automated techniques used to generate a social network. However, only humans can reliably identify the nature of the personal and professional relationships between people.
4 Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
Automation + human curation
LINKED JAZZ 52ND STREET
5
Landing page (http://linkedjazz.org/52ndStreet/)
LINKED JAZZ 52ND STREET
6
Task interface
DESIGNING A CROWDSOURCING TOOL • Best practices for crowdsourcing design are scarce • Methodology: survey of existing tools and literature • Major considerations: • Recruiting participants • Retaining participants
• Quality control of the data collected
7 Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
DESIGNING A CROWDSOURCING TOOL
• Recruiting participants • Retaining participants
8 Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
Understanding what motivates people to participate in crowdsourcing
LINKED JAZZ 52ND STREET
9 Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
Landing page (http://linkedjazz.org/52ndStreet/)
10
4-step introduction
11 Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
12
Available interview transcripts
Progress bar Ego network
USABILITY TESTING Usability tests conducted with Dr. Craig MacDonald at Pratt Institute • Took 30-45 minutes to complete. • Participants: 10 • 2 team members present, also recorded. • Evaluation criteria: • Participants’ experience using the website • Website’s design & functionality • Participants’ level of engagement
• Pre-test questionnaire, 3 tasks, post-test questionnaire
14 Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
RESULTS Overall participants had a positive experience with the website; likely to visit the website again.
Website was found to be visually appealing. Participants did not always fully understand their contributions to the larger project. Participants were not fully engaged with the tool while using it. 15
PLANNED IMPROVEMENTS
16 Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute
Add checkmarks to musician icons when all relationships have been assigned
17
à Provide visual and textual indicators to give users more feedback on task progress.
Track analysis progress on each snippet
17
18 à Arrange musicians alphabetically.
Individual and collaborative
contributions
à Connect users with the community more effectively.
19
FUTURE WORK
Iterative assessment process: 1. Interface Usability 2. Content and Functionality with domain experts 3. Performance and Data quality.
Cristina Pattuelli, Matt Miller, Leanora Lange, Hilary Thorsen | Pratt Institute 20
THANK YOU Our Team: Matt Miller Lea Lange Hilary Thorsen Sean Fitzell Carolyn Li-Madeo
Special thanks to: Dr. Craig MacDonald and the Pratt SILS UX Team
Contact: CRISTINA PATTUELLI