1. User research for thedevelopment of search systemsMax Kemman MScMartijn Kleppe MAESHCCwww.axes-project.eu

2. www.axes-project.eu 3. www.axes-project.eu 4. How do we search for images? By using words! (your own & someone elses) New possibilities:Speech- & Image recognitionAXES:Access to Audiovisual Archives www.axes-project.eu 5. Developing tools providingnew engaging ways to interactwith audiovisual librariesNot just search:Browse Explore Experiencewww.axes-project.eu 6. ... for a multitude of end users... Broadcast professionals Academics Home users www.axes-project.eu 7. www.axes-project.eu 8. www.axes-project.eu 9. PoliMedia research questionWhat choices do different media make in the coverageof people and topics while reporting on debates in theDutch parliament since the first televised evening news in 1956 until 1995? www.axes-project.eu 10. Issues with current approach Media analysis+= Too much workLimitedmaterial+= anddifferentsystems www.axes-project.eu 11. PoliMedia approach PoliMediaNewspapers Portal KBStaten- Browse: GeneraalTelevisiondebate and Digitaal Sound and VisiondateKB- Search:debate and RadiopersonKB www.axes-project.eu 12. Presentation UB - 11-12-2012 www.axes-project.eu 13. Our research agenda Possibilities of eHumanities for research andeducation How and what do people search in our digitalheritage collections? Requirements Testing Presentation UB - 11-12-2012www.axes-project.eu 14. User research Understanding the user Acceptance Performance Capabilities Weaknesses Goal Creating systems that are intuitive and helpful tothe users www.axes-project.eu 15. Who are the users? We can distinguish groups, usingclassifications of Roles (e.g., by occupation) Demographic characteristics (e.g., age, gender) In AXES, we distinguish by role Broadcast Professional Academics (teachers, researchers, students) Home userswww.axes-project.eu 16. Getting to know the users Prior research StatCounter, other literature Asking potential users Interviews Focus groups Surveys Experimentswww.axes-project.eu 17. The more, the merrier? PhD student, History, 24 Presentation UB - 11-12-2012www.axes-project.eu 18. The more, the merrier?If there is an easier way, I willdo it another way. So I wontgo on the Internet to search.Theres so much, there is somuch information. So you canbetter call someone whoknows than search it foryourself. Presentation UB - 11-12-2012www.axes-project.eu 19. Academic user research Interviews Survey Netherlands and Belgium Online N=294 15-20 minutes Lots of data (250 variables in SPSS) Presentation UB - 11-12-2012www.axes-project.eu 20. Who did the survey? Position Largest group: PhD student But good distribution over other positions Age Largest group: 25-34 But good distribution over other age groups Discipline Largest group: History Other disciplines: Social Studies, Mass Communications, Linguistics, Literature, PhilosophyPresentation UB - 11-12-2012www.axes-project.eu 21. Research questions1. To what extent are online databases used?2. Which subdisciplines use digital sources more and which less?3. Which search techniques are applied?Presentation UB - 11-12-2012 www.axes-project.eu 22. Which of the following digital data doyou use professionally?Very oftenOftenText (books, news, etc.) Scholarly publications Regularly Statistical dataSometimesNumericalDigitizedobjects ImagesNeverAudio Videodata Presentation UB - 11-12-2012www.axes-project.eu 23. Differences between disciplinesTraditional digital dataModern digital dataImages: Literature, History Video: Mass CommunicationsDigitized objects: Literature, History, Audio: LinguisticsPhilosophyNumerical data: Social Studies, LinguisticsStatistical data: Social Studies, MassCommunications, LinguisticsOverall: Literature, History, PhilosophyOverall: Mass Communications,Linguistics, Social Studies Presentation UB - 11-12-2012www.axes-project.eu 24. DontSometimesVery oftenOftenRegularlyNever know it Google Google Images Google Scholar YouTube JSTORUitzending GemistKBFlickrEBSCOPresentation UB - 11-12-2012Nationaal ArchiefWeb of KnowledgeYahoo!BingAcademia.nlor databases do you use?EuropeanaScopus Microsoft Academic Search Which of the following search engines EUscreenwww.axes-project.eu Arkyves 25. What about sEURch? 31 respondents from EUR Presentation UB - 11-12-2012www.axes-project.eu 26. When do you trust a search engine ordatabase? 250Number of participants 200 150 10050 0 Experienced Expertise High quality Understand Heard about Broad range Read aboutit behind itselectionits inneritof resultsit online workingsPresentation UB - 11-12-2012www.axes-project.eu 27. Research questions1. To what extent are online databases used? Mostly text-based data usage, followed by images Google dominant in every way Trust is based mostly on experience2. Which subdisciplines use digital sources more and which less? Traditional digital data (Images, Digitized objects): Literature, History and Philosophy Modern digital data (Video, Audio, Statistical and Numerical data) Social studies, Mass Communications, Linguistics3. Which search techniques are applied? Presentation UB - 11-12-2012 www.axes-project.eu 28. Search techniques 1. Keywords 4,75 2. Advanced search 3,36 3. Related terms 2,52 4. Boolean 2,42 5. Browsing subjectcategories 2,29 6. Filters 2,19 7. Thesaurus 1,87 8. Visualization 1,22Presentation UB - 11-12-2012www.axes-project.eu 29. (Audiovisual) search behaviour Academics are surfers with a non-specificgoal in mind Academics are positively confident in theirability to use search tools Respondents below 45 years are more confidentthan those above 45 years Presentation UB - 11-12-2012www.axes-project.eu 30. Research questions1. To what extent are online databases used?2. Which subdisciplines use digital sources more and which less?3. Which search techniques are applied? Most important are ease and speed Search behaviour: younger academics (below 45years) are more confident in their use of(audiovisual) search tools Presentation UB - 11-12-2012www.axes-project.eu 31. Survey conclusion We see that Text is the dominant medium Google is the dominant search system Google dominates search techniques Trust in a search engine or database is basedprimarily on experiencePresentation UB - 11-12-2012 www.axes-project.eu 32. State of affairs?Presentation UB - 11-12-2012 www.axes-project.eu 33. Consequences How do we use this information in our searchsystem development? How to make new search systems desirable?Presentation UB - 11-12-2012 www.axes-project.eu 34. Desirable? PhD student, History, 34 Presentation UB - 11-12-2012www.axes-project.eu 35. Influence of usabilityI think its veryimportant to have a goodand workable interfacefor these objects. Thatswhy I used a papercatalogue, because theinterface and the way tosearch these objects isnot idealPresentation UB - 11-12-2012 www.axes-project.eu 36. Consequences Making new search systems desirable byincorporating user-centred design Basing system design on findings from userstudiesPresentation UB - 11-12-2012 www.axes-project.eu 37. AXES search wireframe Clear and immediate keyword-search Separate advanced-search Support for BooleansPresentation UB - 11-12-2012www.axes-project.eu 38. PoliMedia search wireframe Clear andimmediatekeyword-search Separateadvanced-search Support forBooleans and(some) Google-search operators Presentation UB - 11-12-2012www.axes-project.eu 39. AXES browsing wireframe Keyword-searchremainsprominent Engaging user by: Suggesting query terms Suggesting related videos Presentation UB - 11-12-2012 www.axes-project.eu 40. PoliMedia browsing wireframe Keywords-searchremainsprominent Easy access torelated materialPresentation UB - 11-12-2012www.axes-project.eu 41. Consequences Making new search systems desirable byincorporating user-centred design Basing system design on findings from userstudies Relevancy for UB?Presentation UB - 11-12-2012 www.axes-project.eu 42. Thank you for you attention!Martijn Kleppe kleppe@eshcc.eur.nlL2-47Max Kemman kemman@eshcc.eur.nl L2-47 www.axes-project.euwww.polimedia.nlPresentation UB - 11-12-2012 www.axes-project.eu