You  Can’t  Browse  The  Stacks    In  A  Digital  Library  

 Indexed  Discovery,  Fair  Linking  &    NISO’s  Open  Discovery  IniFaFve  

 

Todd Carpenter  Executive Director, NISO

November 6, 2014

➢ Non-­‐profit  industry  trade  associa2on  accredited    by  ANSI  

➢ Mission  of  developing  and  maintaining  technical  standards  related  to  informa2on,  documenta2on,  discovery  and  distribu2on  of  published  materials  and  media  

➢ Volunteer  driven  organiza2on:  400+  contributors  spread  out  across  the  world  

➢ Responsible  (directly  and  indirectly)  for  standards  like  ISSN,  DOI,  Dublin  Core  metadata,  DAISY  digital  talking  books,  OpenURL,  MARC  records,  and  ISBN  

About    

2�

3�

Short  History  of  Library  Discovery  

Photo: Minneapolis College���of Art and Design Library

4�

Photo: OSU Thompson Library Stacks” by Kristin Six 5�

6�

Short  History  of  Library  Discovery  

The  Context  for  Open  Discovery    •  Emergence  of  Library  Discovery  Services  solu2ons    

– Based  on  index  of  a  wide  range  of  content  – Commercial  and  open  access  content  – Primary  journal  literature,  ebooks,  as  well  as  more  general  web  content  

•  Adopted  by  thousands  of  libraries  around  the  world,  and  impact  millions  of  users  

•  Research  poin2ng  to  increased  library  usage  when  discovery  systems  are  implemented  

7�

The  Context  for  Open  Discovery    It’s  all  great  except  for  ….  

lack  of  clarity  about  how  index  discovery  providers                and  content  providers  should  interact  

data  exchange  and  copyright  concerns  

concerns  about  ranking  algorithms  

concerns  about  bias  of  various  sources  in  results  

8�

TRUST  Any  good  business  rela2onship  is  based  upon  trust  

9�

TRUST…  But  Verify  

•  hUp://xkcd.com/285/  10�

Standards  for  Community  PracFce  

•  Standards  can  be  used  to:  – Make  sure  things  work  together  – Ensure  things  are  done  the  same  way  – Help  people  understand  what/how  to  do  something  

– Understand  what  consumers  are  ge\ng  – Build  trust  among  suppliers  and  consumers  

11�

ODI  -­‐  Open  Discovery  IniFaFve      

Balance  of  ConsFtuents  Libraries  

Service  Providers  

13�

Marshall Breeding, Independent Consultant �Jamene Brooks-Kieffer, Kansas State University �Laura Morse, Harvard University�Ken Varnum, University of Michigan���

Sara Brownmiller, University of Oregon�Lucy Harrison, Florida Virtual Campus (D2D liaison/observer) �

Michele Newberry, Independent �

Publishers  Lettie Conrad, SAGE Publications �Jeff Lang, Thomson Reuters �Linda Beebe, American Psychological Assoc ��

Aaron Wood, Alexander Street Press �Roger Schonfeld, JSTOR, Ithaka�

Jenny Walker, Independent Consultant �John Law, Proquest �Michael Gorrell, EBSCO Information Services ��

David Lindahl, University of Rochester (XC) �Jeff Penka, OCLC (D2D liaison/observer) �

Subgroups  

•  Technical  recommenda2ons  for  data  format  and  data  transfer  

•  Communica2on  of  library’s  rights/descriptors  regarding  level  of  indexing  

•  Defini2on  of  fair  linking  •  Exchange  of  usage  data  

14�

Out  of  Scope  

•  ODI  does  not  address  issues  related  to  performance  or  features  of  the  discovery  services  

•  Inherently  business  and  design  decisions  guided  by  compe22ve  market  forces.  Including:  

User  Interface  Relevancy  Ranking  APIs  exposed  by  discovery  services  Protocols  for  data  exchange  

15�

Deliverables  •  Vocabulary  •  NISO  Recommended  Prac2ce  for  Content  Providers:  – Metadata  elements  provide  to  Discovery  Services  – Metadata  Elements  provided  to  Libraries  – Disclosure  – Technical  Formats  

•  NISO  Recommended  Prac2ce  for  Discovery  Service  Providers:  – Discovery  Service  Content  Lis2ng  – Linking  – File  Formats  and  Methods  of  Transfer  – Usage  sta2s2cs  

•  Educa2on  &  Adop2on  •  Conformance  Checklists  

16�

www.niso.org/workrooms/odi/publica2ons/rp/rp-­‐19-­‐2014  17�

ODI  Metadata  from  content  providers  to  library  

ODI  Metadata  to  discovery  providers  

ODI  Metadata  from  DSP  to  Library  

Recommended  Metrics  

•  Recommended  Metrics  Provided  to  Content  Providers  Total  number  of  searches  

Result  clicks  Total  number  of  click-­‐throughs    

•  Recommended  Metrics  Provided  to  Libraries  Total  number  of  searches  per  month  Total  number  of  unique  visitors  per  month  Total  number  of  click-­‐throughs  per  month  Top  500  search  queries  for  the  last  period  Top  100  referring  URLs  to  discovery  service  in  last  period    

21�

Disclosure  

Annual  repor2ng  requirements:  •  Discovery  service  providers  should  offer  an  affirma2ve  statement  of  the  neutrality  of  their  algorithms    

•  Discovery  service  providers  should  explain  business  connec2ons  with  content  providers    

Licenses  or  contracts  should  not  include  non-­‐  disclosure  agreements  and  similar  arrangements  in  order  to  enable  transparency  regarding  any  possible  bias  

22�

Awareness  

Some  of  the  issues  with  indexed  discovery  systems  are  technical,  some  are  social,  some  are  simply  setup  issues.    

But  not  every  problem  is  technical.    

23�

More  informaFon  

   NISO  just  formed  the  

Open  Discovery  Ini2a2ve  Standing  CommiUee    

www.niso.org/workrooms/odi/  

24�

Thank you!

Todd Carpenter Executive Director

tcarpenter@niso.org @TAC_NISO

National Information Standards Organization (NISO)  3600 Clipper Mill Road, Suite 302 Baltimore, MD 21211 USA  +1 (301) 654-2512  www.niso.org  

November 6, 2014 � 25�