agris and agrovoc: a bibliographic catalogue and its thesaurus

47
AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus into the world of linked data The experience of the Food and Agriculture Organization of the UN (FAO) [email protected] IRCDL 5 th February 2016, Firenze

Upload: vuonghuong

Post on 03-Jan-2017

222 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AGRISandAGROVOC:abibliographiccatalogueandits

thesaurusintotheworldoflinkeddata

TheexperienceoftheFoodandAgricultureOrganizationoftheUN(FAO)

[email protected]

IRCDL5th February2016,Firenze

Page 2: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Today

• AfewwordsonFAO• AGRIS,aLODbasedapplication• AGROVOC,aconceptscheme

Page 3: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

FAOFoodandAgricultureOrganizationoftheUN

Page 4: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

BasicsonFAO• Foundedin1945• Goalsoftheorganization:Helpeliminatehunger,foodinsecurity andmalnutrition– makeagriculture,forestryandfisheriesmoreproductiveandsustainable – reduceruralpoverty - enableinclusiveandefficient foodsystems – increasetheresilience oflivelihoods

• Currently,194members• HQinRome,5regionaloffices,variouscountryoffices

Page 5: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

FAO&information• Corporatedocuments– “Stateof…”,guidelinesforgovernments,researchandreportsonspecificthemes/areas– http://www.fao.org/publications/

• Collectionofstatistics– http://faoostat.org.fao.org…

• Distancelearning- http://www.fao.org/elearning/• Capacitydevelopment• Promotionof(open)accesstoinformationamongmembercountries

Page 6: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AGRIS

Page 7: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AGRISpartnership

• Startedin1975,tohelppartnerspromotetheirscientificproduction– Typically,ministriesandresearchcentresinagriculture

• Inpractice,abibliographicrepositorycontributedbypartnersandcompiled&disseminatedbyFAO(onpaper,CD,..)

Page 8: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Agris today

1. Anetwork:collaborativenetworkofmorethan150institutionsfrom65countries

2. AWebportal:agris.fao.org/ isaWebapplicationthatenrichestheAGRISrepositorywithrelatedWebresources.UsesLinkedOpenDatamethodologies

3. AnRDFdatabase

Page 9: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

TheAGRISnetwork

Page 10: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

TheAGRISnetworkataglance

Page 11: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

TheAGRISportal

Page 12: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

agris.fao.org

Page 13: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AnAGRISrecord

13

Page 14: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Linkedresources• DBPedia• NatureOpenSeach• GBIF• WorldBank• FAOgeopoliticalontology– Countryprofiles• IFPRI• FAOfisheriesandaquaculturefactsheets• Bioversity international• CGRISgermplasm database

• Full-text:anincreasingnumberoffullpapersisavailable,usingsimplesearchthroughGoogle

Page 15: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Agris content

~8millionmultilingual bibliographicrecords– 400,000fromLatinAmerica– 150,000fromAfrica– 760,000fromAsia+400,000linkstoCASDD(China)

• ~250milliontriples

Page 16: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Access

• From200+countriesandterritories

16

GoogleAnalyticsOctober 2015

Page 17: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Multilinguality

Page 18: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AGRISisnativelymultilingual

Page 19: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AGRIS:LinkedOpenDatainaction 19

Page 20: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AGRIS:LinkedOpenDatainaction 20

Page 21: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

TheAGRISLODdataset

Page 22: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

ALODdataset

AGRISURI AGROVOCURI

dcterms:subject

DBPediaURI

skos:closeMatchskos:exactMatch

DBPediaAbstract

WikipediaURL

DBPediaPicture

foaf:isPrimaryTopicOfdbpedia-owl:abstractfoaf:depiction

Entrypoint!

AGROVOCisthe

backbone

Page 23: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AGROVOCenablesAGRISLOD

1. alldocumentsinAGRISareindexedwithAGROVOC–Manually,bythepartner–Automatically,byAGRIS

2. AGROVCisaLODresource– AGROVOC linkstoVoc

– Voc indexesData

– AGRISlinkstoData

3. AGROVOCkeywordsarealsousedtoqueryexternalWebServices

Page 24: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AGROVOCenablesmultilingualsearch

• AGRISrecordsareindexedwithAGROVOCkeywordsinaspecificlanguage

• AGROVOCconceptshavemultilinguallabels–allwiththesameURI

• Queriesareexpandedtomatchresultsindexedinanylanguage

Page 25: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Accessibility

• Sparql endpoints– Records– Serials– centers

• DataservedasLOD• ComeswithaVoID file

AGRISWeb

ApacheSolrIndex

Triplestore

Page 26: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AgriMetaMaker WebAGRIS OAI-PMHharvesterLocalDBsdumps

AGRISinputmodule

RDFmanager

Datacollection&processing

URIscreation,RDFgeneration

Entitiesdisambiguation,provenance,

dataenhancement,…

Page 27: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AGROVOC

Page 28: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

aims.fao.org/agrovoc

Page 29: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AGROVOCinshort

• Startedasathesaurusin1980• CoversallareasofinteresttoFAO,e.g.agriculture,forestry,fisheries,nutrition,environment,…

• 32,000+conceptsinupto23languages• ALinkedOpenDataset,available invariousformats

Page 30: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AnAGROVOCconcept

Page 31: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AnRDFdataset

• ThesaurusconvertedtoanRDFSKOSconceptscheme

• Goaltohave“standard”RDF– SkOS-XL,DC,DCterms,FOAF– andaspecificvocabulary,Agrontology ->

Page 32: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

wheats@en

http://zbw.eu/stw/descriptor/14098-1

skosxl:prefLabel

skos:broader

skosxl:prefLabel2015-02-03T22:59:45Z

c_8373

c_11456

skos:exactMatch

skos:related

skos:definition

dcterms:created

“Adefinition”

rdf:value

“AnURLforitssourcevb:hasLink

skosxl:literlForm

agrontology:hasProduct

c_3032

wheatstraw@enc_3032

foodproducts@en

xl_en_c3955

xl_jp_c3485

xl_en_c134

小麦@zh

Hardwheat@en

Page 33: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Multilinguality

• 32,000+conceptsinupto23languages• =conceptsmayhavelabelsinoneormorelanguages– Onehierarchy,manylanguages– Nolanguageis“compulsory”– AlthoughthereisanhistoricalpreferenceforEnglishasalinguafranca

Page 34: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

VocBench – SKOSeditingplatform

Page 35: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Acommunityofeditors

Page 36: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Akinkeddataset

• Linksto16vocabularies• Skos:closeMatch,• skos:exactMatch• LinksidentifiedwithSemi-automaticprocess

• ComeswithaVoID file

VoID file

Page 37: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus
Page 38: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus
Page 39: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AnAGROVOCconceptintheLODview

Page 40: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

AdoptersofAGROVOC

Page 41: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

HowtoaccessAGROVOC

• Online,search• Download(RDF)• WebservicesbuiltontopoftheRDF• SPARQLendpoint

Page 42: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

TheAGROVOCtechnologystack

Page 43: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Ongoing&future

Page 44: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

GlobalAgricultureConceptSchemeGACS- beta

Page 45: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

GACSataglance

• Workinggroup:AGROVOC,NALT,CABI• Steeringcommittee:..+INRA,CGIAR• Betacore1.6=15,000caconcepts• Amergeofallinfoavailable• Ongoing:preparationforpublicrelease• Future:expandGACSframeworktoincluderelevantsemanticresourcesinagriculture– fordocumentindexing,fordataannotation.PossiblecollaborationwithAgroPortal

Page 46: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

Credits• AGROVOC:Caterina Caracciolo,SarahDister,JohannesKeizer,Marie-AngeliqueLaporte,Karna Wegner,LucianaZedda

• AGRIS:Fabrizio Celli,YvesJaques,MauroRanchicchio• VocBench:ArmandoStellato,AndreaTurbati (UTorVergata,Rome)

• JohannesKeizer,headoftheAIMSteam@FAO

• Technicalsupport:MIMOSBerhad (Malaysia)hostssomeofthetechnicalinfrastructureofAGROVOCandAGRIS.AgroKnow (Greece)supportsthedataAGRISingestionphase.

Page 47: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus

PointersandcontactsAGROVOC:aims.fao.org/agrovocAGRIS: agris.fao.orgVocBench:http://vocbench.uniroma2.it/

VocBench sandbox:http://202.73.13.50:55481/vocbench/ (withAGROVOC)

AIMScommunity:http://aims.fao.org/Subscribe,you get thenews

VBm-list:http://groups.google.com/group/vocbench-user

[email protected]