fao isko short

69
FAO 1/70 http://www.fao.org/aim Semantic Technologies at FAO International Society for Knowledge Organization (ISKO) 3 Aprile 2009, Torino Margherita Sini

Upload: margherita-sini

Post on 16-Apr-2017

1.381 views

Category:

Education


0 download

TRANSCRIPT

Page 1: Fao Isko Short

FAO 1/70

http://www.fao.org/aims/

Semantic Technologies at FAO

International Society for Knowledge Organization (ISKO)3 Aprile 2009, Torino

Margherita Sini

Page 2: Fao Isko Short

FAO 2/70

http://www.fao.org/aims/

Few words about myself

Page 3: Fao Isko Short

FAO 3/70

http://www.fao.org/aims/

Just a very rapid introduction• What?

– semantic, semantic web, semantic technologies– ontologies, Knowledge Organization Systems, – metadata

• Why?– interoperability, exchange, share– user orientation, precision and recall– multilinguality, cultural views, context

• Who?– everybody, all domains, all countries, all .org

• Which instruments?– experts, NLP, methodologies and techniques

Page 4: Fao Isko Short

FAO 4/70

http://www.fao.org/aims/

Outline• Semantic projects involving FAO

– AOS– IPFSAPH, FNA, CWR, Fisheries, Food &

nutrition, Geopolitical ontology, AGROVOC Concept Server

– Thai Rice Onto, Agropedia Indica• Conclusions

– ontology-based applications– Collaborations– Take home messages

Page 5: Fao Isko Short

FAO 5/70

http://www.fao.org/aims/

Semantic projects involving FAO

Page 6: Fao Isko Short

FAO 6/70

http://www.fao.org/aims/

Why AOS

vessel? craft? boat?

bateaux?barco?

ship or

containerTerminology brokering

Semantic navigation,Clustering, Ranking, ...

Intelligent queryexpansion

InferencingReasoning

Machine learning

Interoperability

Page 7: Fao Isko Short

FAO 7/70

http://www.fao.org/aims/

• Built from AGROVOC • Domain concepts• Categories

AGROVOCConcept Server

Agricultural Ontology Service• An FAO initiative for

more coherence in Agricultural Information Systems

• Need of a semantic approach• AOS elements:

– AGROVOC Concept Server– KOS registry– Mapping registries– Metadata standards– Tools– Publications (guidelines, ...)

Ontology registry

Sub-domainontologies

Metadataontologies

Page 8: Fao Isko Short

FAO 8/70

http://www.fao.org/aims/

IPFSAPH

Page 9: Fao Isko Short

FAO 9/70

http://www.fao.org/aims/

IPFSAPH

Page 10: Fao Isko Short

FAO 10/70

http://www.fao.org/aims/

The Ontology

Page 11: Fao Isko Short

FAO 11/70

http://www.fao.org/aims/

Creation of the core ontology

1600 concepts

Information Resources•Brainstorming•Codex Alimentarius•SPS Agreement Ontology

Ontology Editor(OI-Modeler)

subject specialists

Agrovoc

Food SafetyDocuments

GenericDocuments

Page 12: Fao Isko Short

FAO 12/70

http://www.fao.org/aims/

Concept Search

The same records will be retrieved regardless of the specific synonyms or singular/plural forms that the user uses to refer to a concept.

Related concepts

Page 13: Fao Isko Short

FAO 13/70

http://www.fao.org/aims/

Multilinguality

The system is also able to understand a concept even when different languages are used.

Page 14: Fao Isko Short

FAO 14/70

http://www.fao.org/aims/

Check spelling

Spelling errors are corrected: e.g. “desease” into “disease”

Page 15: Fao Isko Short

FAO 15/70

http://www.fao.org/aims/

Paraphrasing

“mad cow disease symptoms” or

“clinical signs of bovine spongiform encephalopathy”

Page 16: Fao Isko Short

FAO 16/70

http://www.fao.org/aims/

give the same results, which are ranked.

Page 17: Fao Isko Short

FAO 17/70

http://www.fao.org/aims/

Semantic navigation of the bibliographical metadata (1)

Page 18: Fao Isko Short

FAO 18/70

http://www.fao.org/aims/

Semantic navigation of the bibliographical metadata (2)

Page 19: Fao Isko Short

FAO 19/70

http://www.fao.org/aims/

Semantic Navigation of Knowledge

parent concept(s)

children concept(s)

Page 20: Fao Isko Short

FAO 20/70

http://www.fao.org/aims/

FNA

Page 21: Fao Isko Short

FAO 21/70

http://www.fao.org/aims/

Page 22: Fao Isko Short

FAO 22/70

http://www.fao.org/aims/

Creation of the core ontologyBIBLIOGRAPHIC

DATABASECORPORATEDOCUMENT

REPOSITORYDATABASE

MERGERECORDS

+TRANSFORM

TO RDFS

Ontology Editor(OI-Modeler) maintain

Page 23: Fao Isko Short

FAO 23/70

http://www.fao.org/aims/

Ontology Relationships

Page 24: Fao Isko Short

FAO 24/70

http://www.fao.org/aims/

The ontology concepts

• Publication• Issue• Work

• Article

• Subject Term• Category• Author• Region• Language• Year

Page 25: Fao Isko Short

FAO 25/70

http://www.fao.org/aims/

The ontology instances

Page 26: Fao Isko Short

FAO 26/70

http://www.fao.org/aims/

Features• Multilingual concept resolution• Get suggestions for the navigation

(e.g. synonyms)• Guided query formulation• Easy navigation of the objects by following the

semantic links

Page 27: Fao Isko Short

FAO 27/70

http://www.fao.org/aims/

RDFa

Page 28: Fao Isko Short

FAO 28/70

http://www.fao.org/aims/

CWR

Page 29: Fao Isko Short

FAO 29/70

http://www.fao.org/aims/

Hierarchy

Page 30: Fao Isko Short

FAO 30/70

http://www.fao.org/aims/

• Undertaken by FAO with partners• Developed in harmony with CWR descriptor list• First version (English only) available by

December 2006• About 800 core terms + acronyms + spelling

variants;• Clearly definition of concepts (AGROVOC +

other sources); and• Relationships: hierarchical + causative

The project

Page 31: Fao Isko Short

FAO 31/70

http://www.fao.org/aims/

More semantics

Term: wild plants

subclass of plants superclass of crop wild relatives

adapted by domestication benefits from resource conservation

Page 32: Fao Isko Short

FAO 32/70

http://www.fao.org/aims/

Properties (1/2)

Page 33: Fao Isko Short

FAO 33/70

http://www.fao.org/aims/

Properties (2/2)

Page 34: Fao Isko Short

FAO 34/70

http://www.fao.org/aims/

Overall Solution (1/2)

Value-added information

services

Shared layer of

interoperability

Distributed Datasets

dataset1

dataset2

Common exchange layer (Vocabularies,Ontologies, RDF/XML)

datasetn

Aggregated Database

View

Subject specific Portals

Information

System (n)

News feed

service…

Page 35: Fao Isko Short

FAO 35/70

http://www.fao.org/aims/

Overall Solution (2/2)

Data

Page 36: Fao Isko Short

FAO 36/70

http://www.fao.org/aims/

Fisheries

Page 37: Fao Isko Short

FAO 37/70

http://www.fao.org/aims/

• The initial goal Making information interchangeable between ASFA, FIGIS, OneFish and

AGROVOC

• The approach Creating an ontology, integrating or mapping the 3 different systems +

AGROVOC Linking of the Ontology through wrappers to the different Information

Systems

• Evolution: NeOn

Fisheries Ontologies

Page 38: Fao Isko Short

FAO 39/70

http://www.fao.org/aims/

Fisheries Ontologies (2/2)OneFish

FIGIS

AGROVOC

Aquaculture

BrackishwaterAquaculture

MarineAquaculture

AquacultureDevelopment

AquacultureFacilities

BROADERTERM

BROADERTERM

RELATEDTERM

RELATEDTERM

FreshwaterAquaculture

AquacultureEconomics

AquacultureEngineering

BROADERTERM

RELATEDTERM

RELATEDTERM

Aquaculture Resource

Water Area

land

strainsSpecieslife cycle

Farming system

management system

Production center

Spawning technique

Breeding technique

Hatchery technique

Expl. form

Regulation

Farming

technique

Environment

Institution

Health monitoring technique

diseases

suppliers

ASFA

Page 39: Fao Isko Short

FAO 40/70

http://www.fao.org/aims/

Features1. Form versus meaning:

a) Traditional Searchb) Concept Search

2. Implemented functionalities:a) synonym searchb) multilingual capabilityc) terminology brokeringd) disambiguatione) related conceptsf) query expansion

3. Basic natural language queries

4. Semantic navigation of bibliographical metadata

5. Semantic Navigation of Knowledgea) Alphabetic list ...b) Core Fishery

Concepts ...

Page 40: Fao Isko Short

FAO 41/70

http://www.fao.org/aims/

Ontology properties|Fishing Grounds@ag| PARTICIPANT-IN |Fishing Operations@ag||Sponges@ag| PARTICIPANT-IN |Sponge Fisheries@ag||Pearls@ag| PARTICIPANT-IN |Pearl Culture@ag||Pearls@ag| PARTICIPANT-IN |Pearl Fisheries@ag||Silk@ag| PARTICIPANT-IN |Sericulture@ag||Small Enterprises@ag| PARTICIPANT-IN |Artisanal Fisheries@ag||Dairy Farms@ag| PARTICIPANT-IN |Milk Production@ag||Fish Farms@ag| PARTICIPANT-IN |Aquaculture@ag||Fish Farms@ag| PARTICIPANT-IN |Fish Feeding@ag||Fish Farms@ag| PARTICIPANT-IN |Fisheries@ag||Natural Resources@ag| PARTICIPANT-IN |Resource Conservation@ag|

Page 41: Fao Isko Short

FAO 42/70

http://www.fao.org/aims/

Example• "tell me what vessels from a nearby country are

currently in the marine area 50N060W within Atlantic Ocean, provided that also some Thunnus alalunga stock can be fished by those vessels, through allowed techniques"

Page 42: Fao Isko Short

FAO 43/70

http://www.fao.org/aims/

Using multilingual lexicalizations ENGLISH

SPANISH

FRENCH

Page 43: Fao Isko Short

FAO 44/70

http://www.fao.org/aims/

Using hierarchically related concepts

hierarchically related concept

Polyvalent Trawlers

Page 44: Fao Isko Short

FAO 45/70

http://www.fao.org/aims/

Using non-hierarchically related concepts

non-hierarchically related concept

gears

Page 45: Fao Isko Short

FAO 46/70

http://www.fao.org/aims/

Help the user formulate queries

Original query: bateau de pêcheTo refine your query, click on the concepts you are interested in. They will appear to the left.

Search:

Page 46: Fao Isko Short

FAO 47/70

http://www.fao.org/aims/

Reconcile different vocabularies

“navire de pêche”, “fishing

vessel”, “embarcaciones

de pesca”

AGROVOC or ASFA or

other“fishing vessels,”

“fishing boat,”

AGROVOC: “fishing vessels”, “barco”, etc...ASFA: “fishing

vessels”

Page 47: Fao Isko Short

FAO 48/70

http://www.fao.org/aims/

Semantic Navigation of Knowledge: Thesaurus based

Highlighting the originator thesaurus. User can select a specific thesaurus to look for.

Page 48: Fao Isko Short

FAO 49/70

http://www.fao.org/aims/

Geopolitical ontology

Page 49: Fao Isko Short

FAO 50/70

http://www.fao.org/aims/

Geopolitical ontology• Incorporate geopolitical data• Will serve as a bridge to allow communication

between the various systems.

Page 50: Fao Isko Short

FAO 51/70

http://www.fao.org/aims/

PropertiesisValidFromhasOfficialNamehasCodeisSuccessorOfhasBorderWithdependsOn

Page 51: Fao Isko Short

FAO 52/70

http://www.fao.org/aims/

Nutrition Ontology

Page 52: Fao Isko Short

FAO 53/70

http://www.fao.org/aims/

Page 53: Fao Isko Short

FAO 54/70

http://www.fao.org/aims/

Procedure

=CONCATENATE("<owl:Class rdf:ID=""",J2,"""><rdfs:subClassOf><owl:Class rdf:ID=""c_",B2,"""/></rdfs:subClassOf><rdfs:label xml:lang=""en""><![CDATA[",D2,"]]></rdfs:label><code><![CDATA[",J2,"]]></code><TAGNAME><![CDATA[",J2,"]]></TAGNAME>",S2, T2,"</owl:Class>")

<?xml version="1.0"?><rdf:RDF xmlns="http://www.fao.org/aos/infoods#" xmlns:protege="http://protege.stanford.edu/plugins/owl/protege#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" xmlns:owl="http://www.w3.org/2002/07/owl#" xmlns:daml="http://www.daml.org/2001/03/daml+oil#" xmlns:dc="http://purl.org/dc/elements/1.1/" xml:base="http://www.fao.org/aos/infoods"> <owl:Ontology rdf:about=""> <owl:imports rdf:resource="http://protege.stanford.edu/plugins/owl/protege"/> <owl:versionInfo rdf:datatype="http://www.w3.org/2001/XMLSchema#string" >Revision 4.0</owl:versionInfo> <protege:defaultLanguage rdf:datatype="http://www.w3.org/2001/XMLSchema#string" >en</protege:defaultLanguage> <rdfs:comment rdf:datatype="http://www.w3.org/2001/XMLSchema#string" >International Network of Food Data Systems (INFOODS) was established in 1984 on the basis of the recommendations of an international group convened under the auspices of the United Nations University (UNU). Its goal was to .....</rdfs:comment> </owl:Ontology> <owl:Class rdf:ID="c_0413"> <code rdf:datatype="http://www.w3.org/2001/XMLSchema#string" >0413</code> <rdfs:subClassOf> <owl:Class rdf:ID="c_041"/> </rdfs:subClassOf> <rdfs:label xml:lang="en">Vitamin D</rdfs:label> </owl:Class>

Page 54: Fao Isko Short

FAO 55/70

http://www.fao.org/aims/

AGROVOC

Page 55: Fao Isko Short

FAO 56/70

http://www.fao.org/aims/

TerminologyWorkbench

AGROVOCOWL

AOS Core: the Concept Server

Export

AGROVOCRDFS formats

(e.g. SKOS)and

TagTextISO2709

Other thesauriand

terminologies

integration

ABACA NT1 Food NT2 AppleANIMAL BT Organ NT ....

mapping

Other thesauri & terminologies

ABACA NT1 Food NT2 AppleANIMAL BT Organ NT ....

Page 56: Fao Isko Short

FAO 57/70

http://www.fao.org/aims/

Concept Server project• Refine semantics and enrich data pool and

lexicon• Develop a workbench for terminology and

ontology development and maintenance. • Support information management specialists in

the development, maintenance, and quality assurance of the AOS/CS

• Global knowledge vs local knowledge

Page 57: Fao Isko Short

FAO 58/70

http://www.fao.org/aims/

AGROVOC Concept Server• AGROVOC cleaning and refinement

CurrentAGROVOC

MySQL

ImprovedAGROVOC

MySQL

AGROVOC OWLRevisionand

Refinement

Page 58: Fao Isko Short

FAO 59/70

http://www.fao.org/aims/

Modelling– Conversion to UTF-8– Migration to MySQL (from SQL server)– Migration to PostgreSQL (from MySQL)– Incorporated AGRIS/CARIS classification scheme

(multilingual) and the mapping with AGROVOC keywords

– Modified structure to store multiple classification schemes– Revised RDBMS scheme for ontology representation– Designed OWL models– Export to OWL format (v0.8a)– Export to SKOS format (v0.8a)

Page 59: Fao Isko Short

FAO 60/70

http://www.fao.org/aims/

Methods• Concepts from

descriptors• Synonym

<owl:DatatypeProperty rdf:ID="synonym">

• Acronyms <owl:AnnotationProperty rdf:about="http://www.fao.org/aos/agrovoc/2005#acronym">

<owl:Class rdf:about=" http://www.fao.org/aos/agrovoc/2005#c_3"> <rdfs:label xml:lang="en">ABA</rdfs:label> <rdfs:label xml:lang="fr">ABA</rdfs:label> <rdfs:label xml:lang="es">ABA</rdfs:label> <rdfs:label xml:lang="ar">آبا</rdfs:label> <rdfs:label xml:lang="zh">脱è½é…¸</rdfs:label>� <synonym xml:lang="en">[8565] Abscisic acid</synonym> <rdfs:subClassOf rdf:resource=" http://www.fao.org/aos/agrovoc/2005#c_3397"/> <rdfs:subClassOf rdf:resource=" http://www.fao.org/aos/agrovoc/2005#c_32543"/></owl:Class>

Page 60: Fao Isko Short

FAO 61/70

http://www.fao.org/aims/

SKOS• SKOS export from AGROVOC Concept Server

Workbench (WB)• SKOS web services

– SKOS-services for DSpace plug-in• SKOS for mapping projects

Page 61: Fao Isko Short

FAO 62/70

http://www.fao.org/aims/

AGROVOC CSWorkbench

triple store

SKOS

export

maintain

WebServices

access

access response

Page 62: Fao Isko Short

FAO 63/70

http://www.fao.org/aims/

Ontology models (AGROVOC Concept Server, LIR, ...)

Concept

Relationshipsbetweenconcepts

Lexicalization/Term

String

Relationshipsbetweenstrings

Relationshipsbetweenterms

designated by

manifested asOther information:language/culture

subvocabulary/scopeaudiencetype, etc.

Note

annotation relationship

Relationship

RelationshipsbetweenRelationships

All terms are created as instances of the class o_terms. All at the same level. Only one language per term.

term levelstring level

concept level

Page 63: Fao Isko Short

FAO 64/70

http://www.fao.org/aims/

Agropedia Indica

Page 64: Fao Isko Short

FAO 65/70

http://www.fao.org/aims/

References• http://www.slideshare.net/marghe_rita/1-pantnag

ar• http://www.slideshare.net/marghe_rita/2-pantnag

ar-w-guidelines• http://www.slideshare.net/marghe_rita/3-pantnag

ar-w-exercices

• http://agropedia.iitk.ac.in/

Page 65: Fao Isko Short

FAO 66/70

http://www.fao.org/aims/

Conclusions

Page 66: Fao Isko Short

FAO 67/70

http://www.fao.org/aims/

Ontology-based applications• Better exploitation of the potentiality at the

application level: powerful IR• No more words but URIs in IS• Networked Ontologies• Ontology Web services (OWS)

Page 67: Fao Isko Short

FAO 68/70

http://www.fao.org/aims/

Collaborations• With AOS partners• Within EU Projects

– NeOn– SEMIC.EU

• With other initiatives– GFIS– Ecoterm

• Mapping projects• GBIF Global Biodiversity Information Facility secretariat• JRC + BGS + Biblioteca Nazionale di Firenze

Page 68: Fao Isko Short

FAO 69/70

http://www.fao.org/aims/

Take-home message

• There are many uses for terminology & ontology systems in food and agriculture, both for information access and information processing

• FAO has several projects using such systems• FAO is deploying the

Agricultural Ontology Server (AOS)as a global resource

• SKOS and other knowledge representation standards play a key role

Page 69: Fao Isko Short

FAO 70/70

http://www.fao.org/aims/

Questions?

Thanks

Margherita Sini: [email protected] Keizer: [email protected]

Dagobert Soergel: [email protected] Kawtrakul: [email protected]

But Also: Gudrun Johannsen, Boris Lauser, Claudio Baldassarre, Gauri Salokhe, Marta Iglesias, Caterina Caracciolo, Sachit

Rajbhandari, Jeetendra Singh, Mary Redahan, Shrestha, Prashanta, Ton, Imm, Thanapth, Trakul, and many others...