4th Workshop on Semantic Deep Learning (SemDeep-4)October 8th 2018 - Monterey

Who are we?

�2

Thierry Declerck DFKI GmbH

Luis Espinosa-Anke Cardiff University

Dagmar Gromann TU Dresden

What is SemDeep?▪ A platform dedicated to ▪ contributions and discussions that appeal

to both Semantic Web and Deep Learning research and industry communities

▪ semantically challenging tasks addressed by both communities

�3

What is SemDeep about?

Deep Learning (DL)Deep learning represents a set of machine learning algorithms that learn data representations by means of transformations with multiple processing layers. This algorithmic set has frequently been applied to feature learning in images, audio and text.

Semantic Web (SW)SW technologies and knowledge representation boost the re-use and sharing of knowledge in a structured and machine readable fashion.With SW technologies, on-the-fly composition and interoperation of Web services, as well as more intuitive search engines can be provided.

�4

�5

Semantic Web Deep Learning

What is SemDeep about?

What are our topics?Structured knowledge in DL:- no, not description logic- introducing structured

knowledge, rules, axioms to DL algorithms

- learning and applying knowledge graph embeddings

- combining knowledge graph embeddings with other types of embeddings

- neural semantic parsing- ….

�6

Reasoning and inferences and deep learning: - inferences based on deep

learning algorithms- axioms as deep learning

constraints - reasoning with deep learning

methods - recent example:

Bassem Makni and James Hendler: Deep Learning for Noise-Tolerant RDFS Reasoning*

- …

* second revision currently under review in our special issue on SemDeep @ Semantic Web journal to be published later this year

Learning knowledge representation with DL: - knowledge-base

completion- learning ontological

annotations with DL- learning ontologies with DL

methods: - our invited talk today

by Marco Rospocher - …

What has happened so far?SemDeep-1 @ ESWC:- Keynote: Volker Tresp:

Learning with Knowledge Graphs

- knowledge-based embeddings

- Event detection with DL & SW

- Argumentation on Ontological Representations

�7

SemDeep-2 @ IWCS: - Negative Sampling on

Deep Structured Semantic Models

- Graph Representations of Word Embeddings

- Multimodal Networks- Tag extraction using

end-to-end memory nets- Coreference with Neural

Semantic Parsing

SemDeep-3 @ COLING: - KeyNote 1: Steven

Schockaert : Knowledge Representation with Conceptual Spaces

- KeyNote 2: Christos Christodoulopoulos: Knowledge Representation and Extraction at Scale

- Sentiment Analysis in Telugu- Lexical Resources linked to

Word Sense Embeddings - Embeddings Transfer - Similarity Learning and

Retrieval in Asymmetric Texts

THIS SEMDEEP�8

14:10 - 15:00 Invited Talk by Marco Rospocher: Learning Expressive Ontological Concept Descriptions via Neural Networks

15:00 - 15:30 Muhammad Rahman and Tim Finin: Understanding and Representing the Semantics of Large Structured Documents

15:30 - 16:00 Coffee break16:00 - 16:30 Gengchen Mai, Krzysztof Janowicz and Bo Yan: Combining Text Embedding and

Knowledge Graph Embedding Techniques for Academic Search Engines16:30 - 17:00 Asan Agibetov and Matthias Samwald: Global and Local Evaluation of Link Prediction

Tasks with Neural Embeddings17:00 - 17:30 Szymon Wieczorek, Dominik Filipiak and Agata Filipowska: Semantic Image-Based Profiling

of Users' Interests with Neural Networks17:30 - 17:50 Michael Cochez, Martina Garofalo, Jérôme Lenßen and Maria Angela Pellegrino: A First

Experiment on Including Text Literals in KGloVe

�9

SemDeep-4 Program

Szymon Wieczorek, Dominik Filipiak and Agata Filipowska: Semantic Image-Based Profiling of Users' Interests with Neural Networks

�10

Best Paper Award

PROGRAM COMMITTEEStephan Baier, Ludwig Maximilian University, Munich, GermanyMichael Cochez, RWTH University Aachen, GermanyBrigitte Grau, LIMSI, CNRS, Orsay, FranceWei Hu, Nanjing University, ChinaMd. Rezaul Karim, Fraunhofer FIT, GermanyEfstratios Kontopoulos, Multimedia Knowledge & Social Media Analytics Laboratory, Thessanloniki, GreeceBrigitte Krenn, Austrian Research Institute for AI, Vienna, AustriaJose Moreno, Universite Paul Sabatier, IRIT, Toulouse, FranceSergio Oramas, Universitat Pompeu Fabra, Barcelona, SpainMaria Angela Pellegrino, University of Salerno, Fisciano, ItalyAlessandro Raganato, Sapienza University of Rome, Rome, ItalySimon Razniewski, Max-Planck-Institute, Germany

�11

Let’s get the WS started!

Hashtag #semdeep4 (also tag #iswc2018, etc.)

�12