LifeLogOn: Log on to Your Lifelog LifeLogOn: Log on to Your Lifelog Ontology!Ontology!

Introduction & Demonstration

Sangkeun Lee, Gihyun Gong, Sang-goo Lee Intelligent Database Systems LabSeoul National University

IntroductionIntroduction

MotivationMotivation

•If we can integrate currently available logs from different devices and create semantic relationships among logs, then it can be a practical starting point of realizing lifelogging...

…

•We already have many types of available logs ..., but they are independent

•LifeLogOn creates semantic relationships among log items

IdeaIdea

Music LogsMovie LogsGPS Logs

Phone Call LogsE-mail HistoryWeb HistorySchedules

Music Logs

Movie Logs

GPS LogsPhone Call Logs

E-mail History Schedules

Sematnic Relationships

LifeLogOn

LifeLogOn OverviewLifeLogOn Overview

• Gives a simple and effective way of integrating heterogeneous logs gathered from many different devices

• Transforms relational log data and metadata into Lifelog Instance-level Ontology and stores in Lifelog Knowledge Base(LKB)

EntityEntity

AttributeAttribute

AttributeAttribute AttributeAttribute

AttributeAttribute

AttributeAttribute

AttributeAttribute

EventEvent

EntityEntity

EntityEntity EntityEntity

EntityEntity

EntityEntity

EntityEntityRole

Role

Role

RoleRole

Role

Identifier

Identifier

Identifier

Domain

LifeLogOn OverviewLifeLogOn Overview

•What can we use it for?

•You can create your own lifelog ontology without understanding any ontology languages

•You can use LifeLogOn when you want to

✓ Find a song you listened at your birthday party and but only know the filename of the photos at the party

✓ Find photos that you took when you are talking with your friend on the phone, saying "It's so beautiful here~!"

✓ Find any events and entities those you know their context information such as time, location,...

✓ ... even more

DemonstrationDemonstration

✓We setup LifeLogOn on our server: http://lifelogon.snu.ac.kr

✓For the demo purpose, we have generated

✓50 digital camera logs

✓50 e-mail histories

✓20 music logs

✓10 phone call logs

✓17 schedule items

✓100 music metadata

✓3 users

Demo SetupDemo Setup

Overall ProcessOverall Process

Part I. Ontology CreationPart I. Ontology Creation

Lifelog Ontology Schema DefinitionLifelog Ontology Schema Definition

• Define Domains• Define Entities & Attributes• Define Events• Create Domain - Entity Relationships• Create Domain - Event Relationships

MusicEntityMusicEntity

LanguageLanguage

TrackNameTrackName

AlbumNameAlbumName

ArtistArtist

PlaytimePlaytime

PlayPlay

UserUser

DateDateTimeTime

LocationLocation

TakePhotoTakePhoto

DigitalCameraDigital

Camera

PhotoEntityPhotoEntity

FileNameFile

Name

ResolutionResolution

Mapping Source Data Schema toMapping Source Data Schema toLifelog Ontology SchemaLifelog Ontology Schema

• Mapping Log data to Lifelog Ontology Schema• Mapping Metadata to Lifelog Ontology Schema

Generating Lifelog Ontology InstancesGenerating Lifelog Ontology Instances

• Choose a Log Data Mapping Profile• Choose a Metadata Mapping Profile• Click ‘Instantiation’

Part II. Use Case ScenariosPart II. Use Case Scenarios

Use Case I: Finding a song that you Use Case I: Finding a song that you don’t rememberdon’t remember

• Find a song you listened at your birthday party and but only know the filename of the photo that is taken at the party

• The filename is ‘DSC_2128.JPG’

• Try below

• Type ‘DSC_2128’ in the keyword search box

• Browse Ontology, following'TakePhoto#467928' - '2009/07/23' - 'MusicPlay#468016' - 'Lazy Rhapsody'

• You've found the song title!

• and even artist, album names!

Use Case II: Finding a photo that you Use Case II: Finding a photo that you took when you were talking on the took when you were talking on the phone with your friendphone with your friend

• Find a picture that you took when you were talking on the phone with your friend, saying ‘It’s so beautiful here~!’

• Now, you want to show the picture to your friends

• But you forgot the date, time , ....

• You only remember your friends cellphone number

• The friend’s cellphone number is ‘018-2144-8842’

• Try below

• Type ‘018-2144-8842’ in the keyword search box

• Browse Ontology, following'PhoneCall#465893' - '2009/01/04' - 'TakePhoto#467929' - 'DSC_4204.JPG'

• You've found the filename! - 'DSC_4204.JPG'