incorporating blockchain into rdf store at the lightweight ... … · –reduce network overhead....
TRANSCRIPT
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices
Anh Le-Tuan, Darshan Hingu, Manfred Hauswirth and Danh Le Phuoc | Technische Universitat Berlin
RDF4LED - An RDF Engine for Edge Devices
Incorporating Blockchain into RDF4Led
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 2
Why Edge Devices ???
Edge Computing - Internet of Things
– reduce network overhead.
– reduce latency for real-time applications.
– improve scalability.
– better privacy control.
Linked Data
– enable data integration of heterogeneous sources.
– enable data federation over edge nodes.
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 3
Missions
Moving semantic data processing task away from centralised cloud for the IoT
– How much semantic data on small devices ?
– How to scale data federation over small devices on edge systems ?
– How to encourage people sharing the data from their edge devices ?
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 4
RDF4LED - An RDF Engine for Edge Devices
System Design
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 5
RDF4LED (cont.)
Physical RDF Organisation: Two-Layers Index
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 6
RDF4LED (cont.)
Targeted Small Devices
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 7
Incorporating Blockchain into RDF4Led
System Overview
Smart Contract Manager
Distributed RDF Storage
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 8
Incorporating Blockchain into RDF4Led
System Workflow
Smart Contract Manager
SPARQL Query Processor
Validation Service
SmartContracts
Storage
Trip
le P
atte
rn
Req
uest
Smart Contracts
2
Payment
Request P
aym
ent
Con
firm
atio
n
Trigger Contracts
Index Entries
Index Entries
Distributed RDF Storage
Req
uest
with
In
dex
Entr
ies
Matched
Triples
3
45
1
6
7
8
9
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 9
Incorporating Blockchain into RDF4Led
Physical Organisation
. . .Transaction N: {Owner: ClientN Price: 0.1 IPFS:hashN}
Transaction 2: {Owner:ClientB Price: 0.1 IPFS:hash2}
. . .IPFS:hash1s1 p1 o1 o2 o3; p2 o4 o5p3 o6.
IPFS:hash2s2 p1 o5; .... .. .. .... .. .. ..
IPFS:hashNs3 p3 o2; .... .. .. .... .. .. ..
Transaction 1:{Owner: ClientA Price: 0.1 IPFS:hash1}
. . .s2p1o5:{ Transaction 2}
s3p3o2:{ Transaction N}
s1p1o1:{ Transaction 1}
Distributed RDF Storage
Blockchain
Smart Contracts Storage
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 10
Incorporating Blockchain into RDF4Led
System Deployment
ValidationService
Client A
Distributed Storage System Cluster
Miner Nodes
Geth Clients
Client B Client N
....
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 11
Incorporating Blockchain into RDF4Led
Evaluation - Input (1) Acc. Throughput on Static Cluster Sizes
0 200 400 600 800 1,0001,000
1,500
2,000
2,500
DatasetSize (in millions)
Thro
ughp
ut(tr
iple
s/se
c)10 nodes Inserting
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 12
Incorporating Blockchain into RDF4Led
Evaluation - Input (2) Acc. Throughput on Varying Cluster Sizes
2 4 6 8 10
10
20
30
40
No of Nodes
Thro
ughp
ut(tr
iple
s/se
c)in
thou
sand
s100 Million triples Dataset
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 13
Incorporating Blockchain into RDF4Led
Evaluation - Query
0.5
5
3060
350
1000
1 10 50 100 500 1000
seco
nd
(in
log
sca
le)
Number of blocks return in query patterns
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 14
Thank You !!!
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 15
RDF4LED (cont.)
Write Management (1): Clustering example
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 16
RDF4LED (cont.)
Write Management (2): Cache Management
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 17
RDF4LED (cont.)
Push-based Join Algorithm
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 18
RDF4LED (cont.)
Evaluation Results - Input (1)
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 19
RDF4LED (cont.)
Evaluation Results - Input (2)
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 20
RDF4LED (cont.)
Evaluation Results - Input (3)
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 21
RDF4LED (cont.)
Evaluation Results - Query (1)
1
10
100
F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5
seco
nd
(in
log s
cale
)
Queries
(a) Query response time on Intel Galileo Gen II
VIRTUOSORDF4LedJENA TDB
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 22
RDF4LED (cont.)
Evaluation Results - Query (2)
1
10
100
F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5
seco
nd
(in
log s
cale
)
Queries
(b) Query response time on Raspberry Pi Zero
VIRTUOSORDF4LedJENA TDB
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 23
RDF4LED (cont.)
Evaluation Results - Query (3)
1
10
100
F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5
seco
nd
(in
log s
cale
)
Queries
(c) Query response time on Beagle Bone Black
VIRTUOSORDF4LedJENA TDB
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 24
RDF4LED (cont.)
Evaluation Results - Query (4)
1
10
F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5
seco
nd
(in
log s
cale
)
Queries
(d) Query response time on Beagle Bone Black (20 mil)
VIRTUOSORDF4Led
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 25
RDF4LED (cont.)
Evaluation Results - Memory (1)
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 26
RDF4LED (cont.)
Evaluation Results - Memory (2)
Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |
Seite 27