bigchaindb - big data meets blockchain

38
A scalable blockchain database Dimitri De Jonghe [email protected]

Upload: dimitri-de-jonghe

Post on 16-Apr-2017

196 views

Category:

Internet


8 download

TRANSCRIPT

A scalable blockchain database

Dimitri De [email protected]

Your assets, your claims

Trust by Institutions & Intermediaries

$ ping www.google.com< PING www.google.com (172.217.17.36)

Digital Trust by Institutions & Intermediaries

Her

e’s

your

pers

onal

data

2008 - Bitcoin

Blockchain DisruptionShared single source of

truth and conduct

Inter-mediary

Trusted third parties

peer to peerdecentralizedcentralized

Blockchain: a special “spreadsheet in the sky”

What’s special?

● Not a single instance owns it● Members/clients can add to it● If they follow the rules● Rules are an integral part● No one can change the history

(immutable)

● Writing to a blockchain is like etching into stone

● Which allows us to issue assets and transfer them

Shades of trust, reputation, blockchain...

Public: Open networks

Writers: Everyone can participate

Trust: World consensus

Applications:

● Decentralized apps

● Cryptocurrencies, programmable money

● Smart contracts

Private: Ecosystems, federations

Writers: Participants known/reputation

Trust: Federated consensus (eg

voting)

Applications:

● Disintermediation: Clearing & settlement

● Transparency: Supply chain, AML, audit

trails, provenance

● Ownership: exchange, partial, trustless

Internet of value: a programmable economy

To develop shared global compute infrastructure,

we must first understand the status quo of infrastructure,

…and how to change it accordingly.

Status quo compute infrastructureModern apps use processing, file system, database

FILE SYSTEMe.g. S3, HDFS

APPLICATION

PROCESSINGe.g. EC2, Azure

DATABASEe.g. MySQL, MongoDB

PLATFORMe.g. AWS, Google App Engine, Heroku

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP

Towards a decentralized compute infrastructure

FILE SYSTEMe.g. S3, HDFS

APPLICATION

PROCESSINGe.g. EC2, Azure

DATABASEe.g. MySQL, MongoDBBitcoin Blockchain?

PLATFORMe.g. AWS, Google App Engine, Heroku

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP

Towards a decentralized compute infrastructure

FILE SYSTEMe.g. S3, HDFS

APPLICATION

PROCESSINGe.g. EC2, Azure

DATABASEe.g. MySQL, MongoDB

PLATFORMe.g. AWS, Google App Engine, Heroku

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP

e-Cash/e-GoldBitcoin

Towards a decentralized compute infrastructure

FILE SYSTEMe.g. S3, HDFSIPFS, SWARM

APPLICATION

PROCESSINGe.g. EC2, Azure, Ethereum, Hyperledger, Tendermint, Lisk, Corda

DATABASEe.g. MySQL, MongoDB

PLATFORMe.g. AWS, Google App Engine, Heroku, Eris/Monax, BlockApps

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP, I

nter

led

ger

ILP

e-Cash/e-GoldBitcoin, zCash, Ripple,

Blockstream, Multichain

Towards a decentralized compute infrastructure

FILE SYSTEMe.g. S3, HDFSIPFS, SWARM

APPLICATION

PROCESSINGe.g. EC2, Azure, Ethereum, Hyperledger, Tendermint, Lisk, Corda

DATABASEe.g. MySQL, MongoDB

???

PLATFORMe.g. AWS, Google App Engine, Heroku, Eris/Monax, BlockApps

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP, I

nter

ledg

er IL

P

e-Cash/e-GoldBitcoin, zCash, Ripple,

Blockstream, Multichain

Towards a decentralized compute infrastructure

FILE SYSTEMe.g. S3, HDFSIPFS, SWARM

APPLICATION

PROCESSINGe.g. EC2, Azure, Ethereum, Hyperledger, Tendermint, Lisk, Corda

DATABASEe.g. MySQL, MongoDBBigchainDB, IPDB

PLATFORMe.g. AWS, Google App Engine, Heroku, Eris/Monax, BlockApps

CO

NN

ECT

NET

WO

RK

S e.

g. T

CP/

IP, I

nter

ledg

er IL

P

e-Cash/e-GoldBitcoin, zCash, Ripple,

Blockstream, Multichain

70 GB3 tx/s

What about planetary scale?

Netflix uses 37% of Internet bandwidthUsing a modern distributed “big data” database

http://techblog.netflix.com/2011/11/benchmarking-cassandra-scalability-on.html

Writes / s vs. # nodes

What’s the difference between a database and a csv file?Querying. From M’s of records, find the relevant ones.

1 Line of standard code, optimizedvs

50-500 lines of slow custom code, unoptimized

How do “big data” databases scale? Answer: Distribute storage across many machines, i.e. sharding

A “consensus” algorithm keepsdistributed nodes in sync.

Native assets

How to build a scalable blockchain database (BigchainDB)1. Start with an enterprise-grade distributed DB, e.g. MongoDB2. Engineer in blockchain characteristics

• Each DB node is a federation nodeDecentralized / Shared Control

• Append-only• Chain hashes

Immutable / Audit Trails

• “Own” = have private key• Asset lives on the database

Federated Consensus Architecture

Blockchain Consensus

Database Consensus

IMPLEMENT A 2 PHASE CONSENSUS

FEDERATION

Single Database

or

MongoDB RethinkDB

Database Options

Decentralized programming

BigchainDB: Big Data meets Blockchain- a blockchain database

Immutability

Decentralized Control

Native Assets

Scalable

Queryability

Operationalized

TraditionalDatabases

Traditional blockchains

BigchainDB

Blockchain as a DB - Applications

Vertical:IP – Music rights

Value proposition:A streaming service owned by all

Vertical:IP – Digital art

Value proposition:Enables creators of digital art to get compensated, via claiming attribution & licensing

ascribe

Vertical:Identity

Value proposition:Low-friction assurance, sovereign personal data

Authenteq

©ITU/L.Berney, (CC BY 2.0)

Vertical:Government – Land Registry

Value proposition:Low-cost registry, less risk of corruption

BenBen

©ITU/L.Berney, (CC BY 2.0)

Vertical:ID - Education Credentials

Value proposition:reduce fraudulent degrees, lower HR friction

Recruit

Vertical:Energy

Value proposition:manage $ flow in energy deregulation

Vertical:Supply Chain / Health

Value proposition:government-mandatedtransparent $ flow

Generating Opportunities: Vertical x Benefit

Decentralized /Shared Control

Immutability / Audit trail

Tokens /Exchanges

Intellectual Property

Identity

Finance

Energy

Government

Dig art – ascribe

Supply Chain

R3

Retail marketplace - OpenBazaar

RWE You?

You?

You?

Res( )nate

Tangent90 Everledger

Recruit

BenBen

• For everyone, everywhere

• Free until heavy usage, then pay web service style

• Initial tech is BigchainDB

• Member caretakers will operate validating nodes

IPDB Caretakes (so far)

BlockstackCOALA

Dyne.orgInternet Archive

OpenMediaUnMonastery

ascribe / BigchainDBConsensys

Eris/Monax IndustriesProtocol Labs (IPFS)SmartContract.com

SynereoTendermint

Dimitri De Jonghe

[email protected]@DimitriDeJonghehttps://be.linkedin.com/in/dimitridejonghe

+32 496 80 94 14

My projects:https://ascribe.iohttps://bigchaindb.comhttps://ipdb.foundationhttps://github.com/bigchaindbhttps://interledger.orghttp://datanews.knack.be/ict/nieuws/bigchaindb-maakt-blockchain-principe-schaalbaar/article-normal-720789.html

Thanks for listening