Photo by Transaction Fraud - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/62015778@N04Created with Haiku Deck

Photo by jev55 - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/52024976@N06 Created with Haiku Deck

Photo by Chrissy Downunder - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/8492674@N08Created with Haiku Deck

Photo by robysaltori - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/7996982@N08 Created with Haiku Deck

Photo by William Brawley - Creative Commons Attribution License http://www.flickr.com/photos/93841400@N00 Created with Haiku Deck

Photo by Daveybot - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/12771303@N00Created with Haiku Deck

Photo by VinothChandar - Creative Commons Attribution License http://www.flickr.com/photos/44345361@N06 Created with Haiku Deck

Photo by digitalnoise - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/8294958@N03Created with Haiku Deck

Photo by PhotoDu.de / CreativeDomainPhotography.com - Creative Commons Attribution License http://www.flickr.com/photos/75814942@N00Created with Haiku Deck

Photo by lars hammar - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/7603557@N08Created with Haiku Deck

Photo by angela7dreams - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/58117789@N00Created with Haiku Deck

GAIA General Architecture

Data Objects

Multi-core Compute and Rendering Device

GAIA Machine Node

Photo by @Doug88888 - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/29468339@N02Created with Haiku Deck

Photo by Werner Kunz - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/35375520@N07Created with Haiku Deck

Photo by Sukanto Debnath - Creative Commons Attribution License http://www.flickr.com/photos/7487149@N03 Created with Haiku Deck

Source Document

Scalable Data parse

service

Scalable Data parse

service

Object Writer Topology

Object Writer Topology

GAIA Topology

GAIA Topology

Kafka QueueKafka Queue

Kafka QueueKafka Queue

1. Parse source document and generates in-memory Object using grammar

Object expressed in common semantic data grammar

2. Generated Object gets written to topic where Object Writer Topology is subscribed

AccumuloAccumulo3. Once an object is received the writer topology ensures that the full object is successfully written to Accumulo, once written it pushes an in memory copy of the object to the ‘written’ topic on which the GAIA topology is listening

GAIAGAIA

4. Once an object is received by the GAIA topology it is written to GAIA via an HTTP request

Object Lifecycle Scenario

5. GAIA Maintains a connection to Accumulo for authorization decisions

Schema C

GAIAGAIASchema B

Schema A

Add object to MASTER

Add object to MASTER

Add object to MASTER

Nai(‘master’,..).select(‘vtype == car || vehicle = 0’).histogram(..)

Single Parent Multiple Children Varying Schemas Single Query Example

Photo by Muhammad Ashiq - Creative Commons Attribution-ShareAlike License http://www.flickr.com/photos/56712180@N02 Created with Haiku Deck

Photo by Oracle_Photos_Screenshots - Creative Commons Attribution License http://www.flickr.com/photos/49034885@N05 Created with Haiku Deck

Photo by onkel_wart (thomas lieser) - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/26405526@N00

Created with Haiku Deck

Photo by tanakawho - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/28481088@N00 Created with Haiku Deck

Photo by octal - Creative Commons Attribution License http://www.flickr.com/photos/70594506@N00 Created with Haiku Deck

Photo by stiefkind - Creative Commons Attribution License http://www.flickr.com/photos/52924836@N00 Created with Haiku Deck

Photo by ~maja*majika~ - Creative Commons Attribution License http://www.flickr.com/photos/93941813@N00 Created with Haiku Deck

Photo by DJOtaku - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/87734610@N00Created with Haiku Deck

Photo by StayRAW - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/24879347@N00Created with Haiku Deck

Photo by pierpeter - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/99295419@N00 Created with Haiku Deck

Photo by miss mass - Creative Commons Attribution-NonCommercial License http://www.flickr.com/photos/9087290@N02 Created with Haiku Deck

Photo by jurvetson - Creative Commons Attribution License http://www.flickr.com/photos/44124348109@N01 Created with Haiku Deck

Photo by xgravity23 - Creative Commons Attribution-NonCommercial-ShareAlike License http://www.flickr.com/photos/21164801@N00Created with Haiku Deck