Download - Apache Ignite - In-Memory Data Fabric
©2014GridGainSystems,Inc.
NIKITAIVANOVFounder,ApachePMC
ApacheIgnite- In-MemoryDataFabricBeyondtheDataGrid
www.ignite.apache.org #apacheignite
©2014GridGainSystems,Inc.
Agenda
• Projecthistory• In-MemoryDataFabric• AdvancedClustering• In-MemoryComputeGrid• In-MemoryDataGrid• In-MemoryServiceGrid• In-MemoryStreaming&CEP• Plug-n-PlayHadoopAccelerator
©2014GridGainSystems,Inc.
In-MemoryDataFabricStrategicApproachtoIMC
• Supports Applications of various types and languages
• Open Source – Apache 2.0• Simple Java APIs• 1 JAR Dependency• High Performance & Scale• Automatic Fault Tolerance• Management/Monitoring• Runs on Commodity Hardware
• Supports existing & new data sources• No need to rip & replace
©2014GridGainSystems,Inc.
Performance– HighThroughput– LowLatencies
Scalability– AddClusterMembers(cores)– AddMemory(RAM)
HighAvailability– DataBackups– DatacenterReplication
In-MemoryDataFabricMainCharacteristics
Transactions– FullyACIDCompliant– Optimistic&Pessimistic
Persistence– SQL,NoSQL,Hadoop
Security– Authentication– Authorization– Tracing&Auditing
©2014GridGainSystems,Inc.
• EaseofGettingStarted– AutomaticDiscovery
• AnyEnvironment– PublicCloud– PrivateCloud– HybridCloud– LocalLaptop
• Zero-Deployment– Auto-DeployCode
• FullClusterManagement• PluggableDesign
In-MemoryClustering&Deployment
©2014GridGainSystems,Inc.
• DirectAPIforMapReduce• ZeroDeployment• Cron-likeTaskScheduling• StateCheckpoints• LoadBalancing• AutomaticFailover• FullClusterManagement• PluggableSPIDesign
In-MemoryComputeGrid
©2014GridGainSystems,Inc.
• DistributedIn-MemoryKey-ValueStore
• ReplicatedandPartitioneddata• TBsofdata,ofanytype• On-HeapandOff-HeapStorage• HighlyAvailableIn-MemoryReplicas• AutomaticFailover• DistributedACIDTransactions• SQL99 queriesandJDBCdriver• CollocationofComputeandData
In-MemoryDataGrid
©2014GridGainSystems,Inc.
• UnlimitedVerticalScale• AvoidJavaGarbageCollectionPauses• SmallOn-HeapFootprint• LargeOff-HeapFootprint• Off-HeapIndexes• FullRAMUtilization• SimpleConfiguration
In-MemoryDataFabric:Off-HeapMemory
©2014GridGainSystems,Inc.
DistributedJavaStructures
• DistributedMap(cache)• DistributedSet• DistributedQueue• CountDownLatch• AtomicLong• AtomicSequence• AtomicReference• DistributedExecutorService
©2014GridGainSystems,Inc.
Client-ServervsAffinityColocation
Client-Server
AffinityColocation
©2014GridGainSystems,Inc.
• DistributeAnyDataStructure– AvailableAnywhereontheGrid– AutomaticRemoteAccessviaProxies
• ControlledDeployment– SupportforClusterSingleton– SupportforNodeSingleton– SupportforCustomTopology– LoadBalanced
• GuaranteedAvailability– AutoRedeploymentinCaseofFailures
In-MemoryServiceGrid
©2014GridGainSystems,Inc.
• StreamingDataNeverEnds
• BranchingPipelines• PluggableRouting• SlidingWindowsfor
CEP/ContinuousQuery
• RealTimeAnalysis
In-MemoryStreamingandCEP
©2014GridGainSystems,Inc.
• PlugandPlayinstallation• 10xto100xAcceleration• In-MemoryNativeMapReduce• In-ProcessDataColocation• IgniteFSIn-MemoryFileSystem• Read-ThroughfromHDFS• Write-ThroughtoHDFS• SyncandAsyncPersistence
In-MemoryHadoopAccelerator
©2014GridGainSystems,Inc.
In-MemoryHadoopAccelerator
• ZeroCodeChange• In-MemoryNativePerformance• UseexistingMRcode• UseexistingPig/Hivequeries• NoNameNode• EagerPushScheduling
©2014GridGainSystems,Inc.
SparkIntegration– IGFS&SharedRDD
©2014GridGainSystems,Inc.
Cross-LanguageInteroperability
• C++/.NET/PHP/Java/Node.js• PortableObjects• PerformanceAcrossLanguages• ClientFeatureParity• DynamicSchemaChanges• Searchable/Indexable• VersionIndependent
©2014GridGainSystems,Inc.
• Upto32DataCenters• Active-Active&Active-Passive• SmartConflictResolution• DurablePersistentQueues• AutomaticThrottling✴ EnterpriseEditionOnly
In-MemoryDataFabric:DataCenterReplication
©2014GridGainSystems,Inc.
Management&Monitoring
✴ EnterpriseEditionOnly
©2014GridGainSystems,Inc.
LocalRestartableStore
• PersistentOn-DiskStore• FastRecovery• LocalDataReload• EliminateNetworkandDbimpacts
whenreloadingin-memorystore
✴ EnterpriseEditionOnly
©2014GridGainSystems,Inc.
• PluggableAuth&Auth– JAAS,LDAP,JNDI,Kerberos
• In-ClusterNodeAuthentication• ClientAuthentication• SecureClientSessions• Fine-GrainedAuthorization• ComprehensiveAuditing– Who?What?When?
✴ EnterpriseEditionOnly
In-MemoryDataFabric:Security
©2014GridGainSystems,Inc.
THANKYOU!
www.ignite.apache.org #apacheignite