Upload File

apache’ignitetm in6memory’data’fabric’in’action’ ·...

  • Home
  • Documents
  • Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States
16
Apache®, Apache Ignite, Ignite®, and the Apache Ignite logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. DMITRIY SETRAKYAN Founder, PMC Apache Ignite TM InMemory Data Fabric In Action Fast Data Meets Open Source https://ignite.apache.org @apacheignite @dsetrakyan

Upload: others

Post on 20-May-2020

3 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

DMITRIY  SETRAKYAN  Founder,  PMC  

Apache  IgniteTM  

In-­‐Memory  Data  Fabric  In  Action  Fast  Data  Meets  Open  Source

https://ignite.apache.org @apacheignite @dsetrakyan

https://ignite.apache.org
Page 2: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Coding  Examples

• Compute  Grid  • Data  Grid  • Streaming  Grid  • Service  Grid

Page 3: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Join  Us!

Page 4: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

In-­‐Memory  Data  Fabric:  More  Than  Data  Grid

Page 5: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• Automatic  Discovery  – Simple  Configuration  – AWS/EC2/S3  – Google  Compute  Engine  – Other  Clouds  with  JClouds  

• Docker  Support  – Automatically  Build  and  Deploy

Apache  Ignite:  Complete  Cloud  Support

Page 6: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• MapReduce  • ForkJoin  • Zero  Deployment  • Cron-­‐like  Task  Scheduling  • State  Checkpoints  • Load  Balancing  • Automatic  Failover  • Full  Cluster  Management  • Pluggable  SPI  Design

In-­‐Memory  Compute  Grid

Page 7: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Coding  Examples:  Compute  Grid

• Coding  Examples  – Compute  • Broadcast  Example  • Closure  Example  • Fail-­‐over  Example

Page 8: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• JCache  (JSR  107)  – Basic  Cache  Operations  – ConcurrentMap  APIs  – Collocated  Processing  (EntryProcessor)  – Events  and  Metrics  – Pluggable  Persistence  

• Ignite  Data  Grid  – Distributed  Key-­‐Value  Store  – ACID  Transactions  – SQL  Queries  (ANSI  99)  – In-­‐Memory  Indexes  – Automatic  RDBMS  Integration

Data  Grid:  JCache  (JSR  107)

Page 9: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Data  Grid:  Partitioned  Cache

Page 10: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Data  Grid:  Replicated  Cache

Page 11: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Coding  Examples:  Data  Grid• Coding  Examples  – Cache  • CachePutGetExample  

– SQL  • CacheQueryExample

Page 12: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• Streaming  Data  Never  Ends  • Branching  Pipelines  • Sliding  Windows  • SQL  &  Pluggable  Indexing  • CEP  &  Continuous  Queries  • Customizable  Event  Workflow  • Collocation  with  Data  Grid

In-­‐Memory  Streaming  Grid

Page 13: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Coding  Examples:  Streaming• Coding  Examples  – Word  Count  • Stream  Words  • Query  Words

Page 14: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

• Singletons  on  the  Cluster  – Cluster  Singleton  – Node  Singleton  – Key  Singleton  

• Custom  Contracts  – Any  Number  of  Instances  – Custom  Deployment  

• Guaranteed  Availability  – Auto  Redeployment  in  Case  of  Failures

In-­‐Memory  Data  Fabric:  Service  Grid

Page 15: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

Coding  Examples:  Service  Grid

• Coding  Examples  – Streamer  as  Cluster  Singleton

Page 16: Apache’IgniteTM In6Memory’Data’Fabric’In’Action’ · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

Apache®,  Apache  Ignite,  Ignite®,  and  the  Apache  Ignite  logo  are  either  registered  trademarks  or  trademarks  of  the  Apache  Software  Foundation  in  the  United  States  and/or  other  countries.

ANY  QUESTIONS?

Thank  you  for  joining  us.  Follow  the  conversation.

https://ignite.apache.org

@apacheignite @dsetrakyan

https://ignite.apache.org

Apache Ignite for Node.js Developers - GridGain Systems · Apache Ignite Support –Faster Time to Reliable Ignite •Get up and running faster with 2 hours initial consultation •Ensure

Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

In-Memory Performance Durability of Disk...Apache Ignite In-Memory Computing Platform Memory-Centric Storage Ignite Native Persistence (Flash, SSD, Intel 3D XPoint) Third-Party Persistence

August 2016 HUG: Better together: Fast Data with Apache Spark™ and Apache Ignite™

Apache Cassandra Ignite Presentation

Apache Mahout - events.static.linuxfound.org · Suneel Marthi did a ‘Distributed Machine Learning with Apache Mahout’ talk at Big Data Ignite, Grand Rapids, Michigan - September

Turbocharge your SQL queries in- memory with Apache® Ignite™€¦ · memory with Apache® Ignite ... Da+a Grid NoSQL DB IN-MEMORY DATA FABRIC JAVA S+reaming Grid HDOOP HADOOP OLAP

Be#er%Together–)Apache%Ignite%&%Apache%Spark% · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)So8ware)Foundaon)in)the)United)States)and

Top 7 Apache Ignite FAQs From Around the World! · • Brief architecture overview of Apache Ignite • Which APIs can I use with Apache Ignite? • How can I get faster data manipulation

Accelerating the Hadoop data stack with Apache Ignite, Spark and Bigtop

The Apache Ignite book - Leanpubsamples.leanpub.com/ignitebook-sample.pdf · Apache Ignite is one of the most widely used open source memory-centric distributed, caching, and processing

IMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing Hub

Ignite Technical Overview - Christos...Apache Ignite Project • 2007: Nikita & Dmitriy create the first version of GridGain • Oct. 2014: GridGain contributes Ignite to ASF • Aug

Apache Ignite - In-Memory Data Fabric

Apache Ignite and Apache Spark - GridGain Systems · Ignite and Spark Integration Spark Application Spark Worker Spark Job Spark Job Yarn Mesos Docker HDFS Spark Worker Spark Job

Fast, In-Memory SQL on Apache Cassandra with Apache Ignite (Rachel Pedreschi, GridGain / Igor Rudyak, EPAM) | C* Summit 2016

TensorFlow with Apache Ignite and Machine and Deep ... · Achieving Continuous Machine and Deep Learning with Apache Ignite and TensorFlow Yuriy Babak 2019 © GridGain Systems

Continuous Machine and Deep Learning at Scale With Apache Ignite · 2020-03-11 · Mainframe Ignite Persistence NoSQL Hadoop Persistent Layer RDBMS Machine and Deep Learning Messaging

Reactive Principles In Data Science€¦ · Grid Gain / Apache Ignite A Telepathic In Memory Computing Fabric. Grid Gain / Apache Ignite and Spark Both share similar goals but "technologies

Better together: Fast Data with Apache Spark™ and Apache Ignite™ by Mike Griggs

TEST DRIVING STREAMING AND CEP ON APACHE IGNITEgo.gridgain.com/rs/491-TWR-806/images/IMCSummit... · WHAT ARE WE GOING TO DO TODAY? ¡ An Overview of Apache Ignite Streaming and CEP

Архитектура Apache Ignite .NET

An Introduction to Apache Ignite - Mandhir Gidda - Codemotion Rome 2017

Apache®, Apache Ignite, Ignite®, and the Apache Ignite ... · Apache®, Apache Ignite, Ignite®, and the Apache Ignite logo are either registered trademarks or trademarks of the

Overview SCALE14x 2016. Agenda/Schedule -Apache Bigtop Overview -Apache Spark Overview/Getting Started -Lunch Break -Apache Ignite -Workshop, tutorial,

Security Guide Apache Ignite and GridGain...2003/04/20  · Mainframe Ignite Persistence NoSQL Hadoop Persistent Layer RDBMS Machine and Deep Learning Messaging Streaming Events Transaction

High Performance in-memory computing with Apache Ignite

Pega Platform 7 · server mode, force the Pega Platform node to start in client mode and open ports for Apache Ignite. See Apache Ignite client-server clustering topology. • Verify

Distributed Systems Coursework · Apache Ignite Overview • In-memory computing platform • High-performance transactions • Real-time streaming • Fast analytics • Single,

INTRODUCING APACHE IGNITE An Apache Incubator Project

Apache Ignite - JCache and Beyond

Getting Started With Apache Ignite SQL · •Ignite SQL Basics: DML, DDL, connectivity, configuration •Affinity Co-Location and Distributed JOINs •Beyond Memory Capacity: Disk

Apache Tomcat...Gemalto and the Gemalto logo are trademarks and service marks of Gemalto N.V. and/or its subsidiaries and are registered in certain countries. All other trademarks

Apache Ignite Extensions - Modularization

Troubleshooting Apache® Ignite™ · 2019 © GridGain Systems Apache Ignite Support –Faster Time to Reliable Ignite •Get up and running faster with 2 hours initial consultation