turbocharge your sql queries in- memory with apache® ignite™€¦ · memory with apache® ignite...

DENIS MAGDA Product Manager, Apache PMC Chair Turbocharge your SQL queries in- memory with Apache® Ignite™ www.ignite.apache.org #apacheignite

Upload: others

Post on 20-May-2020

18 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

DENIS MAGDAProduct Manager, Apache PMC Chair

TurbochargeyourSQLqueriesin-memorywithApache®Ignite™

www.ignite.apache.org #apacheignite

IN-MEMORY DATA FABRICSTRATEGIC APPROACH TO IMC

Page 3: Turbocharge your SQL queries in- memory with Apache® Ignite™€¦ · memory with Apache® Ignite ... Da+a Grid NoSQL DB IN-MEMORY DATA FABRIC JAVA S+reaming Grid HDOOP HADOOP OLAP

IN-MEMORY SQL GRID

ANSI-99SQLCompliantAggregations,groupby,sortingCross-cachejoins,unions,etc.

DMLandDDLJDBC,ODBC,NativeAPIsDistributed

AlwaysconsistentFaulttolerant

Page 4: Turbocharge your SQL queries in- memory with Apache® Ignite™€¦ · memory with Apache® Ignite ... Da+a Grid NoSQL DB IN-MEMORY DATA FABRIC JAVA S+reaming Grid HDOOP HADOOP OLAP

DISTRIBUTED COLLOCATED QUERIES

CollocatedModeAnykindofJOINs(ANSI-99)Datahastobecollocatedinadvance*

RecommendedmodeAvoidsdatamovementEnabledbydefault

Page 5: Turbocharge your SQL queries in- memory with Apache® Ignite™€¦ · memory with Apache® Ignite ... Da+a Grid NoSQL DB IN-MEMORY DATA FABRIC JAVA S+reaming Grid HDOOP HADOOP OLAP

DISTRIBUTED NON COLLOCATED QUERIES

Non-CollocatedModeNoneedtocollocatedataDatamovementonjoins

JustificationNotfeasibletoachievecollocationTosupport100%ofallSQLqueries

Page 6: Turbocharge your SQL queries in- memory with Apache® Ignite™€¦ · memory with Apache® Ignite ... Da+a Grid NoSQL DB IN-MEMORY DATA FABRIC JAVA S+reaming Grid HDOOP HADOOP OLAP

DISTRIBUTED DML

ANSI-99CompliantINSERTUPDATEDELETEMERGE

APIsJava,.NET,C++ODBC&JDBC

Page 7: Turbocharge your SQL queries in- memory with Apache® Ignite™€¦ · memory with Apache® Ignite ... Da+a Grid NoSQL DB IN-MEMORY DATA FABRIC JAVA S+reaming Grid HDOOP HADOOP OLAP

APACHE IGNITE WEB CONSOLE

ConfigurationWizardFullClusterConfigurationRDBMSSchemaImport

ManagementandMonitoringClusterMonitoringQueriesMonitoring

QueriesExecution

Page 8: Turbocharge your SQL queries in- memory with Apache® Ignite™€¦ · memory with Apache® Ignite ... Da+a Grid NoSQL DB IN-MEMORY DATA FABRIC JAVA S+reaming Grid HDOOP HADOOP OLAP

APACHE ZEPPELIN

Page 9: Turbocharge your SQL queries in- memory with Apache® Ignite™€¦ · memory with Apache® Ignite ... Da+a Grid NoSQL DB IN-MEMORY DATA FABRIC JAVA S+reaming Grid HDOOP HADOOP OLAP

DATA ANALYSIS WITH TABLEAU

Page 10: Turbocharge your SQL queries in- memory with Apache® Ignite™€¦ · memory with Apache® Ignite ... Da+a Grid NoSQL DB IN-MEMORY DATA FABRIC JAVA S+reaming Grid HDOOP HADOOP OLAP

THANK YOU!

www.ignite.apache.org #apacheignite

Building)Consistentand)Highly)Available)Distributed ... · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)So8ware)Foundaon)in)the)United)States)and

Apache Ignite - In-Memory Data Fabric

Apache®, Apache Ignite, Ignite®, and the Apache Ignite ... · Apache®, Apache Ignite, Ignite®, and the Apache Ignite logo are either registered trademarks or trademarks of the

TensorFlow with Apache Ignite and Machine and Deep ... · Achieving Continuous Machine and Deep Learning with Apache Ignite and TensorFlow Yuriy Babak 2019 © GridGain Systems

Pega Platform 7 · server mode, force the Pega Platform node to start in client mode and open ports for Apache Ignite. See Apache Ignite client-server clustering topology. • Verify

Elegantes In-Memory Computing mit Apache Ignite und Kubernetes. @data2day

Apache Cassandra Ignite Presentation

Accelerating the Hadoop data stack with Apache Ignite, Spark and Bigtop

IMCS Apache Ignite as MPP Accelerator Ignite as MPP Accelerator Alexander Ermakov, CTO • About us • Why do traditional DWH needs in-memory grid? • Real Time Analytics for Telco

APACHE IGNITE AS A DATA PROCESSING HUB

Distributed Systems Coursework · Apache Ignite Overview • In-memory computing platform • High-performance transactions • Real-time streaming • Fast analytics • Single,

Apache ignite Datagrid

High Performance in-memory computing with Apache Ignite

Distributed Systems Coursework...Apache Ignite Overview • In-memory computing platform • High-performance transactions • Real-time streaming • Fast analytics • Single, comprehensive

and OLTP Use Cases with Apache Ignite Accelerate MySQL for … · 2017-04-27 · Accelerate MySQL for Demanding OLAP and OLTP Use Cases with Apache Ignite Peter Zaitsev, Denis Magda

Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’files.meetup.com/3168962/Apache-Ignite...Data...15.pdfApache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)Software)Foundation)in)the)United)States

INTRODUCING APACHE IGNITE An Apache Incubator Project

Be#er%Together–)Apache%Ignite%&%Apache%Spark% · Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)trademarks)of)the)Apache)So8ware)Foundaon)in)the)United)States)and

Troubleshooting Apache® Ignite™ · 2019 © GridGain Systems Apache Ignite Support –Faster Time to Reliable Ignite •Get up and running faster with 2 hours initial consultation

Apache’IgniteTM (Incubating))A)In:Memory’Data’Fabric’gotocon.com/dl/goto-chicago-2015/slides/DmitriySetraky… · · 2015-05-11meetup/) Apache®,)Apache)Ignite,)Ignite®,)and)the)Apache)Ignite)logo)are)either)registered)trademarks)or)

Top 7 Apache Ignite FAQs From Around the World! · • Brief architecture overview of Apache Ignite • Which APIs can I use with Apache Ignite? • How can I get faster data manipulation

Comparing Apache Ignite and Cassandra For HTAP Applications · 2018-09-30 · Off-heap Removes noticeable GC pauses Automatic Defragmentation Stores Superset of Data Predictable memory

Apache’IgniteTM)A)In6Memory’Data’Fabric’ · Features Apache Ignite Enterprise Edition In-Memory Data Grid CHECK In-Memory Compute Grid Real-Time Streaming & CEP Hadoop Acceleration

Fast, In-Memory SQL on Apache Cassandra with Apache Ignite (Rachel Pedreschi, GridGain / Igor Rudyak, EPAM) | C* Summit 2016

Apache Ignite Extensions - Modularization

Overview SCALE14x 2016. Agenda/Schedule -Apache Bigtop Overview -Apache Spark Overview/Getting Started -Lunch Break -Apache Ignite -Workshop, tutorial,

Stream Ingestion, Processing and Analytics Using In-Memory ... · Stream Ingestion, Processing and Analytics Using In-Memory Computing Denis Magda Apache Ignite PMC Chair ... –

Apache Ignite Persistence: зачем Persistence для In-Memory, и как он работает / Артем Шитов (GridGain)

In-Memory Performance Durability of Disk...Apache Ignite In-Memory Computing Platform Memory-Centric Storage Ignite Native Persistence (Flash, SSD, Intel 3D XPoint) Third-Party Persistence

In-Memory Computing, Storage & Analysis: Apache Apex + Apache Geode

In-Memory Performance Durability of Diskapachecon.com/euroadshow18/ignite-spark-iot.pdf · Ignite is a memory-centric store for Spark • No data movement from Ignite to Spark •

Архитектура Apache Ignite .NET

Apache Ignite and Apache Spark - GridGain Systems · Ignite and Spark Integration Spark Application Spark Worker Spark Job Spark Job Yarn Mesos Docker HDFS Spark Worker Spark Job

Apache Ignite for Node.js Developers - GridGain Systems · Apache Ignite Support –Faster Time to Reliable Ignite •Get up and running faster with 2 hours initial consultation •Ensure

August 2016 HUG: Better together: Fast Data with Apache Spark™ and Apache Ignite™