jax london 2013

Steve Millidge | C2B2

Fast Data: Parallel Processing on the Grid

www.c2b2.co.uk blog.c2b2.co.uk @c2b2consulting

The Leading Independent Middleware Experts

SAFE HARBOR

This talk may contain nonsense.

WHO AM I

Founder C2B2Java since 1.0 EG Member JSR107 and JSR347 (bit dead)

Our MissionWe ensure the middleware that forms the foundation of our customer’s mission critical systems is Fast, Reliable, Manageable and Secure.

Data PerformanceProblem?

What do you mean?

Diagnose Before

You Prescribe

Measure Everything!

Algorithm?

CAPACITY?Can you add more?

CPUDiskMemoryBandwidth

SCALABILITY?

1 2 3 40

Linear Scalability

Typical Scalability

Ability to add more capacity in response to more demand.

Without a reduction in performance!

LATENCYTime delay in requesting an operation and it being initiated

1Gb Ethernet : 25 – 30MB/s10Gb Ethernet : 250 – 350MB/s

Infiniband : 6GB/s (maybe)

PING TIMESLocal : 57µsLAN segment : 300µsLAN: switches : 4msUK : 30msUSA : 100ms3G : 100s ms

GRANULARITY?

Typical SSD Speed540MB/s

Source: tomshardware.com

Spinning Rust

Disk BUS SpeedsSATA 1.0 : 150MB/sSATA 2.0 : 300MB/sSATA 3.0 : 600MB/sSAS : 600MB/sFibre Channel : 1GB/sInfiniband : 1GB/s

DDR3 1600 : 12.8GB/s

Source www.cs.virginia.edu Approx: 3-5GB/s per cpu still about 1 order magnitude faster than SSD and scales with coresThe general rule for STREAM is that each array must be at least 4x the size of the sum of all the last-level caches used in the run, or 1 Million elements -- whichever is larger.

MEMORYIS

FAST!Cache Data

InMemory

“As an extreme example, several current high-end machines run simple arithmetic kernels for out-of-cache operands at 4-5% of their rated peak speeds --- that means that they are spending 95-96% of their time idle and waiting for cache misses to be satisfied”http://www.cs.virginia.edu/stream/ref.html

PARALLELIS

THE FUTURE!

Other manufacturers are available ;-)

Settle into soft grain leather seats with 10/6 way electric adjustment and heating for driver and passenger. The soft grain stitched instrument panel and Gloss Rich Oak veneer complete the luxurious look, while assertive 18 inch Vela alloy wheels further enhance the dynamic exterior.

The rear parking aid and Touch-screen visual indicator make slipping into tight spaces easy, while distractions at night are reduced by auto-dimming rear view mirrors. The Meridian™ 380W Sound System, with Digital Audio Broadcasting (DAB) radio receiver and Front Media Interface with USB and iPod® connectivity, lets you listen to your favourite music in rich detail.

XF PREMIUM LUXURY

http://www.datasciencecentral.com/forum/topics/the-3vs-that-define-big-data

Application

Key Partition

Application

Key Partition

Application

Key Partition

Application

Key Partition

public static void main( String[] args ) { CacheManager cacheManager = Caching.getCachingProvider().getCacheManager();

MutableConfiguration<String, String> config = new MutableConfiguration<String, String>();

cacheManager.configureCache("C2B2",config);

Cache cache = cacheManager.getCache("C2B2");

cache.put("Key", "Value");

System.out.println(cache.get("Key")); }

http://blog.c2b2.co.uk/2013/08/jsr107-getting-started.html

Consistent Hashing

Key SpaceHash Ring

Node 1Hash

Node 2Hash

Node 3Hash

Node 4Hash

Key Hash

Key Partitioning

• Keys Assigned Partition via Hash

• Nodes Own a Partition

• Number of Partitions Fixed

• Number of Nodes isn’t

Partition

Application

Key Partition

Application

Key Partition

Application

Key Partition

Application

Key Partition

NODECRASH!!!

Application

21 Amazon m2.xLargeMemory Instance with 17Gb RAM3 Nodes Per Instance with 4Gb 64bit JVM Heap + 5 Gb OS63 Cluster Nodes252 Gb JVM Heap AvailableApprox 125Gb Data in the Grid when taking into account duplicates42 vCPUsApprox $3633 per month

Application

Key Partition

Application

Key Partition

Application

Key Partition

Application

Key partition

1Gb Ethernet : 25 – 30MB/s10Gb Ethernet : 250 – 350MB/s

Infiniband : 6GB/s (maybe)

Application

CodeCodeCodeCode

Class Size of code to Serialize is a few Kb

// Invoking a MapObject oResult = map.invoke(key, agent);

// Invoke on a subset of the cacheNamedCache map = CacheFactory.getCache("trades");Filter filter = new AndFilter(new EqualsFilter("getTrader", traderid), new EqualsFilter("getStatus", Status.OPEN));Map mapResults = map.invokeAll(filter, agent);

// The Agent Interfacepublic interface EntryProcessor extends Serializable { public Object process(Entry entry); Map processAll(Set setEntries);}

<T> T invoke(K key, EntryProcessor<K, V, T> entryProcessor, Object... arguments) throws EntryProcessorException;

<T> Map<K, T> invokeAll(Set<? extends K> keys, EntryProcessor<K, V, T> entryProcessor, Object... arguments);

T process(MutableEntry<K, V> entry, Object... arguments) throws EntryProcessorException;}

• Financial Risk Calculation– Can I book this Order

• Bet Placement– Can I place this Bet

• Hotel Availability Search– What hotels are available

• Web Translation– Gather Translated Text

Application

• Consumer Trend Analysis– Who orders what when

• Route Optimisation– Delivery Trucks

• Social Graph Search– Patterns in social media

graphs

• Fraud Detection– Transaction analysis

Application

public interface CacheEntryListener<K, V> extends EventListener {

public interface CacheEntryUpdatedListener<K, V> extends CacheEntryListener<K, V> {

/*** Called after one or more entries have been updated.** @param events The entries just updated.* @throws CacheEntryListenerException if there is problem executing the listener*/ void onUpdated(Iterable<CacheEntryEvent<? extends K, ? extends V>> events) throws CacheEntryListenerException;}

• Product Recommendations– Related products

• Alerting– Truck has Stopped!

• Financial Position Calc– Check regs during booking

• Nudge Purchasing– 5 people are looking at this

hotelApplication

Application

http://blog.c2b2.co.uk/2012/06/infinispan-event-push-to-tomcat.htmlhttp://demo.c2b2.co.uk:8080/infinispan/

CoherenceGlassFishWebSocket

http://demo.c2b2.co.uk:7080 or Full URLhttp://demo.c2b2.co.uk:7080/CleanStockTicker/stockticker.jsphttp://blog.c2b2.co.uk/2012/10/java-one-2012-slides-and-code.html

MEMORYIS

Cache DataIn

Memory

PARALLELIS

THE FUTURE!

Send ProcessingAcross theData Grid

PUSH IS HERE

Data Grids + Event Listeners +

WebSockets =

Real Time Push

RememberYou Have a

Latency Problem!

jax london 2013

mbs sata

mbs infiniband

mbs sas

gbs infiniband

mbs fibre channel

cachemanager cachemanager

s lan segment

ms usa

Technology

performance metrics for your delivery pipeline - jax london...

jax clinical knowledgebase (jax ckb) tutorial

jax-rs 2.1 reloaded€¦ · #devoxxus jax-rs 2.1 reloaded...

jax chemical company · jax copper plating jax chemical...

jax london 2014 "building java applications for the cloud:...

spring 3.1 in a nutshell - jax london 2011

secure systems fundamentals - jax london 2021

jax-rs 2.0: new and noteworthy in restful web services api...

jax 2013: introducing eclipse orion

production microservices - jax london · 2018-06-20 ·...

jax london 2015 - architecting a highly scalable enterprise

java ee 6 & glassfish 3: light-weight, extensible, and...

v forge contents · jax - ahahah female sung jax - all jax...

jax london 2014 "moving to devops mode: easy, hard or just...

ssds, imdgs and all the rest - jax london

adobe flex at jax london 2011

personal retrospectives (jax london 2014 & w-jax 2014)

continuous delivery - jax london 2011

mapping, gis and geolocating data in java @ jax london

jax london keynote: the art of shifting perspectives