tales from the sweet shop - connect-community.de performance_i4... · deutsche börse ag shares...

22
www.eurexchange.com 8.4-1H1 and i4 @ Deutsche Boerse Sep. 28 th 2015 4 4 4 7 7 7 Tales from the sweet shop VSI OpenVMS 8.4-1H1 and hp i4 @ Deutsche Boerse Dr. Martin P.J. Zinser, Senior Expert Trading IT, Eurex Frankfurt AG September, 28 th 2015

Upload: dangnhi

Post on 27-Mar-2018

214 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 28th 2015114

102

135

170

182

213

116

129

177

204

214

227

000

000

000

231

241

209

134

134

134

217

217

217

Tales from the sweet shopVSI OpenVMS 8.4-1H1 and hp i4 @ Deutsche Boerse

Dr. Martin P.J. Zinser, Senior Expert Trading IT, Eurex Frankfurt AG

September, 28th 2015

Page 2: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

2

Agenda

• Group Deutsche Boerse

• Targets

• System Setup and Changes for 8.4-1H1

• Performance Observations

• Conclusion

Page 3: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 28th 2015

Group Deutsche Boerse

1

Page 4: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

Historical overview 1585–2014

1585 Beginning of organised exchange trading in Frankfurt/Main

1992 Deutsche Börse AG is established

1993 Deutsche Börse AG begins to operate Frankfurter

Wertpapierbörse (FWB®, the Frankfurt Stock Exchange)

1997 Launch of the electronic Xetra® trading platform

1998 The Eurex derivatives exchange is established on the basis of a

merger of DTB Deutsche Terminbörse and Swiss Soffex

2001 IPO of Deutsche Börse AG

2002 Full integration of Clearstream International;

Deutsche Börse AG shares included in the DAX® index

2007 Founding of an exchange for structured products: Börse Frankfurt

Zertifikate AG; Eurex acquires the US options exchange

International Securities Exchange Holdings, Inc. (ISE)

2011 Migration of the floor trading to Xetra® technology

2012 Full acquisition of the Eurex derivatives exchange

2013 Launch of 7 Market Technology family

2014 Increase of the interest held in the European Energy Exchange

(EEX);

Page 5: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

Settlement CustodyClearingTrading

Market data and technology-based services

Data feeds, market data, news services, reference data, reporting services, indices, external IT services, connectivity services, trading infrastructure

Cash / Derivatives market Clearing

Verification of trade-related informationCentral counterpartyRisk management

ListingConnectivity to international trading participantsOperation of open electronic order books

Post-trading

Custody of securitiesLiquidity managementRelated services, e.g. tax, corporate actions

Delivery of securities (in exchange for payment)Financing servicesCollateral management

Internal IT services, software development

Information technology

Deutsche Börse Group: exchange organisation and provider of financial services infrastructure with comprehensive product range

Page 6: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

Source: www.xetra.com > Trading > Trading participants, as at 30 June 2015

Easy and efficient access:

Xetra® – international participant network

211 participants:

105 participants in Germany

106 participants in other countries

Host system

Access point

Participant

Austria

Czech Republic

Hungary

Spain

Switzerland

France

LuxembourgBelgium

UKIreland

Italy

Bulgaria

Cyprus

Netherlands

Sweden

UAE

Austria Hong Kong

Germany

Page 7: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

1)Worldwide, more than 30 markets are currently operated using Deutsche Börse Group technology.

La Valetta

Malta Stock Exchange

New York

International

Securities Exchange

Vienna

Wiener BörseParis

European

Power

Exchange

Sofia

Bulgarian

Stock Exchange

Ljubljana

Ljubljana Stock Exchange,

Southpool

Helsinki

NASDAQ OMX

Dublin

Irish Stock

Exchange

Spot market

Derivatives market

Berlin

Xontro

Dusseldorf

Xontro

Frankfurt / Main

Xontro

Xetra®

Eurex®

Eurex Bonds®

Eurex Repo®

Börse Frankfurt

Börse Frankfurt Zertifikate

GridLoss Service

Zurich

Eurex Zürich

Prague

Prague Stock Exchange

Germany

George Town

Cayman Islands

Stock Exchange

Mumbai

BSE

Budapest

Budapest Stock Exchange

Hamburg

Xontro (Hamburg/

Hanover)

Leipzig

EEX

Capacity Service

Munich

Xontro

Stuttgart

Xontro

Oslo

NOREXCO

Exchanges and trading venues all over the world use

Deutsche Börse Group technology1)

Page 8: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

Eurex Clearing

Eurex T7

Xetra®

CCP

CASCADE KADILION

Creation CustodyRTS

CEF®

Optimise

StatistiX®WSSXIS

Settlement CustodyClearingTrading

Information

Deutsche Börse IT provides powerful applications that success-

fully support the Groups Services along the process chain

Page 9: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 28th 2015

Targets

2

Page 10: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep, 29th 2015

10

Targets

What are the (non-functional) goals of an exchange trading system?

• 100% Availability

• … during trading hours (i.e. there is still a time window for maintenance)

• Quick recovery of the system in case of medium/large disaster

• Fair and level playing field for all market participants

• Predictable system behaviour for market participants (esp. In case of problems)

• Elastic reaction to quickly increasing load (ms time scale)

• Low latency for order/quote transactions (magnitude 102 us)

Page 11: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep, 29th 2015

11

Targets

Which distribution is preferred by customers?P

rob

ab

ilit

y

Processing Time

short long

Page 12: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep, 28th 2015

System setup

3

Page 13: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

Simplified schematic Data flow

GW Host

R

o

u

t

e

r

MatchingM

a

r

k

e

t

D

a

t

a

Matching

Matching

Matching

GW

GW

GW

GW

GW

TCP UDP

Stream A

Stream B

Mailbox Mailbox

Page 14: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

14

Required SW changes

• Started conformance testing with field test version of 8.4-1H1

• This identified itself as “E8.4-1H1”

• “Serious problems” with the following DCL construct

• Solution: Remove code path keeping compatibility to VAX/VMS 5.4

and earlier

• No further code changes and/or recompiles required

$ IF F$GETSYI("VERSION") .LTS. "V5.5“

Page 15: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep, 28th 2015

Performance

Observations

4

Page 16: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

16

Performance observation - “Free” orders

• Expectation: CPU frequency scaling: i4/i2 = 2.53 GHz/1.73 GHz 46%

• Observation:• Optimized products:

150 us / 225 us 33%

• Standard products:

275 us / 400 us 31%

• Standard products + Broadcast

275 us / 550 us 50%

Page 17: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

17

Performance observation - “Busy” products

• ETF products: Lots of price updates (driven by index(future))

• Data shown here does include queuing effects

• Observation: 575 us / 1250 us 54%

Page 18: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

18

Performance observation - Outliers

• Outliers are a problem for market participants

• Measurement of extremely long order transactions for stocks in the DAX

index

• Percentage decreased by more than a factor of two with the move to i4

Page 19: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

19

Process Layout

BL870c i4

Socket

0

CPU

0

NETACP

DECW

7

FP:PK

6

FP:FG54

3

FP:BG

2

FP:EW,PE

1

ME1_R

Socket

1

CPU

0

FP: PK

7

FP:EW

6

FP:EW

5

FP:EW

MD

4

FP:EW

Router

3

FP:EW

2

FP:EW

1

FP:EW

Socket

2

CPU

0

FP:EW

7

ME1_P

6

FP:EW

5

FP:EW

4

FP:EW

3

FP:EW

2

FP:EW

1

FP:EW

Socket

3

CPU

0

ME2_R

7

ME5_P

6

ME5_R

5

ME4_P

4

ME4_R

3

ME3_P

2

ME3_R

1

ME2_P

Page 20: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

20

Performance observation – IP Congestion

• Attempt to load servers with more optimized products

• Inbound path (TCP) somewhat affected, but still ok

• Outbound path (2 x UDP) considerably degraded, back to i2 level

• Looking forward to 8.4-2 and VSI TCP/IP!

Page 21: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep, 28th 2015

Conclusion

5

Page 22: Tales from the sweet shop - connect-community.de Performance_i4... · Deutsche Börse AG shares included in the DAX ... Router 3 FP:EW 2 FP:EW 1 FP:EW Socket 2 CPU 0 FP:EW 7 ME1_P

www.eurexchange.com

8.4-1H1 and i4 @ Deutsche Boerse Sep. 29th 2015

22

Conclusion

• The move to Poulson/i4 was very smooth from a SW point of view

• Overall performance gain as one would expect from a simple

scaling of CPU frequencies, about 30-40% just by HW upgrade

• For our application

- extremely bursty transaction rate

- lots of IP network IO (both TCP and UDP)

Room for improvement, to utilize full number of cores

• Boot Camp: VSI is working on this, looking forward to 2016