© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Amadeus Air Availability 2.5 MOps/s, Now on Couchbase!

Stéphane RocheR&D Project Manager NoSQL Technologies

Architecture, Quality and Governance

Santa Clara, June2015

Page 2

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Agenda

1. Amadeus is Not Only about Mozart!

2. Air Shopping platform, low latency stores

3. R-Box, distribution and ultra-high scalability

4. Hotel shopping and booking, ultra-high availability

5. Why Couchbase 4.X is a Must have for us?

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Amadeus is Not Only about Mozart!

Amadeus is a technology company dedicated to the

global travel industry.

We are present in 195 countries with a worldwide team of more than 12,000 people. 

Our solutions help improve the

business performance of travel agencies, corporations, airlines,

airports, hotels, railways and more.

Page 4

Amadeus in a few words

© 2

01

5 A

mad

eu

s IT

Gro

up

SA

Page 5

AIRLINES

HOTELS

CA

RS

RAIL

FER

RY

CR

UIS

E

INSURANCE

TOUR OPERATORS CONTENT PROVIDERS

TRAVEL INTERMEDIARIES

AIR

PO

RTS

CORPORATIONS

Our customers

GROUND HANDLERS

© 2

01

5 A

mad

eu

s IT

Gro

up

SA

Page 6

Distribution IT

• Data centre

• Platforms and applications

• Sales & marketing infrastructure

• Customers

In common

Distribution & IT BusinessesTwo complementary business lines

© 2

01

5 A

mad

eu

s IT

Gro

up

SA

Page 7

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Amadeus, airlines partners

121 airlines contracted for Reservation and Inventory

800 millions passengers boarded each year by 2015(a)

+93 airlines

(List of airlines shown is a sample and not exhaustive. Passengers generated by airlines that are Altéa customers with Altéa Inventory and/or Departure Control modules implemented or have contracted the migration to any of these two modules. Estimated annual

PBs calculated as follows: (i) annual PBs migrated to Altéa by 31 December 2010 plus (ii) annual PBs estimated to be migrated to Altéa by 31 December 2013 based on contracts signed through 31 December 2010; all annual PB volume data based on actual

2010 traffic volumes where migrated before 1 January 2011, remainder estimated using historic traffic volumes and therefore exclude any volume trend assumptions

(a) 2015 estimated annual PB calculated by applying the IATA’s regional air traffic growth projections to the latest available annual PB figures to the 121 airlines contracted to Altéa as of 31 December 2012

Page 8

_ Amadeus today3Robust global operations

© 2

01

5 A

mad

eu

s IT

Gro

up

SA

1.6+billiondata requests processed per day

525+milliontravel agencybookings processed in 2014

695+millionPassengers Boarded (PBs) in 2014

95%of the world’s scheduled network airline seats

16 PetaBytesOf Storage

500,000+ database disk IO/second

4,800+ IT Changes per Month

Page 9

Couchbase & Amadeus

Q2 2013Prototyped 2 use cases with Couchbase (air shopping/inventory)

Q3 2014Couchbase went live for Air Shopping

2015Air Shopping ramp-up

Q4 2013Signed Premium Partnership with Couchbase

Q4 2014Implementing a new use case (hotel shopping & booking)

Q4 2015Couchbase will go live for Air Inventory

© 2

01

5 A

mad

eu

s IT

Gro

up

SA

Q1 2016Couchbase production readiness for hotel shopping & booking

Q2 2016New use case R-Box) live in production

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Air Shopping Platform (Air Availability)

High-throughput, low latency,key/value stores

2

Page 11

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

The Air Shopping Flow

Priced solutions

End user

Amadeus

1 Travel request

2 Route Explorer 3 Connection Builder 5 Faring

6

1A Agencies

Airline.com Self-serviceCall Centers

B2T / B2BAgent.com

Flight selection

4 Flt Validation

Availability calculation

Page 12

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Legacy Availability Cache Architecture

Availability Data Services

Miss: read Database

Memcached Servers, 12 servers * 1TB

Miss: Populate Memcached

Availability Services (600 servers)

MySQL Farm, 7 * 4 servers

Shard 1 Shard 2 Shard 3 Shard 4 Shard 5 Shard 6 Shard 7

Page 13

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

_ Simplifying the architecture to • Remove the complex storage logic implemented in the application layer• Decrease operational costs due to:

• Hardware usage optimisation• Day to day effort to operate

_ Online rebalancing• Extending capacity currently takes careful operations, many days of

preparation and many days to warm up the new cache

_ Cold starts• Memcached (very rare) outages are (very) disruptive

Problems we are trying to solve

Page 14

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Availability Cache New Architecture

Availability Data Services

Couchbase Servers, 30 servers * 1TB

Availability Services (600 servers)

Page 15

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Availability Data Workloads

GET 2.6 M/s

SET 1 M/s

Already ramp-up 50%

Already ramp-up 7%Including Major Airlines

Page 16

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

_ Couchbase is fast• Microseconds adds up quickly when exploring thousands of travel solutions• Our cache queries returns in less than 0.5ms

_ Couchbase is predictably fast• Long tail latencies would kill our application response time• Couchbase leverages our memory capacity

_ Couchbase online rebalancing works without impacting our query latency

Couchbase benefits

Page 17

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Asked for it, Got it

_ Ability to read on replica (since 2.1.0)• In failover scenarios, we prefer to be non

consistent but still provide an answer

_ Multithreaded read/write operations (since 2.1.0 + significant improvements in 3.0.1 )• Our workload is write intensive• We want to get the most of our Fusion IO PCI-E

SSDs

_ Rack awareness (since 2.5.0)• Our data center has 6 firecells, we can lose one of

them without losing any data

_ Incremental Backup and Restore (since 3.0.0)

_ XDCR filtering (to be release in 4.0.0)

Strong Partnership

Build our story together

_ Couchbase contributes to our Main Project Kickoff Meetings

_ Dedicated Workshop sessions organized

_ Set Task force when required

_ Involved in our training sessions• R&D• Global Operations

Page 18

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

_ Improvement (compared to 2.5.1)• Automatic, optimized resource utilization

_ Consequences• Same volume processed with less writing threads• Increase of the write throughput

+ 30% write throughput

- 20% CPU consumption on I/O threads

Couchbase 3.0.3 our current choice for Production

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

R-Box

DistributionUltra-high Scalability

3

Page 20

R-Box: an extension of the shopping platform

Projecting availability calculations in remote data centers

Erdi

ng D

atac

ente

r

Alte

a In

vent

ory

Data

cent

er A

Data

cent

er C

R-Box

R-Box

R-Box

R-Box

R-Box

Polling Requests

Polling Requests

R-Box

R-Box

R-Box

Polling Requests

Couchbase XDCR is a Must!

Page 21

What’s in the box?

265ced1609a17cf1a5979880a2ad364653895ae8

R-BoxShell Layer

Core Layer

Data Synchronization

Live Data (Flight, Counters, Yields…)

Data Flow Log/Stat Flow Polling Flow

APP

ComputeServer

Data Synchronization

Caches Data (ABR, RFD, Codeshare)

File Distribution(bittorrent)

CacheServer

Log & Stat Flow

Log Server

LogServer

Administration Tool

Admin API (XML)

Admin Server

AdminServer

Polling Request(XML, EDI)

ESB

ESBServer

Couchbase NoSQL

NoSQLServer

NoSQLServer

APP

ComputeServer

APP

ComputeServer

APP

ComputeServer

APP

ComputeServer

APP

ComputeServer

Actually, a mini data center

Administration and management

Storage for live data: Couchbase

Storage for static data

Middleware components (ESB)

Application servers

Monitoring and logs

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Hotel shopping and booking

Ultra-high availability

4

Page 23

_ Largest hotel group worldwide• A bit more than 4,700 properties• About 680,000 rooms• Occupancy rate: 60-70%

_ Expected traffic: 80 M bookings/year

_ Amadeus to provide• Shopping services – 10,000 TPS• Booking

_ Strict SLAs

Intercontinental Hotels Group

Signed in March 2014

Page 24

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

(for mission critical and high-throughput applications)

Ultra-high availability

_ General trend of the market

_ Our target:

_ Complex infrastructure• Network, storage, databases, application servers, etc …

_ Not possible to achieve using conventional database engines

99.999 %99.95 %

Page 25

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Cross data center replication, allowing for creative topologies

Couchbase XDCR ring topology

Primary CB

Secondary CB

Shopping Shopping Shopping

Primary CB

Secondary CB

Shopping Shopping Shopping

Data Centre 1 Data Centre 2

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Why Couchbase 4.0 is a Must have for us?5

Page 27

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

_ XDCR filtering capability• For R-box

_ Couchbase Security fits the Security Standards• R-box and IHG projects are no more deployed in our own premises• Must enforce security

_ N1QL Query Capabilities / Global Secondary Indexes• A requirement of our IHG platform to retrieve Bookings

Couchbase 4.0 features already part of our designs

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Conclusion6

Page 29

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Couchbase delivers on what Amadeus values:

_ Scalability• Horizontal• Vertical

_ Predictability of raw performance

_ Operability

_ Complex distributed topologies (XDCR)

Key takeaways

© 2

01

4 A

mad

eu

s IT

Gro

up

SA

Thank you

You can follow us on:AmadeusITGroup

amadeus.com/blogamadeus.com