[rakuten techconf2014] [a-4] rakuten ichiba

1

Rakuten Ichiba.

Vol.01 Oct/25/2014

Takao Shiono

ISDOD(Ichiba Service Development and Operation Department), Rakuten Inc.

2

The purpose of this presentation is to introduce our

company ,Rakuten and share the issues for our futu

re development.

Objective

3

Agenda

1.About Rakuten1-1. Japan Business1-2. Global Business1-3. Business KPI

2.System Situation2-1. Network2-2. Database2-3. Application2-4. Summary

3.Organization

4

0. Introduce myself.

5

0. About meAbout my Career.2014/04/01 Rakuten Ichiba Development and Operation Department manager.

2013/06/27 Board of director of STYLIFE.

2012/03/30 Board of director of NETS PARTNERS.(- 1st Dec 2012.)

2011/11/17 Executive officer of RAKUTEN.Inc.

2011/10/22 Development Managing Officer.

2011/01/01 Japan Ichiba Section Manager & Senior Service Producer of Japan Rakuten Ichiba.

2009/05/01 Shopping & Auction Section Vice manager & Senior Service Producer of Auction.

2008/07/01 Portal Service Section Manager & Senior Service Producer of Infoseek.

2008/02/01 New Service Division Vice manager.

2007/04/01 Portal Produce Department manager.

2006/04/01 Portal media company Produce department.

2005/12/01 Portal media company Infoseek CWD/MKT Department manager.

2005/01/01 Corporate Development planning department & Quality Assurance team Supervisor.

2004/04/01 Rakuten Ichiba ID produce department.

2004/02/01 Development Head Office.

6

1. Rakuten

7

Rakuten,Inc.

Founded: February 7, 1997

IPO: April 19, 2000 (JASDAQ Stock Exchange)

Office: Rakuten Tower (Tokyo, Japan)

Employees: 9,311 (as of Dec. 2012)

Market Cap: JPY \2,332 Billion (as of Jan 17, 2014)

8

Most E-commerce

Uniqueness

Efficiency

Controllable Middleman.

Direct Sales

9

RakutenE-commerce

Uniqueness

Bazaar

Entertainment

Pla

tform

Encounter Platform

10

Rakuten Ecosystem

11

Expanding Business Portfolio

Taiwan

1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014

12

1-1. Japan Business

13

E-Commerce Personal Finance

Travel / Booking Pro SportsCommunication

Digital Contents

Service for Japan Customer

14

About Rakuten Ichiba in Japan

http://global.rakuten.com/corp/about/strength/data.html

15

About Rakuten Ichiba in Japan

http://global.rakuten.com/corp/about/strength/data.html

16

About Rakuten Ichiba in Japan

17

1-2. Global Business

18

Rapidly Expanding Worldwide from 2010

English-nization

/Globalization.

Global Expansion

19

Global Expansion

E-Commerce

eBook

Travel

Other services & businesses

Rakuten Institute of Technology

Development center

Head Office / Regional Headquarters

Head Office

• E-commerce in 14 countries and regions

• All services and businesses in 28 countries

20

JapanEU US

ASIA

Expanding Rakuten Ecosystem

21

Taiwan SingaporeIndonesia

89% 54%72%

Brand Awareness

* Aided awareness among general internet users.

Survey Method: Internet survey (panel sampling), July

2014

Malaysia

54%

22

1-3. Business KPI

23

Rakuten Ichiba GMS

0

100

200

300

400

500

600

700

800

900

1,000

2000 2001 2002 2003 2004 2005 2006 2007 2008 2009

(JPY bn)

2010 2011 2020?

10,000

・・・

over 1 trillion$ 1 = JPY 79 over $ 13 Billion

24

The BigData in Rakuten

• 93,870,000+ users

• 800,000,000+ purchase info

• 100,000,000+ reviews

• 3,000,000+ hotel booking per month

• 41,000+ merchants

• 60,000+ hotels

• Bank, Credit Card….

• Tremendous amount of search queries

• Several hundreds GB access log per day

• etc

• increasing more and more.

25

Rakuten Data Explosion

0

20000000

40000000

60000000

80000000

100000000

120000000

140000000

160000000

180000000

200000000

1997 2005 2006 2007 2008 2009 2010 2011 2012 2013

The number of item

26

2. System Situation

27

2-1. Network

28

Network Traffic Between 2005 to 2008

2.0G

4.0G

6.0G

8.0G

10.0G

12.0G

14.0G

2007/12 2008/12

16.0G

18.0G

20.0G

2009/12 2010/12 2011/12

トラフィックトレンドの実績と予測

2006/122005/12

15.0G

22.0G

29

Network Traffic Between 2005 to 2008

2.0G

4.0G

6.0G

8.0G

10.0G

12.0G

14.0G

2007/12 2008/12

16.0G

18.0G

20.0G

2009/12 2010/12 2011/12

トラフィックトレンドの実績と予測

2006/122005/12

15.0G

22.0G

30

Network Traffic From 2009.

2009 2010 2011 2012 2013

Victory sale 108Gbits/sec

Super sale 67Gbits/sec

Super sale 42Gbits/sec

31

Reason of Data Increase

32

2-2. Database

33

History of Database

M9000

(2009)

ExaData

(2013)SF E25K

(2004)

SF 15K

(2002)

E10K

(2001)E420R

(1999)

E4500

(1999)

E450

(1997)

1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014

34

Nothing changed for over 10 years

History of Database

App App App App App

App App App App

Few APP

Few DB

Many APP

Many DB

35

Issues

We have to set the capacity size manually. It is a database specification.

- Max extents

- Max pagesize

- Highly loaded Database.

Data have been increasing day by day

We have to :

- Increase capacity

- Change HW/SW for EOSL

- Version up Software

- Patch Software

Too much maintenance

Causes:

- A large number of dependency ( Node=755, Edge=1,233 )

- Too many connections ( 1DB ⇔ 66 Application )

- Diverse versions ( OS, MW, programing language, script )

Difficult to manage/use the data

36

2-3. Application

37

DB has not been abstracted.Each App connect to DB directly.

Case 1

38

2-3. Application

DB

App A App B App C

API α

App D

Merchant / Consumer

Front

API

Data

If we need to change our database…

Case 1.

39

2-3. Application

DB

App A App B App C

API α

App D

Merchant / Consumer

Front

API

Data

We have to modify & test many applications.

Case 1.

40

2-3. Application

DB

App A App B App C

API α

App D

Merchant / Consumer

Front

API

Data

We will integrate many connections to a single API.

Case 1.

41

2-3. Application

2 phase commit.

Case 2

42

API

InventoryOrder

Order Management tool for Merchant.

Mobile

Application

PC

Application

Order complete

R

It has to do INSERT to Order DB and do UPDATE to Inventory DB at the same time.If either one fails, data mismatch will occur. It is really risky.

Case2.

2-3. Application

43

2-3. Application

New API

InventoryOrder

Order Management tool for Merchant.

Mobile

Application

PC

Application

R

Queue

We are abolishing 2 phase commit.Order DB will be separated from Order application.

Order complete

Case2.

44

2-4. Summary

45

Action plans for future development

1. Reduce management difficultiesReduce App server

Reduce DB server

2. Reconstruct ApplicationReduce too much dependence on DB

‐ Decrease test scope

‐ Decrease development scope

3. Stop 2 Phase Commit (Change the

architecture)

‐ Decrease difficult session control

4. Reconstruct DB schema and design

46

3. Organization

47

Hiring Talented Engineers

Many employees have come to Japan.

48

Hiring Talented Engineers0 50 100 150 200

Japan

China

India

Korea

USA

Bangladesh

Philippines

Taiwan

England

Indonesia

Australia

Canada

Sri Lanka

Brazil

Algeria

Argentine

Swiss

Thailand

Chile

Nepal

Pakistan

Hungary

Republic

Vietnam

Hong Kong

Other

25+

49

Next Challenge

50

Ideal Goal

Engineers from our overseas companies will

become able to develop RMS together.

51

Summary

The purpose of this presentation is to introduce our company ,Rakuten and share the issues for our future development.

52