running hadoop on amazon ec2

26
Running Hadoop on Amazon EC2 Presented by 康康康 2013.01.11 1

Upload: -

Post on 25-Dec-2014

247 views

Category:

Technology


5 download

DESCRIPTION

東海大學 嵌入式虛擬化技術 final presentation

TRANSCRIPT

Page 1: Running Hadoop on Amazon EC2

Running Hadoop on Amazon EC2

Presented by 康志強2013.01.11

1

Page 2: Running Hadoop on Amazon EC2

• Introduction• 註冊 AWS• 使用 EC2• 安裝 Hadoop

Outline

2

Page 3: Running Hadoop on Amazon EC2

AWS 從 2006 年開始就提供一些雲端服務• Compute & Networking:

EC2 、 Elastic MapReduce 、 Route 53 …• Storage & Content Delivery

S3 、 CloudFront …• Database

DynamoDB 、 ElastiCache 、 RDS …

Introduction

3

Page 4: Running Hadoop on Amazon EC2

• Deployment & ManagementCloudFormation 、 CloudWatch …

• App ServicesSES 、 SWF 、 SQS …

Introduction

4

Page 5: Running Hadoop on Amazon EC2

Introduction

5

Page 6: Running Hadoop on Amazon EC2

– 連上 Amazon web services 註冊 , 在右上角有

註冊 AWS

6

Page 7: Running Hadoop on Amazon EC2

– 輸入姓名 ,e-mail 以及密碼就可以繼續下一步申請的動作了

註冊 AWS

7

Page 8: Running Hadoop on Amazon EC2

– 這邊需要輸入個人資料

註冊 AWS

8

Page 9: Running Hadoop on Amazon EC2

– 輸入信用卡

註冊 AWS

9

Page 10: Running Hadoop on Amazon EC2

– 電話驗證

註冊 AWS

10

Page 11: Running Hadoop on Amazon EC2

– *Create Instance登入 https://console.aws.amazon.com/ec2

按下中間  "Launch Instance“

使用 AWS

11

Page 12: Running Hadoop on Amazon EC2

1. Choose AMI2. Choose Instance Type3. Configure Instance4. Add Storage5. Tag Instance6. Configure Security Group7. Review

使用 EC2

12

Page 13: Running Hadoop on Amazon EC2

– Step 1: Choose an Amazon Machine Image (AMI)

使用 EC2

13

Page 14: Running Hadoop on Amazon EC2

– Step 2: Choose an Instance Type

使用 EC2

14

Page 15: Running Hadoop on Amazon EC2

– Step 3: Configure Instance Details

使用 EC2

15

Page 16: Running Hadoop on Amazon EC2

– Step 4: Add Storage

使用 EC2

16

Page 17: Running Hadoop on Amazon EC2

– Step 5: Tag Instance

使用 EC2

17

Page 18: Running Hadoop on Amazon EC2

– Step 6: Configure Security Group

使用 EC2

18

Page 19: Running Hadoop on Amazon EC2

– Step 7: Review Instance Launch

使用 EC2

19

Page 20: Running Hadoop on Amazon EC2

– *Create new key pair

使用 EC2

20

Page 21: Running Hadoop on Amazon EC2

– 等個幾分鐘,出現

使用 EC2

21

Page 22: Running Hadoop on Amazon EC2

–登入你的主機 ,找出 Public IP

使用 EC2

22

Page 23: Running Hadoop on Amazon EC2

– SSH 遠端連線EC2 所產生的 Key 附檔名為 *.pem Windows 下需要的是 *.ppk ,用 puttygen 轉換

使用 EC2

23

Page 24: Running Hadoop on Amazon EC2

– *SSH 遠端連線 ,ID: ubuntu

使用 EC2

24

Page 25: Running Hadoop on Amazon EC2

– 參考作業 五

安裝 Hadoop

25

Page 26: Running Hadoop on Amazon EC2

• 報告完畢… .

26