amazon ec2 and r cloud and r.pdfec2 instances instance type vcpu memory (gib) instance storage (gb)...
TRANSCRIPT
![Page 2: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/2.jpg)
RNASeq Pipeline
Map Reads to Genome (Tophat)
FASTQ File
Assemble Transcripts (Cufflinks)
Gene Level Estimate(FPKM)
SNP Discovery
Isoform Analysis
Significant Genes
Gene Fusions
![Page 3: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/3.jpg)
Pipeline development• Run sequencing simulation to determine
optimal coverage for typical experiments
• Vary number of reads, read length, paired-end
• Run though Tophat/Cufflinks
• Determine optimal coverage
• Want to generate 100 files x 5 replicates
• 500 - 700 files with 18 billion sequence reads
• ~ 1 TB total data
![Page 4: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/4.jpg)
Computing Resources
• Personal Laptop/Desktop
• Small server cluster at work(with limited access)
![Page 5: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/5.jpg)
Amazon Elastic Compute Cloud
![Page 6: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/6.jpg)
Outline
• Look before you leap
• Launching an Amazon EC2 instance
• Launching Multiple Instances for HPC Applications
![Page 7: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/7.jpg)
Look Before You Leap
![Page 8: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/8.jpg)
Banko & Brill, 2001
More Data vs. Better Algorithms
55Monday, June 21, 2010
“The Unreasonable Effectiveness of Data” - Peter Norvig 2010
http://www.youtube.com/watch?v=yvDCzhbjYWs
![Page 9: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/9.jpg)
Thoughts on Big Data
• Sure, Big Data Is Great. But So Is Intuition.http://www.nytimes.com/2012/12/30/technology/big-data-is-great-but-dont-forget-intuition.html
• What statistics should do about big data: problem forward not solution backwardhttp://simplystatistics.org/2013/05/29
• Most data isn’t “big”http://qz.com/81661/most-data-isnt-big-and-businesses-are-wasting-money-pretending-it-is/
![Page 10: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/10.jpg)
Look before you leap
• Optimize code(e.g. use apply instead of for loop)
• Performance testing(I/O, Memory, or CPU bound)
• Work with subset of data
• Quality control testing using positive and negative controls
![Page 11: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/11.jpg)
Getting started with Amazon EC2
Instance Store
Amazon EBS
Amazon S3
Bucket
Instance(from AMI)
Virtual Machine
![Page 12: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/12.jpg)
EC2 InstancesInstance Type vCPU Memory (GiB) Instance
Storage (GB)Network
Performance
t1.micro 1 0.615 EBS only Very Low
m1.small 1 1.7 1 x 160 Low
m1.medium 1 3.75 1 x 410 Moderate
m1.large 2 7.5 2 x 420 Moderate
m1.xlarge 4 15 4 x 420 High
m3.xlarge 4 15 EBS only Moderate
m3.2xlarge 8 30 EBS only High
c1.medium 2 1.7 1 x 350 Moderate
c1.xlarge 8 7 4 x 420 High
cc2.8xlarge 32 60.5 4 x 840 10 Gigabit
m2.xlarge 2 17.1 1 x 420 Moderate
m2.2xlarge 4 34.2 1 x 850 Moderate
m2.4xlarge 8 68.4 2 x 840 High
cr1.8xlarge 32 244 2 x 120 SSD
10 Gigabit
hi1.4xlarge 16 60.5 2 x 1,024 SSD 10 Gigabit
http://aws.amazon.com/ec2/instance-types/
![Page 13: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/13.jpg)
EC2 Pricing (per hour)Instance Type On Demand
InstanceSpot
InstanceReserved Instance
(1 Year of Medium Use)Reserved Instance
(1 Year of Medium Use)
t1.micro $0.020 $0.003 $54 $0.007
m1.small $0.060 $0.007 $139 $0.021
m1.medium $0.120 $0.013 $277 $0.042
m1.large $0.240 $0.026 $554 $0.084
m1.xlarge $0.480 $0.052 $1,108 $0.168
m3.xlarge $0.500 $0.0575 $1,217 $0.184
m3.2xlarge $1.000 $0.115 $2,434 $0.368
c1.medium $0.145 $0.018 $370 $0.054
c1.xlarge $0.580 $0.070 $1,480 $0.216
cc2.8xlarge $1.300 $0.270 $4,146 $0.540
m2.xlarge $0.410 $0.035 $651 $0.103
m2.2xlarge $0.820 $0.070 $1,302 $0.206
m2.4xlarge $1.640 $0.140 $2,604 $0.412
cr1.8xlarge $3.500 $0.343 $5,958 $0.930
hi1.4xlarge $3.100 $0.208 $5,973 $0.909
http://aws.amazon.com/ec2/pricing/
* as of 6/18/2013 for
US East
** For accurate pricing visit -->
![Page 14: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/14.jpg)
EC2 PricingData Transfer IN To Amazon EC2 FromData Transfer IN To Amazon EC2 From
Internet $0.00 per GB
Data Transfer OUT From Amazon EC2 To InternetData Transfer OUT From Amazon EC2 To Internet
First 1 GB / month $0.00 per GB
Up to 10 TB / month $0.12 per GB
Next 40 TB / month $0.09 per GB
Next 100 TB / month $0.07 per GB
Next 350 TB / month $0.05 per GB
Amazon EBS Standard VolumesAmazon EBS Standard Volumes
$0.10 per GB-month of provisioned storage$0.10 per GB-month of provisioned storage
$0.10 per 1 million I/O requests$0.10 per 1 million I/O requests
Amazon EBS Snapshots to Amazon S3Amazon EBS Snapshots to Amazon S3
$0.095 per GB-month of data stored$0.095 per GB-month of data stored
http://aws.amazon.com/ec2/pricing/
* as of 6/18/2013 for
US East
** For accurate pricing visit -->
![Page 15: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/15.jpg)
Snail Mail is Sometimes Faster
![Page 16: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/16.jpg)
Let’s do it!
![Page 17: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/17.jpg)
![Page 18: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/18.jpg)
![Page 19: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/19.jpg)
![Page 20: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/20.jpg)
![Page 21: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/21.jpg)
![Page 22: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/22.jpg)
![Page 23: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/23.jpg)
![Page 24: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/24.jpg)
![Page 25: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/25.jpg)
![Page 26: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/26.jpg)
![Page 27: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/27.jpg)
![Page 28: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/28.jpg)
![Page 29: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/29.jpg)
![Page 30: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/30.jpg)
![Page 31: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/31.jpg)
![Page 32: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/32.jpg)
![Page 33: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/33.jpg)
![Page 34: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/34.jpg)
![Page 35: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/35.jpg)
![Page 36: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/36.jpg)
example_keypair|
![Page 37: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/37.jpg)
-----BEGIN RSA PRIVATE KEY-----9q0d4md52izXfu27xbAnb3uAz5SBSIauqZo2C9L2c3JM2lUcj3kz6j8ErjjSg+hKv9kPcdPNqqYbfRNzaMU1XlVCIlm0F9ctEbwehXRE1FBwjLMIQ0AE9y0Um9/pmvU840MmR/C5Btgaf3dfHShWfO41sbnJr/wqUsdFvdPx87OEIDp6ifp5/GC7CXFLimVbOD+gHGe/B1Ge+qG5LXKsrjQjA9tbdeAzD0bN7JvYbXiWRR9wnEUne5Kzj/zVY/BO7Z2f++HLotQQSpajfDwOuDYsw+tYRoQvLgRiDC74glg3GJuOvMa1FPGB48Fu8iR6fxywHBeCzK2xiLNECgJAhB1PDiI4Wc1ECA4kaj6KC+/AXbJeLS98i18ATZKM0+FKznpuH7JIomPFyDVQiAHRdLh292V+sqP914aqI+G8IweajYntwfYv+ie7U7nqqUhypTYixWboq1oy/xOGlEEmJopfTFsuwix4nXJ4PGHn4xBBzEQ+H0EpUMdYkAA/szT9na0zxKJQzdbkf0YVCjEtWpw6axU1rja0K55ULg3jju6DKM/uz+lg9vAvdPKpubX9LwwBiAIYnOgYxBnIB4CfqhmqrgAWoRoHbqU8KovKw+rwBYl6dslDwwvEk0oX8Lg67t920RXOCOcXgCnCkgz6PUDWkbxf8f9AKWK21+u8ShuarH4Z+j5V58SyZxoYKHLzVO+LgeSCwBPrjyVn9icTAx5kWvJQot4VBSe3a0aFk/QUWMwecnz7OZCLfZ6VO8uj9QCpAGxD6NsvzmyLLhSjgyylHm6+zbX35WzdcH44507lgG0DbSxb3q6i3Sc3vsYpFjPgI0z4LuzeC3Bs8rw9qcKh4cpjhpBQyc/S1g6+vbkwII9OEjh6eBZrhfkd1s7eCWwrl865OJp+6WpcBMYRAjOlL6fOPzDLjhAeSWr5G/FuN1p1EOWib63HfsvxKU9DkLKdHdnL4B3lA8Eor/dZ8iYbiTx2xasv2SVHcYLCenG8X811LXiyMEQ25lm+XUu+FTXfhd3XaRq0Q+KHUMpxM77Bjj6omubDR96rDmCw1x156haFqfwHgDgWddyJj4wEB58G7kSj2U4Y+swVRfejrNlmgd4z/dz8OyvNVWS1+egbclVI7oL+R5TuMZyQoFbHuyPlExDUaESGqP0GZwMjtyGc1jij/9AJBzONJj3nH/Mf+l1Y1iPnk/87qM+h1LEJJol0p+aR3HggYPQNdc+D+aVm7rEbCh5THVHGUUxz7h787kfUKLcTcblqac21iE7Qy7XA09AOLJFFOwiUMpfr1A2jFEG5mHFQToRprEmy7D6j3Qbyn1b9DgVPdV+4kMTKaX2K1NasUJc+0VaUc1xFt8/+ErN1mLTcQBRDcn7mf1uZ7CMd+4ChigGJrQKDQClhxdS6ZgLDd89W2lhGZ+YoB3tYmaUAm4kIJpDFILPcU4tnUk8X9Z2akEjC9o4Q8s/9xvGFmna4tZKxmQQub1qlDb5rLTi5aLxcKz/mROFtB6GkYs9GU+yU7KttKQGKFAsFMxpGbfacjJqGvy0z/U+IkPUzcpc3ioFt1QD9kzWnbJx0YkyIShzdT6i4-----END RSA PRIVATE KEY-----
example_keypair.pem
note: this is not a real key pair
![Page 38: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/38.jpg)
![Page 39: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/39.jpg)
![Page 40: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/40.jpg)
![Page 41: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/41.jpg)
![Page 42: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/42.jpg)
![Page 45: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/45.jpg)
[astling@laptop ~]$ ssh -i example_keypair.pem \[email protected]
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ WARNING: UNPROTECTED PRIVATE KEY FILE! @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@Permissions 0644 for 'example_keypair.pem' are too open.It is recommended that your private key files are NOT accessible by others.This private key will be ignored.bad permissions: ignore key: example_keypair.pemPermission denied (publickey).[astling@laptop ~]$
![Page 46: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/46.jpg)
[astling@laptop ~]$ ssh -i example_keypair.pem \[email protected]
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ WARNING: UNPROTECTED PRIVATE KEY FILE! @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@Permissions 0644 for 'example_keypair.pem' are too open.It is recommended that your private key files are NOT accessible by others.This private key will be ignored.bad permissions: ignore key: example_keypair.pemPermission denied (publickey).[astling@laptop ~]$ chmod 400 example_keypair.pem[astling@laptop ~]$
![Page 47: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/47.jpg)
[astling@laptop ~]$ ssh -i example_keypair.pem \[email protected]
__| __|_ ) _| ( / Amazon Linux AMI ___|\___|___|
https://aws.amazon.com/amazon-linux-ami/2013.03-release-notes/There are 1 security update(s) out of 3 total update(s) availableRun "sudo yum update" to apply all updates.[ec2-user@domU-blah ~]$
Success!!
![Page 48: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/48.jpg)
Package Managers
• yum - Yellowdog Updater Modified(Red Hat, Fedora, CentOS)
• apt-get - Advanced Packaging Tool(Ubuntu, Debian)
![Page 49: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/49.jpg)
[ec2-user@domU-blah ~]$ sudo yum update
[ec2-user@domU-blah ~]$ sudo yum install R
[ec2-user@domU-blah ~]$ sudo yum install svn mercurial gcc-c++ [other packages...]
For Amazon/Red Hat
![Page 50: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/50.jpg)
[ec2-user@domU-blah ~]$ RR version 2.15.2 (2012-10-26) -- "Trick or Treat"Copyright (C) 2012 The R Foundation for Statistical ComputingISBN 3-900051-07-0Platform: x86_64-redhat-linux-gnu (64-bit)
R is free software and comes with ABSOLUTELY NO WARRANTY.You are welcome to redistribute it under certain conditions.Type 'license()' or 'licence()' for distribution details.
Natural language support but running in an English locale
R is a collaborative project with many contributors.Type 'contributors()' for more information and'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or'help.start()' for an HTML browser interface to help.Type 'q()' to quit R.
>
![Page 51: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/51.jpg)
For Ubuntu
$ sudo apt-get update
$ sudo apt-get upgrade
$ sudo apt-get install build-essential
$ sudo apt-get install r-base
$ sudo apt-get install r-cran-cluster r-cran-lattice r-cran-mass r-cran-mgcv r-cran-nlme r-cran-nnet r-cran-survival r-cran-rodbc
![Page 52: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/52.jpg)
Upload Code/Data
[astling@laptop ~]$ scp -r -i example_keypair.pem \path/to/stuff \[email protected]:path/to/folder
![Page 53: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/53.jpg)
Mount Ephemeral Storage
![Page 54: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/54.jpg)
includes 2x 420 GB instance storage
![Page 55: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/55.jpg)
![Page 56: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/56.jpg)
![Page 57: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/57.jpg)
![Page 58: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/58.jpg)
![Page 59: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/59.jpg)
Mounting the Instance Store
[ec2-user@ip-blah ~]$ df -hFilesystem Size Used Avail Use% Mounted on/dev/xvda1 7.9G 1.6G 6.3G 20% /tmpfs 3.7G 0 3.7G 0% /dev/shm/dev/xvdb 414G 199M 393G 1% /media/ephemeral0[ec2-user@ip-blah ~]$
where is /media/ephemeral1 ??
![Page 60: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/60.jpg)
Mounting the Instance Store
[ec2-user@ip-blah ~]$ ls /devautofs full input loop7 ppp stderr ttyS2 vcsa xvda1block fuse kmsg loop-control psaux stdin ttyS3 vcsa1 xvdbbtrfs-control hvc0 log mapper ptmx stdout urandom vcsa2 xvdcchar hvc1 loop0 mem pts tty vcs vcsa3 zeroconsole hvc2 loop1 net random tty0 vcs1 vcsa4core hvc3 loop2 network_latency root tty1 vcs2 vcsa5cpu hvc4 loop3 network_throughput sda1 tty10 vcs3 vcsa6cpu_dma_latency hvc5 loop4 null sdb tty11 vcs4 vga_arbiterdisk hvc6 loop5 oldmem sdc tty12 vcs5 vhost-netfd hvc7 loop6 port shm tty13 vcs6 xen
[ec2-user@ip-blah ~]$
![Page 61: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/61.jpg)
Mounting the Instance Store
$ sudo mkfs /dev/xvdc$ sudo mkdir /media/ephemeral1$ sudo mount -t ext4 /dev/xvdc /media/ephemeral1
$ sudo chown ec2-user /media/ephemeral0$ sudo chown ec2-user /media/ephemeral1
![Page 62: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/62.jpg)
Mounting the Instance Store
[ec2-user@ip-blah ~]$ df -hFilesystem Size Used Avail Use% Mounted on/dev/xvda1 7.9G 1.6G 6.3G 20% /tmpfs 3.7G 0 3.7G 0% /dev/shm/dev/xvdb 414G 199M 393G 1% /media/ephemeral0/dev/xvdc 414G 71M 393G 1% /media/ephemeral1[ec2-user@ip-blah ~]$
![Page 63: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/63.jpg)
Automated Mounting
[ec2-user@ip-blah ~]$ sudo vim /etc/fstab#LABEL=/ / ext4 defaults,noatime 1 1tmpfs /dev/shm tmpfs defaults 0 0devpts /dev/pts devpts gid=5,mode=620 0 0sysfs /sys sysfs defaults 0 0proc /proc proc defaults 0 0/dev/sdb /media/ephemeral0 auto defaults,comment=cloudconfig 0 2/dev/sdc /media/ephemeral1 auto defaults,comment=cloudconfig 0 2
[ec2-user@ip-blah ~]$
Caution: if instance storage fails to mount (e.g. not configured correctly), you may not be able to boot and ssh into the instance
![Page 64: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/64.jpg)
Add EBS Storage
![Page 65: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/65.jpg)
![Page 66: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/66.jpg)
![Page 67: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/67.jpg)
![Page 68: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/68.jpg)
![Page 69: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/69.jpg)
![Page 70: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/70.jpg)
![Page 71: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/71.jpg)
![Page 72: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/72.jpg)
![Page 73: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/73.jpg)
Mounting the EBS Volume
$ sudo mkfs /dev/xvdf$ sudo mkdir -p /Volumes/things_n_stuff$ sudo mount -t ext4 /dev/xvdf /Volumes/things_n_stuff
$ sudo chown ec2-user /Volumes/things_n_stuff
![Page 74: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/74.jpg)
Mounting the EBS Volume
[ec2-user@ip-blah ~]$ df -hFilesystem Size Used Avail Use% Mounted on/dev/xvda1 7.9G 1.6G 6.3G 20% /tmpfs 3.7G 0 3.7G 0% /dev/shm/dev/xvdb 414G 199M 393G 1% /media/ephemeral0/dev/xvdc 414G 71M 393G 1% /media/ephemeral1/dev/xvdf 99G 60M 94G 1% /Volumes/things_n_stuff[ec2-user@ip-blah ~]$
![Page 75: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/75.jpg)
Creating an AMI
![Page 76: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/76.jpg)
![Page 77: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/77.jpg)
![Page 78: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/78.jpg)
![Page 79: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/79.jpg)
![Page 80: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/80.jpg)
![Page 81: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/81.jpg)
Launching Multiple Instances for HPC Applications
![Page 82: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/82.jpg)
launch instances from custom AMI
Run Simulations
result file
download results
instance_1
•••Run
Simulations
result file
instance_2
Run Simulations
result file
instance_n
For Independent Processes
![Page 83: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/83.jpg)
For HPC Applications
http://www.youtube.com/embed/YfCgK1bmCjw
1. Building a Cluster in 10 min
2. MIT StarCluster
http://star.mit.edu/cluster/
3. MPI Cluster Setuphttp://glennklockwood.blogspot.com/2013/04/quick-mpi-cluster-setup-on-amazon-ec2.html
![Page 84: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/84.jpg)
![Page 85: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/85.jpg)
![Page 86: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/86.jpg)
![Page 87: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/87.jpg)
![Page 88: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/88.jpg)
![Page 89: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/89.jpg)
![Page 90: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/90.jpg)
![Page 91: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/91.jpg)
![Page 92: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/92.jpg)
$ sudo groupadd data$ sudo useradd -s /bin/bash -m cluster -G data -p ""$ su - cluster$ cd ~$ ssh-keygen -t dsa$ cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys$ chmod 644 ~/.ssh/authorized_keys
$ R> install.packages("doSNOW")
Configure User
![Page 93: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/93.jpg)
![Page 94: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/94.jpg)
![Page 95: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/95.jpg)
![Page 96: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/96.jpg)
![Page 97: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/97.jpg)
![Page 98: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/98.jpg)
![Page 99: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/99.jpg)
library(doSNOW)servers <- c(rep("localhost", 5), rep("ec2-blah1.compute-1.amazonaws.com", 5), rep("ec2-blah2.compute-1.amazonaws.com", 5), rep("ec2-blah3.compute-1.amazonaws.com", 5) )cl <- makeCluster(servers)registerDoSNOW(cl)
Run Analysis
![Page 100: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/100.jpg)
my.test <- function(n){ for (i in 1:100000) { X <- matrix(rnorm(100), ncol = 10, nrow = 10) solve(X) }}
times <- 100system.time(for (i in 1:times) { my.test(i) })system.time(x <- foreach(i = 1:times) %dopar% my.test(i))
stopCluster(cl)
Run Analysis
![Page 101: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/101.jpg)
> system.time(for (i in 1:times) { my.test(i) }) user system elapsed 1142.071 0.000 1142.021
> system.time(x <- foreach(i = 1:times) %dopar% my.test(i)) user system elapsed 0.096 0.016 58.227
> stopCluster(cl)
Run Analysis
![Page 102: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/102.jpg)
> number.of.cores <- 5> cl <- makeCluster(number.of.cores)> registerDoSNOW(cl)> system.time(x <- foreach(i = 1:times) %dopar% my.test(i)) user system elapsed 0.388 0.016 232.580
Run Analysis
Parallelizing for a single instance (or on your desktop):
![Page 103: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/103.jpg)
Bonus Material
![Page 104: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/104.jpg)
Running RStudio on Amazon EC2
http://www.r-bloggers.com/instructions-for-installing-using-r-on-amazon-ec2/
Follow instructions here:
... and then you can run R and access results through a web browser
![Page 105: Amazon EC2 and R Cloud and R.pdfEC2 Instances Instance Type vCPU Memory (GiB) Instance Storage (GB) Network Performance t1.micro 1 0.615 EBS only Very Low m1.small 1 1.7 1 x 160 Low](https://reader035.vdocument.in/reader035/viewer/2022062507/5fcb131d31213927cb01034d/html5/thumbnails/105.jpg)
Getting Help
• Amazon EC2 Documentationhttp://aws.amazon.com/documentation/ec2/
• Getting Started Guidehttp://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EC2_GetStarted.html
• More HPC Resourceshttp://aws.amazon.com/hpc-applications/
• Manage/Configure Multiple Usershttp://www.youtube.com/watch?v=XuRM4Id6uDY