ia20120118 sekiya
TRANSCRIPT
- 1. IEICE IA Workshop @ WAKAYAMA12/01/18 / WIDE [email protected] / [email protected] 1
2. IEICE IA Workshop @ WAKAYAMA12/01/18 (WIDE ) 2 3. IEICE IA Workshop @ WAKAYAMA 12/01/18 ? Above the Clouds: A Berkeley View of Cloud Computing Electrical Engineering and Computer Sciences University of California at Berkeley, Technical Report No. UCB/EECS-2009-28 3 4. IEICE IA Workshop @ WAKAYAMA12/01/18 Availability of Service Use Multiple Cloud Providers; Use Elasticity to Prevent DDOS Data Lock-In Standardize APIs; Compatible SW to enable Surge Computing Data Confidentiality and Auditability Deploy Encryption, VLANs, Firewalls; Geographical Data Storage Data Transfer Bottlenecks FedExing Disks; Data Backup/Archival; Higher BW Switches Performance Unpredictability mproved VM Support; Flash Memory; Gang Schedule VMs 4 5. IEICE IA Workshop @ WAKAYAMA12/01/18 (cont.) Scalable Storage Invent Scalable Store Bugs in Large Distributed Systems Invent Debugger that relies on Distributed VMs Scaling Quickly Invent Auto-Scaler that relies on ML; Snapshots for Conservation Reputation Fate Sharing Offer reputation-guarding services like those for email Software Licensing Pay-for-use licenses; Bulk use sales 5 6. IEICE IA Workshop @ WAKAYAMA12/01/18 ? Module(n+3) Module(n+2,m0) Module(n+2,m1) VPS Module(n,m0) Module(n,m1) Module(n,m2) Module(n,mModule(n,m)+1) Module(n+1,m)Module(n+1,m+1) 6 7. IEICE IA Workshop @ WAKAYAMA 12/01/18 ? IaaS IaaS 7 8. IEICE IA Workshop @ WAKAYAMA 12/01/18 IaaS StorageStorage HAHAServer Server HA HA HANetworkNetwork HA HA HA8 9. IEICE IA Workshop @ WAKAYAMA 12/01/18 (IaaS) (PaaS, SaaS) (IaaS, PaaS) (IaaS, SaaS)9 10. IEICE IA Workshop @ WAKAYAMA12/01/18 10 11. IEICE IA Workshop @ WAKAYAMA 12/01/18 WIDE / JGN IaaS NAIST JAIST JGN Tunneling11 12. IEICE IA Workshop @ WAKAYAMA 12/01/18 WIDE Inter-University CloudSharing the resources on each private cloud JAISTNAIST WIDE Cloud Univ. of1. Tokyo VM 2. TokyoDC Keio Univ.IaaS (KMD) (IPv6)OsakaDCKeio 3. Univ.(SFC) SFO CNU DC (Korea) 12 13. IEICE IA Workshop @ WAKAYAMA 12/01/18 WIDE Application Layer SQL NoSQLMiddleware LayerFederated Cloud Controller RESTful API VM ImageControl Layer libvirtVirtual Resource LayerNEMOkvm NFS iSCSI Sheepdogmap646Facility Layer VLAN Network ServerStorageApplication 13 14. IEICE IA Workshop @ WAKAYAMA12/01/18 VM cold standby vs. hot standby 14 15. IEICE IA Workshop @ WAKAYAMA 12/01/18 VLAN VLAN MAC address VPLS + PBB ? Ether Fabric (trill) ? OpenFlow ? LISP in Cloud15 16. IEICE IA Workshop @ WAKAYAMA12/01/18NEMO IPv6 Internet!IPv4 Internet!NAT64Boxes!Datacenter 2! Datacenter1! Hypervisors! Hypervisors! Datacenter 3! Datacenter 4!VMs!Hypervisors! Hypervisors! 16 17. IEICE IA Workshop @ WAKAYAMA 12/01/18VM Replication 17 18. IEICE IA Workshop @ WAKAYAMA12/01/18 Gluster FS Ceph Sheepdog Gfarm I/O iSCSI 2 StarBED 18 19. IEICE IA Workshop @ WAKAYAMA12/01/18 VM iSCSI iSCSI 60000800000 70000050000 60000040000500000 KByte 400000FujisawaFujisawaKByte30000300000Nezu 200000 Nezu20000JAIST100000 JAIST10000 00write rewirte randomfwrite frewritewrite VM : :, , 19 20. IEICE IA Workshop @ WAKAYAMA12/01/18 (cache off) Iozone performance Iozone performance Read performance Read performance 1.2e+06600000 1e+06500000 800000400000Kbytes/secKbytes/sec 600000300000400000200000200000100000 0 0 1638416384 4096 40961024 102464 256 1024 25664 256 1024 256 409616384 64 Record size in 2^n Kbytes 409616384 64 Record size in 2^n Kbytes 65536 262144 1665536262144 16 File size in 2^n KBytes 1.04858e+064.1943e+06 4File size in 2^n KBytes 1.04858e+06 4.1943e+06 4 1.67772e+071.67772e+07LOCAL DISK SHEEPDOG 20 21. IEICE IA Workshop @ WAKAYAMA 12/01/18 (cache off) Iozone performanceIozone performanceWrite performanceWrite performance 4500 4000 500000 3500 450000 3000 400000Kbytes/sec350000 2500 Kbytes/sec300000 2000 1500250000200000 1000 150000500 100000050000 0 16384 4096163841024 409664 256 1024 256 Record size in 2^n Kbytes1024 409616384 6464 65536256 1024256 262144 16 File size in 2^n KBytes 1.04858e+064.1943e+06 4 4096 1638464 Record size in 2^n Kbytes 1.67772e+07 6553616 262144 1.04858e+06 File size in 2^n KBytes4.1943e+06 4 1.67772e+07LOCAL DISK SHEEPDOG21 22. IEICE IA Workshop @ WAKAYAMA12/01/18 (cache on)Iozone performance Iozone performanceFread performanceFread performance8e+065.5e+06 7e+065e+06 6e+064.5e+064e+06 Kbytes/sec5e+06Kbytes/sec3.5e+06 4e+063e+062.5e+06 3e+062e+06 2e+061.5e+06 1e+061e+06 500000 0 1638416384 4096 40961024 102464 256 1024 25664256 409616384 64 Record size in 2^n Kbytes 256 1024 65536409616384 64 Record size in 2^n Kbytes 262144 1665536 File size in 2^n KBytes 1.04858e+064.1943e+06 4262144 16 1.67772e+07File size in 2^n KBytes 1.04858e+06 4.1943e+06 41.67772e+07 LOCAL DISKSHEEPDOG22 23. IEICE IA Workshop @ WAKAYAMA 12/01/18 (cache on)Iozone performance Iozone performance Fwrite performanceFwrite performance1.2e+061.2e+061e+061.1e+061e+06800000 900000 Kbytes/secKbytes/sec 800000600000 700000 600000400000 500000200000 400000 3000000 20000016384 163844096 4096 10241024 64 256 1024 25664256 256 1024 409616384 64 Record size in 2^n Kbytes 409616384 64 Record size in 2^n Kbytes 65536 6553616262144 16 262144 1.04858e+06File size in 2^n KBytes 1.04858e+06 4.1943e+06 4 File size in 2^n KBytes4.1943e+06 41.67772e+07 1.67772e+07LOCAL DISK SHEEPDOG23 24. IEICE IA Workshop @ WAKAYAMA 12/01/18 IaaS I/O (SAN) vs. 24