cloud data center and openstack
TRANSCRIPT
KakaocorpAndrew. Yongjoon kong
• CloudTechnicalAdvisoryforGovernmentBroadCastAgency• AdjunctProf.Ajou Univ• KoreaDataBaseAgencyActingProfessorforBigdata• MemberofNationalInformationAgencyBigdata Advisorycommittee• KTcloudware Techlead(ex)!• Kakaoà Daum Kakaoà Kakaocorp,CloudComputingCelllead
Supervised,Koreanedition
KoreanEditioncomingsoon.
KakaocorpOur vision.
KakaocorpF1 team
racer==developer
F1car==Computingresource
mechanic==engineer
KakaocorpF1 team : Strategy
FastChangemeansSuccessfulRace!
ThoseTiresareChangedwithinFewSeconds!
KakaocorpAgile Mith
KakaocorpWhat is Cloud?
• Cloud == “Programmable Resource Management”• What is Programmable?
• What is Resource?
• What is Management?
• Cloud is the one of the ways of managing/deploying resources
• Basically, It’s culture.
• Tech. can support this culture
• Our culture is “Automation”
KakaocorpWhat is Data Center?
Adatacenterisafacilitythatcentralizesanorganization’sIT
operationsandequipment,andwhereitstores,manages,and
disseminatesitsdata.
KakaocorpWhat is Data Center? (Before Cloud)
Adatacenterisafacility thatcentralizesanorganization’sIT
operationsandequipment,andwhereitstores,manages,and
disseminatesitsdata.
Tranditional KeyConcepts
KakaocorpWhat is Data Center? (After Cloud)
Adatacenterisafacilitythatcentralizes anorganization’sIT
operationsandequipment,andwhereitstores,manages,and
disseminatesitsdata.
NewKeyConcepts
CentralizedData
API
User
KakaocorpCloud Data Center’s Must-have function1 : Centralized CMDB
CentralizedCMDB
Network
Server
storage
ERP
ConfigurationAutomation
AssetManagement
DataCenter
Kakaocorp
DataCenter
Cloud Data Center’s must-have function2 : Centralized Measuring System
CentralizedMeasuringSystem
Network
Server
storage
billing
Autocaling
AlertingMonitoroing
Kakaocorp
DataCenter
Cloud Data Center’s must-have function 3 : Central Deploying System
User:Definesresource
VM
Servercontainer
DB
Web
was
Queuescheduler
managerCentralizedDeployingSystem
ResourcePool
KakaocorpCloud Data Center – Center of Data Management
CentralizedCMDB
CentralizedMeasuringSystem
CentralizedDeployingSystem
DataCenterControlPlane
DataCenter Dataplane(P.M/V.M./Network/Cloud/Container)
KakaocorpSome Numbers
7xxx VMs is running.
We revealed this already last Feb. in Openstack Community Days, Korea
superuser.openstack.org
KakaocorpSome Numbers
964 tenants
455 pull request since 2014.9
136 VMs are created/deleted per day
KakaocorpSome information about kakao Openstack
openstack release from grizzly to Kilo
total 3Region
additional service Heat/Trove/Sahara
KakaocorpCloud, We do adopt devops culture : KField
KakaocorpCMDB based Configuration Automation
System team
Network team
CMDB API
New servers
New servers
New servers
New serverstoolbox
(baremetalprovisioner)
provisioned servers
provisioned servers
provisioned servers
provisioned server
Chef serverOur
Team
NSDBCentral
monitoring tree
switches, router, vlans
KakaocorpCloud, we do have SDN, not have Openflow, No others
eth0
Compute node
nova-compute
neutron-linuxbridge-
agent
neutron-dhcp-agent
Gateway10.10.100.1
linux bridge
vm
IP:10.10.100.2/32
Routing Table
1 10.10.100.2/32 via 192.1.1.201
BGP
192.1.1.202 BGPVirtual Switch block
Process block
Neutron-l3-agent
vlan
vlan
Virtual Router
Service Route Table
1 10.10.100.2 via
10.10.100.1
Management Route Table
1
PracticeFrugalitytoBoostCreativity
NoSubnet,NoOpenvswitchNotunnelNoDPDK
192.1.1.201 Physical Router
KakaocorpIntegrated Information Service Bus & EIP : Code Name KEMI
Based on Opensource
Component• Kafka• Samza• Camel• Storm
• Gobblin• Yarn• HDFS• Etcd• OpenTSDB
• Hbase• Tajo• Grafana
KakaocorpIntegrated Information Service Bus & EIP : Code Name Kemi
Enterprise Integration
• Topic based Data ETL• Can cover every computing
resource ( Physical Server, Virtual instance, Container, Public Cloud )
• Abstracting “Data Center Information layer”
• Can make deep engineering experience over every resources.
PhysicalServers
VirtualInstances Containers External
Clouds
Others(switches,
logs)
monitoring
KEMIIMS
(kakao CMDBAPI)
SB
RuleEngine
Notification ETL
Data Center Information abstraction layer
API
predicting
scheduling
OpenstackHeat
OtherServiceAPI
DataCenter(orService)ManagementActivity
control
KakaocorpQ&A
Q&AP.S. We’re hiring, always!
http://www.kakaocorp.com/recruit