1. Zabbix for Hybrid Cloud ManagementTIS Inc. Daisuke IKEDA21 September,2012Riga,LatviaCopyright 2012 TIS Inc. All rights reserved.

2. AgendaAgendaAbout myself - Server Engineer working at Research & Dev. DivisionApproaching to Hybrid Environment Management System- Integration and AutomationSystem Architecture - Products component and Processing flowsDemonstrationCopyright 2012 TIS Inc. All rights reserved. -1- 3. About MyselfDaisuke IkedaBelongs To: TIS Inc.Division: Strategic Technology CenterResearch Subject: Managing Hybrid Cloud environmentMy Recent Activities:- Chrome Extension for checking Zabbix Trigger "Chromix"- Android application for Zabbix "ZabiroiD"- Articles for Technology sharing website by TIS "Tech-Sketch"- Presentation at Zabbix study meeting in Japan(12 May,2012)Copyright 2012 TIS Inc. All rights reserved. -2- 4. Our initiativesWhat you see here todayZabbix Instead of You - AUTOMATION - Host Registration done by ZabbixVMware Virtual machinesAWS EC2 instances- Machine Setup Details kept trackable by ZabbixVM resource status(CPU,Memory,Storage)AWS EC2 instance info.( Instance Type, AZ, IP address etc.)AWS Billing info.Just Zabbix Dashboard - INTEGRATION - Machine Control from Zabbix DashboardStart/Stop/Reboot/TerminateCopyright 2012 TIS Inc. All rights reserved. -3- 5. Backgrounds and CasesComplex and Mixed Machine CircumstancesWe manage machines both on-cloud and on-premise; - Many Cloud Services offered (AWS,Rackspace,...) - Cloud services are prevailing - But, we still need to manage on-premise machines tooTypical Scenario: - Sensitive data needs to remain stored on-premise - What happens ...DB server -> located on-premise for security reasonAP server -> located on-cloud for scalabilityCopyright 2012 TIS Inc. All rights reserved. -4- 6. Requirements and ChallengesTo Manage Hybrid environments1. VMs have their private client software- How many client s/w reguired to manage hybrid configration?e.g.)- vSphere client ( for VMware ESXi )- AWS management console ( for AWS )- System insight Manager ( for HP Physical Machine )2. More VMs to manage- Configuring numbers of VM manually is impractical.3. VMs change their setups very dynamically- Keeping configuration documents up-to-date is really hardCopyright 2012 TIS Inc. All rights reserved. -5- 7. Approaching to Operation Management1. Integrated ManagementforHybrid Environment On-premiseVM VM VM Public Cloud Physical machines Virtual machinesCopyright 2012 TIS Inc. All rights reserved. -6- 8. Approaching to Operation Management2. Automated ManagementforHybrid Environment Manual configAutomatic configCopyright 2012 TIS Inc. All rights reserved. -7- 9. System ArchitectureArchitecture Zabbix layerMessage queueing layer API Integration layer Target Environments(They are hybrid mixture)Copyright 2012 TIS Inc. All rights reserved. -8- 10. System ArchitectureFor integrationCustomized Dashboard - Check ALL instances here - Operate ALL instances herelibcloud implemented- Exclusive APIs abstracted- Easy to add a new type of cloud serviceCopyright 2012 TIS Inc. All rights reserved. -9- 11. System ArchitectureFor automationThe Use of ZabbixAPI and Zabbix Sender - Zabbix API is used to sync instance lists - Zabbix Sender is used to register detailed info of instancesCopyright 2012 TIS Inc. All rights reserved.- 10 - 12. System ArchitectureProcessing Flow1 4 5Auto registration of Hostby "Zabbix API"Flow: 1 2 3 4Detailed info are stored to2Zabbix itemby "Zabbix Sender"Flow: 1 2 3 53Execute actionfrom Zabbix dashboardFlow: 1 2 3Copyright 2012 TIS Inc. All rights reserved. - 11 - 13. AppendixWhat is libcloud ? - A Meta Cloud APIlibcloud(http://libcloud.apache.org)- OSS Meta Cloud API (latest ver. 0.11.1)Support Action- Apache top level project - get node_list - start instance- Written in Python- stop instance - reboot instance- Wrapping many native cloud services API- terminate instanceAWS,Rackspace,CloudStack,OpenStack...- create instance - manage storageInstall- manage LB etc...$ pip install apache-libcloudProgramming step(python script)from libcloud.compute.types import Provider$ pip install apache-libcloudfrom libcloud.compute.providers import get_driverEC2_ACCESS_ID = AWS API KeyEC2_SECRET_KEY = AWS Secret KeyDriver = get_driver(Provider.EC2)conn = Driver(EC2_ACCESS_ID, EC2_SECRET_KEY)nodes = conn.list_nodes()Copyright 2012 TIS Inc. All rights reserved.- 12 - 14. DemonstrationDemo- You can watch FULL machine list on Zabbix Dashboard- You can Operate VM on Zabbix Dashboard- You can connect to ssh,VNC,IPMI console ( feature)Copyright 2012 TIS Inc. All rights reserved. - 13 - 15. DemonstrationDemo- You can watch FULL machine list on Zabbix Dashboard- You can Operate VM on Zabbix Dashboard- You can connect to ssh,VNC,IPMI console ( feature)Copyright 2012 TIS Inc. All rights reserved. - 14 - 16. DemonstrationDemo- You can watch FULL machine list on Zabbix Dashboard- You can Operate VM on Zabbix Dashboard- You can connect to ssh,VNC,IPMI console ( feature)Copyright 2012 TIS Inc. All rights reserved. - 15 - 17. Future ProspectsFuture Prospects - Features to AddStrong cooperation between Hybrid Environments- Easy BACKUP from machine to machine- Simple MIGRATION from service to serviceStrong cooperation between Results and Action- Complex JOB EXECUTION from monitored events to be scheduledCopyright 2012 TIS Inc. All rights reserved. - 16 - 18. Q&A Questions?Copyright 2012 TIS Inc. All rights reserved. - 17 - 19. The End Thank You! Twitter : @ike_dai Facebook: https://www.facebook.com/ikedaiCopyright 2012 TIS Inc. All rights reserved. - 18 -