opennebula conf 2014: expanding opennebula´s support for cloud bursting - emmanuel mathot
DESCRIPTION
The platform currently runs several solutions for Earth Sciences Researchers: Developer Cloud Sandboxes for scalable scientific processors integration, Virtual Archives federating distributed data repositories, Data Challenges for Earth Observation contests, and Digital Marketplaces for reproducible scientific experiments. OpenNebula is also powering our Cloud development environment, that has been enhanced during the past year. Terradue’s Cloud development environment is both our laboratory to test the latest developments from OpenNebula, especially for the integration of our own OpenNebula extensions, and our Engineering team facility to provision servers supporting project-based software developments. OpenNebula provides the virtualization and management of hardware clusters, that we rent from commercial ‘bare-metal’ providers. We have recently further developed several specific drivers for Multi-Cloud bursting, in order to provision virtual machines over public commercial clouds. When their processor integration and validation phase concludes, our researcher users can seamlessly burst their applications at scale, leveraging OpenNebula drivers for on-demand processing tasks.TRANSCRIPT
Expanding OpenNebula’s support for
cloud bursting
Hybrid Cloud Strategy for
Terradue’s Cloud Platform Users
Emmanuel Mathot OpenNebula Conference, Berlin – 3rd December 2014
Terradue Our Company
Provide computational science for researchers
to study the earth system
- Founded 2006 in Italy
- Earth Science start-up
- Head Office in Rome, 13 team members - Branch office in Oxford
- OpenNebula early adopter
Our customers Earth sciences
Platform as a Service
Platform as a Service
• Producer Decks (hybrid)
• Deploy Cloud Appliance clusters on public clouds
• Elastic Catalogues
• S3 data nodes
• Templates (hybrid)
• Community Hubs on private cloud
• Define OneFlow services
• Hadoop Sandboxes on private cloud
• Build Applications
Developers Integrators
Producers Data
Providers
Tailored contextualization
Terradue PaaS Operator
0
20
40
60
80
100
120
#Users
Operations & Support
Operations Infrastructure management
- Configuration Management
- Consistency
- Integrity
- Code Paradigm
- System Monitoring
- Operational readiness
- Services recovery
- notifications
Operations Network & Access
- Dynamic DNS management
- Hostname allocation
- Network Isolation & Security
- Open vSwitch
- Network access
- OpenVPN Access Server
- User profile certification
- LDAP + X.509 auth
Cloud bursting jclouds4one
jclouds4one
jclouds-cli
OpenNebula
Integration DotNet4one
Terradue Laboratories
Projects last week example
Ocean Model Processing Benchmarking experiment
2 use cases :
- Provision 30 nodes hadoop cluster (m3.xlarge with 4
CPUs running 30 parallel tasks, exploiting MPI (4
threads on each node);
- Provision 100 nodes hadoop cluster ( with 1 CPUs
running 100 parallel tasks
Projects application example
Projects application example
Terradue ecosystem
Future work in one
- Invoicing automation based on
accounting
- “Tailorable” dashboard integrating access
and monitoring running services
- OpenID/Oauth
Terradue
terradue.github.io
twitter.com/terradue
terradue.com
https://github.com/Terradue/DotNet4One
https://github.com/Terradue/jclouds4one
https://challenges.esa.int/
Terradue CEO Fabrice Brito
Product Manager Hervé Caumont
Solutions Architect Emmanuel
Mathot
?