task t9.1: general dissemination activities - fiware.github.io · –itbox-puppet: it contains all...

25
eXperimental Infrastructures for the Future Internet Infrastructure Toolbox Alessandro Martellone [email protected] Madrid, 24 th June 2014

Upload: others

Post on 11-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

eXperimental Infrastructures for the Future Internet

Infrastructure Toolbox

Alessandro Martellone

[email protected]

Madrid, 24th June 2014

Page 2: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Agenda

• What is the Infrastructure Toolbox?

• Main requirements

• Installation

• Infrastructure Toolbox architecture

• Current state

• Release plan

02/09/2014 XIFI – Infrastructure Toolbox 2

Page 3: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

What is the Infrastructure Toolbox?

• Infrastructure Toolbox (ITBox) is a tool to support

deployment of cloud infrastructure based on OpenStack.

It provides a web interface through which it is possible to

configure and install Openstack services and GEs on

bare-metal server.

– Operating system (Ubuntu 12.04 LTS)

– OpenStack Grizzly

– DCRM GE (FI-WARE)

– IdM GE (FI-WARE)

– Monitoring adapters

• It is based on Fuel (3.2.1) by Mirantis released under

Apache 2.0 license.

02/09/2014 XIFI – Infrastructure Toolbox 3

Page 4: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Main requirements

• Discover servers that are a part of the node.

• Assign role to discovered servers, install and configure

them with appropriate software modules

– Ubuntu 12.0 LTS, OpenStack modules

• DCRM GE, Monitoring and Adapters GE.

• Verify the deployment and test connection to the

federation.

• Recommend a deployment model based on servers’

capacities (e.g. # cores, RAM, storage volumes).

02/09/2014 XIFI – Infrastructure Toolbox 4

Page 5: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Installation

• ITBox is distributed as an ISO which contains an installer for ITBox Master Server.

The ISO can be installed indifferently, using a virtualization software package, such

as VirtualBox, or a bare-metal server. The first solution is suggested for testing

scopes, whereas the second solution is suggested for production environment.

Suggested minimum hardware requirements for installation in:

testing environment

• Dual-core CPU

• 2+ GB RAM

• 1 gigabit network port

• HDD 80 GB with dynamic disk expansion

production environment

• Quad-core CPU

• 4+ GB RAM

• 1 gigabit network port

• HDD 128+ GB

• A gigabit ethernet switch (e.g. HP3800)

02/09/2014 XIFI – Infrastructure Toolbox 5

Page 6: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Example Deployment

9/2/2014 Title of the event/audience

• Physical Deployment • Service Deployment

Page 7: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Architecture of the ITBox

02/09/2014 XIFI – Infrastructure Toolbox 7

Page 8: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

ITBox Interface

• ITBox Interface provides

infrastructure

administrators with

interfaces to run set-up and

installation of a new XIFI

node

– GUI: web based interface

– CLI: shell based interface

02/09/2014 XIFI – Infrastructure Toolbox 8

Page 9: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

ITBox Middleware

• ITBox middleware provides

services that run the actual

provision and deployment

of OS and services in the

bare-metal infrastructure.

02/09/2014 XIFI – Infrastructure Toolbox 9

Page 10: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

ITBox Middleware

• A server that installs, via

network, OS on node

discovered via PXE. It has

a repository of Host OS

that can be provisioned on

the bare-metal servers.

02/09/2014 XIFI – Infrastructure Toolbox 10

Page 11: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

ITBox Middleware

• Orchestrator coordinates the

deployment of services on the

different servers according to

the configuration passed by the

ITBox Interface.

• It’s necessary to ensure proper

set-up and configuration of the

XIFI node.

02/09/2014 XIFI – Infrastructure Toolbox 11

Page 12: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

ITBox Middleware

• Software Deployment and

Configuration (SDC) provides

access to packages and scripts

for the installation of services

on a single node.

02/09/2014 XIFI – Infrastructure Toolbox 12

Page 13: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Current status

• Version 1.1.4.0

– DCRM (multi-node)

– Nagios

• Version 1.2.4.0

– DCRM multi-node in HA

– Installation in HA using 2 controllers (It requires a manual configuration of the Galera Arbitrator)

– OpenstackDataCollector (multi-node and multi-node in HA)

– ContextBroker

• Version 1.2.4.1 (maintenance version)

– ContextBroker: fixed symbolic link creation when the user deploys again after a failure;

– Nagios: fixed glance-registry service registration.

• Version 1.2.4.2 (maintenance version)

– Nagios: improvements on services monitoring.

Page 14: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

ToDo list

• Current developing

– Keystone Proxy

– Cloud Portal

– Monitoring: NGSI Adapter

• Next developments

– Second external network

– Galera arbitrator

– Update to OpenStack Mirantis 4.1 – Havana

– Object Storage (Swift)

Page 15: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Release plan

02/09/2014 XIFI – Infrastructure Toolbox 15

Version 1.1.4.02014 - March

2014 - April

• Ubuntu 12.04

• DCRM in multi-node deployment

• Nagios

2014 - July

2014 - March

2014 - September

2014 - October

2014 - December

Page 16: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Release plan

02/09/2014 XIFI – Infrastructure Toolbox 16

Version 1.2.4.02014 - March

2014 - April

• DCRM multi-node in HA

• Installation with 2 controllers*

• OpenstackDataCollector (both multi-node and multi-node in HA)

• ContextBroker

2014 - July

2014 - April

* It requires a manual configuration of the Galera Arbitrator

2014 - September

2014 - October

2014 - December

Page 17: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Release plan

02/09/2014 XIFI – Infrastructure Toolbox 17

Version 1.3.4.02014 - March

2014 - April

• Keystone Proxy

• Cloud Portal

• NGSI Adapter

•NAM (Network Active Monitoring)

2014 - July

2014 - July

2014 - September

2014 - October

2014 - December

Page 18: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Release plan

02/09/2014 XIFI – Infrastructure Toolbox 18

Version 2.1.4.02014 - March

2014 - April

• Update to OpenStack Mirantis 4.1 – Havana

2014 - September

2014 - July

2014 - September

2014 - October

2014 - December

Page 19: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Release plan

02/09/2014 XIFI – Infrastructure Toolbox 19

Version 2.2.4.02014 - March

2014 - April

• Galera Arbitrator

• Second external network

2014 - October

2014 - July

2014 - September

2014 - October

2014 - December

Page 20: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Release plan

02/09/2014 XIFI – Infrastructure Toolbox 20

Version 2.3.4.02014 - March

2014 - April

• Object Storage (Swift)

• Recommender for matching servers with roles according to their capacity

2014 - July

2014 - December

2014 - September

2014 - October

2014 - December

Page 21: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

ITBox release life cycle

02/09/2014 XIFI – Infrastructure Toolbox 21

0 - Development

1 - Beta1 - Beta

Testing in a virtual

environment

Development

of features

defined in the

release plan

2 - RC

Testing in a pre-

production

environment (bare

metal servers)

4 – Stable

version

Bug fixing

4.x – Fixed

version

Time

• <Version>.<Development stage>.<Bug fixing>

– The number of version refers to the release plan

– E.g. 1.1.4.0: <1.1>.<4>. <0>

A

c

t

i

o

n

Page 22: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

ITBox architecture at a glance

• It is mainly composed of the following five modules:

– ITBox-web : a web based interface with simplified

functionalities for set-up and installation.

– ITBox-puppet: it contains all puppet scripts.

– ITBox-main: it is the main repository with ISO build

scripts.

– ITBox-astute: it is the orchestrator which performs

provision and deploy.

– ITBox-ostf: (OpenStack Testing Framework, or

Health Check) implements post-deployment

verification of OpenStack.

Page 23: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Source code

• The source code of ITBox can be found on

https://github.com/SmartInfrastructures/:

• https://github.com/SmartInfrastructures/itbox-puppet

• https://github.com/SmartInfrastructures/itbox-web

• https://github.com/SmartInfrastructures/itbox-astute

• https://github.com/SmartInfrastructures/itbox-ostf

• https://github.com/SmartInfrastructures/itbox-main

02/09/2014 XIFI – Infrastructure Toolbox 23

Page 24: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

References

• [1] Component XIFI wiki page (http://wiki.fi-

xifi.eu/Xifi:Wp3:Components:InfrastructureToolb

ox)

02/09/2014 XIFI – Infrastructure Toolbox 24

Page 25: Task T9.1: General Dissemination Activities - fiware.github.io · –ITBox-puppet: it contains all puppet scripts. –ITBox-main: it is the main repository with ISO build scripts

Thank you for your attention!

25

Acknowledgments: The research conducted by XIFI receives funding from the European Commission FP7 under grant agreement

N°: 604590. The European Commission has no responsibility for the content of this presentation.

Find us at www.fi-xifi.eu

Author:[email protected]

Create-Net : http://www.create-net.org/