quantum leap in open source collaboration

Quantum Leap in Open Source Collaboration

Bridging the gap between campus infrastructures

Harold Teunissen et al.April 2012 - #I2SMM12

Quantum Leap in Open Source Collaboration - I2SMM12 - Arlington, VA

Cyberinfra in the Netherlands

• All ICT activities for Higher Education and Research in the Netherlands are brought under one umbrella

Shared Professional and Educational Services

Scientific Computing & Storage

Commercial ICT Products & Services

National Research & Education Network

Big Data — when size does matter

• More is not less...- Large scale and global research - Collaboration in Virtual Organizations- Shared resources- High dependence on ICT

Collaborations and Partnerships

• Virtual Research Team- Focussed on doing research- Small scale - Temporary and elastic- Little ICT awareness

• “Virtual” Infrastructure Provider- Focussed on providing infrastructure for specific discipline- Well-organized with grands and budgets- Longer term collaborations and better ICT awareness- Not virtual (e.g. CLARIN, Lifewatch, LHC, Project Bamboo)

• Virtual Collaboration* = People + Groups + Resources + Multi-Disciplines + Services + Policies + Funding + ...

Virtual Laboratory

Virtual Project

Virtual Colla-boration

Virtual Breeding Environment

Researchers knocking on our door

Radio Astronomy — Pulsar Research

Climate Modeling for Scientist and Decision Makers

CineGRID — 4K+ Video Distribution Testbed

Next Generation DNA SequencingJungle Computing and Multi-Model Multi-Kernel Simulations

Centralized Imaging for Large Scale Population Imaging Studies

e-VBLI relies on intl. networks

• DNA reads of 750 individuals, 300 TB data• Creating a “reference genome” and looking at variations

in individuals to find cause of diseases• Hospitals generate data, and carry out the 1st analysis

• Next Generation Networking for Next Generation Sequencing!

Genomics in the Netherlands

Quantum Leap in Open Source Collaboration - I2SMM12 - Arlington, VA 8

Virtual Collaboration B

Virtual Collaboration A

Multi-Disciplinary Collaboration

Enabled by

Multi-Disciplinary Collaboration

e-Research without limits

Network C

Network BNetwork A

Open Lightpath Exchange

Enabled by

e-Research without limits

Circle of Pain...

Relationship

AuthorizationAccess Control

UsersVirtual Collaboration

Resources & Services

Multi-Domain Service Delivery

Domain II Domain III Domain IV Domain V Domain VI

Domain VIIDomain I

Key words — trust, mutual understanding and standardization!

Multi-Domain Service Delivery

Domain II Domain III Domain IV Domain V Domain VI

Domain VIIDomain I

Key words — trust, mutual understanding and standardization!

What happens if domain is removed

or added?

What happens if domain is removed

or added?

What happens if a domain is removed, added or modified?

OpenConext

• Provides the glue and lubrication middleware to make campus, cloud based services and resources usable for collaboration for both inter campus and virtual collaboration scenarios

• OpenConext o!ers the Identity and Group Infrastructure

• O!er the platform software for large, virtual collaboration-type collaboration to run-you-own

• OpenConext allows you to create your own collaboration environment that organizes your applications, services and resources

Core Components

• Federated Identity Management — SAML• Groups Management — Grouper• Social Network 'Portal' technology — OpenSocial• Collaboration Services and Resources

- Document Sharing- Video Collaboration- Learning Systems- Data Storage- Data Mining- Workspaces- Workflows- Et cetera

9000CALORIES

100% SATISFACTION

Virtual Organization

Eco-system and supply chain

VirtualCollaboration

DNA Sequencer

Research Data StorageCollaboration Portal

Bandwidth on demand

09 12 14

Dynamic Network Service 1.0

Application

Network Management System

BoD GUI

NOC Engineer

Admin GUI Legacy API

• User Management• Resource Management• Topology & Discovery• Path finding• Scheduling & Reservation• Network Element

Provisioning & Association

Resource Reservation 101

Network C

Network BNetwork A

Bandwidth on Demand

258am-10pm

Network C

Network BNetwork A

Bandwidth on Demand

258am-10pm

2610am-12pm

Network C

Network BNetwork A

Bandwidth on Demand

258am-10pm

2610am-12pm

2612.10pm-3pm

Dynamic Network Service 2.0

NOC Engineer Users Applications

Bandwidth on Demand ServiceNSI

NSIBoD GUIAdmin GUI

CIENA NMS

NOC Engineer

Admin GUI

• Topology & Discovery• Path finding• Scheduling & Reservation• Network Element

Provisioning & Association

• Group Management• Resource Management

Inter Domain

New SURFnet7 and BoD

• All Institutes are upgraded to a MultiService Port• Allows for On Demand Lightpath Services• Provide connectivity towards Cloud providers and

Netherlight• O!ers fixed lightpath Quality of Service (bandwidth,

latency, availability, et cetera)• Separation of lightpaths through VLAN tagging

10 Gbps MultiService Port

2 Gbps 2 Gbps 4 Gbps 2 Gbps

Lightpath Lightpath On Demand Lightpath Available

Fusion between users and services

Institute X

BoD Admin Group

Physical Resource Group X

Physical Resource Group Y

BoD Physical Ports

Bandwidth on Demand Service

Institute Y

Physical Resource Group Z

Institute Z

VirtualUser Group

Virtual Collaboration

Virtual Resource Group

Institute’s Admin

Ports are allocated to Institutes...

Institute’s Admin Institute’s Admin

...and can be combined into a Virtual Resource

Group and then used by the collaboration

Architecture

Simplified view

SAML2 Federation

SAML2 Identity ProviderADFS TBD

ConextEngine

OpenSocialContainer

Web Portal

Service Registry

Policy Management

Attribute Management

Group Management

OpenSocialRest

TBDGadget

Grouper

OpenSocial RestOAuth

SAML2 SP SAML2 Metadata

Bandwidth on Demand Service

* Developed by SURFnet

CIENA NMS

NGE / Network

BoD Service — Work in Progress

Virtual Ports Assignment

Bandwidth on Demand

Virtual Ports Overview

Bandwidth on Demand

Reservations

Bandwidth on Demand

Physical Ports

Bandwidth on Demand

BoD uptake in the Netherlands

Institute # of sites

Genome of the Netherlands 12 (2 Intl)

Population Imaging Studies 3

Visual Analysis of Flooding Scenarios 3

Connecting climate model data 3

Distributed Multi-Model / Multi-Kernel Simulations 3

Proteomics 4

CineGrid NL 4

Pulsar Research 3

FOM Rijnhuizen 2

Visualization of climate data 2

Visionair 2

DAS-4 5

NEXPReS 5+ (intl)

harold.teunissen@surfnet.nl haroldteunissen

quantum leap in open source collaboration

Technology

all new quantum leap

quantum leap strategy

a quantum leap for downstream decarbonization

airgun | gun test quantum leap

personal development quantum leap formula

quantum leap - nestorgames · quantum leap a strategy board...

quantum leap goliath virtual instrument manual

quantum leap in the laboratory - mt.com

taking the quantum leap - jcacs.journals.yorku.ca

©2008 srikanth kallurkar, quantum leap innovations, inc....

a quantum leap in production technology.. -...

quantum leap opening remarks

the quantum leap into computing and communication: a ......

enabling quantum leap: quantum interconnect challenges for...

making the quantum leap

quantum leap user manual

is business ready to make the quantum leap? - fujitsu ·...

quantum leap gypsy virtual instrument manual

nsf’s quantum leaptaking the leap • quantum leap builds...

quantum leap colossus - crypton