weblogic at cern now and in the future 13.05.2014 soug2 swiss oracle user group artur wiecek...

43

Upload: emmeline-tyler

Post on 14-Dec-2015

221 views

Category:

Documents


5 download

TRANSCRIPT

Page 1: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department
Page 2: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 2

Weblogic at CERN now and in the future

13.05.2014

Swiss Oracle User Group

Artur WiecekInfrastructure and Middleware ServicesCERN IT Department

Page 3: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 3

Agenda• CERN• IT ENVIRONMENT• WEBLOGIC• FUTURE DEVELOPMENT• CONCLUSION

13.05.2014

Page 4: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

Accelerating Science and Innovation

Page 5: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

The Mission of CERN

Push back the frontiers of knowledgeE.g. the secrets of the Big Bang …what was the matter like within the first moments of the Universe’s existence?

Develop new technologies for accelerators and detectorsInformation technology - the Web and the GRIDMedicine - diagnosis and therapy

Train scientists and engineers of tomorrow

Unite people from different countries and cultures

Page 6: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

6

CERN was founded 1954: 12 European States “Science for Peace”

Today: 21 Member States

Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Israel, Italy, the Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland and the United Kingdom

Candidate for Accession: Romania

Associate Member in Pre-Stage to Membership: Serbia

Applicant States for Membership or Associate Membership:Brazil, Cyprus, Pakistan, Russia, Slovenia, Turkey, Ukraine

Observers to Council: India, Japan, Russia, Turkey, United States of America; European Commission and UNESCO

~ 2300 staff ~ 1600 other paid personnel ~ 10500 users Budget (2014) ~1000 MCHF

Page 7: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

Science is getting more and more global

Page 8: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 8

Agenda• CERN• IT ENVIRONMENT• WEBLOGIC• FUTURE DEVELOPMENT• CONCLUSION

13.05.2014

Page 9: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

CERN IT culture• Specific factors

• Research/creative environment• Technology fashion

Page 10: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

Role• Mission

• Provide best possible/cost effective environment for deployment of JEE applications

• Focus• Architecture• Availability

Page 11: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

IT as Service

Physical infrastructure (HW)Delivers: installed, connected, tested hardware

Internal customers only

IAASDelivers: configured VMs/physical CPU, storage

Internal & external customers

PAASDelivers: platform services

Internal & external customers

Special infrastructure

(for e.g. Oracle)

Special HW

SAASDelivers: complex services,

Internal & external customers

Meta-service (?)(may be just a SAAS)

Manage horizontally to ensure can remove

special needs eventually

Standard model: where we want to be

Databasesjee

Service infrastructure

Storage infrastructure

DB/Java on demand

App servers

Page 12: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

Agile infrastructure • Virtualisation everywhere• OpenStack -> target 100000s• Hyper-V, OVM 2.2 -> phasing out• KVM is in place, OVM3.3 is in beta….

Page 13: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 13

Agenda• CERN• IT ENVIRONMENT• WEBLOGIC• FUTURE DEVELOPMENT• CONCLUSION

13.05.2014

Page 14: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

Java app servers@CERN• 2 platforms:

• Tomcat (Java Public Service - JPS) (6 years)• Weblogic

• Areas:• Business Side/Administration• Engineering• Accelerator (ADF)

• Middleware products (forms, reports)• APEX

Page 15: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

WLS Deployment 1/2• Started 4 years ago• RHES 5.x, 6.x, Apache 2.2• Kerberos/SSH node manager• CERN CC managed with Puppet• Everything is RPM.

Page 16: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

Java app servers@CERN• 2 platforms:

• Tomcat (Java Public Service - JPS) (6 years)• Weblogic

• Areas:• Business Side/Administration• Engineering• Accelerator (ADF)

• Middleware products (forms, reports)• APEX

Page 17: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

WLS Deployment 2/2• Weblogic 12.1.1/ Jrockit• All customisations in WLST scripts / LDAP• Fully certified stack (constantly updated,

PSU/CPU)• 200 clusters, 2 people

Page 18: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 18

Provisioning

13.05.2014

LDAP CONFIGURATION

SERVER

ADMIN SERVER

PUPPET AGENT

WLST SCRIPTS

MANAGED SERVERPUPPET AGENT

WLST SCRIPTS

MANAGED SERVERPUPPET AGENT

WLST SCRIPTS

Page 19: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 19

ADMIN SERVERS

Application Deployment

13.05.2014

WLS CLUSTER-

11

SSH WLS SSH GATEWAY

WLS CLUSTER-

21

WLS CLUSTER-

31

DOMAINADMIN-1

DOMAINADMIN-N

Page 20: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 20

Typical WLS Cluster

13.05.2014

HTTPDWLS

CLUSTER

DB appRDBMS

SSO

LDAP (AD)

SAML2(ADFS)

DNS MOD_WLS

Page 21: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 21

Patching

13.05.2014

WLS SERVER 1

RPM REPOSITORY

BUILD SERVER

BASE WLS INSTALLATION

APPLY ALL PATCHES

BUILD RPM

WLS SERVER 2

WLS SERVER 3

Page 22: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

Monitoring• EM 12c

• Huge progress compare to 11g• 1 agent per domain• Driven by emcli• Issues:

• status• historical data

• Wily Introscope

Page 23: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

Major upgrades• iAS 10.3.5 - OC4J gone

• 11g -> 12c migration• Weblogic 12.1.1 everywhere• Worked fine

Page 24: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

CERN SSO

24

Page 25: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SSO

25

• It works! Some figures: ~31000 “signins” per day ~5000 “signouts”

• The hard work: Workaround the SAML2 & WLS constraints Fit the requirements of the legacy systems

• WLS does not provide the SLO: CERN saml2slo OpenSource (coming soon, hopefully) Very complicated to put in place/automate

Page 26: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SAML2 Issues• %20 spaces – wlsproxy servlet• Single security per domain• RDBMS Security Store• Fixed context /saml2• Artefact binding blocked

Page 27: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

Issues and Concerns• Deployment

• app-1 app-2 after redeployment• Broken apps can break admin server & the

whole domain (XML parsers)• Developers

• Admin server vs. WLST, not always coherent• New WLS installer based on universal

installer – scary prospect.

Page 28: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 28

Agenda• CERN• IT ENVIRONMENT• WEBLOGIC• FUTURE DEVELOPMENT• CONCLUSION

13.05.2014

Page 29: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 29

Java Services today…

Scope• Java EE

was(J2EE) Clients• AIS• EDMS• CS• ACC• J2EEPS

Deployment• Private• Public• 400 applications• 70 servers

Technologies• Weblogic• iAS (OC4J)• Tomcat• RHEL/SLC

Staff• 2 FTE

13.05.2014

Page 30: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 30

Java Services today…

REQUESTS

CAPACITY

13.05.2014

Page 31: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 31

One Platform to Rule Them All

Experience

DB in Demand

Technologies•Openstack

•Puppet•SSO

•IAS->Weblogic

Common Setup

For all clients

… and in the future.

13.05.2014

Page 32: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 3213.05.2014

Java Platform as a Service• On-Demand Provisioning• Self Management & Configuration• Scalability• Security (Systems, Data, SSO)• Improved redundancy• Higher productivity

Page 33: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 33Agile Infrastructure

SOUG 33

Java PaaS Services Stack

Website

Website

Java Java Java

App App

SSO

DB

Storage

Monitoring

DNS

Management

Web Services

Deployement

App App

13.05.2014

Page 34: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 34

Java PaaS Infrastructure• Support for any host

• Openstack VMs• Physical Servers and Virtual Machines

• Machine Pools• System configuration managed by Puppet• Multiple Java technologies

• Apache Tomcat • Oracle Weblogic• Designed to provide other Java environments

like JBoss, Glassfish, etc…

13.05.2014

Page 35: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 35

Java PaaS User Experience• More control for the users

• Self selection of Software type and versions• Self allocation of resources• Configuration management (Runtime properties,

logging properties, server-side libraries…)• SSO Management (ADFS Groups,

External/lightweight accounts, …)• Applications & configuration versioning• Management of Administrators and Authors

13.05.2014

Page 36: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 36

Java PaaS Architecture

Java MWDB

Java MWManager

Create Jobs

DaemonRead Jobs

ServicesRepository

Register services

ManagedHostManaged

HostManagedHostManaged

Host

ManagedHostManaged

HostManagedHostManaged

HostProvisioning & Management

tools

Dispatch Jobs

ManagedHostManaged

Host

DeployConfigureOperate

CERN Web

Services

CERN SSO

Register website

Admins

Users

DNSLB

Configure

ConfigureOperate

13.05.2014

Page 37: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 37

Front - End

● Java Web Application● User Interface: ZK Framework

– Java + Jquery + MVC– IT-DB standard

● Data Access: Hibernate– Object Relational Mapping– Easy to use

● Notifications: REST (Jersey)– Simple, easy

● Orchestration: Quartz13.05.2014

Page 38: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 38

Back – End

● On Demand Daemon● It looks for pending jobs● jobs & parameters → Execute Command

● It Works!

● Service Configuration Repository (LDAP)● Container, virtual host, mount points...● CReate Update Delete (CRUD API)

● Common actions across cloud:● Start/stop/deploy/undeploy● Apache configuration (mod_jk, shibboleth management

13.05.2014

Page 39: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 39

The Result

● Prototype is working● https://mysite01.web.cern.ch/mysite01

● Registration in the CERN Web Services● Apache Front End configuration● Creation of the default container● Deployment of the sample application

13.05.2014

Page 40: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 40

Agenda• CERN• IT ENVIRONMENT• WEBLOGIC• FUTURE DEVELOPMENT• CONCLUSION

13.05.2014

Page 41: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

Weblogic Challanges• WLS Swiss army knife for JEE• New remote data centre• Change deployment model• Do something with Admin server• So far so good but

• Oracle, please, don’t mess it up• Developer productivity• Keep it simple <-> Fusion?

Page 42: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 42

Java Platform

• Problem:• Growing demand/Limited resources

• Answer:• OnDemand model• One platform

• What made it possible?• Agile Infrastructure• Java technologies• Integration with IT services

13.05.2014

Page 43: Weblogic at CERN now and in the future 13.05.2014 SOUG2 Swiss Oracle User Group Artur Wiecek Infrastructure and Middleware Services CERN IT Department

SOUG 43

Thank You

13.05.2014