art vandenberg account manager customer relations/research art vandenberg account manager customer...
TRANSCRIPT
A.Vandenberg 1
Art Vandenberg
Account ManagerCustomer Relations/Research
Cloud Computingat Georgia State University
CSc 4998September 14, 2011
Georgia State University
9/14/2011
A.Vandenberg 2
Georgia State Strategic Plan http://www.gsu.edu/strategicplan/
President BeckerPlan adopted Jan 2011
• Goal 1: Become a national model for undergraduate… demonstrating that students from all backgrounds can achieve academic and career success
• Goal 2: Significantly strengthen and grow the base of distinctive graduate and professional programs
9/14/2011
A.Vandenberg 3
Georgia State Strategic Plan
• Goal 3: Become a leading public research university addressing the most challenging issues of the 21st century.
• Goal 4: Be a leader in understanding the complex challenges of cities and developing effective solutions.
• Goal 5: Achieve distinction in globalizing the University.
9/14/2011
A.Vandenberg 4
Cloud Computing for Students• Dr. Yi Pan, computer science, is working with Information
Systems & Technology on cloud computing solutions for campus. http://www.gsu.edu/news/46617.html
• Open source Virtual Computing Lab is improving student computing options. https://cwiki.apache.org/VCL/
• Instead sitting in a computer lab, students can request "images” via a browser - from anywhere.
• MATLAB, SAS, SPSS, Maple… - is available “in the cloud”
9/14/2011
Selecting Matlab2010a (or other options) using my browser…
A.Vandenberg 6
VCL Cloud advantages
• Not just student impact (software available that students did not have before, convenience of working from anywhere,
anytime)• But also lab
impact (images, HW costs, SW costs, complexity,
turnaround time)• AND, it can be
faster!
Initial results with Matlab indicate that VCL performs better than a standalone laptop (Lenovo Thinkpad, Intel Core 2 Duo, 1.9GHz, 2GB RAM)
9/14/2011
A.Vandenberg 7
VCL as a way to address costs -Hardware/Software Cost Cycles: Requested vs. Funded
• Ref: An Analysis of Full Cost Student Computing Labs and Potential for Virtual Computing Options, M. L. Russell, A. Vandenberg and N. Xiong, Poster, 3rd International Conference on the Virtual Computing Initiative, October 22-23, 2009, Research Triangle Park, NC.
9/14/2011
A.Vandenberg 8
VCL Architecture
• https://cwiki.apache.org/VCL/
9/14/2011
A.Vandenberg 9
Small VCL Configuration
ESM
ESM
OPM
MM
1 BladeCenter E chassish 2 Ethernet Switch Modules (BNT Layer
2/3 copper)h Power supplies 3&4 (for 7 or more
blades)h Chassis network module to connect
management node to storage– Fiber Channel - Optical pass through – iSCSI - Copper pass through
2-14 HSxy Bladesh At least one blade configured to attach
to external storage for Image Library (FC, iSCSI, …)
h Server for scheduler, database, and management node
h Server(s) to deliver VCL services Storage for Images
h FC or iSCSI storage array (few TB)
Three NetworksPublic, Private, ManagementIntelligent Images, Security
9/14/2011
A.Vandenberg 10
Scaling VCL
GigE Switch
GigE Switch
Public Network
GigE Switch
Private Management Network Private Network
Network switch Cisco 6509e (or equivalent
in your favorite network vendor flavor)
3 separate networks + VLANsh Network connected to
Internet for user accessh Private Network connected to
VCL management node (for loading and managing images)
h Private Management network (connecting BladeCenter Management Modules and VCL management node - controls power on/off, reboot, …)
VCL Management nodesh One management node for
every ~100 bladesh Physical connection to storage
array - shared file system (GFS, GPFS) for multiple management nodes at one site
9/14/2011
A.Vandenberg 11
IBM Cloud AcademyIBM Cloud Academy - GSU one of inaugural members Nov 2009http://www-03.ibm.com/press/us/en/pressrelease/28749.wss
Initial membership from 16 institutions (K-12, Higher Ed) world-wide - "We are very pleased to be a founding member of this innovative initiative that will
bring on-demand computing resources to all Georgia State students," said J. L. Albert, GSU's Associate Provost, CIO
The mission… provide an organization for K-12 schools and higher education institutions… actively integrating cloud technologies into their infrastructures… to share best practices… and to collaborate with partners to create innovative cloud technologies and models.
IBM Cloud Academy Goals - Forum for exchange of best practices - Access to emerging cloud technology R&D from IBM & partners - Repositories for cloud computing curriculum, tools, resources - Foster pilot projects and collaboration - Disseminate insights, metrics, benefits of cloud computing
9/14/2011
A.Vandenberg 12
Virtual Computing LabVCL installed on IBM iDataPlex - cost effective solution
Students evaluated virtual computing options Jan-Mar 2009 - recommended VCL, iDataplex option
- effective use of student tech fee funding
Acquired iDataPlex October 2009- dx340, 84 nodes (672 cores, 2GB/core)- Power, UPS, HVAC completed Dec 2009
First images January 2010 - config: ESXi for provisioning, LDAP, Antivirus…
Demo accounts released April 2010- image: Windows XP, browser, MS Office+app
Pilot Production accounts released August 2010- base image: 1GB RAM, Windows XP + (MS Office; Matlab, Maple, etc.)
Engineering & frank talk November 20109/14/2011
A.Vandenberg 13
Virtual Computing LabCloud Colloquium, August 30, 2010
Computer Science, Departmental Colloquium- Dr. Andy Rindos, IBM Research, RTP Center for Advanced Studies (CAS), Raleigh, NC- Dr. Bill Robinson, CIS - Windows XP image with IBM Rational Products
Opportunities for collaboration with IBM around cloud computing, including a review of VCL-based education cloud activities around the world.- Dr. Yi Pan, IBM Faculty Award ($24K)
- Potential University Delivery Services (students support/supporting VCL)
Outcome of Colloquium - Demand queue for images:- Dr. Andrey Shilnikov, Neuroscience - Matlab, dynamical systems- Tim Olsen, PhD student - images for process improvement- Dr. Robert Clewley, Neuroscience - Python based environment- Dr. Dave McDonald, CIS - upper level database design courses- Dr. Michael Weeks, CS – programming in Linux/Matlab environment
9/14/2011
A.Vandenberg 14
Technical details of our VCLHigh level summary of experience July 2010…
RedHat Enterprise Linux 5 for iDataPlex management node - ESXi for compute nodes provisioning
- free!- enables multiple virtual machines per single node/hypervisor
(vs. xCAT provisioning of complete node)
Virtualized the head node- avoids “burning” whole node as head node- flexibility for head nodes (devl, test/QA, prod…)
Perhaps Might Have: - configured iDataPlex dx360, not 340 (for remote system administration)
- reversed fast disk on compute nodes & GigE connection via switch
9/14/2011
A.Vandenberg 15
Other technical notesYour experience may vary…
ESXi v.3 - newer version “broke” VCL code - ESXi doesn’t support Windows 7, so using Windows XP
- ESXi v.3 no longer generally available- hope to resolve
Antivirus software may not work well with clones…- McAfee, for instance, refuses to update a virtual image that is - invoked with out-of-synch time-stamp.- We’re use MS Security Essentials
Multimedia experience may be limited - Ericom’s BLAZE (http://www.ericom.com/) being tested by GMU
9/14/2011
A.Vandenberg 16
A Faculty teaching perspective…
Dr. Predrag Punosevac, GSU Mathematics & Statistics
On Jan 27, 2010, at 12:04 AM, Predrag Punosevac wrote:Dear Art,
This is so COOL! I was just using Windows 2003 image in the full screen mode over RDP (rdesktop) on my PIII laptop 700 MHz and 128 MB of RAM which is running OpenBSD 4.5.
The session was so snappy, I could not believe my eyes. It is faster then DeLL workstation in my office with Core 2 duo and 4 GB of RAM.…
Predrag
P.S. I am like kid now :-)
I will now play with RedHat images.
9/14/2011
A.Vandenberg 17
Another Faculty perspective…
Dr. William Robinson, GSU Computer Information Systems
On Sep 30, 2010, at 11:53 AM, William Robinson wrote:Kelly,
I’m concerned about the vcl. I just now reserved and ran an image. It took about 3 minutes to get the reservation. Then, I tried to connect. It failed until about 10 minutes later. Then, everything was fine.
This was after all the students had left.
I’m concerned that:- Its too slow- Cannot handle 20 students- Unreliable
I have to make other plans. I’ve contacted IBM about their cloud and will start restart our CIS vcl.
9/14/2011
A.Vandenberg 18
An Engineering perspectiveIS&T Managing Technology Engineer’s feedback – November 2010
1) VCL is not a turnkey product.
There is not a clean definition of what is code vs. configuration, there is not a clean path for defining what you would need to customize. Most commercial software would document a few different install options based on how you were going to use the software, and have some descriptions of what those configuration require in order to function.
2) VCL software is not designed to keep a good separation between users and infrastructure.
For example the VM that the user is given access to has two network interfaces, one of which is on a network that has infrastructure components (ESXi management interface on it).
9/14/2011
A.Vandenberg 19
An Engineering perspective…
Your experience may vary…
3) iDataPlex network switches are a black box set of switches.
…Even IBM has a hard time making them do more advanced configurations. This makes debugging of issues that might involve the network extremely difficult, even if you have support from IBM.
4) iDataPlex is built around xcat.
…But xcat doesn't (or at least IBM install engineer could not) get it to deploy ESXi.
5) We did KVM on the head node.
…Which is helpful for allowing you to get a production and development system running on the same physical hardware, but this to adds a layer of complexity that IBM has a hard time offering support, especially if KVM, XCAT and the network switches all need to be looked at while trouble shooting a problem.
9/14/2011
A.Vandenberg 20
An Engineering perspectiveThe short answer…
The short answer is our implementation is going VERY slowly, and consuming a LOT of time.
We will eventually get it working, but if you factor in cost of staff time, we would have been much better off selecting a commercial product. A commercial product would have been in production sooner, cost us less, and in the long run be more maintainable, especially should we face any staff turn over issues in the future.
9/14/2011
A.Vandenberg 21
My (Art Vandenberg) perspectiveThe short answer…
Disruptive technologies are that.We need to understand that production, research, teaching have different perspectives.
We need to work together on solutions (what is taking me forever may be easy for you to solve…)
The future is not built by doing the same thing as today
Update September 2011As part of VCL Office hours, we alerted NCSU developers to our performance issues
IBM, VCL developers conf called with GSU technical – recommended steps to take
VCL 2.2.1 inplemented
And by the way, our experience was similar to that of VCL Bootcamp performance
9/14/2011
Pop quiz: If NCSU has 1000-2000 blades across multiple racks and GSU has 84 blades in one rack, would there be different performance?
A.Vandenberg 22
IBM Cloud Academyan overview and timeline
9/14/2011
23
The mission of the IBM® Cloud Academy is to provide an organization for K-12 schools and higher education institutions who
are actively integrating cloud technologies into their infrastructures to share best practices in the use of clouds and to collaborate with
partners to create innovative cloud technologies and models.
IBM and education: collaborating for innovation
IBM Cloud Academy
From IBM Cloud Academy charter as developed by initial member institutions, 1Q 2010
24
Integrate
Cloud Services and Technologies
Implement solutions for education based on IBM world-class cloud services and
technology, accelerating the transformation to a Smarter Planet™
Collaborate
with peers, researchers and developers
Work with colleagues from around the globe in a cloud-based collaboration forum to share best practices, ideas,
and insights
Innovate Cloud services and technologies
Participate in the definition of emerging cloud technologies and implementations with IBM researchers, developers and Business Partners
Three Functions of the IBM Cloud Academy
25
What are the goals of the IBM Cloud Academy?
• Exchange of best practices – Accelerate deployment of successful models
• Access to emerging technologies – Gain insight from IBM developers and research
• Creation of a repository – Provide curriculum, tools and resources
• Support for pilot and collaborative projects – Evaluate technical, financial and service qualities
• Dissemination our findings– Document experiences, performance metrics, and benefits
IBM Cloud Academy Charter, 1Q 2010
26
Membership qualifications criteria and responsibilities
– Integrate IBM cloud computing technologies and solutions into institutional infrastructure
– Institutional-level commitment to participle over a multi-year membership
– Commitment to collaborative projects and initiatives
– Engage. Use cloud computing technologies and solutions
– Participate. Share insights, lessons learned and experiences members and the broader education community.
– Advance. Contribute to or lead strategic projects
– Influence. Provide IBM with feedback on cloud computing solutions and offerings
IBM Cloud Academy Charter, 1Q 2010
Membership participation qualifications
Member responsibilities
27
Membership benefits• Community Access. Access to a support community that is changing local IT culture by
embracing cloud computing.
• Knowledge Sharing. Thought leaders and technical experts with knowledge of proven cloud computing technologies and solutions.
• Project Support. Technical and business case examples, benchmarking data and access to resources that support cloud computing projects.
• Project Funding. Funding opportunities for cloud computing projects and research that are competitively awarded
• Resources. Strategies to use cloud computing to transform education and research in K-12 and higher education globally.
• Headlights: Trends in K-12 and higher education globally as relates to the move to cloud computing models and approaches.
IBM Cloud Academy Charter, 1Q 2010
28
Collaboratory used for IBM Cloud Academy member projects
• Collaboratory– Members from around the globe work together using IBM LotusLive™ cloud
services with web conferencing, social networking and collaboration tools
• Collaborative themes • Selected by the IBM Cloud Academy governing board
– 2010 focus themes: • Enhancing research computing using cloud computing• Delivering educational resources with a cloud • Building the institution’s future infrastructure and roadmap with cloud
• IBM technical community support– Initiatives supported by a technical board comprised of IBM researchers,
architects, developers and members of the IBM Academy of Technology specializing in cloud computing
IBM Cloud Academy’s first white paper illustrates a statewide approach:“The Transformation of Education through State Education Clouds”
OC12 (622 Mbps Cicruit)
OC48 (2.4 Gbps Circuit)
DWDM (10 Gbps Ethernet)
WFU
North Carolina Virtual Computing Lab / VCL cloud featuredProduction/pilots/users also present within:NC Community College SystemNC K-12
NCA&T
Research
Production/Pilots/Users
Interest/Plans
Available on IBM Cloud Academy website: http://www.ibm.com/solutions/education/cloudacademy/us/en/
29
30
K-12 and higher edsuccess storiesalso available
on website
31
IBM SmartCloud for Educationofferings to get started
Education Workloads
LotusLive!
Life-cycle and service
management
Analytics
CollaborationDevelopment
and test
Desktop and
devices
Infrastructurestorage
Infrastructurecompute
Businessprocesse
s
Educationsolutions
IBM SPSS®Decision Management
for Education
IBM SmartCloud Enterprise
IBM BladeCenter® Foundation for Cloud
IBM SmartDesktop Cloud
IBM Smart Business Storage Cloud
*Note: Only key offerings mentioned, many more
available
Turn information into insights
Increase agility
Connect and empower
people
Drive Effectiveness & Efficiency
Offerings on IBM SmartCloud
IBM ‘For Cloud’ (private)Enabling Technologies
IBM Tivoli®Provisioning Manager
Virtual Computing Lab
Cast IronCloud Integration
32
IBM Cloud Academy member locations globally (growing each month)
HanoiVietnam
Silicon ValleyCalifornia
DublinIreland
São PauloBrazil Johannesburg
South Africa
BangaloreIndia
TokyoJapan
IBM Cloud Labs
SeoulS. Korea
BeijingChina
IBM Cloud Academy Members
ibm.com/solutions/education/cloudacademy
33
It is a new IT consumption and delivery model well suited for colleges, universities and K-12 schools
Is cloud computing really all that new? Yes and no.
Centralized Computing
Client-Server
Virtualization
Internet
Cloud is a derivative of what we have done in the past,
and is enabled by a convergence of maturing technologies
Cloud computing
34
“Cloud-onomics”: Why education is looking to the cloud
CLOUD COMPUTING
= OPTIMIZED
SERVICES=AGILITY + BUSINESS
AND IT ALIGNMENT +SERVICE
FLEXIBILITYINDUSTRY
STANDARDS+
=REDUC
EDCOSTS
….makes use of virtualization, standardization and automation to free up operational budget for new investment
=VIRTUALIZATION + ENERGY EFFICIENCY +STANDARDIZATION
AUTOMATIONAND SELF SERVICE+
…allowing you to optimize new investments for direct business benefits
35
Cloud computing helps move beyond organizational silos
With cloud computingWithout cloud computing
Virtualized resources Automated deployment
of IT resources Standardized services
Location-independent
Rapid scalability Self-service
• Software• Hardware
• Storage• Networking
• Software• Hardware• Storage• Networking
• Software• Hardware• Storage• Networking
Universities, for example, can be the innovation centers within Smarter Cities™; associated business incubator & entrepreneurship parks for job & business creation
36
There is a spectrum of deployment options for cloud computing
Third-partyoperated
Third-party hosted and operated
Client data center
Client data center
Private cloud Hosted private cloud
Managed private cloud
Client
Shared cloud services
Client A Client B
Public cloud services
A
Users
B
Internal/Private PublicHybridIT capabilities are provided “as a service,” over an intranet, within the client and behind the firewall
Internal and external service delivery
methods are integrated
IT activities / functions are
provided “as a service” over the
Internet
64%
30%Public
Private
Note: Not all workloads will move to cloud!
Source: IBM Market Insights, Cloud Computing Research, July 2009. n=1,090
Cloud workload preference
37
Cloud computing benefits in education
Students:
Raises computing resource accessibility, even in underserved districts
Increases availability and integrity of data, applications and research materials
Adds mobility
Reduces client application and system resource footprint
Amplifies application and computing performance
Improves server and data storage capacity
Offers convenient web access
Faculty:
• Grants accessibility to virtual machines
• Schedules delivery of assignment instructions, study materials, syllabi or software
• Enables faculty to create custom images for specific course, independent of (and not conflicting with) other faculty course images
• Unites departments and campuses to eliminate information silos to deliver comprehensive educations
Administration:
Standardizes applications and processes
Provisions software, resources and management of data
Lightens the burden of software version control
Reduces total cost of ownership (TCO)
Lowers the need for in-house IT staff
Cuts resource management costs including power and cooling
Raises server utilization and software licenses, reducing purchasing requirements
Brings greater virtualization
Optimizes resource allocation
A.Vandenberg 38
March 25, 2010
IBM Cloud Academy
9/14/2011
A.Vandenberg 39
Preliminary Results of the Survey for Collaborative Themes
IBM Cloud Academy Collaborative Themes Votes
Research computing models using clouds 5Delivering educational resources via a cloud 4Analytics and business intelligence on the cloud 3Building the institution's future infrastructure 1Roadmap for adoption and integration into current infrastructure 1Security, identify, trust and privacy on clouds 1Enhancing accessibility through cloud services 0Financial impact and benefits of cloud computing 0Impact on learning and teaching of cloud computing 0Impact on learning and teaching of cloud computing 0Open Standards for cloud computing 0Web 2.0 for improved collaboration using cloud services 0
9/14/2011
A.Vandenberg 40
April 8, 2010
IBM Cloud Academy
9/14/2011
A.Vandenberg 41
Cloud Computing Seminar April 22-23 Preliminary Agenda: Thursday, April 22nd
9:00 - 9:10 AM Welcome 9:10 - 10:00 AM NC Education Cloud & Virtual Computing Lab (VCL) Apache Project - Mladen Vouk, NC State Assoc. V. Provost IT & CSC Dept. Head, Aaron Peeler, Program Manager Advanced Academic Computing Initiatives, et al. 10:00 - 10:25 AM The VA VCL and Cloud Computing at George Mason University - Sharon Pitt, GMU Executive Director of the Division for Instructional Tech. & John Savage, GMU Director Advanced Academic Computing 10:25 - 10:45 AM Cloud Computing at VA Tech and K-12 Outreach - 10:45 - 11:00 AM Break 11:00 - 11:20 AM Cloud Computing at Georgia State University - Art Vanderberg, GSU Director Advanced Campus Services, & Kelly Robinson 11:20 - 11:40 AM Cloud Computing within the University System of Maryland (incl. UMBC) - Yelena Yesha, Co-director, Multicore Computational Center (UMBC) 11:40 AM - noon The HBCU (Historically Black Colleges and Universities) Cloud - Ramon Harris, Director, Tech. Transfer Project (Exec. Leadership Council) noon - 1:00 PM Lunch, discussion 1:00 - 1:45 PM The IBM Cloud Academy Program - Patty Sullivan (IBM WW Education) 1:45 - 2:15 PM Global University Programs and Cloud Computing –
JoAnn Washam Winson (IBM GUP 2:15 - 2:45 PM The IBM University Delivery Services (UDS) Program –
Alex Harvilchuck (IBM GBS) 2:45 - 3:00 PM Break 3:00 - 3:45 PM IBM Hardware Solutions for Cloud Computing - Dave Doria (IBM STG) 3:45 - 4:30 PM IBM Tivoli Cloud Computing Products - Pratik Gupta (IBM SWG) 4:30 - 5:15 PM IBM Services Solutions for Cloud Computing - Jack Santoni (IBM GTS) 5:15 - 5: 30 PM The IBM WebSphere CloudBurst Appliance - Andy Rindos (IBM SWG) 5:30 - 5:40 PM Wrap-up Friday, April 23rd 9:00 - 10:00 AM IBM Research Cloud Computing Activities (incl. Research Compute Cloud) 10:00 AM - noon Additional education presentations and follow-up discussions noon - 12:30 PM Wrap-up and end of seminar
Friday, April 23rd (further update on call)
IBM Research Cloud Computing Activities (including the Research Compute Cloud)
Additional education presentations and follow-up discussions
9/14/2011
A.Vandenberg 42
May 6, 2010
IBM Cloud Academy
9/14/2011
A.Vandenberg 4343
Binghamton University – SUNY (April 22 - 23)
9/14/2011
44
• IBM philanthropic endeavor• Launched: November 2004• Donates massive compute power to
projects solving humanitarian and world problems using grid technology
• Public donates spare PC cycles• Direct results to public domain• Grow membership for multiple
projects – leverage recruitment effort
Over 342,000 CPU years 300 cpu years in typical weekday 1.52 million devices 509,000 members
Over 100,000 IBM employees 222 countries
45
How it works
• Member joins – Register at web site WCGRID.ORG– Download software– Install software
• Agent asks for work• Device processes work at
lowest CPU priority• Device contacts the servers• Repeat…
World Community GridServers
Returns computed results
Gets new work unit
Don’t have to leave computer on 24/7…. Just use it as you normally would“BOINC” software Berkeley Open Infrastructure for Network Computing
A.Vandenberg 46
What research is being run on World Community Grid
9/14/2011
47
Typical Project
• Large computing problem is split into millions of smaller independent runs
• Donor machines around the world request those work units from our servers
• The machines return their results after they have processed them
• Servers assemble pieces of the answers to produce the final results of the research project
• Direct results made available in the public domain
Input
Output
48
And it is GREEN
• We don’t ask people to leave computers on 24/7, just use them as they normally would
• Default CPU use set to 60% to limit extra energy consumption• Checkpointing to not lose results computed so far• Can limit further with custom settings
75
50
50% 100%
CPU utilization
Watts
Thinkpad T42p power consumption
49
Running on a Cloud
• Cloud runs virtual images of production work• Hardware supports virtual images• Run World Community Grid at lowest priority on hardware not fully
utilized by production work VS. Run as a virtual image
VMVM
VMVM
VMVM
VMVM
VMVM
VM
VM VM
50
World Community Grid assumes the burden of running the grid
• Security work• Grid enabling new projects• Importing research data• Creating work units• Scheduling work units• Voting on results• Combining results• Backups• Results to researchers• Monitoring disk space• Checking errant devices• Problem work units• Helping the scheduler• Web site modifications• Forum monitoring• Support emails• Soliciting new research• Beta testing• System updates / upgrades• Audits
Georgia State University has been a World Community Grid Partner since July 2007!http://www.worldcommunitygrid.org/
GSU team contributes to a dozen different such projects (over 44 years of compute total) and we are ranked overall as #781 out of 27,061 teams.
Join GSU team: http://www.worldcommunitygrid.org/reg/viewRegister.do And then search for and select GEORGIA STATE UNIVERSITY team.
A.Vandenberg 51
June 29, 2010
IBM Cloud Academy
9/14/2011
52
Participants in ICA-sponsored are encouraged to become contributors to the VCL Apache incubator project http://incubator.apache.org/projects/vcl.html – The Apache ICLA (Individual Contributor License Agreement) that should be filled out
can be found at: http://www.apache.org/licenses/icla.txt The VCL code base consists of
– (a) a PhP-based GUI front-end (currently using the Apache web server) – (b) a PERL-based back-end management daemon, and – (c) a database (with defined/input metadata) through which front- and back-ends
intercommunicate – currently MySQL. Some immediate project opportunities around the VCL code base include:
– Extending VCL database support (beyond just the current MySQL)• Code changes to (a) & (b) above have been made allowing VCL to use Derby or DB2.• A general approach has been to integrate other DBs, e,g., Informix, Oracle.
– Extending VCL native hypervisor support • VCL currently directly supports various flavors of VMware, with a module providing
KVM support under test• Other native hypervisor support needs to be developed, e.g., for XEN.
– Extending VCL deployment modules beyond xCAT• A module allowing VCL deployment using TPMfOSD is almost complete• A module integrating IBM Director with VCL, allowing deployment of Virtual
Systems Pools has been completed, with opportunities to further extend that work.
ICA Infrastructure Projects around VCL
53
ICA Infrastructure Projects around VCL (cont.)
– Extending VCL web server support (e.g., to accommodate IHS, sMash, etc.)– Extending VCL to interoperate with/access resources from other public or private clouds.
• VCL can currently access mainframe LUs from the Marist College mainframe supporting the IBM System z Academic Initiative
• Other clouds/cloud stacks with which VCL could interoperate include through the development of appropriate (PERL) modules include: IBM CCMP, IBM TSAM, Amazon EC2, Microsoft Azure, Eucalyptus, OpenNebula, etc.
– Extending the security and access management capabilities of VCL• Engagement in the NC State sponsored SOSI (Secure Open Systems Initiative) project• Enabling VCL private VLAN support
– Integrating image management technologies/solutions into VCL• Also exploring image repository technologies through projects like Olive.org
– Providing additional metering and charge back capabilities to VCL– Integrating more analytics into VCL management
• For example, developing smarter pre-provisioning algorithms beyond last used – Extending VCL hardware platform support (especially for high-end HPC platforms)– Extending degree of VCL virtualization support– Extending VCL real-time and rendering application support
• Exploration of NoMachine etc. protocols, user-side applets, etc.
Andy
HBCU Cloud
GA Education Cloud
NC Education Cloud
MD Education Cloud
SC Education Cloud
VA Education Cloud
HBCU
HBCU
HBCU
HBCU
HBCU
Southern State Education Cloud Consortium
Opportunity: GSU as nucleus of GaCloud?
A.Vandenberg 55
July 29, 2010
IBM Cloud Academy
9/14/2011
A.Vandenberg 56
Maritta
9/14/2011
A.Vandenberg 57
August 26, 2010
IBM Cloud Academy
9/14/2011
A.Vandenberg 58
Art
9/14/2011
59
http://vss.umwblogs.org/
Sharon
A.Vandenberg 60
September 30, 2010
IBM Cloud Academy
9/14/2011
A.Vandenberg 61
Ramon
9/14/2011
A.Vandenberg 62
• Welcome to Dr. Jerzy Kotowski – President of Cloud Committee at the University
• First university cloud computing center in Poland– http://www-03.ibm.com/press/us/en/pressrelease/32
226.wss– Cloud-focused courses to more than 1,500 students– Started with 500 students over the summer
ICA Welcomes: WROCLAW UNIVERSITY OF TECHNOLOGYChris B
9/14/2011
A.Vandenberg 63
October 28, 2010
IBM Cloud Academy
9/14/2011
A.Vandenberg 64
John Digilio
9/14/2011
65
A.Vandenberg 66
• Welcome to Dr. Omar Al-Jarrah – Vice President and CIO will be JUST’s liason to the IBM Cloud Academy
• New Center of Excellence for Service Science Innovation based on Cloud– http://www.just.edu.jo/News/Lists/Activities/display.aspx?List=525a663d-304f-442
0-a708-6adc93023c93&ID=102&RootFolder=%2FNews%2FLists%2FActivities
– IBM CloudBurst 2.1 environment to nurture Service Science Innovation– Will deliver teaching resources & technology expertise to students via cloud,
including• Developing new curricula on key technology areas such as Service Oriented
Architecture (SOA), Business Processes Management (BPM), Business Analytics, Business Processes Optimization (BPO), Service Science and Cloud Computing.
ICA Welcomes: Jordan University of Science and Technology
Chris B
9/14/2011
A.Vandenberg 67
December 16, 2010
IBM Cloud Academy
9/14/2011
68
Özyegin University• A new non-profit university located in Istanbul, Turkey
– Focused on becoming an entrepreneurial research university– New departments and Research centers are being added– The student body is growing almost exponentially– Every registered student is given a laptop/netbook– Classroom teaching is coupled with online CMS (Moodle)– Student emails are maintained at Google
69
The Goals• Integrate Cloud Computing into curriculum • Encourage use of Cloud Computing in academia• Help faculty to easily adopt emerging technologies• Enable online/offline computer-based exams with 100s of
students• Enable E-science and E-engineering
“Ozyegin University has become a very critical and preferred partner for IBM Cloud Academy in Turkey, especially for the development of Cloud-based and traditional E-education curriculum. Distinguished research and academic capability of the university is unique and promises a bright future for high quality education in Turkey.” Jale AkyelIBM University Relations Leader, Central Eastern Europe and Turkey
70
The Challenges
• Adopting state-of-the-art, but fast-changing technologies– Many courses have accompanying lab sessions– The speed of change in technology puts pressure on the physical
infrastructures including the IT infrastructures– E-engineering and E-science are evaluated as feasible alternatives
• Reduce IT-related burden on faculty & Reduce software-maintenance burden on IT
– Engineering software can be hard to install & maintain– IT staff cannot deal with the support of all software from different
engineering disciplines (faculty either too busy or not tech-savvy)– Cloud-based software support customized for specific courses and
maintained elsewhere will be helpful
71
The Solution• Apache Virtual Computing Lab (VCL) and similar others
– Being tested over IBM servers to dynamically grant researchers and instructors access to computational resources and revoke these resources when not needed
• E-Engineering platform services developed as part of the Cloud@Özyeğin initiative.– Finite element analysis (FEA) cloud service – Data mining & modeling service for collaborative analytics– Complex event processing service– IaaS configurations
• Virtual MPI and Hadoop clusters
72
The Progress– Research:
• Implementing a cloud-based FEA service to be used for HPC research and teaching in several engineering departments.
– Teaching: • Combination of USB-bootable operating systems (OS) with cloud applications
to deliver custom-designed and network-controlled applications (labs and exams) to hundreds of students simultaneously
– Collaboration: • Testing Drupal and Liferay as front-end portals to our services• Installation and testing of IBM LotusLive/LotusQuickr™® suites is in progress to
bring together members of IBM Cloud Academy in Turkey
7373
IBM Global Education 2010
Trends in Virtual Classrooms
• Ubiquitous Mobile Devices – Challenging the traditional virtual classroom platforms to move into mobile device platforms.
• Research Collaboration - Virtual Classrooms are facilitating research and grant proposals among faculty and graduate students.
• Easy Data Reporting - Pressure from administration and school officials for success metrics and data are accelerating the use of virtual classroom platforms because of their built in analytics.
• New Teaching Models – Breakout rooms, micro-lectures, collaborative class projects, etc. are enabling creative teaching methods. Distinct move from “sage on the stage” to collaborative teaching environment.
Patty Sullivan
A.Vandenberg 74
Biweekly birds-of-a-feather calls for the community of VCL users. Proposed title: “VCL Virtual Office”.– Each week, a VCL community member will discuss a defined VCL issue or topic (technical
tutorial, suggested best practices, user experiences, etc.) – followed by an open discussion period, where members can discuss problems they are facing, joint projects they would like to launch, etc.
– If you would like to participate, please send me an email with your availability to [email protected]
– Feel free to provide a VCL issue or topic that you would like to discuss on these calls. We are soliciting volunteers for the first few presentations slots.
Once again, for those interested in VCL, you can:– Install the open source VCL cloud computing code. All material can be found at
http://incubator.apache.org/vcl/• Installation documents: https://cwiki.apache.org/VCL/vcl-installation.html
Participants who wish to contribute code changes will need to join the VCL Apache incubator project at http://incubator.apache.org/projects/vcl.html
• The Apache ICLA (Individual Contributor License Agreement) that should be filled out can be found at: http://www.apache.org/licenses/icla.txt
ICA Infrastructure Projects around VCL (Virtual Computing Lab)
9/14/2011
75
Development & Research Work on “HPC-as-a-Service” Model Son Huynh
HPC Infrastructure
Virtual Private Clusters (Virtual) Production Cluster
Maya
Virtual Compute Nodes
Moab
Compute Nodes
LoadLever
ADM Private Cluster
InfinibandiDataplex GPFS
Compute Nodes
Power UsersSchool Admin
Request virtual private clusters
Normal Users
Submit Jobs
HPC Center Admin
Approve requests
Virtualized InfrastructureVirtual Nodes, Virtual Private Clusters, Virtual Networks
Cloud Management Platform
HPC Cloud PortalSubmit Jobs
Cloud API
Moab API
HPC Cloud API
Visualization
Hadoop App.’s
Weather Modeling
Virt
ua
l P
riva
te
Re
sea
rch
C
lust
ers
MANAGING HPC COMPLEXITY
WITH CLOUD INFRASTRUCTURE:
• Performance & Utilization
• On-Demand Resource Deployment
• Self-Service Web Access
• Automation Workflow
• Capacity Planning
• Dynamic Scalability
• Network Partitioning
(Multi-tenancy)
• Monitoring & Tracking
• Usage Accounting
• Centralized User
Management & Security
School Faculty & Students
Research Community
Cloud ServiceProvider (CSP)(IT/Data Center)
Seismic Modeling
Portfolio Trading Analytics
76
Research Collaboration on Cloud Son Huynh
Percent R&D Investments of the overall GDP:
•Qatar: 2.8%•Arab: 2%• Brazil, Costa Rica, Cuba: 0.9%• Israel: 4.93%• Sweden: 3.8%• EU: 1.9%• India 0.8• World: 1.7%
CMU-Q: Performance Impact byProvisioning Variation on Cloud
Presented at IEEE CloudCom 2010
AALIM: Advanced Analytics for Information Management
• Text mining: Extracting diagnosis from reports
• Extracting measurements from reports
• Evaluating clinical decision support - EKG
• Echo video analysis: spatio-temporal trajectories
• Multimodal Fusion of modality searches
Research
77
Cloud Computing Roadmap for Education Work Group
• Goal: Provide a resource for the Education Sector to assess the potential use of cloud computing within their organization.
• Assessment Tool – A brief survey tool based on school size, investment funds, IT Skills and other criteria to determine possible cloud computing adoption
A.Vandenberg 78
February 3, 2011
IBM Cloud Academy
9/14/2011
A.Vandenberg 79http://www.ibm.com/solutions/education/cloudacademy
Sharon Pitt
9/14/2011
A.Vandenberg 80
• Sharon, Henry, Art, John and Lee – take a bow:– Link to this recent article on The Invisible Computer Lab published in "INSIDE Higher Ed",
featuring IBM Cloud Academy members: George Mason University, North Carolina State University, Georgia State University, Marist College and California State University, East Bay:
• http://www.insidehighered.com/news/2011/01/20/virtual_computing_labs_could_boom_as_colleges_trim_costs_and_grow_enrollments
Other member activities and events upcoming on the horizon
Chris B
9/14/2011
A.Vandenberg 81
March 10, 2011
IBM Cloud Academy
9/14/2011
A.Vandenberg 82
IBM Cloud Academy Welcomes:
Chris B
Michael Krieger, Unit Mgr for HPC, Research Institute for Symbolic Computation, is liaison to the IBM Cloud Academy community
9/14/2011
A.Vandenberg 83
IBM Cloud Academy Welcomes:Chris B
9/14/2011
A.Vandenberg 84
IBM Cloud Academy Welcomes:
Chris B
Dr. Thoai Nam, Dean of the Faculty of Computer Science and Engineering, is liaison to the IBM Cloud Academy community
9/14/2011
A.Vandenberg 85
May 19, 2011
IBM Cloud Academy
9/14/2011
86http://www.ibm.com/solutions/education/cloudacademy/
Scott Futrell
A.Vandenberg 87
August 18, 2011
IBM Cloud Academy
9/14/2011
88
Hype around cloud has created a flurry of standards and open source activity leading to market confusion.
As important as current standards development efforts are, they are not enough.
There is a lack of a customer driven prioritization and focus within the cloud standards development process.
Context for cloud standards
Cloud computing is a model for enabling cost effective business outcomes through the use of shared application and computing services. The value …. if possible …. is better economics in the execution of business processes.
88
89
The reality of cloud standards
Dozens of new communities and organizations have formed around cloud standards including industries and governments (e.g. China CESI).
90
• Drive user requirements into standards development process.
• Establish the criteria for open standards based cloud computing.
• Deliver content in the form of best practices, case studies, use cases, requirements, gap analysis and recommendations for cloud standards.
• Position your organization as a thought leader in Cloud Computing
Join your colleagues including Aetna, AT&T, Boeing, Citigroup, Daimler, Kroger, Lockheed Martin, North Carolina State University State Street, Valspar and over 180 other organizations!
http://www.cloud-council.org
The Cloud Standards Customer Council, the first customer led consortium designed to shape the face of open standards-based cloud computing.
• Participation –. Primarily C-Level executive, VP of Development, IT management, Enterprise architects, cloud strategy
• Meetings– Monthly virtual meetings. Quarterly face-to-face co-located at OMG events. Participation through forums and subgroups.
• Oversight – Managed by OMG with IBM sponsorship (similar to SOA Consortium)
• Leadership – Founding members form steering committee• Standards Development – This group will not produce standards but
will provide guidance to existing standards development organizations
• Web Presence- Community, Webcasts, Case studies, blogs, vendor showcase, whitepapers, case studies awards.
• Candidate Deliverables – ready to use content in the form of use cases, case studies, requirements, gap analysis and recommendations for cloud standards.
• Awareness – Drumbeat of awareness utilizing events, press, books, analysts partnerships and media.
Structure Deliverables
91
The Cloud Standards Customer Council Status
• Steering Committee has been elected and is now operational • Members include Lockheed Martin, Aetna, Daimler and IBM
• Formal liaison relationships have been established with standards development organizations
• DMTF, OASIS, TOG, SNIA, NIST and OGF
• Working Groups have been created to focus on cross-industry and industry specific aspects of cloud computing
• Practical Guide to Cloud Computing• Service Model working groups: IaaS, PaaS, SaaS• Interoperability in the Cloud• Cloud Reference Architecture• Cloud Business Patterns• Legal Considerations for the Cloud• Social Business Cloud Standards• Industry related working groups: Financial Services, Government,
Education, Telecommunication
A.Vandenberg 929/14/2011
Some more details of the cloud – (from the cloud)
Virtual Computing Laboratory (VCL) BootcampJuly 2011, Raleigh, North Carolina, USA
Attending from GSU:Dr. N. XiongBrian Franklin (CS grad… planning MS)Armad Ellis(CS senior)
http://renoir.csc.ncsu.edu/VCL/Program/program.html
A.Vandenberg 93
Let’s look at GSU
https://vcl.gsu.edu
New version 2.2.1Or prior version (Note: The previous version of VCL can be found here)
9/14/2011
A.Vandenberg 94
Things to do
• Join VCL incubator project• Join mailing lists: vcl-dev, vcl-user• Community (https://cwiki.apache.org/VCL/)
– Interested in joining the community or giving back to open source? There are several ways to assist:
– Join the mailing lists below and discuss ideas.– Contribute bug-fixes or get involved in development.– How to Become a committer– Help with the documentation, both end-user and
installation.– Help improve the website.
9/14/2011
A.Vandenberg 95
For instance, projects - easy(?) harder
• 1) Provide option on the VCL Statistics so that one can download resource management traces, e.g. to CSV file.
Aaron Peeler sent us a sql query (6/22/2011 email). Students can use as start and implement an option to download (e.g. user selectable option to download CSV file)
• 2) A feature that Kelly Robinson (GSU) asked about (8/31/2011 email): "Block Allocation request: Can this be limited so that only those within a particular group (faculty) can make the request?”
Mike Waldron's reply (8/31) was "I don't know a way to restrict this function to specific users. Looks like it would require a coding change for the frontend." That might be another feature of interest.
9/14/2011
A.Vandenberg 96
Use JIRA There are 2 places for these types of features to be listed right now. One is to look at the roadmap listed on the latest release page. However, those features are more high level and rather involved.
The other is in our JIRA* system. Anyone can create new issues there. There are various types of issues that can be created, most notable are:
• Bug• Improvement• New Feature
So, what I would suggest is to create a "New Feature" issue for anything you'd like to see added to VCL. Issues can be voted on. Anyone else wanting the same feature can vote for them so that they become a higher priority to the rest of the community.
Josh- -------------------------------Josh ThompsonVCL DeveloperNorth Carolina State University * JIRA provides issue tracking and project tracking for software development teams to improve code quality and the speed of development.9/14/2011
A.Vandenberg 97
More
• Create Linux base image…https://cwiki.apache.org/VCL/create-a-linux-base-image.html
9/14/2011
A.Vandenberg 98
Closing thoughts
• Ongoing, interactive approach:– Understand strategies - where we are going?– Find alignment with your campus strategy plan– Find common interests
• Value of listening, communication, and participation
9/14/2011
A.Vandenberg 99
More info…
• Art Vandenberg – [email protected]
• http://www.gsu.edu/ist/acs (research computing)
9/14/2011
A.Vandenberg 100
Art Vandenberg
Georgia State University
Thank you
Georgia State University
9/14/2011