national grid – beyond r&d to industry adoption
DESCRIPTION
National Grid – Beyond R&D to Industry Adoption. e-Science Workshop 18 Jul 2006. National Grid Mission. to facilitate the seamless use of an integrated cyber infrastructure in a secure, effective & efficient manner to advance scientific, engineering & biomedical R&D, - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/1.jpg)
National Grid –National Grid –Beyond R&D to Industry Beyond R&D to Industry
AdoptionAdoption
e-Science Workshop18 Jul 2006
![Page 2: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/2.jpg)
National Grid MissionNational Grid Mission
to facilitate the seamless use of an integrated cyber infrastructure in a secure, effective & efficient manner to advance scientific, engineering &
biomedical R&D,
with the longer term goal of transforming the Singapore economy
using grid
![Page 3: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/3.jpg)
Resource Usage by DomainsResource Usage by Domains(Apr 2005 – Mar 2006)(Apr 2005 – Mar 2006)
Defence R&D, 61.7
Digital Media, 0.6
Life Sciences, 34.8
Physical Sciences, 0.3
CERN, 2.6
Defence R&D
Digital Media
Life Sciences
Physical Sciences
CERN
![Page 4: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/4.jpg)
PC GridsPC Grids• Beyond vacation camp …
– Raffles Institution• Mentors: Zhang Xinhuai (NUS) & Dr. Bryan Lee (BII)• Project: Autodocking
– Hwa Chong Institution• Mentor: Dr. Li Haizhou (I2R)• Project: Speech modelling
• Finalizing syllabi (for IDA ICT Club scheme)– Apple, SCS, SES
• Software Platform– United Devices, BOINC & XGrid
![Page 5: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/5.jpg)
AeroGenome – Crunching on a PC AeroGenome – Crunching on a PC GridGrid
• Aim: To study bacterial micro-organisms in the air in Singapore.
• Motivation: Air plays significant role in public & environmental health
• Initial dataset of 20,000 DNA sequences were matched against database of 3 million known sequences. Single run on isolated compute resources took an entire month.
• Same process took less than 2 days on TCG@NUS
• Future: Scale up study using larger datasets.
A
B C
SHOPExhaust Air
Fresh Air (20%)
Air filter A/C
Recycling Air (80%)
AHU fan
Open door
SHOPExhaust Air
Fresh Air (20%)
Air filter A/C
Recycling Air (80%)
AHU fan
Open door
A
B C
SHOPExhaust Air
Fresh Air (20%)
Air filter A/C
Recycling Air (80%)
AHU fan
Open door
SHOPExhaust Air
Fresh Air (20%)
Air filter A/C
Recycling Air (80%)
AHU fan
Open door
[Courtesy of Dr. Patrick Tan, GIS]
![Page 6: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/6.jpg)
Optimal Resource Management – Zones & Containers by Liang Seng Quee (Sun Microsystems)
Virtual Infrastructure – The Next Generation Data Centerby Lee Poh Wah (VMWare)
Key Issues in Grid Computingby Prof. David Walker (Welsh e-Science Centre & Cardiff University, UK)
Using Virtualisation Techniques in a Grid Environmentby Dr. Ruediger Berlich (Institute for Scientific Computing, Germany)
Microsoft Virtual Server 2005 R2 - An Introduction & Real World Application by Arnold Clemente (Microsoft)
![Page 7: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/7.jpg)
07 Feb - Grid Computing: New FrontiersDr. Ruediger Berlich (Institute for Scientific Computing, Germany)
07 Mar – Romance of the PC GridA/Prof. Tan Tin Wee (National University of Singapore)
08 Apr – Grids for Business for Real?Ong Guan Sin (Singapore Computer Systems)
15 May – A Million Years of ComputingDr. David Andersen (UC Berkeley, USA)
08 Jun – From Grid to Pervasive ComputingProf. Xian-He Sun (Illinois Institute of Technology, USA)
Grid is Good: Unleashing Grid Computing to Power Business, Education & Life
07 Jul – Grid: A Tool for Science & BusinessDr. Simon See (Sun Microsystems Inc., Asia)
18 Aug – Commercial Grids: Remote Rendering for 3D AnimationAlfred Lie (Frontline Technologies)
Sep – Grids in EducationBenjamin Khoo (Apple Computers)
06 Oct – AeroGenomeDr. Patrick Tan (National Cancer Center)
Nov – Sensor GridsDr. Lim Hock Beng (ST Engineering)
![Page 8: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/8.jpg)
Brings leaders, critical thinkers &
speakers of international
renown to Singapore several
times a year to provoke thoughts,
stimulate discussions, &
provide insights on a variety of topics in Grid Computing
Prof. Carl Kesselman (USC)
Kevin Walsh (Oracle Corporation)
![Page 9: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/9.jpg)
• Venue: SMU city campus• Date: 16 – 19 May 2006
GECON 2006
Rocks-A-Palooza II
Sun HPC ConsortiumMeeting
![Page 10: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/10.jpg)
Global Operational Grid (GOG)
HP Tiramisu Program
SINGAPORE
CERNPSCSDSC
ANLNCSAPurdue
CaltechCERN LCG
ASCC
GOGCluster
• Implement baseline grid HPC resources• Build partnerships• Industry-relevant IP creation
In collaboration with
![Page 11: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/11.jpg)
International Collaboration & International Collaboration & MembershipMembership
![Page 12: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/12.jpg)
• Members
• PurposeTo provide a forum for national level discussions on setting up grid infrastructures, deploying applications, and facilitating coordination of projects of common interest in South East Asia.
• Meetings – 8 Feb 2006, and 19 May 2006 in Singapore– 3rd meeting is tentatively in Sep 2006, Thailand.
South East Asia Grid Forum
Sponsored by:
![Page 13: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/13.jpg)
Digital MediaDigital MediaRenderingRendering
![Page 14: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/14.jpg)
Digital MediaDigital Media• Free access to common pool of mental ray licenses• No charge to commercial users, IHL users & independent
animators• Digital Media companies that have used the facilities
• TheContentCompany• Omens-Studio• VHQ Productions
• Digital Media companies scheduled to use the facilities• mega media • Cubix International• Cyber-Max
• Grid Service Brokers• Frontline Technologies Pte Ltd
• IHLs• Singapore Polytechnic• Ngee Ann Polytechnic
![Page 15: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/15.jpg)
Pipeline of Animation Pipeline of Animation ProjectsProjects
• Completed– Smoking Fish – Hold onto Your Butt– The Yellowman Shortfilm– UK Bull Dog Singing
• In the queue …– Piko the Silkworm (22 x 2min episodes)– Man Made Marvels Documentary– Zheng He Documentary– Fun Bots– Nutritional Immunology Sciences
Documentary
![Page 16: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/16.jpg)
Usage – Usage – TheContentCompanyTheContentCompany
• A 2-man company
• Title: The Yellowman Shortfilm
• Required resources for rendering a submission to “Cannes Lions 2006” 53rd International Advertising Festival (18-24 June 2006)
![Page 17: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/17.jpg)
Usage – Usage – TheContentCompanyTheContentCompany
• Mental Ray licenses & servers were used to render the entire animation.
• Facts:– 6500 frames were rendered– Urgent request for required resources over
weekend of 7 - 11 April 2006– Generation of background, animation, &
ambient occlusion layers
Time Taken
CPUs Mental Ray Licenses
Grid 10.46 hrs 46 46
Own ~103.64 hrs 1 1
![Page 18: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/18.jpg)
Usage – Usage – TheContentCompanyTheContentCompany
• 2nd Project: UK Bull Dog Singing
• Animation for the World Cup 2006, to be shown on UK television. The commissioning company offers viewers to download ring tone & animation.
• Facts:– 3200 frames were rendered– Generation of background, animation, & ambient
occlusion layersTime Taken
CPUs Mental Ray Licenses
Grid 20 hrs 20 20
Own ~330 hrs 1 1
Speed up of 16.5x
![Page 19: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/19.jpg)
Usage – Usage –
“Smoking Fish – Hold onto Your Butt”
• Public Service Announcement commissioned by the Surfrider Foundation of America to educate the public about how pollution is harming the country’s coastline. • Working in tandem with Hollywood writer Adam McKay (“Anchorman - Legend of Ron Burgundy”, “Bewitched”) & director Ian O’Roarty,
• Omens Studios produced the CG animation for the project. The PSA will be televised nationally in USA in 2006 on various networks.
![Page 20: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/20.jpg)
Usage – Usage –
• Mental Ray licenses & servers were used to render the “sea floor”.
• Facts:– 755 frames were
rendered
Time Taken
CPUs Mental Ray Licenses
Grid 24 mins 40 40
Own ~760 mins 1 1
![Page 21: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/21.jpg)
Usage – Usage – ProductionsProductions
• Proposed rendering job (Life-Buoy) was rendered in-house as it was not large to use the Grid).
• NGO tested rendering the job over the Grid to confirm resolution of porting & cross-platform issues.
• Facts: 50 frames were renderedTime Taken
CPUs Mental Ray Licenses
Grid 10 min 30 30
Own 30 min 10 10
Speed up of 3x
![Page 22: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/22.jpg)
QuotesQuotes
• “It is now easier and faster to visualize our work, instead of waiting for days before the work is finished.”
Tang Chi SimMD, Omens Studios
• “Grid Computing allows local digital media firms to focus on the creative side of things, rather than worrying over the lack of computing resources.”
Yeo Chun ChengCIO, Media Development Authority
![Page 23: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/23.jpg)
Grid Service Broker – Grid Service Broker –
• Frontline Technologies is a company which has started to explore the business of remote rendering for Digital Media companies.
• Frontline will use of the mental ray licenses from NG’s license server & use NG’s servers as spillover
• Frontline will also provide machines to be used on the grid.
![Page 24: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/24.jpg)
DemonstrationDemonstration
![Page 25: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/25.jpg)
Animation Rendering on the Animation Rendering on the GridGrid
Submission Host / Digital Media Portal Network Switch
. . .
Internet / Internet
2
Internet / Internet
2
NGPPNetwor
k
NGPPNetwor
k
Clusters
1
2
3
User connects to the submission host via internet
Submission host is where user’s input & output files resides and where user submits rendering jobs and collects his ourput.
Rendering is done on the resources
Clusters
![Page 26: National Grid – Beyond R&D to Industry Adoption](https://reader036.vdocument.in/reader036/viewer/2022062517/56813463550346895d9b4824/html5/thumbnails/26.jpg)
EndEnd