tuning genie earth system model components using a grid enabled data management system andrew price...
TRANSCRIPT
![Page 1: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/1.jpg)
Tuning GENIE Earth System Model Components using a Grid Enabled
Data Management SystemAndrew Price
University of Southampton
http://www.genie.ac.uk/
UK e-Science Programme, Booth 2140SC2004, Pittsburgh, USA
11th November 2004
![Page 2: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/2.jpg)
http://www.genie.ac.uk/
Outline
• Introduction• Scientific aims of GENIE• e-Science tools
– Data Management System– Geodise Toolboxes– OPTIONS Design Search and Optimisation
• Results• Future work• Conclusions
![Page 3: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/3.jpg)
http://www.genie.ac.uk/
Introduction
The GENIE project is developing a Grid-based system to:
• Flexibly couple together state-of-the-art components to form a unified Earth system model
• Execute the resulting model on the Grid
• Share the distributed data produced in simulations
• Provide high-level open access to the system, creating and supporting virtual organisations of Earth system modellers
![Page 4: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/4.jpg)
http://www.genie.ac.uk/
Scientific Aims
ice-age ice-ageice-ageice-age
• Orbital parameters affect incident radiation and climate• Biological and geological processes interact with, and
feedback upon, the climate (via, for instance, CO2)
![Page 5: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/5.jpg)
http://www.genie.ac.uk/
The target GENIE Model
3D atmosphere
3D ocean
2D sea ice
AtmosphericCO2
2D land surface
Land vegetation
Ocean biogeochemistry
Ocean sediments
3D ice sheets
Atmosphere – Bristol’s IGCM3Ocean – SOC’s GOLDSTEIN
Land – Met. Office’s TRIFFIDLand ice – Bristol’s GLIMMER
Ocean biogeochemistry andsediments – UEA’s BioGEM
![Page 6: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/6.jpg)
http://www.genie.ac.uk/
Initial GENIE experiments
• Initial studies in GENIE performed parameter sweeps to investigate the properties of the model
![Page 7: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/7.jpg)
http://www.genie.ac.uk/
e-Science Tools
• Data Management System (augmented version of the Geodise Database System)
• Matlab scripting environment• Geodise Toolboxes• XML Toolbox• OPTIONS Design Search and Optimisation
package• Template and Example scripts
![Page 8: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/8.jpg)
http://www.genie.ac.uk/
Data Management System
JavaClient Code
Apache Axis
CoG
JythonFunctions
Globus Server
Geodise Database Toolbox
Metadata Database
Client Grid
SOAP
MatlabFunctions
DatabaseWeb Services
AuthorisationService
LocationService
Metadata Archive & Query
Services
Jython
XML Schema
GridFTP
Portal
![Page 9: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/9.jpg)
http://www.genie.ac.uk/
Data Management Client
1
2
3
4
5
![Page 10: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/10.jpg)
http://www.genie.ac.uk/
Geodise Toolboxes
Geodise Compute Toolbox
gd_createproxy.m Creates a Globus proxy certificate for the user's credentials
gd_destroyproxy.m Destroys the local copy of the user's Globus proxy certificate
gd_jobsubmit.m Submits a compute job to a Globus GRAM job manager
gd_jobstatus.m Gets the status of a Globus GRAM job
gd_putfile.m Puts a remote file using GridFTP
gd_getfile.m Retrieves a remote file using GridFTP
gd_rmfile.m Deletes a remote file using GridFTP
gd_makedir.m Creates a remote directory using GridFTP
gd_rmdir.m Deletes a remote directory using GridFTP
Geodise Database Toolbox
gd_archive.m Archives a file or data structure to the database
gd_query.m Query the database for data matching specified criteria.
gd_retrieve.m Retrieves a file or data structure from the database
![Page 11: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/11.jpg)
http://www.genie.ac.uk/
Grid Computation
OptionsMatlab
UK National Grid Service (GT2)Oxford Leeds
RAL Manchester
Local Resource (GT2)
GENIE Database
objfun.m objfun_parse.m
optjobparallel.m
OptionsMatlab invokes the wrapped binary using parameters provided by the selected optimisation algorithm.
Soton Condor Pool(1700 Nodes)
![Page 12: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/12.jpg)
http://www.genie.ac.uk/
IGCM3 Atmosphere Model
iii
cellscells
ncepi
cellscells
ncepi
obsi
i
xfwxobjfun
N
Areax
N
Areaxx
xf2
2
• The objective function is a weighted sum of the RMS differences between the model state and NCEP data.• Compare annual means for a number model fields.
![Page 13: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/13.jpg)
http://www.genie.ac.uk/
IGCM3 Tuning Results
• 40% reduction in error statistic compared to default parameters
• Similar result to a parallel study performed using the Ensemble Kalman Filter
• Model physics insufficient to perfectly match observational data.
![Page 14: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/14.jpg)
http://www.genie.ac.uk/
e-Science Summary
![Page 15: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/15.jpg)
http://www.genie.ac.uk/
Conclusions
• Provided the environmental scientist with a toolset for tuning GENIE models:– Scripting environment– Database repository– Computational Grid interface– Suite of generic optimisation algorithms
• A Global minimum can reliably be found in low dimensional problem space.
• For higher dimensional problems, the tools are appropriate for locating local minima in the state space.
![Page 16: Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK](https://reader030.vdocument.in/reader030/viewer/2022032709/56649ebb5503460f94bc38d1/html5/thumbnails/16.jpg)
http://www.genie.ac.uk/
The GENIE Team
Coordinator: Tim Lenton – CEH Edinburgh
Principal investigator:Paul Valdes – Bristol
Research Team and Collaborators:James Annan – FRSGC, Japan Chris Brockwell – UEA Norwich
David Cameron – CEH Edinburgh
Peter Cox – Hadley Centre (UKMO)
Neil Edwards – Bern, Switzerland
Murtaza Gulamali – London e-Science Centre Julia Hargreaves – FRSGC, Japan Phil Harris – CEH Wallingford
Dan Lunt – Bristol
Bob Marsh – SOC
Andrew Price – Southampton e-Science Centre
Andy Ridgwell – UBC, Canada
Ian Rutt – Bristol
Gang Xue – Southampton e-Science Centre
Andrew Yool – SOC
Management Team:Melvin Cannell – CEH Edinburgh
Trevor Cooper-Chadwick – Southampton e-Sci. Centre
Simon Cox – Southampton e-Sci. Centre
John Darlington – London e-Science Centre
Richard Harding – CEH Wallingford
Tony Payne – Bristol
John Shepherd – SOC
Andrew Watson – UEA Norwich
Thanks toSteven Newhouse