consortium 2010 - seismic laboratory for imaging and ... · ๏seismic applications are: ... java...

SLIMUniversityofBritishColumbia

Consortium2010

HenrykModzelewski

Software releases and architecture

Thursday, December 9, 2010

SLIM

• Challenges

• Developmentenvironment

• Knowledgetransfer

• Pastsoftwarereleases

• Nextsoftwarerelease

• Conclusions

Outline


SLIM

๏ Seismicapplicationsare:• memorydemanding• computationallyintensive• IOintensive• weuselarge‐scale‐optimizationiterativealgorithms

๏ SLIM’stechnologyisdrivenbymulti‐d(d>2)non‐separabletransforms

๏Academicenvironmentcallsfor• codereuse&reproducibility• fastlearningcurves

Challenges


SLIM

๏ In‐corecomputations:• MatlabandJava• C/C++/FORTRANforlow‐levelimplementations

๏Seismictoolsfordatainput/output:• SeismicUnix,Delphi,SegyMAT,Madagascar (RSF)

๏Scriptingtools:• Unixshells,SCons,Python

๏Parallelism• MATLABandJava(forparallelIO)

Programming tools


SLIM

๏Desktops(forsmall‐problemprototyping)๏Cluster(forparalleldevelopmentandcomputations• 288CPUcores(Intel2.66GHz)• 16TBofdiskspace• Funding:‐ contributiontoinitialpurchase(2006)‐ departmentalefforttoupgrade(2009)

Hardware


SLIM

๏StudentstypicallyhavealreadyexperiencewithMATLABprogramming

๏MATLABintroducedthecapabilitiesthatallowmoreefficientalgorithmdevelopment:• supportforparallelcomputations• supportfordistributedarrays/vectors• MATLABinterfaceswithotherlow‐levellanguages

๏Ourgoalistoisolatestudents,asmuchaspossible,fromlow‐levelprograming

Development in MATLAB


SLIM

๏MATLABaddressesourmajorchallenges:• massiveparallelcomputations• capabilitytohandlelargememoryfootprint• fasterlearningcurve(lesssoftwaretolearn)

๏UnfortunatelyMATLABisnotfree๏ButthereisvastamountofscientificsoftwaredevelopedinMATLAB



SLIM

๏ Thereisstillneedtobuiltorutilizeefficientlow‐levelroutinesandinterfacethemwithMATLAB,like:• 3Dparallelcurvelettransform

๏ SomeoftheexistingMATLABcodeisbeingconvertedorextendedtoallowparallelcomputations,like:• SPOT• SPGL1

๏ Thereisstillneedtoimplementutilitiesforout‐of‐coreprocessinganddatainput/output



SLIM

๏ Currentsoftwareprojects:

• SPOTextensionsforparallelprocessingusingpSPOT

• pSPOT:parallelextensionstoSPOT

• botharesubjectsofthenextpresentations



SLIM

๏ Futureprojects:

• furtherdevelopmentofpSPOT

• improvementstointerfacingout‐of‐coredata

‐ investigatingJavaSeis(www.javaseis.org)

‐ improvementstoRSF‐MATLABinterface

• MATLABimplementationofparallel3Dcurvelets

• nSPOT:non‐linearextensionstoSPOT



SLIM

๏Weintendtomaintain4positionstoaccommodate• part‐timeseniorprogrammer• 2full‐timejuniorprogrammers• part‐timesystemadministrator

๏FocusonsupportingMATLABdevelopment

Programming staff (future)


SLIM

• Publications• Softwarereleases‐ algorithms‐ applications’demos

• Webinars(monthly/bi‐monthly)‐ presentations‐ softwaredemonstrations‐ softwaretutorials

Knowledge transfer


SLIM

๏SoftwareHighlights:• https://wave.eos.ubc.ca/Software/SINBAD/highlights/

๏SoftwareReleases:• https://wave.eos.ubc.ca/Software/SINBAD/

๏Accessibleonlytoconsortiummembers• ([email protected])

Past software releases


SLIM

• 1releasein2006• 2releasesin2007• 1releasein2008• 1releasein2010

Past software releasesWhen:


SLIM

• Wavefieldreconstruction• Wavefieldseparation• Modelling• Imaging• Solvers(ISTc,SPGL1)• Transforms(Curevelets,Surfacelets,...)

• seeWebPagesformoredetails

Past software releases:Categories:


SLIM

• Weplanthenextreleaseinearly2011• Weintendtounifythesoftwarereleaseasmuchaspossibleto:‐ clearlyseparatealgorithmsformapplications‐ packagetogetherasmanyexternalsoftwarepackagesaspossible

‐ includeautomaticdependencies/unittests‐ streamlineinstallationandimplementationofoursoftwareinthecompanies

Next software release


SLIM

• Weplanthenextreleaseinearly2011• Thesoftwarereleasewillcontainthefollowingapplications:‐ L1migrationwithactivecontributionfromsurface‐relatedmultiples

‐ CompressSensingofFull‐waveforminversiongradients‐ CurveletMatchedEstimationofPrimariesviaSparseInversion

‐ Estimationofsurface‐relatedprimarieswithL1inversionandinformedblinddeconvolutiontechniques(update)

‐ ...

Next software release


SLIM

๏Wehave:• builtalargesoftwareframeworkforseismic‐imagingapplications.

• implementednewalgorithmsinthisframework.• buildanumberoflow‐leveltoolstosupportthosealgorithms.

• successfullystartedeffortstointroduceMATLABasourmainresearchanddevelopmentenvironment.

Conclusions


SLIM

๏Wemadeahugeeffortinstreamlining/acceleratingalgorithmdevelopmentandtryingtoallowresearcherstofocusonresearchratherthansoftwaredevelopment,andwewishtopursuethisgoal.

๏MATLABoffersanefficientalternativesodowearecompelledtoexploititandusetoourbenefit.

Conclusions


Acknowledgements

ThisworkwasinpartfinanciallysupportedbytheNaturalSciencesandEngineeringResearchCouncilofCanadaDiscoveryGrant(22R81254)andtheCollaborativeResearchandDevelopmentGrantDNOISEII(375142‐08).ThisresearchwascarriedoutaspartoftheSINBADIIprojectwithsupportfromthefollowingorganizations:BGGroup,BP,Chevron,ConocoPhillips,Petrobras,TotalSA,andWesternGeco.

SLIM


consortium 2010 - seismic laboratory for imaging and ... · ๏seismic applications are: ... java...

Documents