An update on obs4MIPs

WDAC Observations for Model Evaluation Task Team Peter Gleckler, co-chair, PCMDI and Duane Waliser, co-chair, JPL/NASA

Mike Bosilovich, GSFC/NASA Helene Chepfer, IPSL

Carol Anne Clayson, WHOI Veronika Erying, DLR

Robert Ferraro, JPL/NASA Pierre-Phillipe Mathieu, ESA

Jerry Potter, GSFC Roger Saunders, UKMO Jörg Schulz, EUMETSAT

Karl Taylor, PCMDI Jean-Noël Thépaut, ECMWF

Additional regular contributors: Otis Brown, Michel Rixen

Tsengdar Lee (NASA) and Renu Joseph (DOE) Luca Cinquini (JPL) – CoG technical support Denis Nadeu (PCMDI) – CMOR development Paul Durack (PCMDI) – Data specifications

Sophie Cloché (IPSL) – CFMIP archive Jim Biard (NCEI) and Matthias Tuma (WCRP) – beta testers

… and many others WDAC7, Geneva, 26-27 March 2018

Presenta(onoutline

•  Quickreview,generalstatusreport•  Challenges,solu6onsintheworks

•  Strategicconsidera6onsforWCRPSP

•  Aprojectforiden6fying,documen6nganddissemina6ngobserva6onsforclimatemodelevalua6oninWCRPmodelintercomparisons,notablyCMIP.

•  Data(andtechnotes)accessiblewiththedistributedCMIPmodeloutput,adheringtosameconven6ons

•  GuidedbytheWCRPDataAdvisoryCouncilobs4MIPSTaskTeam

obs4MIPshKps://www.earthsystemcog.org/projects/obs4mips/

….andgrowing!

ModelOutput

TargetQuan66es

Griddeddatasets

Complete(~125*)InProgress*(~15)ProposalsfromDataCall(~100)

DataaccessibilityforWCRPprojectsTheEarthSystemGridFedera6on(ESGF)isbeingusedforCMIP6andotherWCRPprojects

ESGFDec2016conferencereport(Williamsetal.,2017)ESGFDec2017Recap(finalreportinprepara6on)

Dataaccessandprojectconnectedness

•  Obs4MIPsdata(andana4MIPs)areavailablethroughtheCoG

•  CoGisintegratedwithESGF

•  CMIP6willbehostedontheCoG,asaremanyotherprojects

Obs4MIPsleverageskeyprotocolsandinfrastructure

•  Experiment protocol and CMIP standard output

•  Climate Forecast (CF) Convention (as applied in CMIP) •  CMIP data governance led by WGCM Infrastructure panel (WIP)

•  Utilities to ensure data complies to CMIP structure: CMOR3

•  Distribution/replication via ESGF, technically aligned with CMIP data

•  CoG: Project information, data search/retrieval, integrating projects

Pros: Pulling together key efforts that serve WCRP projects

Cons: Vulnerable to weak links

obs4MIPsplanningmee(ngforCMIP6April2014,NASAHQbuts6llrelevant!

Selectedconsensusrecommenda6onsthatappliedtoallofthemee6ngtopicareas:

•  Expandtheinventory

•  Includemorehigherfrequencydata(a“goldenperiod”?)•  Reliableanddefendableerrorcharacteriza(on/es6ma6onofobserva6ons•  Includedatasetsinsupportofoff-linesimulators(primeexample:COSP—CloudFeedbackModelIntercomparisonProject[CFMIP]Observa6onSimulatorPackage)

•  Collocatedobserva(ons,includingin-situdatasetsforprocessesleveldiagnos6cs•  Precisedefini(onsofdataproducts(what’sactuallybeingreported),includingbiases,andprecisedefini6onsofthemodeloutputvariablesarerequired

Ferraroetal.(2015)BAMSandfullmee(ngreportonCoGwebsite

ProgresssinceWDAC6

• 5TTtelecons,mul6plepresenta6onsatscien6ficmee6ngs

• Twomanuscriptsin-prep(#1strategy,#2datadescrip6ongovernance)

• Furtherstreamlining,e.g.,managingcontrolledvocabulariesonGitHub

• Datasetsspanacross7ESGFnodes,completelis6nggenerateddaily• CMIP6/obs4MIPsdataconven(onintegra(oncompleted

(obs4MIPsDataSpecifica(onsODS2.1)

• Collabora6onwithES-DOCtohandleobs4MIPstechnotes,DOI’s

• Twostrategiceffortstobroadenprojectscopeprototyped:

• obs4MIPsdataindicatorsnowestablished

• MechanismforincludingSupplementalInforma(on

obs4MIPsDatasetSuitability&MaturityIndicators

IndicatorsforalldatasetswillbedeterminedbyTTinconsulta6onwithdatasetproviders

TTwillberesponsibleforconfirmingindicators(proposedbydataproviders)foralldatasets

SIis“freeform”,accessiblefrom“bestes6mate”butnotsearchableindependently

CoordinatedCMIP/obs4MIPsglobala_ributes,controlledvocabulary(CV),RegisteredContent(RC),andDataReferenceSyntax(DRS)

Somepredefinedglobala_ributes(therearemanyothers)

VariableID# Source_id*+ Source_version_number*+ Ins(tu(on_id+ Region**# Frequency* Nominal_resolu(on*# License

*Newobs4MIPssearchfacets+RegisteredContent(RC)#CVwithpre-definedop6onsmaintainedongithub

Sample‘sfcWind’

‘NOAA-NCEI-SeaWinds-1-2’‘1.2’

‘NOAA-NCEI’‘globalocean’

‘Amon’‘1x1degree’

2018TimelinesWinter'18 Spring'18 Summer'18 Fall'18 Winter'19

Submit two papers

(strategy and conventions)

Possible 2nd Dataset Call:

Beyond Gridded?

Prototype enhanced

CoG features

Make existing obs4MIPs data consistent with ODS2.1

Prepare new datasets including from "1st Dataset Call"

Propogate use of new CoG features across

ESGF nodes (search facets , indicators

and Supplemental Info )

SummaryandPerspec(ve

•  obs4MIPsiswellposi(onedtohavesubstan(alimpactonCMIP6andotherWCRPMIPs

•  WCRPSP:mightobs4MIPsprovideabasisforbe_erconnec(ngmodelsanddata?

•  obs4MIPsTThasbeenabletoaddressmanyrecommenda(ons(e.g.,enablemoredataandinforma(ontobeincluded)

•  Keychallengecon(nues:further“greasingthewheels”sothatdatasetscanbeefficientlymadetomeettheobs4MIPsdataspecifica8ons,andpublishedonESGF

•  Thegoalforthecomingyearistogreatlyexpandtheobs4MIPsarchive,exploi(ngthenewobs4MIPsdataspecifica(ons(ODS2.1),supplementalinforma(onanddataindicators

•  Effortstoadvanceobs4MIPsremainfocusedongriddeddatasets.Expandingthescopetoincludein-situdatawillrequirednewcontributorspreparedtodosubstan(alwork

SummaryandPerspec(veii

•  Presumingobs4MIPscon(nuestosuccessfullymature,therewilllikelybeaneedtorevisithowitissupportedandgoverned.

•  Whileagreatdealofinfrastructureisinplace,abroaderobs4MIPswouldrequiremorepeopledoinghandsonwork.

•  TheWGCM’sWIPmayserveasagoodexampleofhowtodothis,andperhapscouldbefurtherleveraged.

Linkstorelatedmaterial–NEEDSTOBEUPDATED

•  ESGFDec2016conferencereport(pdf)

•  CMIP6dataspecifica6ons(googledocs)

•  obs4MIPsdataspecifica6ons

•  obs4MIPstablescontrolledvocabulary(github)

•  ClimateModel/obsOutputRewriKer,CMOR(website)

•  Drajuserguideforpreparingobs4MIPs(googledocs)

EXTRAS

1.  Use the CMIP* Standard Model Output as guideline for selecting observations

2.  Observations to be structured in coordination with the CMIP output (e.g. NetCDF, CF Convention, common vocabularies)

3.  Hosted side by side on the ESGF with CMIP model output

4.  Include a Technical Note for each variable describing observation and use for model evaluation (at graduate student level)

obs4MIPs:The4Commandments

*obs4MIPsconven(onshavebeenupdatedtobeconsistentwithCMIP6

•  CMOR3nowsupportsobserva6onaldata!

•  Stronglyrecommendedforobs4MIPs–itistheeasiestwaytoensurecompliance

•  SupportforCMIPand

obs4MIPsusers•  Opensource,canbe

adoptedforotherpurposes

•  BeingusedbymostCMIPpar6cipa6ngmodelinggroups

•  AvailableviaAnacondawithpython,Candfortraninterfaces

cmor.llnl.gov

Beyondthe“bestes(mate”obs4MIPsdataset

SupplementalInforma(onStrategycurrentlyinprepara(on

byWDACtaskteam

Supplementalinfo

Apossiblepathforwardtodealwithmul6pleunresolvedissueswithinobs4MIPs,e.g.:

•  Addi6onaldocumenta6on•  Uncertaintydata•  Dataflags,masks•  Suppor6ngvalida6ondata•  DetailedMaturitymatrices

Organiza6onofsupplementaldatawillini6allybemoreheterogeneousthanassociated“bestes6mate”,andthereforenotsearchablefromahigherlevel.Itwillbealongsidebestes6mateasazippedarchive

Obs4MIPs:StatusofObserva(onHoldings/

SubmissionsEarly2018

DatasetsCurrentlyHostedatobs4MIPs(VariableLongName)

•  AirTemperature•  AmbientAerosolOp6calThicknessat550nm•  CALIPSO3DClearfrac6on•  CALIPSO3DUndefinedfrac6on•  CALIPSOClearCloudFrac6on•  CALIPSOCloudFrac6on•  CALIPSOHighLevelCloudFrac6on•  CALIPSOLowLevelCloudFrac6on•  CALIPSOMidLevelCloudFrac6on•  CALIPSOScaKeringRa6o•  CALIPSOTotalCloudFrac6on•  CloudFrac6onretrievedbyMISR•  CloudSat94GHzradarTotalCloudFrac6on•  CloudSatRadarReflec6vityCFAD•  EastwardNear-SurfaceWind•  EastwardWind•  Frac6onofAbsorbedPhotosynthe6callyAc6veRadia6on•  ISCCPCloudAreaFrac6on(Jointhistogramofop6calthicknessandcloudtop

pressure)•  ISCCPMeanCloudAlbedo(Cloud-frac6onweighted&day6meonly)•  ISCCPMeanCloudTopPressure(Cloud-frac6onweighted&day6meonly)•  ISCCPMeanCloudTopTemperature(Cloud-frac6onweighted&day6meonly)•  ISCCPTotalCloudFrac6on(day6meonly)•  LeafAreaIndex•  MoleFrac6onofO3•  Near-SurfaceWindSpeed•  NorthwardNear-SurfaceWind•  NorthwardWind•  PARASOLReflectance•  Precipita6on•  SeaSurfaceHeightAboveGeoid•  SeaSurfaceTemperature•  SpecificHumidity•  SurfaceDownwellingClear-SkyLongwaveRadia6on•  SurfaceDownwellingClear-SkyShortwaveRadia6on•  SurfaceDownwellingLongwaveRadia6on•  SurfaceDownwellingShortwaveRadia6on•  SurfaceUpwellingClear-SkyShortwaveRadia6on•  SurfaceUpwellingLongwaveRadia6on•  SurfaceUpwellingShortwaveRadia6on•  TOAIncidentShortwaveRadia6on•  TOAOutgoingClear-SkyLongwaveRadia6on•  TOAOutgoingClear-SkyShortwaveRadia6on•  TOAOutgoingLongwaveRadia6on•  TOAOutgoingShortwaveRadia6on•  TotalCloudFrac6on•  WaterVaporPath

AirTemperatureSpecificHumidityAirTemperatureSpecificHumiditySeaSurfaceTemperatureTOAOutgoingLongwaveRadia6onTOAOutgoingClear-SkyLongwaveRadia6onTOAOutgoingShortwaveRadia6onTOAOutgoingClear-SkyShortwaveRadia6onTOAIncidentShortwaveRadia6onSurfaceDownwellingLongwaveRadia6onSurfaceDownwellingClear-SkyLongwaveRadia6onSurfaceUpwellingLongwaveRadia6onSurfaceDownwellingShortwaveRadia6onSurfaceDownwellingClear-SkyShortwaveRadia6onSurfaceUpwellingShortwaveRadia6onSurfaceUpwellingClear-SkyShortwaveRadia6onTotalCloudFrac6onSeaSurfaceHeightAboveGeoidPrecipita6on-monthlyPrecipita6on–3hourlyPrecipita6on-dailyPrecipita6on-monthlyNear-SurfaceWindSpeedEastwardNear-SurfaceWindNorthwardNear-SurfaceWindLeafAreaIndexMoleFraciontofOzoneAmbientAerosolOpi6calThicknessat550nmAmbientAerosolOpi6calThicknessat550nmWaterVaporPathISCCPCloudalbedoISCCPCloudalbedoCALIPSOScaKeringRa6o,srbox1CALIPSOScaKeringRa6o,srbox2CloudSatRadarReflec6vityCFADCALIPSOCloudFrac6onCALIPSOClearCloudFrac6onCALIPSOHighLevelCloudFrac6onISCCPCloudFrac6onCALIPSOLowLevelCloudFrac6onCALIPSOMidLevelCloudFrac6onCALIPSO3DClearFrac6onCALIPSOTotalCloudFrac6onCLOUDSATTotalCloudFrac6onISCCPTotalCloudFrac6onISCCPCloudTopTemperatureISCCPCloudTopTemperatureMissingdatafrac6onOverpassesPARASOLReflectanceSolarZenithAngleISCCPCloudTopPressureISCCPCloudTopPressureMISRCTH-ODCloudFrac6onCALIPSO3DUndefinedfrac6on

WaterVaporPathFrac6onofAbsorbedPhotosynthe6callyAc6veRadia6onSnowareafrac6onAmbientAerosolEx6nc6onOp6calThicknessat550nmSeaIcefrac6onSeaIcefrac6onSeaSurfaceTempSeaSurfaceTempSeaSurfaceTempTOAOutgoingLongwaveRadia6onTOAOutgoingLongwaveRadia6onTOAOutgoingShortwaveRadia6onTOAOutgoingLongwaveRadia6onMoleFrac6onofOzonealbedo;Ra6ooftwovariablesIceSheetTemperature?AmbientAerosolOpi6calThicknessat550nmSurfaceAqueousPar6alPressureofCO2dry_atmosphere_mole_frac6on_of_carbon_dioxideNear-SurfaceWindSpeed

Near-SurfaceAirTemperatureAirTemperatureGeopoten6alHeightEastwardNear-SurfaceWindNorthwardNear-SurfaceWindNear-SurfaceWindSpeedNear-SurfaceSpecificHumiditySurfaceDownwardLatentHeatFluxSurfaceDownwardSensibleHeatFluxNear-SurfaceAirTemperaturePrecipita6onSealevelpressureSeaSurfaceTempTotalChlorophyllMassConcentra6onInfraredbrightnesstemperatures(11μm,0.6μm,6.7μm)LeafAreaIndexnormalizeddifferencevegeta6onindexFrac6onofPhotosynthe6callyAc6veRadia6onSeaSurfaceTemperatureprecipita6onairtemperatureBurntAreaFrac6onSurfaceSnowAmountMidTroposphericHumidityUpperTroposphericHumidityAirTemperaturegeopoten6alheightbendinganglerefrac6vityCLARAcloud_area_frac6on;CFMIP45surfacealbedocloud_area_frac6oncloudtopphase;area_frac6on_of_liquid_cloud_water_par6cles_at_cloud_topcloudtoppressure;air_pressure_at_cloud_topcloudop6calthickness;atmosphere_op6cal_thickness_due_to_cloudcloudicewaterpath;atmosphere_cloud_ice_contentsurface_downwelling_shortwave_flux_in_airsurfacedownwellingclearskyshortwavefluxsurface_downwelling_shortwave_flux_in_aircloudicewaterpath;atmosphere_cloud_ice_contentcloudliquidwaterpathccicloudareafrac6on(7x7table);CFMIP45(tbd)cloudareafrac6oncloudtopphase;area_frac6on_of_liquid_cloud_water_par6cles_at_cloud_topcloudtoppressure;air_pressure_at_cloud_topcloudop6calthickness;atmosphere_op6cal_thickness_due_to_cloudSeaIceAreaFrac6onSurfaceTemperatureSeaIceAreaFrac6onsurface(2m)airtemperatureanomalyNear-SurfaceSpecificHumidityNear-SurfaceRela6veHumidity,Near-SurfaceAirTemperature

Complete(~125*)InProgress*(~15)SubmissionsFromDataCall(~90)*Afewtechnotesremaintobecompleted

TaskTeamEfforts/Organiza6on•  RegularTTtelecons(~monthly)•  AllprojectmanagementdataaccessibletoTTviaGoogleDocs•  MuchoftheTTefforthasbeenhelpingtobeKerdefine

strategicpath,butincreasingly…•  Movingtowardhelpingtoshepherddatasetsfromproposal

topublica6ononESGF

Monitoringdatasetsacrossthedistributedfedera6on:AnewcapabilityscansallESGFnodesandgeneratesacatalogofavailabledatasets

~125DataSets