scheduled meteorological product creation using ninjo batch 1.3 sören kalesse deutscher...

16
Scheduled Meteorological Product Scheduled Meteorological Product Creation using NinJo Batch 1.3 Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst [email protected], http://www.dwd.de

Upload: mikaela-moris

Post on 01-Apr-2015

225 views

Category:

Documents


6 download

TRANSCRIPT

Page 1: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

Scheduled Meteorological Product Scheduled Meteorological Product Creation using NinJo Batch 1.3Creation using NinJo Batch 1.3

Sören KalesseDeutscher Wetterdienst

[email protected], http://www.dwd.de

Page 2: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (2)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Agenda

• What are SMPC and NinJo Batch?

• Example products

• Architectural overview

• Runtime parametrization

• Conclusions & Outlook

Page 3: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (3)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

What is SMPC?

• concept: Scheduled Meteorological Product Creation

typical time constraints of a meteorological product:

model runbased on a

issue timewill be issued at a

valid time/rangewill be valid at a

time

manipulate and create the product

issue and distribute the product

• products might be:» forecast chart, diagram, analysis plot, ...

Page 4: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (4)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

What is SMPC? (2)

• NinJo 1.3 knows two ways of approaching SMPC

non-interactiveNinJo Batch

concept: parametrization

interactiveProductWorkbench

concept: interactive editing

Page 5: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (5)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

What is NinJo Batch?

Bundle of NinJo client/server components used fornon-interactive Scheduled Meteorological Product Creation

• main goal:» automated production of maps of meteorological data

» key concept: runtime parametrization of NinJo– product properties changed at runtime by an external source

– multiple scenes stacked into one single product

– extensive annotations through legend framework

• What NinJo Batch is not» no data manipulation, no animations, no webpages

» distribution is not part of NinJo Batch

» no user interaction

Page 6: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (6)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Agenda

• What are SMPC and NinJo Batch?

• Example products

• Architectural overview

• Runtime parametrization

• Conclusions & Outlook

Page 7: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (8)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

NinJo Batch – Example Products (1)

• observations and derived products

satellite images

sat composite maps

radar/SCIT composite maps

Page 8: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (9)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

NinJo Batch – Example Products (2)

• model output

NWP grid fields

meteograms

cross-sections

Page 9: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (10)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

• custom plots

composite NWP grid field

model comparison

NinJo Batch – Example Products (3)

Page 10: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (11)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Agenda

• What are SMPC and NinJo Batch?

• Example products

• Architectural overview

• Runtime parametrization

• Conclusions & Outlook

Page 11: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (12)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

distributed server environment

Architectural Overview

BatchScripts

WebBrowser

ext. Schedulers

NinJo Data Servers

BatchProductDesigner–GUI

Batch Favorite

Bat

chW

ebR

eque

stH

andl

er

Batch Processor.1

Batch Processor.N ...

request handling + logging + client export

BatchServiceHTTP request

operating system functionality + job creation/management + scheduling + load balancing

NinJo client functionality + job processing + caching + export

Page 12: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (13)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Agenda

• What are SMPC and NinJo Batch?

• Example products

• Architectural overview

• Runtime parametrization

• Conclusions & Outlook

Page 13: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (14)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

BatchProcessor

Runtime Parametrization

Batch Favorite

scene configuration by templates

runtime parametersrequest

1

ModelRun: 2009.05.30#00:00ForecastTime: +24hModel: GMEElement: rel. HumidityLevel: 700hpaLevelType: gpm

setting scene properties from an external source

2

3render and export

NinJo client

• Example

» loop over forecast time in 3h steps to produce forecast animations

Page 14: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (15)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Conclusion and Outlook

• operational launch at DWD is underway» towards an operational product management system

• WMS support is currently been worked on» GeoTIFF export of maps to support raster coverages

» SpatialFile and GML may be used for exporting model output as vector data coverage

• NinJo Batch as client/server component bundle provides» scalable/distributed architecture for non-interactive SMPC

» theoretically everything that can be displayed in NinJo is batchable

» key-concept: runtime parametrization and configuration

» uniform and flexible request language

mid term goals:

Page 15: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

Thank You for Your attention!

Page 16: Scheduled Meteorological Product Creation using NinJo Batch 1.3 Sören Kalesse Deutscher Wetterdienst soeren.kalesse@dwd.de,

SMPC using NinJo Batch 1.3 (17)Sören Kalesse, Deutscher WetterdienstEGOWS '09, De Bilt (NL)

Example request

• form a Batch request to the BatchWebRequestHandler

./request -D 2008.11.24#16:00 // displaytime: 00+16h -o 600 -bl // request options -p BatchProcessor.0 // use Processor 0 -d BatchProcessor.0 // force Processor 0

-V path.PATH_PROPERTY=gme~surfpressure~01-016-2008-11-24-00-00.png -V dimension.DIMENSION_PROPERTY=800#800 // 800x800px

-V grid.GRID_ELEMENT.ModelRun=..#00:00 // model run: midnight -V grid.GRID_ELEMENT.ForecastTime=H=16 // forecastime: +16h -V grid.GRID_ELEMENT.Model=GME // global model

test~gme~surfpressure // favorite

('request' is part of the Batch-Scripts tool-chain for the Unix command line)