127 625-cd-520-001 backward chaining (cont.) production subscribe notification register subscription...

47
1 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve Data Process On Demand Insert terminates with an insert event notification to Subscribe, which in turn triggers initiation of ETS algorithm

Upload: milo-dixon

Post on 21-Jan-2016

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

1625-CD-520-001

Backward Chaining (Cont.)

PRODUCTION

Subscribe

NotificationRegister

Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

ProcessOn

Demand

Insert terminates with an insert event notification to Subscribe,which in turn triggers initiation of ETS algorithm

Page 2: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

2625-CD-520-001

ASTER: Notification and Subscription Triggering Process

Notify all AST_09T:Insert subscribers. This includes notification of thePlanning Subsystem, for chained processing.

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

Client

1. Trigger AST_09T:Insert event

2. Notify (AST_09T:Insert, direct)

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

3. Data Processing Request (ETS)

CommunicationsSubsystem

SBSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

Page 3: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

3625-CD-520-001

Landsat7Gateway

EcCsLandsat7Gateway

DomainName Service

DNS

E-MailServicesEmail Server

SubscriptionService

EcSbGui

Distributed ComputingConfiguration Item (DCCI)

DAR CommGateway

EcGwDARServer

E-Mail ParserGateway

EcCsEmailParser

FTPNotification

CsFtpNotify

Bulk DataServer

BDS

NetworkFile System

NFS

DCE ServicesName Service

Security ServiceTime Service

SubscriptionServer

EcSbSubServer

File TransferProtocol

FTP/KFTP

FilecopyEcUtFileCopyEcUtFileExec

VirtualTerminal

VT

Crypto-graphicManage-

mentInterface

CMI

Infra-structureLibrary

PF, SRF, Urs,Message Passing,

Event Logging,Service Locator,Failure Recovery

Framework

MOJOGateway

EcCsMojoGateway

Data ProcessingSubsystem

(DPS) Data Proc

0110001011001011001011010111010110001011

Algorithm Integration and Test Tools(AITTL) CSCI

SSAP GUIEcDpAtSSAPGui

SSIT ManagerEcDpAtMgr

EcDpAtMgrLogDump

Define PGEEcDpAtCheckODL

EcDpAtCreateODLTemplateEcDpAtRegisterPGE

EcDpAtOpDbGui

View/CompareData Tools

EOSView, IDLEcDpAtBinDiffGui

EcDpAtBinDiffPrepareFilesEcDpAtCheckHdfFile

hdiff, xdiff

Check SoftwareTools

EcDpAtCheckPCFEcDpAtBadFuncGui

EcDpAtBadFuncEcDpAtPrologs

EcDpAtReplaceString

Insert/AcquireTools

EcDpAtINSTALLEcDpAtInsertStaticFile

EcDpAtInsertExeTarFileEcDpAtInsertTestFile

EcDpAtStageDAPEcDpAtGetMCF

SDP ToolKit(SDPTK) CSCI

(Separatesoftware libraries

for SSI&T)

Processing(PRONG) CSCI

DataManagement

EcDpPrDM

ExecutionManagement

EcDpPrEMEcDpPrSMFLink

PGEManagement

EcDpPrRunPGEEcDpPrRusage

DeletionServer

EcDpPrDeletion

Job ManagementEcDpPrJobMgmt

EcDpPrJobMgmtClientEcDpPrViewJobStates

AutoSysCOTS Product

QAMonitor

EcDpPrQaMonitorGUI

ResourceManagement

DpPrRM

DataStore

Sybase Database (COTS)

Ground EventProcessEcDpPrGE

Data PreprocessingEcDpPrAm1AncillaryDPREP

EcDpPrAm1EphemerisGapFillDPREPEcDpPrAm1FddAttitudeDPREP

EcDpPrAm1FddReplaceEphemerisDPREPEcDpPrAm1ToolkitToHdfDPREP

EcDpPrDumpAttitudeDPREPEcDpPrDumpEphemerisDPREP

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

PlanningSubsystem

(PLS) Planning

abcdef

ghi

jkl

mno

Production Planning(PLANG) CSCI

DataStore

Sybase Database (COTS)

Resource PlanningWorkbench

EcPlRpReEcPlRpSiEcPlRpTl

ProductionRequest Editor

EcPlPrEditor

ProductionPlanning Workbench

EcPlWbEcPlTl

PlanningSubscription Editor

EcPlSubsEditor

SubscriptionManagerEcPlSubMgr

ProductionStrategies GUI

EcPlProdStrat

ASTER: CSCI/Component Role in Notification/Subscription Triggering

Triggers event; retrieves metadata for

requested input granules from the

Sybase/SQS database

Database; contains

metadata for search

and retrieval

Receives eventnotice from SDSRV;queries database;notifies Planning

Adds UR for new granule (AST_09T)to data context; matches metadata against job input needs; notifies Job Management to release ETS

Relea

ses

ETS job

Begins ETS staging andprocessing activities

Page 4: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

4625-CD-520-001

Backward Chaining (Cont.)

PRODUCTION

Subscribe

NotificationRegister

Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Retrieve AST_ANC (ASTER ancillary data set), and ETS PGE granules as input to ETS production job; PGE execution begins

ProcessOn

Demand

Page 5: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

5625-CD-520-001

ASTER: Job (ETS) Staging Process

ETS production job retrieves required ETS PGE andAST_ANC (ASTER ancillary data set) input data granules(Note: AST_09T is already available on DPS resources).

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

Client

CommunicationsSubsystem

SBSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

1. Acquire (AST_ANC & ETS, ftpPush)

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

2. Distribution Request (AST_ANC & ETS files, ftpPush)

3. Copy (AST_ANC & ETS files, ftpPush)

4. ftpPush (AST_ANC & ETS files)

Page 6: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

6625-CD-520-001

Data ProcessingSubsystem

(DPS) Data Proc

0110001011001011001011010111010110001011

Algorithm Integration and Test Tools(AITTL) CSCI

SSAP GUIEcDpAtSSAPGui

SSIT ManagerEcDpAtMgr

EcDpAtMgrLogDump

Define PGEEcDpAtCheckODL

EcDpAtCreateODLTemplateEcDpAtRegisterPGE

EcDpAtOpDbGui

View/CompareData Tools

EOSView, IDLEcDpAtBinDiffGui

EcDpAtBinDiffPrepareFilesEcDpAtCheckHdfFile

hdiff, xdiff

Check SoftwareTools

EcDpAtCheckPCFEcDpAtBadFuncGui

EcDpAtBadFuncEcDpAtPrologs

EcDpAtReplaceString

Insert/AcquireTools

EcDpAtINSTALLEcDpAtInsertStaticFile

EcDpAtInsertExeTarFileEcDpAtInsertTestFile

EcDpAtStageDAPEcDpAtGetMCF

SDP ToolKit(SDPTK) CSCI

(Separatesoftware libraries

for SSI&T)

Processing(PRONG) CSCI

DataManagement

EcDpPrDM

ExecutionManagement

EcDpPrEMEcDpPrSMFLink

PGEManagement

EcDpPrRunPGEEcDpPrRusage

DeletionServer

EcDpPrDeletion

Job ManagementEcDpPrJobMgmt

EcDpPrJobMgmtClientEcDpPrViewJobStates

AutoSysCOTS Product

QAMonitor

EcDpPrQaMonitorGUI

ResourceManagement

DpPrRM

DataStore

Sybase Database (COTS)

Ground EventProcessEcDpPrGE

Data PreprocessingEcDpPrAm1AncillaryDPREP

EcDpPrAm1EphemerisGapFillDPREPEcDpPrAm1FddAttitudeDPREP

EcDpPrAm1FddReplaceEphemerisDPREPEcDpPrAm1ToolkitToHdfDPREP

EcDpPrDumpAttitudeDPREPEcDpPrDumpEphemerisDPREP

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

ASTER: CSCI/Component Rolein Job (ETS) Staging

Releases and

sequencesDPRs (Jobs)

Controls staging andprocessing activities

Handles requests to the Archive for retrieving andinserting granules

Database; contains metadata for search and retrieval

Retrieves metadata; creates metadata Staging Disks; creates and passes metadata files to DDIST

Creates staging disks for granule files; requests granule file retrieval by STMGT

Allocates space in response to Distribution Requests

Stages granule files to read-only cache disks

Provides Resource

Manager for

ftpPushes

Page 7: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

7625-CD-520-001

Backward Chaining (Cont.)

PRODUCTION

Subscribe

NotificationRegister

Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Archive newly created AST_08 (L2 Surface Temperature) and AST_05 (L2 Surface Emissivity) granules after completion of ETS PGE;

ProcessOn

Demand

update catalogue with references to AST_08 and AST_05

Page 8: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

8625-CD-520-001

ASTER: PGE (ETS) Execution and Output Insertion Process

ETS PGE is successfully executed and newly created AST_08(L2 Surface Temperature) and AST_05 (L2 Surface Emissivity)granules are archived; inventory is updated.

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

Client

CommunicationsSubsystem

SBSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

1. Get DSS UR

2. Insert (AST_08 & AST_05)

3. Store (AST_08 & AST_05 files)

4. Add (AST_08 & AST_05 metadata)

Page 9: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

9625-CD-520-001

Interoper-ability(IOS)

Advertising Service(ADSRV) CSCI

AdvertisingServer

EcIoAdServer

Advertising Server Component

Advertising ServiceSQL Server

Sybase Server (COTS)

Advertising ServiceReplication Server

Sybase Replication Server (COTS)

Data ProcessingSubsystem

(DPS) Data Proc

0110001011001011001011010111010110001011

Algorithm Integration and Test Tools(AITTL) CSCI

SSAP GUIEcDpAtSSAPGui

SSIT ManagerEcDpAtMgr

EcDpAtMgrLogDump

Define PGEEcDpAtCheckODL

EcDpAtCreateODLTemplateEcDpAtRegisterPGE

EcDpAtOpDbGui

View/CompareData Tools

EOSView, IDLEcDpAtBinDiffGui

EcDpAtBinDiffPrepareFilesEcDpAtCheckHdfFile

hdiff, xdiff

Check SoftwareTools

EcDpAtCheckPCFEcDpAtBadFuncGui

EcDpAtBadFuncEcDpAtPrologs

EcDpAtReplaceString

Insert/AcquireTools

EcDpAtINSTALLEcDpAtInsertStaticFile

EcDpAtInsertExeTarFileEcDpAtInsertTestFile

EcDpAtStageDAPEcDpAtGetMCF

SDP ToolKit(SDPTK) CSCI

(Separatesoftware libraries

for SSI&T)

Processing(PRONG) CSCI

DataManagement

EcDpPrDM

ExecutionManagement

EcDpPrEMEcDpPrSMFLink

PGEManagement

EcDpPrRunPGEEcDpPrRusage

DeletionServer

EcDpPrDeletion

Job ManagementEcDpPrJobMgmt

EcDpPrJobMgmtClientEcDpPrViewJobStates

AutoSysCOTS Product

QAMonitor

EcDpPrQaMonitorGUI

ResourceManagement

DpPrRM

DataStore

Sybase Database (COTS)

Ground EventProcessEcDpPrGE

Data PreprocessingEcDpPrAm1AncillaryDPREP

EcDpPrAm1EphemerisGapFillDPREPEcDpPrAm1FddAttitudeDPREP

EcDpPrAm1FddReplaceEphemerisDPREPEcDpPrAm1ToolkitToHdfDPREP

EcDpPrDumpAttitudeDPREPEcDpPrDumpEphemerisDPREP

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

ASTER: CSCI/Component Role in PGE (ETS) Execution and Output Insertion

Executes PGE; places output files in output directory

Provides DSS Universal Reference (UR)

Gets DSS UR from Advertising Server; handles requests to the Archive for retrieving andinserting granules

Database; receives and stores metadata

Provides Metadata Configuration File (MCF);requests STMGT to insert output granule files; adds metadata to inventory

Reads files from DPS

disks and stores

files in Archive

Page 10: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

10625-CD-520-001

Backward Chaining (Cont.)

Insert terminates with an insert event notification to Subscribe,

RE

TRIE

VA

L

Deliver

Electronic

Search& Order

OrderProducts

Subscribe

NotificationStandingOrders

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

which triggerse-mail notification to the Science User that the AST_08 granule has been inserted; standing order processing for new AST_08 granule can begin

Page 11: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

11625-CD-520-001

ASTER: Notification and Subscription Triggering (AST_08) Process

With insertion of the AST_08 (L2 Surface Temperature) granule,the ASTER Scientist is notified by e-mail; processing can beginfor the standing order

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

Client

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

1. Trigger AST_08:Insert event

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

CommunicationsSubsystem

SBSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

2. Notify (AST_08:Insert, e-mail)

Page 12: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

12625-CD-520-001

Landsat7Gateway

EcCsLandsat7Gateway

DomainName Service

DNS

E-MailServicesEmail Server

SubscriptionService

EcSbGui

Distributed ComputingConfiguration Item (DCCI)

DAR CommGateway

EcGwDARServer

E-Mail ParserGateway

EcCsEmailParser

FTPNotification

CsFtpNotify

Bulk DataServer

BDS

NetworkFile System

NFS

DCE ServicesName Service

Security ServiceTime Service

SubscriptionServer

EcSbSubServer

File TransferProtocol

FTP/KFTP

FilecopyEcUtFileCopyEcUtFileExec

VirtualTerminal

VT

Crypto-graphicManage-

mentInterface

CMI

Infra-structureLibrary

PF, SRF, Urs,Message Passing,

Event Logging,Service Locator,Failure Recovery

Framework

MOJOGateway

EcCsMojoGateway

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

ASTER: CSCI/Component Role in Noti-fication/Subscription (AST_08) Trigger

Triggers event (AST_08:Insert)

Receives event notice from SDSRV; queries database; executes e-mail notification

Sendmail deliverse-mail messageto mail host

Page 13: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

13625-CD-520-001

Backward Chaining (Cont.)

Submit order for new AST_08on behalf of scientist

RE

TRIE

VA

L

Deliver

Electronic

Search& Order

OrderProducts

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Subscribe

NotificationStandingOrders

Page 14: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

14625-CD-520-001

ASTER: Standing Order, Acquire Submission Process

Subscription Server submits order for AST_08 (L2 SurfaceTemperature) data, via ftpPush, on behalf of the Science User

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

Client

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

CommunicationsSubsystem

SBSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

1. Acquire (AST_08: ftpPush)

Page 15: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

15625-CD-520-001

Landsat7Gateway

EcCsLandsat7Gateway

DomainName Service

DNS

E-MailServicesEmail Server

SubscriptionService

EcSbGui

Distributed ComputingConfiguration Item (DCCI)

DAR CommGateway

EcGwDARServer

E-Mail ParserGateway

EcCsEmailParser

FTPNotification

CsFtpNotify

Bulk DataServer

BDS

NetworkFile System

NFS

DCE ServicesName Service

Security ServiceTime Service

SubscriptionServer

EcSbSubServer

File TransferProtocol

FTP/KFTP

FilecopyEcUtFileCopyEcUtFileExec

VirtualTerminal

VT

Crypto-graphicManage-

mentInterface

CMI

Infra-structureLibrary

PF, SRF, Urs,Message Passing,

Event Logging,Service Locator,Failure Recovery

Framework

MOJOGateway

EcCsMojoGateway

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

ASTER: CSCI/Component Role in Standing Order, Acquire Submission

Connects to SDSRV; establishes data context; submits Acquire request for ftpPush of granule and request for e-mail notice of distribution

Retrieves metadata

Database; stores metadata for search and retrieval

Page 16: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

16625-CD-520-001

Backward Chaining (Cont.)

Retrieve newly created AST_08 granule

RE

TRIE

VA

L

Deliver

Electronic

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Subscribe

NotificationStandingOrders

Search& Order

OrderProducts

Page 17: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

17625-CD-520-001

ASTER: Retrieval of Data for Distribution Process

Retrieve newly created AST_08 (L2 Surface Temperature) granulefrom Archive.

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

Client

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

CommunicationsSubsystem

SBSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

1. Distribution Request (AST_08:ftpPush)

2. Copy (AST_08, ftpPush)

Page 18: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

18625-CD-520-001

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

ASTER: CSCI/Component Role in Retrieval of Data for Distribution

Database; contains metadata for search and retrieval

Creates metadata Staging Disks; creates and passes metadata files to DDIST

Creates staging disks for granule files; requests granule file retrieval by STMGT

Allocates space in response to Distribution Requests

Stages granule files to read-only cache disks

Provides Resource

Manager for

ftpPushes

Page 19: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

19625-CD-520-001

Backward Chaining (Cont.)

Ftp newly created AST_08 granule to scientist’s workstation together with an e-mail notification of the distribution

RE

TRIE

VA

L

Subscribe

NotificationStandingOrders

Search& Order

OrderProducts

Deliver

Electronic

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Page 20: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

20625-CD-520-001

ASTER: Electronic Data Push Distribution Process

Ftp AST_08 (L2 Surface Temperature) granule toASTER Scientist’s workstation.

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

Client

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

CommunicationsSubsystem

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

1. Ftp AST_08 data

2. Build e-mail notification

3. Send e-mail notification of AST_08 distribution

4. Forward notification

Page 21: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

21625-CD-520-001

Landsat7Gateway

EcCsLandsat7Gateway

DomainName Service

DNS

E-MailServicesEmail Server

SubscriptionService

EcSbGui

Distributed ComputingConfiguration Item (DCCI)

DAR CommGateway

EcGwDARServer

E-Mail ParserGateway

EcCsEmailParser

FTPNotification

CsFtpNotify

Bulk DataServer

BDS

NetworkFile System

NFS

DCE ServicesName Service

Security ServiceTime Service

SubscriptionServer

EcSbSubServer

File TransferProtocol

FTP/KFTP

FilecopyEcUtFileCopyEcUtFileExec

VirtualTerminal

VT

Crypto-graphicManage-

mentInterface

CMI

Infra-structureLibrary

PF, SRF, Urs,Message Passing,

Event Logging,Service Locator,Failure Recovery

Framework

MOJOGateway

EcCsMojoGateway

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

ASTER: CSCI/Component Role in Electronic Data Push Distribution

Client for CSS

execution of actual

ftp

Executes ftpBuilds e-mail notifica-tion that user’s order has been filled;sends it to DAAC Distribution Tech-nician for forwarding

Sendmail deliverse-mail messageto mail host

Page 22: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

22625-CD-520-001

Backward Chaining (Cont.)

RE

TRIE

VA

L

Subscribe

NotificationStandingOrders

Search& Order

OrderProducts

Deliver

Electronic

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Scientist uses EOSView to perform Quality Assurance (QA) check on the AST_08 product and e-mails DAAC Operations; DAAC Operations updates AST_08 inventory metadata

Page 23: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

23625-CD-520-001

ASTER: QA Metadata Update Process

Science User uses EOSView tool to review AST_08 (L2 SurfaceTemperature) product and sends e-mail request to DAAC Operationsfor update of the Science QA Metadata for the granule; DAAC Operationsuses QA Monitor tool for the update.

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

Client

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

CommunicationsSubsystem

SBSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

1. Invoke EOSView to view AST_08

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

2. Scientist e-mails DAAC with request to update the Science QA metadata for the granule

3. InvokeQA Monitor

4. Request update of QA metadata

5. Update metadata inventory, AST_08

Page 24: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

24625-CD-520-001

Data ProcessingSubsystem

(DPS) Data Proc

0110001011001011001011010111010110001011

Algorithm Integration and Test Tools(AITTL) CSCI

SSAP GUIEcDpAtSSAPGui

SSIT ManagerEcDpAtMgr

EcDpAtMgrLogDump

Define PGEEcDpAtCheckODL

EcDpAtCreateODLTemplateEcDpAtRegisterPGE

EcDpAtOpDbGui

View/CompareData Tools

EOSView, IDLEcDpAtBinDiffGui

EcDpAtBinDiffPrepareFilesEcDpAtCheckHdfFile

hdiff, xdiff

Check SoftwareTools

EcDpAtCheckPCFEcDpAtBadFuncGui

EcDpAtBadFuncEcDpAtPrologs

EcDpAtReplaceString

Insert/AcquireTools

EcDpAtINSTALLEcDpAtInsertStaticFile

EcDpAtInsertExeTarFileEcDpAtInsertTestFile

EcDpAtStageDAPEcDpAtGetMCF

SDP ToolKit(SDPTK) CSCI

(Separatesoftware libraries

for SSI&T)

Processing(PRONG) CSCI

DataManagement

EcDpPrDM

ExecutionManagement

EcDpPrEMEcDpPrSMFLink

PGEManagement

EcDpPrRunPGEEcDpPrRusage

DeletionServer

EcDpPrDeletion

Job ManagementEcDpPrJobMgmt

EcDpPrJobMgmtClientEcDpPrViewJobStates

AutoSysCOTS Product

QAMonitor

EcDpPrQaMonitorGUI

ResourceManagement

DpPrRM

DataStore

Sybase Database (COTS)

Ground EventProcessEcDpPrGE

Data PreprocessingEcDpPrAm1AncillaryDPREP

EcDpPrAm1EphemerisGapFillDPREPEcDpPrAm1FddAttitudeDPREP

EcDpPrAm1FddReplaceEphemerisDPREPEcDpPrAm1ToolkitToHdfDPREP

EcDpPrDumpAttitudeDPREPEcDpPrDumpEphemerisDPREP

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

ASTER: CSCI/Component Role inQA Metadata Update

Submits request to

SDSRV for update of

granule metadata

Client (CLS)External/InternalUsers

Workbench(WKBCH) CSCI

User RegistrationTool (URT) Scripts

EcClWbUrEcClWbUrConfirmEcClWbUrSubmit

HDF ProductViewing Tool

EOSView

Java DARTool

EcClWbJdt

User ProfileGateway

EcClDtUserProfileGateway

Displays HDF files

for visualization

Generates query calls to inventory database; packages and returns results; updates metadata

Database; contains metadata

Page 25: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

25625-CD-520-001

ASTER Scenario: Expedited DataIN

SE

RTI

ON

RE

TRIE

VA

L

PRODUCTION

Subscribe

Search& Order

Store

ExternalData Provider User

Deliver

Generate Plan

Ingest

Data SubscriptionData InsertionData Notification

Page 26: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

26625-CD-520-001

INS

ER

TIO

N

Ingest

Polling

DAAC submits subscription, on behalf of scientist for notification of new ASTER Expedited data

Expedited Data

Subscribe

NotificationRegister

Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Page 27: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

27625-CD-520-001

ASTER: User Subscription Registration for AST_EXP Process

DAAC enters subscription, on behalf of scientist, for e-mail notificationof newly inserted ASTER Expedited Data product.

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Client

CommunicationsSubsystem

SBSRV

1. Subscribe (AST_EXP, e-mail)

Page 28: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

28625-CD-520-001

Landsat7Gateway

EcCsLandsat7Gateway

DomainName Service

DNS

E-MailServicesEmail Server

SubscriptionService

(a service of CSS,not a CSCI)

EcSbGui

Distributed ComputingConfiguration Item (DCCI)

DAR CommGateway

EcGwDARServer

E-Mail ParserGateway

EcCsEmailParser

FTPNotification

CsFtpNotify

Bulk DataServer

BDS

NetworkFile System

NFS

DCE ServicesName Service

Security ServiceTime Service

SubscriptionServer

EcSbSubServer

File TransferProtocol

FTP/KFTP

FilecopyEcUtFileCopyEcUtFileExec

VirtualTerminal

VT

Crypto-graphicManage-

mentInterface

CMI

Infra-structureLibrary

PF, SRF, Urs,Message Passing,

Event Logging,Service Locator,Failure Recovery

Framework

MOJOGateway

EcCsMojoGateway

GUI used by User ServicesRepresentative to createsubscription for Science User

ASTER: CSCI/Component Role in AST_EXP Subscription Registration

Stores subscriptionin the Sybase Database

Page 29: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

29625-CD-520-001

INS

ER

TIO

N

Ingest

Polling

EDOS initiates AST_EXP (Expedited Data) ingestion via EDOS PDR

Expedited Data (Cont.)

Subscribe

NotificationRegister

Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

EDOS

Page 30: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

30625-CD-520-001

ASTER: Polling Ingest for AST_EXP Process

Ingest begins polling specified location (directory), looking for an ExpeditedData Record (EDR) file.

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Client

CommunicationsSubsystem

SBSRV

1. Ingest Subsystem polling for files

EDOS2. Move EDR file to directory

3. Read EDR file

4. Getmcf (AST_EXP)

5. Read AST_EXP files

EDOS transfers the file, via ftp, to thepredetermined directory. [Location, directory, username, and passwordare as specified in the ASTER-ECS Interface Control Document (ICD).]

Page 31: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

31625-CD-520-001

Ingest(INGST) CSCI

AutomatedNetwork Ingest

Interface ProcessEcInAuto

Polling IngestClient Interface

ProcessEcInPolling

MediaIngest Interface

ProcessEcInGUI

IngestRequest Manager

ProcessEcInReqMgr

IngestGranule Server

ProcessEcInGran

IngestDatabase

Sybase Server (COTS)

Cross-ModeIngest Interface

EcInEmailGWServer

IngestSubsystem

(INS) Ingest

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

ASTER: CSCI/Component Role in Polling Ingest for AST_EXP

Polls remote location for files named *.EDR.XFR; packages requests

Requests meta-

data configuration

file (mcf) fr

om

SDSRV

Provides metadata configuration file (mcf)

PackagesIngest Requestinto Granules

Staging Disk Server

receives request from

Ingest to create staging

disk and reserves space

Ingest reads delivery

record file and data files

from provider site via ftp

Page 32: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

32625-CD-520-001

INS

ER

TIO

N

Ingest

Polling

Expedited Data (Cont.)

Subscribe

NotificationRegister

Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Archive ingested AST_EXP data; update catalogue with reference to AST_EXP

Page 33: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

33625-CD-520-001

ASTER: AST_EXP Insertion Process

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

IngestSubsystem Ingest

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Client

CommunicationsSubsystem

SBSRV

Newly ingested AST_EXP granule is archived; inventory is updated.

1. Insert (AST_EXP)

2. Store (AST_EXP files)

3. Add (AST_EXP metadata)

Page 34: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

34625-CD-520-001

Ingest(INGST) CSCI

AutomatedNetwork Ingest

Interface ProcessEcInAuto

Polling IngestClient Interface

ProcessEcInPolling

MediaIngest Interface

ProcessEcInGUI

IngestRequest Manager

ProcessEcInReqMgr

IngestGranule Server

ProcessEcInGran

IngestDatabase

Sybase Server (COTS)

Cross-ModeIngest Interface

EcInEmailGWServer

IngestSubsystem

(INS) Ingest

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

ASTER: CSCI/Component Rolein AST_EXP Insertion

Builds metadata

file; requests

SDSRV to

validate

metadata;

requests

SDSRV to insert

received files

Validates metadata;

requests archiving of

granule files; adds

metadata to inventoryReads inserted files from Ingest staging disks

Store

s va

lidat

ed

met

adat

a in

the

inve

ntory

Page 35: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

35625-CD-520-001

INS

ER

TIO

N

Ingest

Polling

Expedited Data (Cont.)

Subscribe

NotificationRegister

Subscription

Store

ArchiveData

LocateData

CatalogueData

RetrieveData

Insert terminates with an insert eventnotification to Subscribe. e-mails ASTER Scientist noticeof a completed AST_EXP granule insert

Subscribe

Page 36: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

36625-CD-520-001

ASTER: AST_EXP Event Notification Process

Notify all AST_EXP:Insert event subscribers.

CommunicationsSubsystem

SBSRV

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Client

IngestSubsystem Ingest

1. Trigger (AST_EXP:Insert)

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

2. Notify (AST_EXP:Insert, e-mail)

Page 37: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

37625-CD-520-001

Landsat7Gateway

EcCsLandsat7Gateway

DomainName Service

DNS

E-MailServicesEmail Server

SubscriptionService

EcSbGui

Distributed ComputingConfiguration Item (DCCI)

DAR CommGateway

EcGwDARServer

E-Mail ParserGateway

EcCsEmailParser

FTPNotification

CsFtpNotify

Bulk DataServer

BDS

NetworkFile System

NFS

DCE ServicesName Service

Security ServiceTime Service

SubscriptionServer

EcSbSubServer

File TransferProtocol

FTP/KFTP

FilecopyEcUtFileCopyEcUtFileExec

VirtualTerminal

VT

Crypto-graphicManage-

mentInterface

CMI

Infra-structureLibrary

PF, SRF, Urs,Message Passing,

Event Logging,Service Locator,Failure Recovery

Framework

MOJOGateway

EcCsMojoGateway

Data Server Subsystem (DSS)

SDSRVDDIST

STMGT

Inven-toryDB

Collection Science Data Server(SDSRV) CSCI

ScienceData Server

EcDsScienceDataServer

HDF EOSServer

EcDsHdfEosServer

Science DataServer GUIEcDsSdsrvGui

Sybase/SQSSybase Server (COTS)

Data Distribution(DDIST) CSCI

DataDistribution

EcDsDistributionServer

DataDistribution GUI

EcDsDdistGui

Data BaseSybase Server (COTS)

Storage Management(STMGT) CSCI

Staging MonitorProcess

EcDsStStagingMonitorServerEcDsStStagingDiskServer

ResourceManager Process

EcDsSt8MMServerEcDsStD3Server

EcDsStIngestFtpServerEcDsStFtpDisServer

EcDsStCDROMServerEcDsStPrintServer

Pull MonitorProcess

EcDsStPullMonitorServer

Archive ServerEcDsStArchiveServer

Data BaseSybase Server (COTS)

ASTER: CSCI/Component Rolein AST_EXP Event Notification

Triggers AST_EXP:Insert event; notifies the correct subscription server

Fires subscriptions; sends e-mail notification of the AST_EXP:Insert event

Sendmail deliverse-mail messageto mail host

Page 38: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

38625-CD-520-001

Landsat Goals- Directory Search- User Registration- Data Ingest- Standing Orders (media)- Access to WRS Scenes (fixed scene subsetting) -Viewing Order Status

Landsat PreconditionsLandsat ESDTs Inserted into ECS -L70R, L70RF1, L70RF2, L70RWRS, L70RWRS1, L70WRS2, L7CPF, BrowseSubscription for: - L70R data notification - Standing Order for CPF production on tape

Landsat Scenario

Note:

Page 39: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

39625-CD-520-001

User Registration

Science User starts User Registration Tool from link on EOSDIS Home Page or on page for EOS Gateway Web Client and submits registration information.

RE

TRIE

VA

L

UserAccess

UserRegistrationSubscribe

Deliver

ManageSystemMonitor &Coordinate

ManageApplications

Logistics

Page 40: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

40625-CD-520-001

User Registration Request Process

Scientist clicks on link for user registration to invoke User Registration Tooland then enters and submits registration data.

CommunicationsSubsystem

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Client

IngestSubsystem Ingest

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

1. Request User Registration

Mgmt SupportSubsystem

MSS

2. Submit Registration Request

Page 41: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

41625-CD-520-001

Mgmt SupportSubsystem

MSS

ManagementAgent CSCI

(MACI)

SubAgentEcMsAgSubAgent

Deputy AgentEcMsAgDeputy

Proxy AgentEcMsAgGenProxy

Master AgentEcMsAgAgent

ManagementLogistics CSCI

(MLCI)

Baseline MgrXRP-II (COTS)

Inventory/Logistics/Maintenance Mgr

XRP-II (COTS)

SoftwareChange MgrClearCase (COTS)

ChangeRequest Mgr

DDTS (COTS)

SoftwareDistribution Mgr

Tivoli Courier (COTS)

SoftwareLicense Mgr

FLEXlm (COTS)iFOR/LS (COTS)

MsLiiFORLSMkDayLog

ManagementCSCI (MCI)

Network andEnterprise

ManagementHP OpenView NNM

Tivoli SentryMode Mgmt

Securityanlpasswd (COTS)

TCP Wrappers (COTS)Tripwire (COTS)SATAN (COTS)Crack (COTS)

AccountabilityEcMsAcRegUserSrvrEcMsAcRegUserGUI

EcMsAcOrderSrvrEcMsAcOrderGUI

Trouble Ticketaruser GUI (COTS)

aradmin GUI (COTS)MsTfHTML web interface

notifier GUI (COTS)notifier daemon (COTS)

Submit, Query, Notify (COTS)armail daemon (COTS)

UNIX sendmail

NetworkBackup/RestoreNetworker Server (COTS)Networker Client (COTS)

ASTER E-mailHeader Handler

EcMsAsAddHeader.plEcMsRemoveHeader.pl

Client (CLS)External/InternalUsers

Workbench(WKBCH) CSCI

User RegistrationTool (URT) Scripts

EcClWbUrEcClWbUrConfirmEcClWbUrSubmit

HDF ProductViewing Tool

EOSView

Java DARTool

EcClWbJdt

User ProfileGateway

EcClDtUserProfileGateway

CSCI/Component Role inUser Registration Request

Provides User Registration applications (HTML)

Submits request to User

Registration Server

Saves request as a “pending”

User Registration Request

awaiting approval

Page 42: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

42625-CD-520-001

User Registration (Cont.)

DAAC Operations (User Services) retrieves pending User Registration request and creates User Profile to register the user R

ETR

IEV

AL

UserAccess

UserRegistrationSubscribe

ManageSystemMonitor &Coordinate

ManageApplications

Logistics

Deliver

Page 43: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

43625-CD-520-001

User Registration Approval Process

DAAC User Services Representative uses User Registration Server GraphicalUser Interface (GUI) to retrieve pending User Registration request andcomplete a User Profile, which is saved to register the user.

CommunicationsSubsystem

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Client

IngestSubsystem Ingest

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

Mgmt SupportSubsystem

MSS

1. Retrieve and approve User Registration; create and save User Profile

Page 44: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

44625-CD-520-001

Mgmt SupportSubsystem

MSS

ManagementAgent CSCI

(MACI)

SubAgentEcMsAgSubAgent

Deputy AgentEcMsAgDeputy

Proxy AgentEcMsAgGenProxy

Master AgentEcMsAgAgent

ManagementLogistics CSCI

(MLCI)

Baseline MgrXRP-II (COTS)

Inventory/Logistics/Maintenance Mgr

XRP-II (COTS)

SoftwareChange MgrClearCase (COTS)

ChangeRequest Mgr

DDTS (COTS)

SoftwareDistribution Mgr

Tivoli Courier (COTS)

SoftwareLicense Mgr

FLEXlm (COTS)iFOR/LS (COTS)

MsLiiFORLSMkDayLog

ManagementCSCI (MCI)

Network andEnterprise

ManagementHP OpenView NNM

Tivoli SentryMode Mgmt

Securityanlpasswd (COTS)

TCP Wrappers (COTS)Tripwire (COTS)SATAN (COTS)Crack (COTS)

AccountabilityEcMsAcRegUserSrvrEcMsAcRegUserGUI

EcMsAcOrderSrvrEcMsAcOrderGUI

Trouble Ticketaruser GUI (COTS)

aradmin GUI (COTS)MsTfHTML web interface

notifier GUI (COTS)notifier daemon (COTS)

Submit, Query, Notify (COTS)armail daemon (COTS)

UNIX sendmail

NetworkBackup/RestoreNetworker Server (COTS)Networker Client (COTS)

ASTER E-mailHeader Handler

EcMsAsAddHeader.plEcMsRemoveHeader.pl

CSCI/Component Role inUser Registration Approval

GUI retrieves pending

requests; operator enters User

Profile information; server

stores the User Profile

Page 45: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

45625-CD-520-001

User Registration (Cont.)

RE

TRIE

VA

L

UserAccess

UserRegistrationSubscribe

ManageSystemMonitor &Coordinate

ManageApplications

Logistics

Deliver

System Management Support Services (MSS) sends e-mail to the Science User confirming registration

Page 46: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

46625-CD-520-001

User Registration Confirmation Process

System Management Support Services (MSS) User Registration Servercreates a new user confirmation message and sends it via e-mail to theScience User.

CommunicationsSubsystem

Data MgmtSubsystem

DDICT

Interoper-ability

ADSRV

PlanningSubsystem

Planning

abc

def

ghi

jkl

mno

DataProcessingSubsystem Data Proc

0110001011001011001011010111010110001011

Client

IngestSubsystem Ingest

Data Server Subsystem

SDSRVDDIST

STMGT

Inven-toryDB

Collection

Mgmt SupportSubsystem

MSS

1. Build new user confirmation message

2. E-mail notification

Page 47: 127 625-CD-520-001 Backward Chaining (Cont.) PRODUCTION Subscribe Notification Register Subscription Store Archive Data Locate Data Catalogue Data Retrieve

47625-CD-520-001

Mgmt SupportSubsystem

MSS

ManagementAgent CSCI

(MACI)

SubAgentEcMsAgSubAgent

Deputy AgentEcMsAgDeputy

Proxy AgentEcMsAgGenProxy

Master AgentEcMsAgAgent

ManagementLogistics CSCI

(MLCI)

Baseline MgrXRP-II (COTS)

Inventory/Logistics/Maintenance Mgr

XRP-II (COTS)

SoftwareChange MgrClearCase (COTS)

ChangeRequest Mgr

DDTS (COTS)

SoftwareDistribution Mgr

Tivoli Courier (COTS)

SoftwareLicense Mgr

FLEXlm (COTS)iFOR/LS (COTS)

MsLiiFORLSMkDayLog

ManagementCSCI (MCI)

Network andEnterprise

ManagementHP OpenView NNM

Tivoli SentryMode Mgmt

Securityanlpasswd (COTS)

TCP Wrappers (COTS)Tripwire (COTS)SATAN (COTS)Crack (COTS)

AccountabilityEcMsAcRegUserSrvrEcMsAcRegUserGUI

EcMsAcOrderSrvrEcMsAcOrderGUI

Trouble Ticketaruser GUI (COTS)

aradmin GUI (COTS)MsTfHTML web interface

notifier GUI (COTS)notifier daemon (COTS)

Submit, Query, Notify (COTS)armail daemon (COTS)

UNIX sendmail

NetworkBackup/RestoreNetworker Server (COTS)Networker Client (COTS)

ASTER E-mailHeader Handler

EcMsAsAddHeader.plEcMsRemoveHeader.pl

Landsat7Gateway

EcCsLandsat7Gateway

DomainName Service

DNS

E-MailServicesEmail Server

SubscriptionService

EcSbGui

Distributed ComputingConfiguration Item (DCCI)

DAR CommGateway

EcGwDARServer

E-Mail ParserGateway

EcCsEmailParser

FTPNotification

CsFtpNotify

Bulk DataServer

BDS

NetworkFile System

NFS

DCE ServicesName Service

Security ServiceTime Service

SubscriptionServer

EcSbSubServer

File TransferProtocol

FTP/KFTP

FilecopyEcUtFileCopyEcUtFileExec

VirtualTerminal

VT

Crypto-graphicManage-

mentInterface

CMI

Infra-structureLibrary

PF, SRF, Urs,Message Passing,

Event Logging,Service Locator,Failure Recovery

Framework

MOJOGateway

EcCsMojoGateway

CSCI/Component Role inUser Registration Confirmation

User Registration Server builds

new user confirmation

message

Sends e-mail notification confirming new user registration