goes users’ conference iv may 1-3, 2006 broomfield, co prepared by integrated work strategies, llc...

11GOES Users’ Conference IVMay 1-3, 2006Broomfield, CO

Prepared by Integrated Work Strategies, LLC

GOES USERS’ CONFERENCE IV:GOES USERS’ CONFERENCE IV:Discussion HighlightsDiscussion Highlights

Algorithm Development Algorithm Development

David KitzmillerDavid Kitzmiller



1)1) (A) What groups (beyond the system prime (A) What groups (beyond the system prime contractor and NOAA/NESDIS/ORA) should be contractor and NOAA/NESDIS/ORA) should be represented on the AWG teams? represented on the AWG teams?

(B) Should there be other potential AWG teams?(B) Should there be other potential AWG teams?

A) add users and international partners to A) add users and international partners to appropriate AWGs.appropriate AWGs.

B) potential new AWGs are decision support and B) potential new AWGs are decision support and visualizationvisualization



2) What do each of you perceive as the greatest 2) What do each of you perceive as the greatest risks for complete data usage on “Day 1” in the risks for complete data usage on “Day 1” in the area of algorithm development?area of algorithm development?

Definition: Day 1 is the first day of full operations after Definition: Day 1 is the first day of full operations after the intensive on-orbit calibration and checkout period.the intensive on-orbit calibration and checkout period.

Lack of input early on from nontraditional users so that Lack of input early on from nontraditional users so that the products do not meet their needs for sampling, the products do not meet their needs for sampling, format, interface, compatibility with their data format, interface, compatibility with their data systems, etc.systems, etc.• Do outreach to nontraditional usersDo outreach to nontraditional users

Data not of advertised qualityData not of advertised quality Data not certified by other agencies (e. g. FAA) Data not certified by other agencies (e. g. FAA)

therefore cannot be used for their requirements. therefore cannot be used for their requirements.

Recommend NOAA mitigate these risks earlyRecommend NOAA mitigate these risks early



3) What type of test beds and documentation is 3) What type of test beds and documentation is recommended to demonstrate GOES-R algorithms meet recommended to demonstrate GOES-R algorithms meet mission requirements? And how should radiances and mission requirements? And how should radiances and products be validated after GOES-R is launched?products be validated after GOES-R is launched?

Test bed to be defined by the algorithm working Test bed to be defined by the algorithm working groups and users to meet their requirements for groups and users to meet their requirements for algorithm development.algorithm development.

Post launch validation to be conducted by the Post launch validation to be conducted by the AWGs.AWGs.• Algorithm validation plan developed and discussed with Algorithm validation plan developed and discussed with

the users before launchthe users before launch• Include intensive validation experiments and long-term Include intensive validation experiments and long-term

validation for the life of the system validation for the life of the system



4) What test beds are recommended to allow users 4) What test beds are recommended to allow users to prepare for the utilization of GOES-R products to prepare for the utilization of GOES-R products & how far in advance?& how far in advance?

AWG produces the Test BedAWG produces the Test Bed• Engage the user group in the design and data used in the Engage the user group in the design and data used in the

test bedtest bed• Provide at least one season of proxy data in the test bed.Provide at least one season of proxy data in the test bed.• Include all data types the user community usesInclude all data types the user community uses• Deliver test bed to users at least 2 years before launchDeliver test bed to users at least 2 years before launch

Use open standards and platforms for the test bed Use open standards and platforms for the test bed and data systems.and data systems.

Provide data from on-orbit checkout (operate for Provide data from on-orbit checkout (operate for 3-6 months prior to on-orbit storage?) to the users 3-6 months prior to on-orbit storage?) to the users through the test bed. through the test bed.



4-6) What do users need when? 4-6) What do users need when? (Top 4 (Top 4 points):points):

Test Beds 2 yrs before launchTest Beds 2 yrs before launch Add a user readiness team to the AWGsAdd a user readiness team to the AWGs

• User forums User forums Comprehensive performance analysis over full Comprehensive performance analysis over full

range of conditionsrange of conditions Provide real data from the checkout period prior Provide real data from the checkout period prior

to on- orbit storage to the users through the test to on- orbit storage to the users through the test beds.beds.



7) How should improvements to the algorithms be 7) How should improvements to the algorithms be implemented?implemented?

AWG responsible for validation of products and AWG responsible for validation of products and implementing improvements as necessaryimplementing improvements as necessary

Evaluate impact on users. User needs is a guide Evaluate impact on users. User needs is a guide for deciding to implement improvements.for deciding to implement improvements.

Satellite Product Services Review Board (SPSRB) is Satellite Product Services Review Board (SPSRB) is the mechanism in place at NOAA for this processthe mechanism in place at NOAA for this process



8) Will the algorithms and/or software be 8) Will the algorithms and/or software be available to the user communities? available to the user communities? What about the international communities?What about the international communities?

Recommend that algorithms source code and Recommend that algorithms source code and documentation to be widely available documentation to be widely available

Should be available to the international Should be available to the international community. Important for international community. Important for international collaboration (GEOSS)collaboration (GEOSS)



9) What other questions or issues would you like 9) What other questions or issues would you like to have the group discuss?to have the group discuss?

Test beds will require funding at the receiving Test beds will require funding at the receiving agencies to use them and prepare to use the agencies to use them and prepare to use the data.data.

Involve the users throughout in the process of Involve the users throughout in the process of algorithm develop, testing, validation and algorithm develop, testing, validation and improvementimprovement



Background InformationBackground Information

GOALSGOALS• To optimize the development processTo optimize the development process• To provide efficient transition from the algorithm To provide efficient transition from the algorithm

developers to operationsdevelopers to operations• To engage the usersTo engage the users

DefinitionDefinition• An algorithm is an equation that converts data to a An algorithm is an equation that converts data to a

desired product. It starts with a piece of code (scientific desired product. It starts with a piece of code (scientific algorithm) that then needs be documented and placed in algorithm) that then needs be documented and placed in robust code and validated with test data including robust code and validated with test data including identifying the error characteristics. identifying the error characteristics.

goes users’ conference iv may 1-3, 2006 broomfield, co prepared by integrated work strategies, llc...

Documents