moret - a software for model management - r project
TRANSCRIPT
Model RepositoryMORET 2008
Summary
MORET - A Software For Model Management
Ralf Seger Antony Unwin
Institut für MathematikRechnerorientierte Statistik und Datenanalyse
UseR 2008
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Outline
1 Model RepositoryManaging Large Sets Of ModelsMORET 2006 - fixed model structures
2 MORET 2008Further RequirementsConfiguring ModelsOther Improvements
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
Outline
1 Model RepositoryManaging Large Sets Of ModelsMORET 2006 - fixed model structures
2 MORET 2008Further RequirementsConfiguring ModelsOther Improvements
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
The Task: When A Small Set Of Models grows and becomeshard to handle.
Models can be computed quickly todayLots of data pile up during this process
Managing large sets of models by hand is cumbersomework.
no bit of information must be lostworking with the data (transformation, plots ...)information should be kept at one place (desk, notes, R ...)
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
The Task: When A Small Set Of Models grows and becomeshard to handle.
Models can be computed quickly todayLots of data pile up during this process
Managing large sets of models by hand is cumbersomework.
no bit of information must be lostworking with the data (transformation, plots ...)information should be kept at one place (desk, notes, R ...)
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
The Task: When A Small Set Of Models grows and becomeshard to handle.
Models can be computed quickly todayLots of data pile up during this process
Managing large sets of models by hand is cumbersomework.
no bit of information must be lostworking with the data (transformation, plots ...)information should be kept at one place (desk, notes, R ...)
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
The Task: When A Small Set Of Models grows and becomeshard to handle.
Models can be computed quickly todayLots of data pile up during this process
Managing large sets of models by hand is cumbersomework.
no bit of information must be lostworking with the data (transformation, plots ...)information should be kept at one place (desk, notes, R ...)
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
The Task: When A Small Set Of Models grows and becomeshard to handle.
Models can be computed quickly todayLots of data pile up during this process
Managing large sets of models by hand is cumbersomework.
no bit of information must be lostworking with the data (transformation, plots ...)information should be kept at one place (desk, notes, R ...)
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
The Task: When A Small Set Of Models grows and becomeshard to handle.
Models can be computed quickly todayLots of data pile up during this process
Managing large sets of models by hand is cumbersomework.
no bit of information must be lostworking with the data (transformation, plots ...)information should be kept at one place (desk, notes, R ...)
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
Outline
1 Model RepositoryManaging Large Sets Of ModelsMORET 2006 - fixed model structures
2 MORET 2008Further RequirementsConfiguring ModelsOther Improvements
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006collects all input from Rstores the data, input and models in a databasesupported model types
lmglmgamrpart
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006collects all input from Rstores the data, input and models in a databasesupported model types
lmglmgamrpart
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006collects all input from Rstores the data, input and models in a databasesupported model types
lmglmgamrpart
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006collects all input from Rstores the data, input and models in a databasesupported model types
lmglmgamrpart
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006collects all input from Rstores the data, input and models in a databasesupported model types
lmglmgamrpart
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006collects all input from Rstores the data, input and models in a databasesupported model types
lmglmgamrpart
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006provides database support for selection and deletion ofmodels or dataallows the comparison global model statistics
on a very abstract level (complexity, quality)on a model specific level Model Explorer
external software can be supplied with stored information
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006provides database support for selection and deletion ofmodels or dataallows the comparison global model statistics
on a very abstract level (complexity, quality)on a model specific level Model Explorer
external software can be supplied with stored information
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006provides database support for selection and deletion ofmodels or dataallows the comparison global model statistics
on a very abstract level (complexity, quality)on a model specific level Model Explorer
external software can be supplied with stored information
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006provides database support for selection and deletion ofmodels or dataallows the comparison global model statistics
on a very abstract level (complexity, quality)on a model specific level Model Explorer
external software can be supplied with stored information
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
MORET at UseR 2006provides database support for selection and deletion ofmodels or dataallows the comparison global model statistics
on a very abstract level (complexity, quality)on a model specific level Model Explorer
external software can be supplied with stored information
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Managing Large Sets Of ModelsMORET 2006 - fixed model structures
Model Explorer
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Outline
1 Model RepositoryManaging Large Sets Of ModelsMORET 2006 - fixed model structures
2 MORET 2008Further RequirementsConfiguring ModelsOther Improvements
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Further RequirementsThere are many more model types and new types emergeregularly
Generic Database and Model ConfigurationAssessing model data
Feature QueryExternal information is not accessible (papers, plots ..)
Attachments
...
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Further RequirementsThere are many more model types and new types emergeregularly
Generic Database and Model ConfigurationAssessing model data
Feature QueryExternal information is not accessible (papers, plots ..)
Attachments
...
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Further RequirementsThere are many more model types and new types emergeregularly
Generic Database and Model ConfigurationAssessing model data
Feature QueryExternal information is not accessible (papers, plots ..)
Attachments
...
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Further RequirementsThere are many more model types and new types emergeregularly
Generic Database and Model ConfigurationAssessing model data
Feature QueryExternal information is not accessible (papers, plots ..)
Attachments
...
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Further RequirementsThere are many more model types and new types emergeregularly
Generic Database and Model ConfigurationAssessing model data
Feature QueryExternal information is not accessible (papers, plots ..)
Attachments
...
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Further RequirementsThere are many more model types and new types emergeregularly
Generic Database and Model ConfigurationAssessing model data
Feature QueryExternal information is not accessible (papers, plots ..)
Attachments
...
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Further RequirementsThere are many more model types and new types emergeregularly
Generic Database and Model ConfigurationAssessing model data
Feature QueryExternal information is not accessible (papers, plots ..)
Attachments
...
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Outline
1 Model RepositoryManaging Large Sets Of ModelsMORET 2006 - fixed model structures
2 MORET 2008Further RequirementsConfiguring ModelsOther Improvements
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Generic Database Structure
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Mapping R Model Informationgeneric database structure allows storing arbitraryinformationR models come in different data types (List, Vector)To store meaningful information the structure from R needsto be filtered/mapped
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Mapping R Model Informationgeneric database structure allows storing arbitraryinformationR models come in different data types (List, Vector)To store meaningful information the structure from R needsto be filtered/mapped
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Mapping R Model Informationgeneric database structure allows storing arbitraryinformationR models come in different data types (List, Vector)To store meaningful information the structure from R needsto be filtered/mapped
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Full model summary example (loess)
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Prerequisites For R Model Mappingthe returned structure from R must provide
a global quality statistic "ResidualDeviance"a global complexity statistic "DF"
All required information
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Prerequisites For R Model Mappingthe returned structure from R must provide
a global quality statistic "ResidualDeviance"a global complexity statistic "DF"
All required information
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Prerequisites For R Model Mappingthe returned structure from R must provide
a global quality statistic "ResidualDeviance"a global complexity statistic "DF"
All required information
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Configurating An R Model Mapping
Custom CommandMost R models provide a usable summary command. If stillinformation is missing a custom command can be used tocompute the full tree from.
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Using generic modelsAfter the configuration (wizard) is finished the data will bestored according to the mappingThe stored information can be accessed
via the overview table orthe Model Explorerexternal software
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Using generic modelsAfter the configuration (wizard) is finished the data will bestored according to the mappingThe stored information can be accessed
via the overview table orthe Model Explorerexternal software
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Using generic modelsAfter the configuration (wizard) is finished the data will bestored according to the mappingThe stored information can be accessed
via the overview table orthe Model Explorerexternal software
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Using generic modelsAfter the configuration (wizard) is finished the data will bestored according to the mappingThe stored information can be accessed
via the overview table orthe Model Explorerexternal software
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Using generic modelsAfter the configuration (wizard) is finished the data will bestored according to the mappingThe stored information can be accessed
via the overview table orthe Model Explorerexternal software
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Outline
1 Model RepositoryManaging Large Sets Of ModelsMORET 2006 - fixed model structures
2 MORET 2008Further RequirementsConfiguring ModelsOther Improvements
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Feature Query
Feature QueryRetrieve stored models by features instead of relation
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Other ImprovementsAttachments
Models or data sets relate to other files that can be linkedwith MORETs database
Model Management By GroupAny model can be added or removed to an administrativegroupThis groups can be used to filter the model tablen:m mappings are possible and useful
Bootstrapping is supported, the index set is persistentDatabase can be exported and merge-processimplemented
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Other ImprovementsAttachments
Models or data sets relate to other files that can be linkedwith MORETs database
Model Management By GroupAny model can be added or removed to an administrativegroupThis groups can be used to filter the model tablen:m mappings are possible and useful
Bootstrapping is supported, the index set is persistentDatabase can be exported and merge-processimplemented
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Other ImprovementsAttachments
Models or data sets relate to other files that can be linkedwith MORETs database
Model Management By GroupAny model can be added or removed to an administrativegroupThis groups can be used to filter the model tablen:m mappings are possible and useful
Bootstrapping is supported, the index set is persistentDatabase can be exported and merge-processimplemented
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Other ImprovementsAttachments
Models or data sets relate to other files that can be linkedwith MORETs database
Model Management By GroupAny model can be added or removed to an administrativegroupThis groups can be used to filter the model tablen:m mappings are possible and useful
Bootstrapping is supported, the index set is persistentDatabase can be exported and merge-processimplemented
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Other ImprovementsAttachments
Models or data sets relate to other files that can be linkedwith MORETs database
Model Management By GroupAny model can be added or removed to an administrativegroupThis groups can be used to filter the model tablen:m mappings are possible and useful
Bootstrapping is supported, the index set is persistentDatabase can be exported and merge-processimplemented
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Further RequirementsConfiguring ModelsOther Improvements
Other ImprovementsAttachments
Models or data sets relate to other files that can be linkedwith MORETs database
Model Management By GroupAny model can be added or removed to an administrativegroupThis groups can be used to filter the model tablen:m mappings are possible and useful
Bootstrapping is supported, the index set is persistentDatabase can be exported and merge-processimplemented
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Summary
By adapting (mapping) model data, MORET is able tohandle all kinds of models.The further improvements facilitate the managementprocess.
OutlookXSLT has been successfully used to map from one XMLformat to other target formats. Try out if XSLT is capable ofmapping models instead of the tree-mapping-wizard.
Ralf Seger, Antony Unwin MORET - A Software For Model Management
Model RepositoryMORET 2008
Summary
Summary
By adapting (mapping) model data, MORET is able tohandle all kinds of models.The further improvements facilitate the managementprocess.
OutlookXSLT has been successfully used to map from one XMLformat to other target formats. Try out if XSLT is capable ofmapping models instead of the tree-mapping-wizard.
Ralf Seger, Antony Unwin MORET - A Software For Model Management