bhl europe atos origin wp3 insights v1.0
DESCRIPTION
presentation during the BHL-Europe kick-off meetingTRANSCRIPT
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Lee NambaChief ArchitectPublic Sector – France
Museum für Naturkunde
Roger EssohHead of InnovationBiz Dev ManagerOpen Source ManagerPublic Sector - France
�Represent Atos Origin in BHL-Europe Consortium
� Acting as Open Source and Preservation and Archive System consultant
�Roger Essoh Deputy in BHL-Europe Consortium
� Acting as Preservation and Archive System consultant
Go for a PAS**Preservation & Archive System
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
We’ve a PAS* to build !
ACCESSACCESSINGESTINGEST STORAGESTORAGE
WP 2
WP 3* Preservation and Archive System
PROVIDERS
Europeana
CONSUMERS
ENGINE
Thank to CASPAR for the nice picture
Compliance with Europeana Meta-Data requirements
Meta-Data is a key success factor of the consumers satisfaction !(Taxonomic, Multilanguage's,…)
Europeanaconnect API
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Our primary goalPrototype for German language
ACCESSACCESSINGESTINGEST STORAGESTORAGE
PROVIDERS
Europeana
CONSUMERS
ENGINE
German digital content
Now how to build a PAS ?
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Building a PAS :Digital Preservation issues
1. How To guarantee a digital information may be accessed and accessed and understoodunderstood in the future
2. How To guarantee a proper information package managementinformation package managementwithin and OAIS Archive
3. How To guarantee longlong--time preservation maintenancetime preservation maintenance of any information package
4. How To guarantee retrievalretrieval of Archival Information5. How To guarantee intellegibilityintellegibility within heterogeneous Designated
Communities and their digital information6. How To guarantee preservation actors are informed about change informed about change
eventsevents7. How To guarantee an adequate security accesssecurity access with the proper
rightsrights to any resource and functionality within an OAIS Archive8. How To guarantee an adequate integrity and identityintegrity and identity for any
Archival Information
Source – Luigi Briguglio
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Ideal approach ???
Standards
Work close
� Long-term
Open Source
Partnership
Integration
More risks
Maintenance
Community
Standards
Not relevant
� Short-term
Open Source
Not essential
Integration
Less possible
Maintenance
By my own
SUSTAINABLE ROAD
SUSTAINABLE ?
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Long-term ?
Standards
Work close
� Long-term
Open Source
Partnership
Integration
More risks
Maintenance
Community
SUSTAINABLE ROAD
� Define what we mean by Standard regarding our requirements !
�Be sure we’re choosing the right standards !
� Build a B2B (win-win) partnership…No reinvent the wheel
�Focus on the BHL System maintenance and mutual interests during the deal
Reuse Europeanaassets (quick wins, best practices, standards,…)
� An Integration project
�Setup an Implementation methodology and industrialize the development platform
� Share our roadmap
�Setup a process review to ensure we stay aligned with the communities
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Some integration challenges
BHL-Europe - Infrastructure
OAIS CORE
Ingest
BHL-Europe System
Preser-vation
Adminis-tration
Rights management
Data management
Storage
Access
Storage Abstraction Service (SAS)
Pre Ingest
OAI repository(descriptive metadata
catalog)
META DATA Policeman
Identity management
(rights metadata management)
RIGHT MEDIATOR
Users
Producer 1
Producer 2
Producer 3
Producer n
Easy, simple, understanding, Multilanguage'
s and homogeneous
access
THE SUCCESS FACTOR
Total Performance ExcellencePOWER &
ROBUSTNESS
Challenge
Challenge Challenge
Challenge
Challenge
Challenge
Challenge
OAIS compliance
The SYSTEM HEART
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Integration success factors
BHL-EuropePreservation & Archive System
Development & Integration strategy & methodology
Use Agile approach to manage complexity and technical risks
Digital preservationexpertise
Design a Digital preservation leader
Stable specificationsASAP
Execute Iterative benchmarks to validate requirements
System integrationexpertise
Design a system integration leader
Industrialize your development platform
Use continuous Integration enginewith a strong issues tracker
Drivers Answers
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Development strategy
SelfSelfSelfSelf----ContainedContainedContainedContained + + + +
Well DescribedWell DescribedWell DescribedWell Described + + + +
AdaptableAdaptableAdaptableAdaptable + + + +
Replaceable = Replaceable = Replaceable = Replaceable =
PreservablePreservablePreservablePreservable
Pure Service-oriented designguarantees that the component can provide functionality without requiring cooperation of other components
Component analysis, design and development process is strongly based on complete – shared – opendocumentation at any level
•• No DependenciesNo Dependencies•• Loosely coupledLoosely coupled•• DistributedDistributed
• Sharing knowSharing know--howhow•• Open SpecificationOpen Specification•• Open Source Open Source •• Open DocumentationOpen Documentation
Design choices and implementation allows to adapt and configure each component to provide always at least a minimal set of functionality independently from the deployment framework and condition
•• FlexibilityFlexibility•• ScalabilityScalability
Design choices and implementation allows to replace any component in the framework with compliant one.
•• InteroperabilityInteroperability•• MantainabilityMantainability
Source – Luigi Briguglio
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Example of development steps
BHL-Europe - Infrastructure
OAIS CORE
Ingest
BHL-Europe System
Preser-vation
Adminis-tration
Rights
management
Data management
Storage
Access
Storage Abstraction Service (SAS)
Pre Ingest Pre Ingest
• Activity 1
• Activity 2
• Activity n
Ingest
• Activity 1
• Activity 2
• Activity n
Infrastructure
• Activity 1
• Activity 2
• Activity n
Preservation
• Activity 1
• Activity 2
• Activity n
Data Mgt
• Activity 1
• Activity 2
• Activity n
Storage
• Activity 1
• Activity 2
• Activity n
Rights Mgt
• Activity 1
• Activity 2
• Activity n
SAS
• Activity 1
• Activity 2
• Activity n
Administration
• Activity 1
• Activity 2
• Activity n
Access
• Activity 1
• Activity 2
• Activity n
STEP 1
STEP 3STEP 2
STEP 4
• Work by module
• Driven by an Integration strategy
• Based on development by contract
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
An Agile approach
Ingest ModuleRelease 1
Sprint 1 Sprint 2 Sprint 3
4 weeks 4 weeks 3 weeks
Pre Ingest
• Activity 1
• Activity 2
• Activity n
Ingest
• Activity 1
• Activity 2
• Activity n
Infrastructure
• Activity 1
• Activity 2
• Activity n
Preservation
• Activity 1
• Activity 2
• Activity n
Data Mgt
• Activity 1
• Activity 2
• Activity n
Storage
• Activity 1
• Activity 2
• Activity n
Rights Mgt
• Activity 1
• Activity 2
• Activity n
SAS
• Activity 1
• Activity 2
• Activity n
Administration
• Activity 1
• Activity 2
• Activity n
Access
• Activity 1
• Activity 2
• Activity n
STEP 1
STEP 3STEP 2
STEP 4
Storage ModuleRelease 1
Sprint 1 Sprint 2 Sprint 3
4 weeks 4 weeks 3 weeks
Integration
• Respect implementation contract to ensure efficient integration
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Continuous Integration Engine
Final versionRelease 1 Release 2 Release n
Eclipse / SCM / Hudson Architecture
Automate integration, Improve release quality, Identify regressions
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
Dev collaboration platform
Ideas for collaboration platform
Hudson platform(Continuous Integration)
Mercurial ?SVN ?
….
Technical Wiki
Jtrac(Issues tracker)
Mercurial/ JIT(tech)
CentralizeDevelopment ?
DistributedDevelopment ?
P
PP
P P
Synchronizedplatform
Timesheetsystem
BHL-Europe Wiki
Instant messaging ?Gtalk,…?
……
BHL-Europe
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
BHL-Europe - Infrastructure
OAIS CORE
Ingest
BHL-Europe System
Preser-vation
Adminis-tration
Rights management
Data management
Storage
Access
Storage Abstraction Service (SAS)
Pre Ingest