Orchestrating Business Processes
E-ARK Overview
Introduction to the digital archiving components of the E-ARK project.
István Alföldi Poliphon, Hungary Hungarian National Archives [email protected]
Orchestrating Business Processes
2
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Format Specifications and Tools
OLAP
FILES
DB
ERMS
HDFS Storage
Search and Display GUI
Order Management Tool
GeoServer
QGIS
E-ARK Web Search
Lily – Ingest
AIP2DIP Converter
IP Viewer
CMIS Portal Viewer
EAD Metadata
DB Visualisation Toolkit
IP Viewer
Oracle OLAP Viewer
QGIS
Peripleo
RODA-In
ESSArch Tools For Producer
SIP Creator SIP2AIP Converter
Universal Archival Modul
FILES
DB
GML
ERMS
DBPTK
ERMS Export Module
SIARD 2.0
E-ARK SMURF
Geodata
ESSArch Tools for Archive
RODA Repository
ESSArch Preservation Platform
SOLR index
GML
E-ARK Web
E-ARK SFSB
E-ARK SIP
E-ARK DIP
E-ARK AIP
Orchestrating Business Processes
3
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Viewers
E-ARK Format Specifications and Tools
OLAP
FILES
DB
ERMS
HDFS Storage
Search and Display GUI
Order Management Tool
GeoServer
QGIS
E-ARK Web Search
Lily – Ingest
EAD Metadata
RODA-In
ESSArch Tools For Producer
SIP Creator SIP2AIP Converter
Universal Archival Modul
FILES
DB
GML
ERMS
DBPTK
ERMS Export Module
SIARD 2.0
E-ARK SMURF
Geodata
ESSArch Tools for Archive
RODA Repository
ESSArch Preservation Platform
SOLR index
GML
E-ARK Web
E-ARK SFSB
E-ARK SIP
E-ARK AIP
AIP2DIP Converter
IP Viewer
CMIS Portal Viewer
DB Visualisation Toolkit
IP Viewer
Oracle OLAP Viewer
QGIS
Peripleo
E-ARK DIP
Orchestrating Business Processes
4
e-Document Archive
P
r
o
d
u
c
e
r
C
o
n
s
u
m
e
r
Reference Model of an Open Archival Information System (OAIS)
OAIS
Submission Information
Package
Archival Information
Package
Dissemination Information
Package
Orchestrating Business Processes
5
Data Management
Ingest
Preservation Planning
Access
Administration
Archival Storage
P
r
o
d
u
c
e
r
C
o
n
s
u
m
e
r
queries
result sets
orders
Reference Model of an Open Archival Information System (OAIS)
OAIS
SIP DIP
Pre-Ingest e-Document
Archive AIP
Descriptive Metadata
Orchestrating Business Processes
6
Data Management
Ingest
Preservation Planning
Access
Administration
Archival Storage
P
r
o
d
u
c
e
r
C
o
n
s
u
m
e
r
queries
result sets
orders
Reference Model of an Open Archival Information System (OAIS)
OAIS
SIP DIP
Pre-Ingest e-Document
Archive AIP
Descriptive Metadata
Links Reference Model for an Open Archival Information System (OAIS)
Orchestrating Business Processes
7
SIP DIP
AIP
E-ARK Common Specification for Information Packages
Orchestrating Business Processes
8 E-ARK Information Packages
E-ARK SIP
E-ARK DIP
E-ARK AIP
Links DILCIS Board Common Specification for Information Packages Submission Information Package Archival Information Package Dissemination Information Package
Orchestrating Business Processes
9
Data Management
Ingest
Preservation Planning
Access
Administration
Archival Storage
P
r
o
d
u
c
e
r
C
o
n
s
u
m
e
r
queries
result sets
orders
E-ARK Processes
OAIS
SIP DIP
Pre-Ingest e-Document
Archive AIP
Descriptive Metadata
Orchestrating Business Processes
10
Ingest Access Pre-Ingest
Ingest Access Pre-Ingest
E-ARK Processes
Orchestrating Business Processes
11
Pre-Ingest Ingest Access
E-ARK Processes
Orchestrating Business Processes
12
Pre-Ingest Ingest Access
E-ARK Processes
Orchestrating Business Processes
13
PRODUCERARCHIVE
Extract and Ingest ERMS
records based on MoReq2010
Extract and Ingest Relational
DB based on SIARD
Extract and Ingest files from
simple file-system
Extrac and Ingestt files from simple
file-system - GML
Data Management
Archival Storage
Preservastion
Archival Repository
CONSUMER
Data
OLAP
FILES
DB
GML
Access databases via
SOLR (not SQL)
Access databases via
DBVTK (SQL)
Access single ERMS records
Access data with OLAP
via Oracle
Access geodata via QGIS
ERMS
DB
ERMS
FILES
GML
E-ARK Use cases
Ingest Access
C
o
n
s
u
m
e
r
SIP DIP
Pre-Ingest AIP
P
r
o
d
u
c
e
r
Orchestrating Business Processes
14 E-ARK Format Specifications and Tools
OLAP
FILES
DB
ERMS
EAD Metadata
FILES
DB
GML
ERMS
GML
E-ARK SIP
E-ARK AIP
Pre-Ingest Ingest Archival Storage Access
E-ARK DIP
Orchestrating Business Processes
15
Pre-Ingest Ingest Archival Storage Access
E-ARK Content Type specifications
OLAP
FILES
DB
ERMS
EAD Metadata
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK SIP
E-ARK AIP
E-ARK DIP
Links SIARD 2.1 (Software Independent Archival of Relational Databases) specification E-ARK ERMS (SMURF and SFSB) Content Type specification
Orchestrating Business Processes
16
Pre-Ingest Ingest Archival Storage Access
OLAP
FILES
DB
ERMS
EAD Metadata
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK SIP
E-ARK AIP
E-ARK Content Type specifications
E-ARK DIP
Orchestrating Business Processes
17
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
OLAP
FILES
DB
ERMS
EAD Metadata
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK SIP
E-ARK AIP
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
E-ARK DIP
Orchestrating Business Processes
18
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
OLAP
FILES
DB
ERMS
QGIS
EAD Metadata
FILES
DB
GML
ERMS
DBPTK
ERMS Export Module
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK SIP
E-ARK AIP
E-ARK DIP
Orchestrating Business Processes
19
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
OLAP
FILES
DB
ERMS
EAD Metadata
RODA-In
ESSArch Tools For Producer
Universal Archival Modul
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK AIP
SIP Creator
E-ARK SIP
E-ARK DIP
Orchestrating Business Processes
20
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
OLAP
FILES
DB
ERMS
HDFS Storage
Search and Display GUI
Order Management Tool
GeoServer
E-ARK Web Search
Lily – Ingest
AIP2DIP Converter
EAD Metadata
SIP2AIP Converter
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
ESSArch Tools for Archive
RODA Repository
ESSArch Preservation Platform
SOLR index
GML
E-ARK SFSB
E-ARK AIP
E-ARK SIP
E-ARK DIP
Orchestrating Business Processes
21
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
OLAP
FILES
DB
ERMS
EAD Metadata
FILES
DB
GML
ERMS
SIARD 2.0
E-ARK SMURF
Geodata
GML
E-ARK SFSB
E-ARK SIP
E-ARK AIP
IP Viewer
CMIS Portal Viewer
DB Visualisation Toolkit
IP Viewer
Oracle OLAP Viewer
QGIS
Peripleo
E-ARK DIP
Orchestrating Business Processes
22
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Tools (E-ARK4LL Sample Software Portfolio)
OLAP
FILES
DB
ERMS
HDFS Storage
Search and Display GUI
Order Management Tool
GeoServer
QGIS
E-ARK Web Search
Lily – Ingest
EAD Metadata
RODA-In
ESSArch Tools For Producer
SIP Creator SIP2AIP Converter
Universal Archival Modul
FILES
DB
GML
ERMS
DBPTK
ERMS Export Module
SIARD 2.0
E-ARK SMURF
Geodata
ESSArch Tools for Archive
RODA Repository
ESSArch Preservation Platform
SOLR index
GML
E-ARK Web
(Reference Implementation)
E-ARK SFSB
E-ARK SIP
E-ARK AIP
AIP2DIP Converter
IP Viewer
CMIS Portal Viewer
DB Visualisation Toolkit
IP Viewer
Oracle OLAP Viewer
QGIS
Peripleo
E-ARK DIP
Orchestrating Business Processes
23
Pre-Ingest Ingest Archival Storage Access
Export tools SIP Creation
tools Preservation
Data Management Search and Order
management tools DIP Creation tools Presentation tools
E-ARK Format Specifications and Tools
OLAP
FILES
DB
ERMS
HDFS Storage
Search and Display GUI
Order Management Tool
GeoServer
QGIS
E-ARK Web Search
Lily – Ingest
AIP2DIP Converter
IP Viewer
CMIS Portal Viewer
EAD Metadata
DB Visualisation Toolkit
IP Viewer
Oracle OLAP Viewer
QGIS
Peripleo
RODA-In
ESSArch Tools For Producer
SIP Creator SIP2AIP Converter
Universal Archival Modul
FILES
DB
GML
ERMS
DBPTK
ERMS Export Module
SIARD 2.0
E-ARK SMURF
Geodata
ESSArch Tools for Archive
RODA Repository
ESSArch Preservation Platform
SOLR index
GML
E-ARK Web
E-ARK SFSB
E-ARK SIP
E-ARK DIP
E-ARK AIP
Orchestrating Business Processes
24 E-ARK General Model
Links E-ARK General Model 3.0
With lots of links inside!
Orchestrating Business Processes
25 E-ARK General Model – Pilot Scenarios and Documentation
Links Detailed Pilot Definition Pilot documentation Volume 1. Pilot documentation Volume 2.
Orchestrating Business Processes
26 Getting started with E-ARK tools
1. Select your use cases
2. Select the E-ARK information package and content type specifications Read the documentation
3. Select the tools Read the documentation
4. Look for an E-ARK pilot scenario similar to yours in the General Model Read the documentation
6. Experiment with the tools Run a pilot
5. Get more information from eArchiving Training, Service Desk support
Orchestrating Business Processes
? István Alföldi Poliphon, Hungary [email protected]
Questions & Answers