repomman: using web services and bpel to facilitate workflow interaction with a digital repository
DESCRIPTION
RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository Richard Green. Overview. JISC Workflows activity and implementation meeting Aston Business School Tuesday 13 th February 2007. RepoMMan Project overview User and University needs - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/1.jpg)
RepoMMan: using Web Services and BPEL to facilitate
workflow interaction with a digital repositoryRichard Green
![Page 2: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/2.jpg)
Overview
• RepoMMan Project overview
• User and University needs
• A solution: BPEL and Web Services
• Example workflows: deposit and metadata
• Problems? What problems?
• Future work
JISC Workflows activity and implementation meeting
Aston Business SchoolTuesday 13th February 2007
![Page 3: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/3.jpg)
RepoMMan project
Repository, Metadata and Management project
JISC-funded for two years to end May 2007...
...to develop a BPEL-based, standards-compliant, Web Services based, workflow tool for Fedora
Closely aligned with the University’s commitment to deploy an institutional repository
![Page 4: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/4.jpg)
RepoMMan
Two strands: research – user needs, documentation etc (BPEL,
surveys, Beginner’s guide etc)
technical – development
Surface tool in University portal and/or Sakai C&LE
![Page 5: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/5.jpg)
Hull’s vision for a DR
Hull’s vision for an Institutional Repository is an extremely broad one
Conventional view was exposure of completed objects
Hull’s view encompasses storage, access, management and preservation of a wide range of file types from concept to completion
![Page 6: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/6.jpg)
User needs
Survey and interviews revealed very wide range of file types potentially to deal with
Users need Storage (backed up)
Access (from anywhere)
Management (sharing, locking, versioning etc)
Some want preservation
Tool must fit users’ expectations and environment Assist/improve doing what they already do
![Page 7: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/7.jpg)
University needs
Flexible wide range of content, some public - some private,
appropriate UIs
Standards-based Web Services, standards – BPEL, JSR168 etc
Scalable initially 2500 potential depositors
Open source software
Effective search & discovery need good metadata
![Page 8: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/8.jpg)
The repository grand plan
![Page 9: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/9.jpg)
Summary
The repository will be a working environment as well as a showcase
Aim is to provide storage, access, management and potential preservation painlessly
Development based on user needs
Standards compliant, Web Service approach
![Page 10: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/10.jpg)
Solution
Toolset to manage repository workflows for usersBPEL - Business Process Execution Language
(Active Endpoints Open Source version)
Web Services
Fedora repository softwareSOAP, RESTscales to millions of flexible objects (NSDL =
6m+)
![Page 11: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/11.jpg)
BUT
Fedora is not an ‘out-of-the-box’ solution
Provides the repository functionality for YOU to use flexibly
![Page 12: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/12.jpg)
Basic depositor workflows
Put object into repository including some sort of structuring
Get object from repository
Delete including at version level
Add metadata
Publish= promote to public space
![Page 13: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/13.jpg)
The RepoMMan deposit tool
![Page 14: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/14.jpg)
‘Putting’ and ‘getting’ a file
Left hand side of screen gives browse capability on user’s hard drive
Right hand side of screen shows the user’s private repository space like a directory structure
(‘Folders’ are in fact repository collections)
Folders can be expanded and new folders created
Objects can be further expanded to show versions
![Page 15: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/15.jpg)
Three-tier stack
![Page 16: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/16.jpg)
Three-tier stack
Model View Controller layer providing user interface
BPEL orchestrating Web Services (Fedora and other) to move files and objects around
Fedora drawing on ID Management System and University Storage Area Network
![Page 17: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/17.jpg)
UML diagram for simple deposit
![Page 18: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/18.jpg)
Three-tier stack: simple deposit
![Page 19: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/19.jpg)
‘Putting’ a file
Part of the BPEL process diagram(Active Endpoints visualisation software)
- switch depending on whether object already exists
- the left hand side branch creates a new object
- the right hand side modifies an existing one
- each of the globes with a ‘swirl’ round it is a Web Service call
![Page 20: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/20.jpg)
BPEL and web services
BPEL can draw on any available Web Service
Access to an expanding range of data made available through Web Services at Hull (and, of course, elsewhere)
Which brings us to metadata!!!
![Page 21: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/21.jpg)
Making public
Good metadata at the heart of effective search and discovery
When a user wants to ‘make an object public’ we will automatically add metadata
Potentially complex: BPEL to orchestrate
Has object already got metadata? Derive metadata using tool(s) Extract appropriate parts Combine with contextual metadata Allow user to edit Create datastream(s) (DC, Rich metadata (UVa),
preservation metadata, etc) Add to digital object
![Page 22: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/22.jpg)
Metadata from web services
Much contextual metadata about the ‘author’ can be derived from University systems’ Web Services or context
Technical metadata can be derived by using tools such as JHOVE (as a Web Service)
Descriptive metadata about the content is the Holy Grail?Data Fountains (UC Riverside & NSDL)
![Page 23: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/23.jpg)
Metadata from context & web svcs
Contextual metadata from environment (LDAP, Portal, Sakai)
Technical metadata (JHOVE etc)
Additional descriptive metadata from content (Data Fountains etc)
Allow user to edit / tweak
Acknowledgements to the Arrow consortium for the design idea
![Page 24: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/24.jpg)
Problems? What problems?
Not a smooth journey! Lessons: Don’t be a pioneer? Puppies don’t come free?
Active BPEL was/is fine
Fedora Web Services (v2.0, v2.1, v2.1.1) an issue Web Services were rpc/encoded
BPEL and AXIS couldn’t always successfully validate responses
Fedora Web Services (v2.2) OK! Web Services now document/literal
![Page 25: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/25.jpg)
Next stages
Complete the RepoMMan deposit tool (!!!) Internal testing
Trialling with users
Small-scale trials
Complete the RepoMMan metadata work
Post-project, develop further and deploy
Develop workflow tools for the admin side of the ‘make public’ process, records management, preservation...
In time switch to DROID (for MIME type)? Shibboleth?
![Page 26: RepoMMan: using Web Services and BPEL to facilitate workflow interaction with a digital repository](https://reader036.vdocument.in/reader036/viewer/2022062409/56815175550346895dbfabdd/html5/thumbnails/26.jpg)
Project website and contacts
RepoMMan: http://www.hull.ac.uk/esig/repomman
Contacts:
[email protected] (Manager)
[email protected] (Integration architect)
[email protected] (Director)
[email protected] (Software developer)