338 seminar4 keithlawrenz

Los Angeles | London | New DelhiSingapore | Washington DC

One approach to an online digital content repository

Automating Workflow from Acceptance to Publication

Automating Workflows from Acceptance to Publication, SSP, 2010 Los Angeles | London | New DelhiSingapore | Washington DC

SAGE Publications

● Books, journals and reference publishing programs for higher education• 560+ journals

● Publishing offices in • Los Angeles, CA• London, England• New Delhi, India• Washington DC


My background

● Keith Lawrenz• Senior Business Analyst, Publishing Technologies• 4 years with SAGE

● Specialties• Business process engineering• Content modeling• XML, XQuery, XSLT, XProc, relaxNG schema…


Overview

● Why SAGE invested in a repository● The SAGE repository workflow and how we

implemented phase one repository with RSuite

● Results and lesson learned


The business opportunity

● Secure SAGE online digital assets● Reliably deliver online content● Provide a platform for content analytics● Enable online product development


The business landscape

● HighWire upgrade to H2O● Migrating from proprietary DTD to NLM

schema● XML first workflow from back end XML

conversion● Online reference and book products that

require archive support


SAGE Online Content Repository


Attributes in a repository solution

● Flexibility• Analyst implemented business rules

● Scale• To support SAGE journal content• To support all SAGE content ongoing

● Access• Deployed worldwide


Implementation phases

1. Current journal content

2. Journal backfile

3. Encyclopedias and handbooks

4. Electronic books


Manuscript Management

SAGE Journals Workflow

Production Management

Online Content Repository


The scale

● 560+ journals● 770,000 articles since 1894● 40,000 new articles / year

• 80% PDF with header and references XML• 20% Full text

● ~70,000 unique issue deliveries / year to 50+ ftp targets

● 2 full-time headcount U.S. & UK offices


Overview of a journal issue

XM

L C

onv

ersi

on

Ven

dor

(Jou

ve)

Onl

ine

Con

tent

E

dito

rC

ont

ent

Re

cepi

ent

sS

OC

RJo

urn

al

Pro

duct

ion

Unit of Content is a Journal Issue

Start

FTP (UK) or NFS (US)

Zip Final Print-Ready

PDFs

Ingest Unencoded

Issue

Store in Repository

Deliver Unencoded

Issue

FTPCreate

SAGEMeta XML

Nomalize PDF Files

Zip Issue

FTP Store in Repository

Deliver HW Issue

Ingest Encoded

Issue

FTP – HighWire Express

Process Issue for Hosting

Quality Check Issue

Changes? Edit ArticlesApprove

Issue

Deliver Full Issue

Deliver PubMed Abstract

XML

FTP and/or NFS sites

Online Preview Issue Online

Issue Online?

End

Deliver XML Issue

End

Yes

Yes

OK to Host?Yes



XM

L C

onv

ersi

on

Ven

dor

(Jou

ve)

Onl

ine

Con

tent

E

dito

rC

ont

ent

Re

cepi

ent

sS

OC

RJo

urn

al

Pro

duct

ion


Start



PDFs

Ingest Unencoded

Issue

Store in Repository

Deliver Unencoded

Issue

FTPCreate

SAGEMeta XML

Nomalize PDF Files

Zip Issue


Deliver HW Issue

Ingest Encoded

Issue



Quality Check Issue


Issue

Deliver Full Issue


XML



Issue Online?

End

Deliver XML Issue

End

Yes

Yes

OK to Host?Yes

Ingest print-ready article PDF



XM

L C

onv

ersi

on

Ven

dor

(Jou

ve)

Onl

ine

Con

tent

E

dito

rC

ont

ent

Re

cepi

ent

sS

OC

RJo

urn

al

Pro

duct

ion


Start



PDFs

Ingest Unencoded

Issue

Store in Repository

Deliver Unencoded

Issue

FTPCreate

SAGEMeta XML

Nomalize PDF Files

Zip Issue


Deliver HW Issue

Ingest Encoded

Issue



Quality Check Issue


Issue

Deliver Full Issue


XML



Issue Online?

End

Deliver XML Issue

End

Yes

Yes

OK to Host?Yes

Deliver to encoding vendor



XM

L C

onv

ersi

on

Ven

dor

(Jou

ve)

Onl

ine

Con

tent

E

dito

rC

ont

ent

Re

cepi

ent

sS

OC

RJo

urn

al

Pro

duct

ion


Start



PDFs

Ingest Unencoded

Issue

Store in Repository

Deliver Unencoded

Issue

FTPCreate

SAGEMeta XML

Nomalize PDF Files

Zip Issue


Deliver HW Issue

Ingest Encoded

Issue



Quality Check Issue


Issue

Deliver Full Issue


XML



Issue Online?

End

Deliver XML Issue

End

Yes

Yes

OK to Host?Yes

Ingest xml-encoded issue



XM

L C

onv

ersi

on

Ven

dor

(Jou

ve)

Onl

ine

Con

tent

E

dito

rC

ont

ent

Re

cepi

ent

sS

OC

RJo

urn

al

Pro

duct

ion


Start



PDFs

Ingest Unencoded

Issue

Store in Repository

Deliver Unencoded

Issue

FTPCreate

SAGEMeta XML

Nomalize PDF Files

Zip Issue


Deliver HW Issue

Ingest Encoded

Issue



Quality Check Issue


Issue

Deliver Full Issue


XML



Issue Online?

End

Deliver XML Issue

End

Yes

Yes

OK to Host?Yes

Deliver to hosting platform



XM

L C

onv

ersi

on

Ven

dor

(Jou

ve)

Onl

ine

Con

tent

E

dito

rC

ont

ent

Re

cepi

ent

sS

OC

RJo

urn

al

Pro

duct

ion


Start



PDFs

Ingest Unencoded

Issue

Store in Repository

Deliver Unencoded

Issue

FTPCreate

SAGEMeta XML

Nomalize PDF Files

Zip Issue


Deliver HW Issue

Ingest Encoded

Issue



Quality Check Issue


Issue

Deliver Full Issue


XML



Issue Online?

End

Deliver XML Issue

End

Yes

Yes

OK to Host?Yes

Support editorial approval process



XM

L C

onv

ersi

on

Ven

dor

(Jou

ve)

Onl

ine

Con

tent

E

dito

rC

ont

ent

Re

cepi

ent

sS

OC

RJo

urn

al

Pro

duct

ion


Start



PDFs

Ingest Unencoded

Issue

Store in Repository

Deliver Unencoded

Issue

FTPCreate

SAGEMeta XML

Nomalize PDF Files

Zip Issue


Deliver HW Issue

Ingest Encoded

Issue



Quality Check Issue


Issue

Deliver Full Issue


XML



Issue Online?

End

Deliver XML Issue

End

Yes

Yes

OK to Host?Yes

Track go-live on hosting platform



XM

L C

onv

ersi

on

Ven

dor

(Jou

ve)

Onl

ine

Con

tent

E

dito

rC

ont

ent

Re

cepi

ent

sS

OC

RJo

urn

al

Pro

duct

ion


Start



PDFs

Ingest Unencoded

Issue

Store in Repository

Deliver Unencoded

Issue

FTPCreate

SAGEMeta XML

Nomalize PDF Files

Zip Issue


Deliver HW Issue

Ingest Encoded

Issue



Quality Check Issue


Issue

Deliver Full Issue


XML



Issue Online?

End

Deliver XML Issue

End

Yes

Yes

OK to Host?Yes

Deliver to additional targets


The results

● 100,000+ issue deliveries● 99.5% plus uptime● Aggressive expansion plans

• NLM XML-first workflows• Ingesting back content ~770,000 journal articles• ~200 encyclopedias and handbooks• SAGE Research Methods Online ~600 books


Important features

● Rich & accessible workflow• Human readable error messaging• SAGE configurable

● Supports key XML technologies● CMS functions● Web-delivered application● MarkLogic inside● Active Directory integration


Lessons learned

● Understand and document your workflows● Use proven software● Start small● Iterate● Technologists must partner with users


Keith Lawrenz

Senior Business Analyst, Publishing Technologies

[email protected]

RSuite – Booth #218

338 seminar4 keithlawrenz

Documents

england new delhi

ca london

new articles year

uk officesautomating

sage journal content

sage repository workflow

journal backfile3

journal issue track