tzunami deployer

Tzunami Deployer

Training

Presented by -Prabhakar GiriTzunami Inc.

2

Training HighlightDays Goals

Day 1 - Developing high level understanding of various components involved and migration process using Tzunami Deployer

- Understanding eRoom7 structure & contents- Setup

Day 2 - Using Tzunami eRoom Exporter to view and export eRoom contents- Developing in-depth understanding content deployment using Tzunami Deployer

Day 3 - Content modeling and committing - Deployer advanced options and migration automation using rule engine

Day 4 -Batch migration-Remote & Licensing service- Trouble shooting

3

Content Migration – Content • Typically

– Microsoft Office, Adobe PDF– XML documents, images, audio, video, …

• Reality– Document streams (file contents)– Metadata (content properties)– Structure (folders)– Access controls (security)

4

Content Migration – Content

Source Content Store SharePoint Environment

4. Access Role Based Access Control 4. Access Site, Library and List Access Control

3. Structure Collection, Facility, eRoom, Folder 3. Structure Site Hierarchies, Multiple Libraries, Folders

2. Metadata Extensible Item Schemas, Document Properties 2. Metadata Custom Document Library and List Column

Properties

1. Document Document, Contacts, Discussion, Poll, Calendar, Appointment, Task, etc. 1. Document Document, Picture, and XML Forms Libraries

Tool

5

Content Migration – Processes• Analyzing• Planning• Modeling• Extraction• Mapping• Injection• Verification

6

Content Migration – Challenges• Need for Co-existence• Source/Target Architectural Differences• Often Outdated Source System• Data Volume Involved• Varying Needs

7

Tzunami Deployer Features

• Tool for rapid migration and consolidation of contents from multiple sources into Microsoft SharePoint

• Migrate from wide range of content sources

• Content modeling • Drag and drop migration• Metadata management• Security migration • Customizable mapping• Offline simulation environment

8

Tzunami Deployer Features

• Tool for rapid migration and consolidation of contents from multiple sources into Microsoft SharePoint

• Automates bulk of migration tasks• Saves time & reduces migration cost• Supports remote operations• Supports multitasking model• Supports scripted/batch migration• Ensures content consistency and

accuracy at every stage

9

Tzunami Deployer - Architecture

TargetsDeployer

s

Exporters

Sources

10

General Migration Workflow

11

Tzunami Deployer Phases

• Exporting source content

• View source contents• Select contents to extract• Extract to local file store• Extract metadata, hierarchy & security

Export to TDX LoadeRoom

12


• Loading source and target information– The first stage of defining a Tzunami Deployer project is

to load the information that will be required for the project.

• Load source content• Load target structure

13


• Perform virtual migration– The next stage is to simulate a migration from source to

target

• Deploy source content to target• Work independent of source or target• Undo and retry if needed

14


• Modeling target SharePoint structure– Design or modify the target SharePoint structure into

which the content of the source systems will be deployed

• Simulate target SharePoint• Create or modify SharePoint sites,

libraries, lists, folders and security in target

15


• Committing the migration

• Reflect changes to target SharePoint• Failsafe operation

16

eRoom - History

• eRoom is an online project collaboration solution

• Started in 1996 Instinctive Technology (v5), led by CEO Jeffrey Beir.

• Acquired in 2002 by Documentum (v6)• Acquired in 2003 by EMC Corporation

(v7) added project/customer management

• Latest Version: 7.41

eRoom Architecture

17

eRoom Browser

Browser and Plug-in

Custom Application

eRoom Monitor

Web Development

Client Tier

eRoom Web Service Real Time Service IM Integration ServiceMiddle Tier

Database File Server

Directory Server

Email Server

Index Server

Content Server

Back End Server

eRoom 3 – Tier Architecture

18

eRoom Site Architecture

eRoom 7 Site

Community - A

Facility A1

Facility A2

Facility A3

eRoom X1eRoom X2

eRoom X3

Community - B

Facility B1

Facility B2

Facility B3

eRoom Y1eRoom Y2

eRoom Y3

Community - C

Facility C1

Facility C2

Facility C3

eRoom Z1eRoom Z2

eRoom Z3

19

eRoom Security ArchitectureSML

eRoom Site Security

eRoom Site

Community A

Community B

Community C CML C

CML B

CML A

External Authentication

SourceFacility C3eRoom X1

eRoom X2eRoom X3

CoordinatorParticipants

Observer

20

eRoom Object Structure

eRoom Objects

Link Note Folder Inbox

Database Calendar File Poll DiscussionAnnouncement Project Plan

21

eRoom – Migration Workflow

Expo

rtLo

ad Tzunami RemoteServices

Microsoft SharePoint Server

Database Server

SharePoint Farm

TDX

CommitCommit

eRoom Server

22

eRoom to SharePoint 2010

Tzunami Deployer

Facility

eRoomeRoomeRoom

Facility

eRoomeRoomeRoom

Folder

CalendarDatabase

Discussion

Files

Poll

Inbox

NoteLink

Facility

eRoomeRoomeRoom

EMC Docum

entum eRoom

FacilitiesRoomsDocumentsFoldersLinksDatabasesMailboxesCalendarsDiscussionsPollsProcesses Databases.Project Schedule

Load

Tzunami Exporter

Export

Deploy, Model

& Com

mit

Mapping

Mapping

23

Questions

?

24

Setup• Tzunami Deployer• Tzunami eRoom Exporter• eRoom

– Creating Community– Creating Facility– Creating eRooms– Setting Security– Creating Objects/Items

25

Workshop• Setups

– Tzunami Deployer– Tzunami eRoom Exporter– Remote Service

• eRoom– Creating Community– Creating Facility– Creating eRooms– Setting Security– Creating Objects/Items

Migration Process

Tzunami Deployer

Training

Presented byPrabhakar GiriTzunami Inc.

27

Migration Process- Export

Facility

eRoomeRoomeRoom

Facility

eRoomeRoomeRoom

Folder

CalendarDatabase

Discussion

Files

Poll

Inbox

NoteLink

Facility

eRoomeRoomeRoom

Export

FacilitiesRoomsDocumentsFoldersLinksDatabasesMailboxesCalendarsDiscussionsPollsProcesses DatabasesProject Schedule…

Commit

Tzunami Deployer

Loading Source/Target Information

Deploying

Commit

Modeling

Load

Tzunami eRoom Exporter

Configuration

Filter

Select Content

Select Destination

View Export Report

TDX, STDX, File Store

28

Tzunami eRoom Exporter

• Exports selected eRoom contents to TDX, STDX and FileStore

• Pre-Requisites– Microsoft .NET framework 3.0– Must be run on eRoom Server (6 or

above)• Can be run as standalone application

or integrated with Tzunami Deployer• Supports command line invoking

Migration Process

29

Configuration - General

• Select types of eRoom contents to export

• Files• Mail Items• Links

– Link as ASPX file• Notes• Discussions• Polls• Calendars• Databases• Project Plans• Announcements (eRoom 7 or above)

Migration Process

30

Configuration – Advanced • Security• Versions• Version Comments

• Configure advanced export settings

Migration Process

31

Content Selection

• Select eRoom contents to export

Migration Process

32

Content Filter

• Set filter on eRoom contents to export

• Select property• Select condition• Add/Remove condition

Migration Process

33

Destination

• Select destination folder to store the exported contents• Save specification file to be used as template for

command line export (optional)

• Export Specification File• Choose destination near the root drive

Migration Process

34

Export

• Exports and save contents

Migration Process

35

Export Report

Migration Process

36

Command Line Export

• Automate bulk export

TzunamiExporter.exe [-r <ResultFile>] -s <ExportSpecificationsFile>

• Non interactive mode of export• Provide export options through

Specifications file• Perform batch export• Schedule export

Migration Process

37

Content Analysis• TDX• STDX• FileStore

Migration Process

38

Export – Best Practices• Export in small chunks • Organize exported data• Move dynamically through migration phases• Ensure consistency• Select Facility and Room during export to avoid confusion

later in Deployer

Migration Process

39

Migration Process– Loading

Tzunami Deployer


Deploying

Commit

Modeling

Create a Project

Load Source TDX

Connect Target

Load Target

Tzunami Exporter

Load

eRoom TDX

Facility

eRoomeRoomeRoom

Facility

eRoomeRoomeRoom

Folder

CalendarDatabase

Discussion

Files

Poll

Inbox

NoteLink

Facility

eRoomeRoomeRoom

Export

FacilitiesRoomsDocumentsFoldersLinksDatabasesMailboxesCalendarsDiscussionsPollsProcesses DatabasesProject Schedule...

Commit

40

Creating a Project

• Stores all the information related to a particular project in a Tzunami Deployer Project

Migration Process

41

Loading Source (TDX)

• Loads eRoom contents and structures

Migration Process

42

Connecting to Target

• Connect to the target SharePoint

Migration Process

43

Selecting Target to Load

• Select Web Application• Select Site Collection, Sites and Items…

Migration Process

44

Loading Target

• Load target SharePoint structure information including sites, lists, libraries, folders, documents, items, security and metadata information.

Migration Process

45

Loaded Project

Migration Process

46

Loading – Best Practices

Migration Process

• Load only what is needed– Load structure and then reload desired structure for

content– Version for target need not be loaded

47

Migration Process – Deploying

Tzunami Deployer


Deploying

Commit

Modeling

Structure

Mapping

Security

Deploy Options

Filtering

Defective Items

Deployment Report

Tzunami Exporter

Load

eRoom TDX

Facility

eRoomeRoomeRoom

Facility

eRoomeRoomeRoom

Folder

CalendarDatabase

Discussion

Files

Poll

Inbox

NoteLink

Facility

eRoomeRoomeRoom

Export


Commit

48

Deploy Option

• Deploying contents from source to target

• Structure• Files• Security

Migration Process

49

Deploy Option – Structure

• Select appropriate target• Rule engine provides auto suggestions

Migration Process

50

Target Suggestions for eRoomeRoom Item Type Relevant SharePoint Types

Facilities Web Application (create manually in SharePoint)Site Collection

Room Site CollectionSite

Discussion Discussion Board

Poll Survey

Calendar Calendar List

Project Plan Task ListGantt

Inbox Document Library

Database For the basic database templates, some SharePoint lists (Contacts List, Links List, and so on)Generic List

Folders Depending on the content of the folder, valid options may include migrating as Lists, Folders, or even Sites

Documents Files in a Document Library

Notes Items in a Generic List

Links Items in a Links List

51

Deploy Option – Property Mapping

• Mapping of source properties to target properties

• Add missing properties• Choose not to move one or more

properties to target• Export/Import mappings

Migration Process

52

Deploy Option – Value Mapping

• Mapping of source property values to target property values

• Map values for Choice and Boolean properties

Migration Process

53

Deploy Option – Security• Group mapping• Entity mapping• Role mapping

• Map source security structure to target

Migration Process

54

Deployment Report

Migration Process

• View summary of deployment• Do not ignore warnings

55

Defective Items

• Displays all defective items that will fail to migrate if not fixed

• Displays cause of the defect

Migration Process

• Deployment verification and fixing• Fix issues before proceeding• Cancel and redeploy if needed

56

Filtering

• Filtering Source Items by Item Property

• Selective Deployment

Migration Process

57

Deployment – Best Practices• Review the Deploy Reports for any warnings• Locate known deployment problems early• Keep in mind SharePoint column limitations while adding

missing properties• When migrating Polls as Surveys, each question is

represented as a property. You can add the various questions as part of the deployment process

• For folders that contain several types of items, Tzunami recommends filtering the folders based on the eRoom Item Type property and migrating each type of item to a different list

• Simulate multiple deployments for a source type till you find the one that suits your needs best. Use the same deployment pattern for that item type in future

Migration Process

58

Questions

?

59

Workshop

Tzunami Deployer

Training


61

Migration Process– Modeling

Tzunami Deployer


Deploying

Commit

Modeling

Structure

Metadata

SharePoint Security and Permission

Tzunami Exporter

Load

eRoom TDX

Facility

eRoomeRoomeRoom

Facility

eRoomeRoomeRoom

Folder

CalendarDatabase

Discussion

Files

Poll

Inbox

NoteLink

Facility

eRoomeRoomeRoom

Export


Commit

62

Modeling Structure

• Design target structure (Full, Partial, Auto)• Modify or delete items in the target SharePoint structure

• Sites• Lists• Folders• Items

Migration Process

63

Modeling Metadata

• Documents and data items have associated metadata• Design/Edit/Delete metadata

• Create new property sets• Duplicate property sets• Create new properties• Copy property set

Migration Process

64

SharePoint Security and Permission

• Contents can be secured at all hierarchy levels: site, list, library, folder, or item

• Create groups• Assign permissions to users• Modify or delete groups• Modify permissions• Edit Permission Levels• View the Users Permissions report• Import/Export users

Migration Process

65

Modeling– Best Practices• Drag and Drop • Mass Deploy • Review the Deploy Reports for any warnings• Locate known problems• Create a web app for each Facility and the facility Rooms

in it

Migration Process

66

Migration Process- Committing

Tzunami Deployer

Commit

Modeling

Commit

Batch Commit


Deploying

Tzunami Exporter

Load

eRoom TDX

Facility

eRoomeRoomeRoom

Facility

eRoomeRoomeRoom

Folder

CalendarDatabase

Discussion

Files

Poll

Inbox

NoteLink

Facility

eRoomeRoomeRoom

Export


Commit

67

Commit

• Upload changes to target• Select commands to commit

• Commit Now• Commit Later

Migration Process

68

Batch Commit• Non-interactive migration• Run as Command-line tool• Work offline from SharePoint• Commit operations in batch• Schedule commit with Windows Task Scheduler

Migration Process

69

Commit – Best Practices• *** Check for problems before commit• Run several Deployer instances on one server • Don’t waste time, work in parallel• Avoid ex-Deployer SharePoint changes during commit• Estimate commit time• Schedule commits if necessary• Verify target after commit

70

Deployer Advanced Options

• Configure Tzunami Deployer behavior

• General• Save• Mapping• Logging• SharePoint• Rule Engine• Auto Fixes

71

Deployer – Advance Settings

• Specify the path to the Custom Global Templates mapping file

• Lists of Custom Domains (separated with commas (,)) to read Active Directory users and groups from

72

Rule Engine

• Offers best matching suggestions during different stages of migration

• Create and reuse rules to match your needs

• Automate migration decisions

73

Rule Set

• Contains several built-in Rule Sets that define some common deployment logic schemas.

• Create a Rule Set• Duplicate a Rule Set• Create a Rule in a Rule Set• Duplicate a Rule in a Rule Set• Define Conditions• Define Actions

74

Questions

?

75

Workshop

Tzunami Deployer

Training


77

Tzunami Deployer Remote Service

• Required to support remote operations on SharePoint• Can handle requests from multiple Deployers

Tzunami Deployer Remote Service

Tzunami Deployer Licensing Service

Tzunami Deployer

78

Tzunami Deployer Licensing ServiceSharePoint A

SharePoint B

Deployer

Deployer

Deployer

Remote Service

Remote Service

Remote Service

Licensing Service

Licensing Service

LicensingServiceConsole

LicensingServiceConsole

Production scenario

Tzunami

• Provides project manager with an overview of the current license

• Ability to update new licenses

79

Planning Your Migration

80

Planning Your Migration• Divide the project into phases:

– Development stage – 10% migration to a test environment

– Migration POC stage – presenting partial results to the client

– Production stage• Check migration results in SharePoint• Plan meta-data migration• Keep connection to the source system• Pre-Modeling of SharePoint• Plan how to use your hardware• Monitor your environment

81

Best PracticesSource Analyzing Phase• How many items do you have in the source• Which items do you have in the source• Identify complex issues with the source

Export Phase• Export in small chunks • Organize exported data• Move dynamically through migration phases• Ensure consistency

82

Best PracticesProject Preparation Phase• Use a template project• Be organized • Prepare a project for Deploying

Deploy Phase• Drag and Drop • Mass Deploy • Review the Deploy Reports for any warnings• Locate known problems

83

Best PracticesAll Phases• Look-out for problems • Save the Export/Deploy/Commit reports with any

warnings or errors • Notify the Tzunami Support Team on any such issues

84

Troubleshooting• Logs• Execution Report

85

Tips and Tricks• Multi select and change property• TDX Tools• Find Windows• Filter• Rule Engine• Cross domain user mapping• Find problem• Drill down reading• Delta migration

86

eRoom vs. SPGood Part• Similar to Raw SharePoint

– Related Objects and Metadata– Has item level equivalence in SP– Minimal customization

Bad Part • Too much flexible in terms of arranging contents and managing security• Hierarchical Dissimilarity with SP

– Data items and document under same folder– Attachments to containers and documents

• Column Limit issues can occur because of the need to add too many columns.– Add properties carefully

87

Questions

?

88

Workshop

89

Thank you !

tzunami deployer

Documents

tzunami deployer project

target informationthe

targetdeploy source

source systems

sharepoint sites

data items

list access control3

multiple libraries