novell open enterprise server 2

Novell® Open Enterprise Server 2 Storage Technology

Marcus GouldPremium Support EngineerUK Major Accounts TeamNovell, [email protected]

mailto:[email protected]

© Novell Inc. All rights reserved

2

Agenda

• Novell Storage Services™ Overview

• NetWare® to Linux Comparison

• Architecture

• Caching and Performance

• Dynamic Storage Technology


3

What to Expect

• An introduction to NSS on OES Linux

• Get over the “Where do I start?” bump

• Ways to take advantage of what you already know

• A point of view (Mine!)


4

What Not to Expect

• A step-by-step tutorial

• How to install Linux/OES/NSS

Overview


6

Introduction

• NSS is a core NetWare® technology

• NSS now runs on SUSE™ Linux as part of OES

• We are not running down Linux file systems -Reiser, EXT2, EXT3, etc, all have their advantages

• We are going to talk about Open Enterprise Server 2 for Linux


7

Don't Leave!

• Message to NetWare® people– NSS on OES Linux is as easy as you want to make it

– It is all reassuringly familiar


8

Don't Leave!

• Message to Linux people– NSS on OES Linux is as difficult as you want to make it

– There are still plenty of really esoteric command-line things you can do


9

Overview: Features

• Things NetWare® is traditionally good at– Trustee model & inheritance

– Salvage

– Directory quotas

– User quotas

– Compression

– Data shredding

– Immediate flush

– Multiple name spaces

– Encryption

– Manageability


10

Overview: Features

• Things Linux is traditionally not good at– Trustee model & inheritance

– Salvage

– Directory quotas

– User quotas

– Compression

– Data shredding

– Immediate flush

– Multiple name spaces

– Encryption

– Manageability


11

Overview: Rights and Attributes

• Linux– RWX assigned to a file/directory based on User, Group or

Other

• NetWare®

– SyHiARoIcShDiCiRiDcDmDsTXPi assigned to a file/directory

– SRWCEMFA assigned to Users, Groups and Containers

– Inheritance

– Inheritance filters

NetWare® to Linux Comparison


13

A Quick Word About Mount Points

• Linux mounts a file system as a directory– e.g. CD-ROM mounted as /mnt

– e.g. iPod mounted as /media/ipod

– NSS Volume mounted as /media/nss/<VOLNAME>

• See what's where with mount


14

NSS NetWare® vs NSS Linux

• Common, mature code base– NSS4 released with OES Linux in March 2005

– NSS3 released with NetWare 6.0 in October 2001

– NSS2 released with NetWare 5.0 in September 1998

• Familiar management tools

• Some features starting to diverge– Dynamic Storage Technology only on Linux

– IPX™ & AFP only on NetWare


15


• Things that are exactly the same– iManager

– nssmu


16

iManager


17

iManager


18

iManager


19

iManager


20

iManager


21

nssmu


22

nssmu


23

nssmu


24


• Things that are more or less the same– metamig - Save/restore trustee and/or quota information

– rights - Examine/change trustee rights

– attrib - Examine/change attributes


25

metamig


26

metamig


27

rights


28

rights


29

rights


30

attrib


31

attrib


32

attrib


33


• Things that have changed a bit– NetWare: Console command line

– Linux: nsscon & ncpcon


34

nsscon


35

nsscon


36

nsscon


37

nsscon


38

ncpcon


39

ncpcon


40

ncpcon


41

ncpcon


42

ncpcon


43


• Things that have changed a bit more– NetWare: NSS /PoolVerify and /PoolRebuild

– Linux: ravsui (Rebuild And Verify Simple User Interface) ravview (view log files)


44

ravsui


45

ravsui


46

ravsui


47

ravview


48

ravview


49

Back to nsscon


50

Back to nsscon


51

Back to nsscon


52


• Things that have changed quite a lot– NetWare: MONITOR.NLM

– Linux: ncptop


53

ncptop


54

ncptop


55

ncptop


56

ncptop


57

ncptop


58

ncptop


59

ncptop


60

ncptop


61

What About Legacy Stuff?

• Many Legacy tools should still work

• ...But not necessarily supported!– DOS command-line Tools

– DOS C-Worthy Tools

– Windows Tools

– NWAdmin

– ConsoleOne®


62

Things You Weren't Expecting to See at BrainShare® 2008...


63



64



65



66



67



68


Your in-house toolsmay require little

or no modification


69


Use at your own risk!

Your in-house toolsmay require little

or no modification


70

Interesting Log Files

• /var/opt/novell/log/ncpserv.log

• /var/opt/novell/log/ncpserv.audit.log

• /var/opt/novell/log/ncp2nss.log

• /var/opt/novell/log/ncp2nss.audit.log


71

Interesting Configuration Files

• /etc/opt/novell/nss/nssstart.cfg

• /etc/opt/novell/ncpserv.conf

• /etc/opt/novell/ncp2nss.conf

Architecture


73

Linux User Management (LUM)

• Allows local Linux users to be managed via, and interface with eDirectory™

• An optional feature

• That's all you need to know for this presentation!


74

Architecture: NSS on NetWare®

Device Drivers

Media Manager

Loadable Storage Subsystem (LSS)

NSS Common Layer

CIFS Semantic Agent AFP Semantic Agent NFS Semantic Agent NCP™ Semantic Agent


75

Architecture: NSS on Linux

Device Drivers

EVMS(Enterprise Volume Management System)

Media Manager Logic

NSS Storage Subsystem

Linux SemanticAgent

Linux Applications(e.g. SAMBA)

NCP™ _Admin Management(Virtual File System)

eDirectory™

Handler

Up Call

VFS(Virtual File Services)

Reiser EXT3 XFS

User

Kernel


76

Device Drivers


Media Manager Logic


Linux SemanticAgent

Linux Applications(e.g. SAMBA) NCP

_Admin Management(Virtual File System)

Up Call


Reiser EXT3 XFS

eDirectoryHandler

Architecture: NSS on Linux


77

EVMS (Enterprise Volume Management System)

• Allows NSS to be moved between NetWare® and Linux– Without modification

– Yes! NetWare-created pools can mount on Linux

– Yes! Linux-created pools can mount on NetWare

– Must Use iManager, NSSMU or NSS command-line tools

– Required for Novell Cluster Services™, Software RAID, Snapshot

• Don't want to use EVMS?– Lose all of the above

– Use mkfs, etcDevice Drivers


Media Manager Logic


Linux SemanticAgent



eDirectoryHandler

Up Call


Reiser EXT3 XFS


78

VFS (Virtual File Services)

• Allows Linux-based applications to access any file system

• Registers NSS as a normal Linux file system

• Most access to NSS is via VFS (POSIX layer)

• Some access to NSS is direct (zAPI and xattr)

– e.g. SMS

Device Drivers


Media Manager Logic


Linux SemanticAgent



eDirectoryHandler

Up Call


Reiser EXT3 XFS


79

Novell Storage Services™

• NSS automatically mounted in NCP™

• All features work as NetWare®

– Except non-LUM modifier, archiver and deleter of files show as root

Device Drivers


Media Manager Logic


Linux SemanticAgent



eDirectoryHandler

Up Call


Reiser EXT3 XFS


80

eDirectory™

• eDirectory users can access NSS

• Local users require LUM– NSS uses eDirectory GUIDs internally

– Linux passes UIDs to NSS

– Link GUID to UID via eDirectory

Device Drivers


Media Manager Logic


Linux SemanticAgent



eDirectoryHandler

Up Call


Reiser EXT3 XFS


81

NCP™

• Communicates with NSS– Via VFS (open, close, read, write)

– Uses extended attributes for special operations

– Processes events generated by NSS (NEB)

• Operates as root– Extended attributes

– Archiver, deleter is root (without LUM)

– Owner is correct (ownership is a GUID)

– Last modifier always root

• Maintains its own trustee store– Synchronised with NSS

Device Drivers


Media Manager Logic


Linux SemanticAgent



eDirectoryHandler

Up Call


Reiser EXT3 XFS


82

NCP™

• Can make Linux volumes available via NCP™

– Can mount native Linux file systems

– Any path

– Read-only devices; e.g. CD

• Considerations if not using LUM– No user space restrictions

– Creator is root

• Only eDirectory™ users have access

Device Drivers


Media Manager Logic


Linux SemanticAgent



eDirectoryHandler

Up Call


Reiser EXT3 XFS


83

Run That One By Me Again...

• Can make Linux volumes available via NCP™

– Can mount native Linux file systems

– Any path

– Read-only devices; e.g. CD

Device Drivers


Media Manager Logic


Linux SemanticAgent



eDirectoryHandler

Up Call


Reiser EXT3 XFS


84

Mount a Native Linux Partition


85



86



87

Check Nothing Up Our Sleeves


88

Mount /usr as NCP Using ncpcon


89



90



91



92

Now Available via NCP!


93

Or Just Use Remote Manager


94

Why Do I Need NSS Then?

• NCP™ mounted Linux volumes have limitations– Scalability limited to underlying file system

– Lacks NSS features> Salvage

> Compression

> Shredding

> Snapshots

> ...etc

Performance and Caching


96

Linux Memory Recap

• Kernel Memory– Low memory directly addressable by the kernel

– Bottom 1GB on 32 Bit Linux (can be customized)

– All memory on 64 Bit Linux

• User Memory aka HiMem– High memory used by applications

– Kernel has to map it to use it

User

Kernel0

1

4 GB

2

3


97

NSS Caching on NetWare®

• Memory below 4GB– Shared with rest of the OS

– Subject to /CacheBalancePercent

– NSS manages independent user vs metadata caches

• Memory above 4GB– Treated as RAM disk

– User data only

– 128KB files or larger

– Subject to /Above4GigMemoryPercent


98

NSS Caching on 32 Bit Linux

• NSS Metadata cached in HiMem– Check with /status

– /HighMemoryCacheType=> Private: Memory dedicated to, and managed by, NSS

Default 20% - modify with /PrivateCacheSizeInBlocks

> Linux: Memory shared with, and managed by, LinuxMemory hungry applications can purge cache

> None: OES1 FCS Method

– Forced defaults> IF Private Cache Blocks < 2 x NSS Cache Blocks THEN default = Linux

> IF HiMem < 2 x NSS Cache Blocks THEN default = None

– NSS User data integrated into Linux cache


99

NSS Caching on 64 Bit Linux

• No HiMem memory constraints– Metadata cache configurable

> /MinBufferCacheSize

– NSS user data integrated into Linux cache


100

Previous Versions of NSS on Linux

• OES– All user and metadata in kernel memory

• OES SP1– NSS Metadata cached in kernel memory

– NSS user data integrated into Linux cache

• OES SP2– NSS Metadata cached in HiMem

> Private: Memory dedicated to, and managed by, NSS

> Linux: Memory shared with, and managed by, Linux

– NSS User data integrated into Linux cache

– Enhanced version in OES2


101

Performance

• NCP™ server engine largely rewritten– No IPX™ support

– Large memory model

– NCP on Linux can outperform NCP on NetWare®

• NSS Scalability– Consistent performance from 500 to 5,000,000 files

– cf. EXT3 starts faster and gets slower


102

Performance

• Horses for courses– Do you need NSS functionality?

– Do you need all that metadata?

• Think it through– GroupWise®

– Database

– User home directories

Dynamic Storage Technology


104


• aka Shadow Volumes

• New in OES 2 for Linux

• Reduce cost of data storage

• Reduce time to backup

• Reduce time to restore


105


H:\Syd>dir Volume in drive H is LXVOL1 Volume Serial Number is 9302-2B38

Directory of H:\Syd

07/08/2007 19:38 <DIR> .07/08/2007 19:38 <DIR> ..07/08/2007 19:39 1,438,456 Blackmail Photo of The Boss.jpg07/08/2007 19:39 1,015,738 Comfortably Numb - Pink Floyd.m07/08/2007 19:39 1,344,918 Customer Proposal.doc07/08/2007 19:39 1,560,792 Customer Referrals.xls07/08/2007 19:39 1,560,792 Expenses for August 07.xls07/08/2007 19:40 1,345,075 I Should Be So Lucky - Kylie.mp307/08/2007 19:40 1,345,075 Little Fluffy Clouds - The Orb.07/08/2007 19:39 1,043,795 Me on Holiday.jpg07/08/2007 19:39 1,438,456 My New Car.jpg07/08/2007 19:39 1,344,918 New System Design.doc 10 File(s) 13,438,015 bytes 2 Dir(s) 2,867,396,608 bytes free

H:\Syd>

User View


106



Directory of H:\Syd


H:\Syd>

07/08/2007 19:39 1,344,918 Customer Proposal.doc07/08/2007 19:39 1,560,792 Customer Referrals.xls07/08/2007 19:39 1,560,792 Expenses for August 07.xls07/08/2007 19:39 1,344,918 New System Design.doc

User View

Primary Tree


107



Directory of H:\Syd


H:\Syd>


07/08/2007 19:39 1,438,456 Blackmail Photo of The Boss.jpg07/08/2007 19:39 1,015,738 Comfortably Numb - Pink Floyd.07/08/2007 19:40 1,345,075 I Should Be So Lucky - Kylie.mp07/08/2007 19:40 1,345,075 Little Fluffy Clouds - The Orb.07/08/2007 19:39 1,043,795 Me on Holiday.jpg07/08/2007 19:39 1,438,456 My New Car.jpg

User View

Primary Tree Shadow Tree


108



Directory of H:\Syd


H:\Syd>



User View

Primary Tree Shadow Tree


109



Directory of H:\Syd


H:\Syd>



User View

Primary Tree Shadow Tree- Mission Critical Data- Dynamic Data- Fast, Expensive Storage- Backed up First- Restored First


110



Directory of H:\Syd


H:\Syd>



Primary Tree Shadow Tree- Mission Critical Data- Dynamic Data- Fast, Expensive Storage- Backed up First- Restored First

- Less Important Data- Static Data- Cheap Storage- Backed up Last- Restored Last

User View


111

Policy Driven

• Move data in either direction– Last modified date

– Last accessed date

– File type

– File size

– File owner

• Optional move to primary– On modify

– On access


112

Location, Location, Location

• Primary and shadow volumes in different places– Different pools

– Different servers

– Different SANs

– Different sites


113

Configured Using NoRM


114



115



116

Benefits

• Primary data– Mission critical

– Dynamic

– Mirrored high-end super-fast SAN

– Backup policies

• Shadow data– Less important

– Static

– iSCSI or entry-level SAN

– Remote NFS/CIFS server


117

Benefits

• Finally fix the backup & restore nightmare– Restore current data first

– Restore important data first

• Stop filling expensive storage with junk– What's the cost per GB of high-end storage?

– What's the cost per GB of entry-level storage?


118

Start Right Away

• Profile your data using NoRM

• Identify what you can move to shadow storage– Junk: .MP3, .JPG

– Stale: Files older than 30 days


119

Profiling with NoRM Inventory


120

Profiling with NoRM Inventory


121

DST is Not HSM

• Hierarchical Storage ManagementPros without the cons

– No demigration of data (accidental or otherwise!)

– No delay accessing files

– No stub files

– No special hardware


122

Using DST in Migration

• Volume or server upgrade– Primary tree: New storage or server

– Shadow tree: Old storage or server

– Data is migrated as it is accessed

– Data is migrated out of hours

– Data is always online


123

All Good Stuff

• Dynamic Storage Technology saves time and money– Maximize usage of expensive resources

– Reuse existing hardware (e.g. old SAN)

– Reduce backup times

– Reduce restore times


124

For More on DST...

• TUT208 - Dynamic Storage Technology: Reducing The Cost of Storage DeeAnne Higley and James Hammond

• Tuesday - 16:00 255B

• Thursday - 10:00 255C


125

And Finally...


126

Has Anyone Been Thinking...


127

• I can mount remote file systems like NFS and CIFS on Linux...



128


• I can make any mounted file system available via NCP™...



129


• I can make any mounted file system available via NCP™...

• So...



130

Use at Your Own Risk!


131

Use at Your Own Risk!


132

Windows Share Available in Linux


133

Create NCP™ Volume from Linux Mount


134

Create NCP™ Volume from Linux Mount


135

Windows Share Available via NCP™

• Windows files now managed by eDirectory™

– No Novell® client, no IDM, no NDS4NT, no cheating!


136

Summary

• NSS brings the NetWare® tried, tested and much-loved file system to Linux

• NSS can exploit Linux's scalability

• Moving NSS from NetWare to OES Linux isn't too painful

– It looks exactly the same to users (Client, SAMBA, etc)

– It looks exactly the same to administrators (iManager)

– It looks pretty similar to support (NSSMU, NSSCON, etc)

Question and Answer

DisclaimerThis document is not to be construed as a promise by any participating company to develop, deliver, or market a product. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. Novell, Inc. makes no representations or warranties with respect to the contents of this document, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. The development, release, and timing of features or functionality described for Novell products remains at the sole discretion of Novell. Further, Novell, Inc. reserves the right to revise this document and to make changes to its content, at any time, without obligation to notify any person or entity of such revisions or changes. All Novell marks referenced in this presentation are trademarks or registered trademarks of Novell, Inc. in the United States and other countries. All third-party trademarks are the property of their respective owners.

novell open enterprise server 2

Documents