ase 15 architecture diagram

1
Data1 Log Data1 Data1 Log Data Log Data Log Data 4K Mich Talebzadeh Version 3, Jan 2006 User 1 Log Cache Shared Memory dbccdb Cache * Named Cache * 4K buffer pool * ASE Static Overhead Procedure Cache Short term memory needs Others Hash Values 16K buffer pool * - Object Permissions - Column Stats Sybase Open Client Engine 0 Registers File Descriptors/channels CPUs CPUs Stored procedures Triggers Cursors Log Cache Runnable Task Queue Sleep Queue Lock Chains Running Task User N Log Cache Execution Plans - Procedures - Views ASE Executable Total Physical Memory (read-only) Maximum Memory (Dynamic) Fork Fork Engine 1 Registers File Descriptors/channels Running Task ASE Executable Engine N Registers File Descriptors/channels Running Task ASE Executable Sybase Open Client Application Server Client PC Spare Capacity ASE Internal Threads Checkpoint Worker(s) Main ASE checkpoint process. Shutdown Deadlock Tune Checks periodically for deadlocks Mirror Handler Disk mirroring. Handles ASE specific mirroring ASTC Handler(s) Intra-server cross database two-phase commit Checkpoint Sleep Performs periodic checkpoints HK Wash Housekeeper job. Washes dirty buffers. Runs at CPU idle time HK GC Housekeeper job. Garbage collector, example deleted rows HK Chores Flushes table and account statistics. Handles timeout of detached transactions Port Manager Enables Dynamically to start and stop listeners on any given port on a per-engine basis Network Handler(s) There are as many network handler threads as there are ‘master' entries in the interfaces file master System Catalogue & MDA Tables model Template database sybsystemprocs System stored procedures sybsystemdb Two-phase Commit sybsecurity ASE Audit tempdb Temporary Work Area Additional tempdbs System Databases Backup Server Tape ASE Job Scheduler ASE Config File ASE Run Server File ASE Error log File Inter- faces File XP Server User Databases syslogs Data Cache Overhead ULC, One Logical Page each ASE Internal threads can run on any engine Task queue cycle 1- Sleep queue 2- Runnable task queue 3- Running (on any Engine) 4- Sleep queue Data Cache (with default 2K page example) User 1 User 1 thread initiates “group commit” and flushes the Log Cache MRU Wash Marker LRU tempdb Cache * Spinlock default data cache Operating System Hash Table MRU/LRU strategy. Asynchronous Write of dirty buffers after the Wash Marker Buffer ageing C D D D 1 Initial Network Handshake by any engine 3 Master Device Network affinity migration to the least loaded engine 2 Partitioned cache sybsystemprocs device tempdbs, on separate data & log devices. On file systems with dsync false User databases are built on separate data and log devices. Databases can share multiple devices and a device can have fragments from multiple databases Separate data and log devices Hot local or remote compressed backups. Password protected. Cross- platform dump and load capability ASE recommends raw devices. tempdbs can be on file systems, tmpfs or ramdisks Free Memory To another ASE Pending I/O - Process Waiting for I/O - Process Waiting for lock - Process sent to sleep LRU Strategy MRU (fetch-and- discard) strategy C C D C Transportable databases Rep Agent * picks up replicated data Syslogshold table (Dynamic) Oldest open transaction Disk Offline Engines License Heartbeat Checks and synchronizes licensing information with License Server License Server * indicates optional setup PLC Flusher * In Asynchronous log service, it flushes the User Log Cache to the Log Cache Log Writer * In Asynchronous log service it flushes the Log Cache to disk Statement Cache

Upload: simon

Post on 14-Oct-2014

131 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: ASE 15 Architecture Diagram

Dat

a1

Log

Dat

a1

Dat

a1

Log

Dat

a

Log

Dat

a

Log

Dat

a

Log

Cac

he

4K

Mic

h Ta

lebz

adeh

Ver

sion

3, J

an 2

006

Use

r 1 L

og

Cac

he

Shar

ed M

emor

y

dbcc

db C

ache

*N

amed

Cac

he *

4K b

uffe

r poo

l *

ASE

Sta

tic

Ove

rhea

d

Proc

edur

e C

ache

Sho

rt te

rm m

emor

y ne

eds

Oth

ers

Has

h V

alue

s

16K

buf

fer p

ool *

-Obj

ect

P

erm

issi

ons

-Col

umn

Stat

sSyba

se

Ope

n C

lient

Engi

ne 0

Reg

iste

rsFi

le D

escr

ipto

rs/c

hann

els

CP

Us

CPU

s

Sto

red

proc

edur

es

Trig

gers

Cur

sors

Log

Cac

he

Run

nabl

e Ta

sk Q

ueue

Sle

ep Q

ueue

Lock

Cha

ins

Run

ning

Tas

k

Use

r N L

og

Cac

he

Exe

cutio

n P

lans

-Pro

cedu

res

-Vie

ws

ASE

Ex

ecut

able

Total Physical Memory (read-only)

Maximum Memory (Dynamic)

Fork

ForkEn

gine

1R

egis

ters

File

Des

crip

tors

/cha

nnel

sR

unni

ng T

ask

ASE

Ex

ecut

able

Engi

ne N

Reg

iste

rsFi

le D

escr

ipto

rs/c

hann

els

Run

ning

Tas

k

ASE

Ex

ecut

able

Syba

se

Ope

n C

lient

Appl

icat

ion

Ser

ver

Clie

nt P

C

Spar

e C

apac

ity

ASE

Inte

rnal

Thr

eads

Che

ckpo

int

Wor

ker(

s)M

ain

ASE

ch

eckp

oint

pr

oces

s.

Shu

tdow

n

Dea

dloc

k Tu

neC

heck

s pe

riodi

cally

for

dead

lock

s

Mirr

or

Han

dler

Dis

k m

irror

ing.

H

andl

es A

SE

spec

ific

mirr

orin

g

AST

C

Han

dler

(s)

Intra

-ser

ver

cros

s da

taba

se

two-

phas

e co

mm

it

Che

ckpo

int

Slee

pPe

rform

s pe

riodi

c ch

eckp

oint

s

HK

Was

hH

ouse

keep

er

job.

Was

hes

dirty

buf

fers

. R

uns

at C

PU

id

le ti

me

HK

GC

Hou

seke

eper

jo

b. G

arba

ge

colle

ctor

, ex

ampl

e de

lete

d ro

ws

HK

Cho

res

Flus

hes

tabl

e an

d a

ccou

nt

stat

istic

s.

Han

dles

tim

eout

of

det

ache

d tra

nsac

tions

Port

M

anag

erE

nabl

es

Dyn

amic

ally

to s

tart

and

stop

list

ener

s on

any

giv

en p

ort o

n a

per-

engi

ne b

asis

Net

wor

k H

andl

er(s

)Th

ere

are

as m

any

netw

ork

hand

ler

thre

ads

as th

ere

are

‘mas

ter'

ent

ries

in

the

inte

rface

s fil

e

mas

ter

Sys

tem

C

atal

ogue

&M

DA

Tabl

es

mod

elTe

mpl

ate

data

base

sybs

yste

mpr

ocs

Sys

tem

sto

red

proc

edur

es

sybs

yste

mdb

Two-

phas

e C

omm

it

sybs

ecur

ityA

SE

Aud

it

tem

pdb

Tem

pora

ry W

ork

Area

Add

ition

al

tem

pdbs

Syst

em D

atab

ases

Bac

kup

Serv

erTa

pe

ASE

Job

Sc

hedu

ler

ASE

C

onfig

Fi

le

ASE

R

un

Serv

er

File

ASE

Er

ror l

og

File

Inte

r-fa

ces

File

XP S

erve

r

Stan

dby

Engi

ne(s

)S

tand

by E

ngin

es

Use

r Dat

abas

es sysl

ogs

Dat

a C

ache

O

verh

ead

ULC, One Logical Page each

ASE

Inte

rnal

thre

ads

can

run

on a

ny e

ngin

e

Task

que

ue c

ycle

1-Sl

eep

queu

e2-

Run

nabl

e ta

sk q

ueue

3-R

unni

ng (o

n an

y En

gine

)4-

Slee

p qu

eue

Dat

a C

ache

(with

def

ault

2K p

age

exam

ple)

Use

r 1U

ser 1

thre

ad

initi

ates

“gro

up

com

mit”

and

flu

shes

the

Log

Cac

he

MR

UW

ash

Mar

ker

LRU

tem

pdb

Cac

he *S

pinl

ock

defa

ult d

ata

cach

e

Ope

ratin

g Sy

stem

Has

h Ta

ble

MRU/LRU strategy.

Asynchronous Write of dirty

buffers after the Wash Marker

Buf

fer a

gein

g

CD

DD

1

Initi

al N

etw

ork

Han

dsha

ke b

y an

y en

gine

3

Mas

ter D

evic

e

Net

wor

k af

finity

m

igra

tion

to th

e le

ast

load

ed e

ngin

e2

Par

titio

ned

cach

e

sybs

yste

mpr

ocs

devi

ce

tem

pdbs

, on

sepa

rate

dat

a &

log

devi

ces.

On

file

syst

ems

with

ds

ync

fals

e

Use

r dat

abas

es a

re b

uilt

on s

epar

ate

data

and

log

devi

ces.

Dat

abas

es c

an s

hare

mul

tiple

dev

ices

and

a

devi

ce c

an h

ave

frag

men

ts fr

om m

ultip

le d

atab

ases

Sepa

rate

dat

a an

d lo

g de

vice

s

Hot

loca

l or r

emot

e co

mpr

esse

d ba

ckup

s. P

assw

ord

prot

ecte

d. C

ross

-pl

atfo

rm d

ump

and

load

cap

abili

ty

ASE

reco

mm

ends

raw

dev

ices

. tem

pdbs

can

be

on

file

syst

ems,

tmpf

s or

ram

disk

s

Free

Mem

ory

To a

noth

er A

SE

Pen

ding

I/O

-Pro

cess

Wai

ting

for I

/O-P

roce

ss W

aitin

g fo

r loc

k-P

roce

ss s

ent t

o sl

eep

LRU

Stra

tegy

MR

U (f

etch

-and

-di

scar

d) s

trate

gy

CC

DC

Tran

spor

tabl

eda

taba

ses

Rep

Age

nt *

pick

s up

re

plic

ated

dat

a

Sysl

ogsh

old

tabl

e(D

ynam

ic)

Old

est o

pen

trans

actio

n

Dis

k

Offl

ine

Engi

nes

Lice

nse

Hea

rtbe

atC

heck

s an

d sy

nchr

oniz

es

licen

sing

info

rmat

ion

with

Lic

ense

Ser

ver

Lice

nse

Serv

er

*ind

icat

es

optio

nal s

etup

PLC

Flu

sher

*In

Asy

nchr

onou

s lo

g se

rvic

e, it

flus

hes

the

Use

r Log

Cac

he

to th

e Lo

g C

ache

Log

Writ

er *

In A

sync

hron

ous

log

serv

ice

it flu

shes

the

Log

Cac

he to

dis

k

Sta

tem

ent

Cac

he