heavy traffic how the bc integrated land management bureau used open source to deploy...

Heavy Traffic

How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-

Strength GeoWeb Services

Michael RossGeoWeb ArrghitectIntegrated Land Management BureauProvince of British Columbiamichael.ra.ross@gov.bc.ca

FOSS4G 2007Victoria, BC

September 2007

1:7 000 000 Base Map

TRIM 1:20 000 Base Map

OGC Catalogue Service v1.0

Integrated Cadastral Fabric WMS

DIS Imagery Warehouse Land and Resource Data Warehouse

Client Tier

MapServer WMS

Airphoto IndexBase

CadastreForest Vegetation

Wildlife ManagementTerrestrial EcologyWater Management

ArcSDE Oracle

Database

Web Browser

IMF application (e.g.,iMapBC, BMOS, CoinPacific,Mapster, NFIS)

GeoWebServices

ArchitectureAug 1, 2007

GeoServer WFS

LRDW Feature Service*

Earth ResourcesImage Web Server WMS

Orthophoto ImagerySatellite Imagery

JP2/ECW images

*internal use only

OGC Web Service Tier

Data Tier

OGC-compliant Mapping Tool

ArcMap, Google Earth, GAIA, JUMP

Apache Web Server

Web Server Tier

ArcIMS with OGC WMS Connector

Base and Forest Veg

In The Beginning (2002)

There Was An Interoperability Problem

Warehouse designed to support internal clients

External clients needed online access to TRIM, Forest Cover, and Imagery(CFS, DFO Pacific, public)

CGDI To The Rescue Used ArcIMS 4 OGC Connector Single WMS serving TRIM and imagery 2,000 hits per month

Gearing Up

ER Map

per I

mage

Web

Ser

ver

AXS Tec

hnolo

gy E

ye S

py

ESRI Arc

IMS/T

IFF

ESRI Arc

IMS/S

DE Ras

ter

0

1

2

3

4

5

6

Average Image Retrieval Time Under Heavy Load

Time (In Seconds)

Source

1. Software Evaluation for DIM, Final Report v1.1; BC Ministry of Sustainable Resource Management; September, 2003; Performance Test p.2.8

Imagery Server Evaluation

Gearing Up

How Many Eyes Looking at MapServer/SDE or GeoServer/SDE? None

Initial Evaluation Poor Performance No SDE 9 support

Enhanced MapServer/GeoServer Connection pooling SDE 9 support

Gearing Up

Source

1. Land Information BC Open Infrastructure WMS Final Test Results, BC Ministry of

Sustainable Resource Management, 2005

Regular Traffic Over an Extended Period (Throughput)

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 32

Number of Concurrent Users

Map

s P

er S

eco

nd

ArcIMS

MapServer

WMS Re-evaluation

MapServer

ArcIMS

Cruisin'

MapServer/GeoServer In ProductionStable

Good Performance

Easy to administrate

Supports complex styles and SLD's

Good support both locally and globally

Cruisin'

Arc IMS 30%

WMS 70%

Percentage of Map Layer Hits by Protocol

Arc IMS

WMS

Cruisin'

Aug 2006

Sep 2006

Oct 2006

Nov 2006

Dec 2006

Jan 2007

Feb 2007

Mar 2007

Apr 2007

May 2007

Jun 2007

Jul 2007

Aug 2007

0

500000

1000000

1500000

2000000

2500000

Vector Layer Hits By Month

Arc IMS/OGC Connector

MapServer

Total

Cruisin'

Aug 2006

Sep 2006

Oct 2006

Nov 2006

Dec 2006

Jan 2007

Feb 2007

Mar 2007

Apr 2007

May 2007

Jun 2007

Jul 2007

Aug 2007

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

Average Base and Forest Veg Layer Response Time (in Seconds) By Month

Arc IMS/OGC Connector

MapServer

Cruisin'

Aug 2006

Sep 2006

Oct 2006

Nov 2006

Dec 2006

Jan 2007

Feb 2007

Mar 2007

Apr 2007

May 2007

Jun 2007

Jul 2007

Aug 2007

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

5

Average Imagery Layer Response Time (in Seconds) By Month

Arc IMS/OGC Connector

Image Web Server

Bumps Along The Way

Average Response Time for "Aquifer" layer

1237 1311

3135

6179

1256 1368

2642

4396 4305

0

1000

2000

3000

4000

5000

6000

7000

1 2 5 10 15

Concurrent Requests

Res

po

nse

Tim

e (m

s)

ArcIMS

Mapserver

Source

Performance Comparison: ArcSDE Joins in MapServer vs. ArcIMS, BC Ministry of Environment, 2007

➢Added support for

SDE Joins in

MapServer

➢Discovered

performance

problem in ArcIMS

X

Bumps Along The Way

Mt Seymour @ 1: 60 000 ScaleBefore Scale Range Adjustment

Mt Seymour @ 1: 60 000 ScaleAfter Scale Range Adjustment

Bumps Along The Way

AfterBefore

Annotation Orientation Problem

Bumps Along The Way

ArcSDE Patch Failure

OracleArcSDE db2 PostGIS Shape

MapServer/GeoServer

Cross-dbms support gave us elbow room

Bumps Along The Way

The Road Ahead

• 200 WMS layers defined, 1,000 to go

• WFS access

• Transactional WFS Support

• Gazetteer Service

• GeoWeb Processing Services

• Plotting Service

• 3D Stereo Service

Links

Natural Resource Information Centre

http://www.nric.ca

GeoConnections Discovery Portal

http://geodiscover.cgdi.ca/gdp/