heavy traffic how the bc integrated land management bureau used open source to deploy...

22
Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect Integrated Land Management Bureau Province of British Columbia [email protected] FOSS4G 2007 Victoria, BC September 2007

Upload: arnold-spencer

Post on 19-Jan-2016

251 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Heavy Traffic

How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-

Strength GeoWeb Services

Michael RossGeoWeb ArrghitectIntegrated Land Management BureauProvince of British [email protected]

FOSS4G 2007Victoria, BC

September 2007

Page 2: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

1:7 000 000 Base Map

Page 3: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

TRIM 1:20 000 Base Map

Page 4: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

OGC Catalogue Service v1.0

Page 5: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Integrated Cadastral Fabric WMS

Page 6: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

DIS Imagery Warehouse Land and Resource Data Warehouse

Client Tier

MapServer WMS

Airphoto IndexBase

CadastreForest Vegetation

Wildlife ManagementTerrestrial EcologyWater Management

ArcSDE Oracle

Database

Web Browser

IMF application (e.g.,iMapBC, BMOS, CoinPacific,Mapster, NFIS)

GeoWebServices

ArchitectureAug 1, 2007

GeoServer WFS

LRDW Feature Service*

Earth ResourcesImage Web Server WMS

Orthophoto ImagerySatellite Imagery

JP2/ECW images

*internal use only

OGC Web Service Tier

Data Tier

OGC-compliant Mapping Tool

ArcMap, Google Earth, GAIA, JUMP

Apache Web Server

Web Server Tier

ArcIMS with OGC WMS Connector

Base and Forest Veg

Page 7: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

In The Beginning (2002)

There Was An Interoperability Problem

Warehouse designed to support internal clients

External clients needed online access to TRIM, Forest Cover, and Imagery(CFS, DFO Pacific, public)

CGDI To The Rescue Used ArcIMS 4 OGC Connector Single WMS serving TRIM and imagery 2,000 hits per month

Page 8: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Gearing Up

ER Map

per I

mage

Web

Ser

ver

AXS Tec

hnolo

gy E

ye S

py

ESRI Arc

IMS/T

IFF

ESRI Arc

IMS/S

DE Ras

ter

0

1

2

3

4

5

6

Average Image Retrieval Time Under Heavy Load

Time (In Seconds)

Source

1. Software Evaluation for DIM, Final Report v1.1; BC Ministry of Sustainable Resource Management; September, 2003; Performance Test p.2.8

Imagery Server Evaluation

Page 9: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Gearing Up

How Many Eyes Looking at MapServer/SDE or GeoServer/SDE? None

Initial Evaluation Poor Performance No SDE 9 support

Enhanced MapServer/GeoServer Connection pooling SDE 9 support

Page 10: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Gearing Up

Source

1. Land Information BC Open Infrastructure WMS Final Test Results, BC Ministry of

Sustainable Resource Management, 2005

Regular Traffic Over an Extended Period (Throughput)

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 32

Number of Concurrent Users

Map

s P

er S

eco

nd

ArcIMS

MapServer

WMS Re-evaluation

MapServer

ArcIMS

Page 11: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Cruisin'

MapServer/GeoServer In ProductionStable

Good Performance

Easy to administrate

Supports complex styles and SLD's

Good support both locally and globally

Page 12: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Cruisin'

Arc IMS 30%

WMS 70%

Percentage of Map Layer Hits by Protocol

Arc IMS

WMS

Page 13: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Cruisin'

Aug 2006

Sep 2006

Oct 2006

Nov 2006

Dec 2006

Jan 2007

Feb 2007

Mar 2007

Apr 2007

May 2007

Jun 2007

Jul 2007

Aug 2007

0

500000

1000000

1500000

2000000

2500000

Vector Layer Hits By Month

Arc IMS/OGC Connector

MapServer

Total

Page 14: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Cruisin'

Aug 2006

Sep 2006

Oct 2006

Nov 2006

Dec 2006

Jan 2007

Feb 2007

Mar 2007

Apr 2007

May 2007

Jun 2007

Jul 2007

Aug 2007

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

Average Base and Forest Veg Layer Response Time (in Seconds) By Month

Arc IMS/OGC Connector

MapServer

Page 15: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Cruisin'

Aug 2006

Sep 2006

Oct 2006

Nov 2006

Dec 2006

Jan 2007

Feb 2007

Mar 2007

Apr 2007

May 2007

Jun 2007

Jul 2007

Aug 2007

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

5

Average Imagery Layer Response Time (in Seconds) By Month

Arc IMS/OGC Connector

Image Web Server

Page 16: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Bumps Along The Way

Average Response Time for "Aquifer" layer

1237 1311

3135

6179

1256 1368

2642

4396 4305

0

1000

2000

3000

4000

5000

6000

7000

1 2 5 10 15

Concurrent Requests

Res

po

nse

Tim

e (m

s)

ArcIMS

Mapserver

Source

Performance Comparison: ArcSDE Joins in MapServer vs. ArcIMS, BC Ministry of Environment, 2007

➢Added support for

SDE Joins in

MapServer

➢Discovered

performance

problem in ArcIMS

X

Page 17: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Bumps Along The Way

Mt Seymour @ 1: 60 000 ScaleBefore Scale Range Adjustment

Mt Seymour @ 1: 60 000 ScaleAfter Scale Range Adjustment

Page 18: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Bumps Along The Way

AfterBefore

Annotation Orientation Problem

Page 19: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Bumps Along The Way

ArcSDE Patch Failure

OracleArcSDE db2 PostGIS Shape

MapServer/GeoServer

Cross-dbms support gave us elbow room

Page 20: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Bumps Along The Way

Page 21: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

The Road Ahead

• 200 WMS layers defined, 1,000 to go

• WFS access

• Transactional WFS Support

• Gazetteer Service

• GeoWeb Processing Services

• Plotting Service

• 3D Stereo Service

Page 22: Heavy Traffic How The BC Integrated Land Management Bureau Used Open Source to Deploy Government-Strength GeoWeb Services Michael Ross GeoWeb Arrghitect

Links

Natural Resource Information Centre

http://www.nric.ca

GeoConnections Discovery Portal

http://geodiscover.cgdi.ca/gdp/