Client-Server Paradise

ICOM 8015

Distributed Databases

Problems

• Earth Science Application generate massive amounts data– GIS Feature– Satellite Images, Maps– Temperature, Wind Speed

• Want to store, search or disseminate these data sets.– Internet

Sample Schema & Queries

• Images(week integer, band integer, region Rectangle, data Image)

SELECT week, band

FROM Images

WHERE region overlaps BOX;

SELECT week, band, Clip(data, region, BOX)

FROM Image

WHERE energy(data) > 10293.2

Issues

• Efficient Storage of Images

• Support for Image Processing algorithms and other operations.

• Support for spatial queries– Need spatial Indexing

• Reduce communications cost

• Execute operations in Parallel

Issues

• Image Visualization:– Composites and multilayers

New Data Product

State of the Art

• OS:– Store all data in OS files.

• DBMS– Store all data on DBMS

• Hybrid– Scalar and Spatial Data in a DBMS– Images on File System

Paradise

• Store data on a client-server parallel DBMS– SHORE storage System

• Storage, buffer management, transactions, etc.

– Paradise Server• Optimizer, Execution Engine, Catalog Manager,

ADTs

– Paradise Client• Caching, GUI, ADTs

Paradise Client

• Map View – multi layer display• Layer Manager – logic to control Map View• Browser – Management of data sets, and how

should they be displayed.• Composer – Create ad-hoc queries• Local Executor – Ship queries, local processing,

cache control• Object – Cache the tuples in an external format.• Meta Cache – caching catalog information.

SHORE

• Storage Manager for OO and Relational DBMS• Support parallel access to disks, or tertiary

storage.– Disk arrays, RAID– Tape Robots

• Supports transactions, recovery, and indexing.• Can be used as a toolkit to build a DBMS on top

of it

Parallel Execution

• Multiple Paradise Servers can be used to run a query.

ParadiseServer

ParadiseServer

ParadiseServer

ParadiseServer

LAN

ParadiseClient

Image Processing in Parallel

ParadiseServer

ParadiseServer

ParadiseServer

ParadiseServer

Apply some AlgorithmTo an image

User-defined Types

• Support for GIS types such as lines, rectangle, polygons, etc.

• System can grow since new types can be added

• Need to provide operations to read, write, data from files, memory, disk.