load testing of helidem geo-portal: an ogc open standards interoperability example integrating wms,...
DESCRIPTION
This paper presents a load testing of the HELIDEM geo-portal, which is an example of interoperability between a numbers of standard geospatial services as defined by the Open Geospatial Consortium. The portal was developed within the European project HELIDEM (www.helidem.eu) with the aim of valorizing the main project output which is a cross-border digital terrain model. The portal aims at fostering its diffusion and usage trough easily accessible tools. The DTM covers the alpine area located between Southern Switzerland (Canton Ticino) and Northern Italy (Lombardy and Piedmont Regions). From a technological point of view, the server-side component of the portal is based on a Service Oriented Architecture implemented using the open source software Zoo-Project, GRASS GIS and Geoserver; the client-side component is a Web interface based on CSS3 and HTML5 trough the usage of the ExtJS framework and the OpenLayers software. The presented solution is a mix of technologies and software, some of which are considered, within the open source for geospatial community, mature and robust while others are considered promising but not sufficiently tested yet. For this reason this research conducted a load test over concurrent users in order to verify the robustness, quality and performance of the system and to identify eventual bottlenecks. Test results didn’t register any exception confirming the good quality of the implemented system and underlying software. Nevertheless, performance and response time exponentially degrades with increasing number of concurrent users, area of analysis and process complexity. Finally, the test confirms that system is robust, in fact no system failure was recorded during the analysis.TRANSCRIPT
![Page 1: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/1.jpg)
HELI-DEM portal for geo-processing services: overview and load testing
Massimiliano Cannata, Milan Antonovic, Monia Molinari
![Page 2: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/2.jpg)
DACD / IST / HELI-DEM geo-portal
HELI-DEM project’s goals
Creation of a unified digital terrain model, for the Alpine and Sub-Alpine area on the border between Italy and Switzerland, correctly geo-referenced in the three dimensions
Administrative areas: Piemonte, Lombardia, Canton Ticino, Canton Grigioni
DTM elaboration by coordination and fusion of available information
+ Correction of DTM with
LiDAR HR DTM +
Cross-border GNSS network experiments
+ Cross-border geoid calculation (IT-CH)
+ Experimentation, diffusion
and valorization of DTM
![Page 3: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/3.jpg)
DACD / IST / HELI-DEM geo-portal
HELI-DEM geo-portal architecture (OWS / SOA)
3
![Page 4: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/4.jpg)
DACD / IST / HELI-DEM geo-portal
FOSS4G stacks
4
SERVER SIDE STACK CLIENT SIDE STACK
![Page 5: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/5.jpg)
DACD / IST / HELI-DEM geo-portal
Operation sequence disgramm
5
WCS WMS WFS FS WPS process
DTM area
Publish results
Publish results
Publish results Links to results
![Page 7: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/7.jpg)
DACD / IST / HELI-DEM geo-portal
7
![Page 8: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/8.jpg)
DACD / IST / HELI-DEM geo-portal
8
17/07/2014
![Page 9: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/9.jpg)
DACD / IST / HELI-DEM geo-portal
17/07/2014
9
![Page 11: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/11.jpg)
DACD / IST / HELI-DEM geo-portal
PDF report or CSV parameters
17/07/2014
11
![Page 12: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/12.jpg)
DACD / IST / HELI-DEM geo-portal
17/07/2014
12
![Page 13: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/13.jpg)
DACD / IST / HELI-DEM geo-portal
Load testing
13
2.1 MB
7.5 MB
17.3
MB
29.2
MB
![Page 14: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/14.jpg)
DACD / IST / HELI-DEM geo-portal
Load testing procedure
7 test sessions with 1, 2, 4, 8, 16, 32, 64 concurrent users
14
Contour lines
Altimetric profiles
Watershed analysis
Elevation derivatives
Maggia - Large
Varzasca - medium
Breggia - small
Cama – very small E
qu
all
y b
ala
nc
ed
Ra
nd
om
ly se
lec
ted
![Page 15: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/15.jpg)
DACD / IST / HELI-DEM geo-portal
System configuration
parameter WPS / WMS / WFS
server WCS server
OS Ubuntu server
version 12.04, 32 bit (VM)
Ubuntu server version 12.04, 32 bit (VM)
RAM 4GB 4GB
CPU Intel(R) Xeon(R)
CPU E5-2650 0 @ 2.00GHz
Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz
N° of processors 6 4
Disk size * 100GB 100GB
15
* Increased from 50GB after some test configuration
![Page 16: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/16.jpg)
DACD / IST / HELI-DEM geo-portal
Load testing results: the system
• No exception recorded
• Response time exponentially grows after 16 concurrent users
16
1 2 4 8 16 32 64
Average 28326 31705 29732 42239 52193 128932 303406
Exceptions 0 0 0 0 0 0 0
0
50000
100000
150000
200000
250000
300000
350000
Ave
rage
res
po
snse
tim
e [m
illis
eco
nds]
General statistics
350k
300k
250k
200k
150k
100k
50k
![Page 17: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/17.jpg)
DACD / IST / HELI-DEM geo-portal
Load testing results: the processes
17
Min = 2.5 sec.
Max = 2 min.
Avg = 18 sec.
Min = 8.4 sec.
Max = 17.4 min.
Avg =2.2 min.
Min = 3.6 sec.
Max = 3 min.
Avg =26.9 sec.
Min = 24 sec.
Max = 23.5 min.
Avg = 3.15 min.
80 % CPUs
100 % CPUs
![Page 18: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/18.jpg)
DACD / IST / HELI-DEM geo-portal
Where is the bottleneck ?
18
WCS WMS WFS FS WPS process
DTM area
Publish results
Publish results
Publish results Links to results
![Page 19: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/19.jpg)
DACD / IST / HELI-DEM geo-portal
Load testing results: data retrieval
• More smoothed behavior suggests it isn’t the real weak point, at least for this amount of data (ranging from 3 MB to 30 MB)
19
1 2 4 8 16 32 64
Very small 808 854 861 890 774 839 1444
Small 1624 1663 1668 1862 1546 1677 2424
Medium 2831 2957 3070 3222 2865 3019 3800
Big 5538 5662 6004 6198 5717 6252 9093
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
10000
AV
G r
esp
on
se t
ime
(m
illi
sec
on
ds)
WCS
![Page 20: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/20.jpg)
DACD / IST / HELI-DEM geo-portal
WCS impact over offered processes
1. The data retrieval impacts more the fast processes (-)
2. Increasing concurrent user lead to longer response time and minor relative cost for data retival (-)
20
![Page 21: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/21.jpg)
DACD / IST / HELI-DEM geo-portal
Conclusions: the good
Proven quality of the HELI-DEM portal and thus of the FOSS4G/OWS stack it relies on:
• good robustness having (no system failure – even when exceptions raised in load testing setting)
• good application quality (no exception response registered)
• average good performances (compared with desktop processing)
Serve dynamic analyses to non GIS experts for better planning !
21
![Page 22: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/22.jpg)
DACD / IST / HELI-DEM geo-portal
Conclusions : the bad
Scalability issues:
• Scalability: response time exponentially degrades with increasing number of user
– Increase hardware infrastructure (more CPUs, load balancing, scalable cloud computing service, etc..)
– Optimize processing (asynchronous programming, parallelization, etc.)
Patience is a rare virtues in Web users…
22
![Page 23: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/23.jpg)
DACD / IST / HELI-DEM geo-portal
Conclusions : the ugly
Open questions to be investigated:
• Impact of WPS service (overhead to GRASS processing)
• Behaviour under different hardware settings (what if you increase the CPUs?)
• What under larger concurrency?
• Any other hints or suggestions?
23
![Page 24: Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS, WFS, WCS and WPS](https://reader034.vdocument.in/reader034/viewer/2022051207/53fdb7168d7f72a81c8b4a9b/html5/thumbnails/24.jpg)
24
Thanks to: - FOSS4G developers - project partners - the audience