from a niche to a global user community: open source gis and osgeo
DESCRIPTION
OGRS 2009: International Opensource Geospatial Research Symposium www.ogrs2009.org From a niche to a global user community: Open Source GIS and OSGeo Markus Neteler IASMA Research and Innovation Centre Fondazione Edmund Mach Environment and Natural Resources Area GIS and Remote Sensing Unit, Trento, Italy Web: http://gis.fem-environment.eu/ Email: markus.neteler . iasma.it Geographical Information Systems (GIS) have evolved from a highly specialized niche to a technology that affects nearly every aspect of our lives, from finding driving directions to managing natural disasters. The masses have discovered geospatial data and technologies through the availability of popular globes; wiki-fied street mapping which was started by a few individuals has grown to weekly mapping parties around the globe. Today almost everybody can create customized maps or overlay GIS data. Current GIS technology covers viewing maps and images on the web, simple and complex spatial analysis, modeling and simulations. In our presentation we'll present highlights of the last 20 years of Open Source GIS developments. Many projects are born as initiative of individuals when the lack of available software for a specific application is solved by own development and the result is then made available to the public on the Internet for further collaborative development. In the early 80's, the first Open Source GIS (MOSS and GRASS GIS) reached production status followed by the PROJ4 library project, a first crucial library for many Open Source GIS applications. In 1995 the UMN MapServer project was started to implement OGC standard. The second cross-project library GDAL/OGR was born in 1998. While these projects became mature, new applications were started with partially extraordinary success (OpenEV, OSSIM, MapBuilder, PostGIS, Geoserver, Quantum GIS, uDIG, MapGuide Open Source, MapBender, gvSIG, Geonetwork and OpenLayers). The wealth of available but partially unconnected projects suggested to establish an umbrella foundation to foster source code and knowledge sharing. Hence, in February 2006, the Open Source Geospatial Foundation (OSGeo, www.osgeo.org) has been created to support and promote worldwide use and collaborative development of Open Source geospatial technologies and data. The foundation supports outreach and advocacy activities to promote Open Source concepts. It also builds shared infrastructure for improved cross-project collaboration. OSGeo has been a stimulating force for cooperative developments of sister projects, leveraging each other efforts by developing shared architecture components and expanding interoperability. To become an OSGeo member, the software project needs to undergo a rigorous review of its source code, development structure and community health. In these community-developed projects a whole “ecosystem” of users, translators, developers, and provides quick support and tested solutions, both for beginners and professionals. In our opinion, Open Source GIS is an appropriate choice for scientific computing as it is developed in a peer review process. We will show some case studies for GRASS GIS usage in research which illustrates its academic roots especially in environmental applications. This covers analysis of spatio-temporal data sets such as multi-temporal Lidar and remote sensing data including processing of large amounts of geospatial data on a cluster.TRANSCRIPT
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
From a niche to a global user community:
Open Source GIS and OSGeo
Markus NetelerFondazione E Mach - CRIItaly, [email protected]
Opensource Geospatial Research SymposiumNantes, 8-10 July 2009http://www.ogrs2009.org
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Open GIS Open Geospatial Consortium (OGC) Consortium (OGC)
GRASS InteragencySteering Commitee
1990 1992 2006
Open GRASS Foundation (OGF)
1994 2004
OSGeo
The early days of open source GIS:pre-Internet times...
1978: MOSS1982: GRASS GIS
1987: William Shatner narrates ...
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
1980 1985 20001990 1995 2005 2010
http://wiki.osgeo.org/wiki/Open_Source_GIS_History#Timeline
WWW Civil Internet
Open Source GIS Timeline
MOSS
GRASS GIS
PROJ4
UMN Mapserver
deegree
GDAL/OGR
OSSIM
GEOS
PostGIS
QGIS
Mapbuilder
Geonetwork
MapGuide OS
Openlayers
Mapbender
gvSIG Communities developing software
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Connecting the OSGeo stackPortability, interoperability
GRASS
View InteractTeach
SpatialAnalysisModeling
GeostatisticsPredictive modeling
Databaseengine:Tables,
attributes DBF
vector
rasterExternal
data
Visualize
Web ProcessingService
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
What you can do withOpen Source GIS....
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Stereo rendering inParaview (www.paraview.org)
Visualization: GRASS data export to Paraview and Povray
Povray rendering (www.povray.org): adding clouds and haze
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Raster and 3D vectorElevation model combined with extruded 3D buildings;also true 3D vector supported
Trento, Italy
Optional: KML export for virtual globes
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Viewshed analysis with GRASSNew, extremely fast viewshed algorithm (yet in GRASS-Addons): r.viewshed
Viewshed fromDos Trento
Comparison on a 5m Lidar based DEM (left map) – calculation time:
- common command: r.los: 4.5h
- rewritten: r.viewshed: 18 sec
Viewsheds includeEarth curvature
5km
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
v.vol.rst wcolumn=sigma_v
From D. Francisci (2009): Fabric Analysis in ArchaeologyFrom D. Francisci (2009): Fabric Analysis in Archaeologya
b
v
2D Interpolation
Contourlines
2D and 3D interpolation in GRASS
3D Interpolation(voxel)
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Google SoC 2007: Map generalisation in GRASSGeneralisation:Of contour lines (reduction of points to improve interpolation quality)
Lines and polygons supported; 10 algorithms
Daniel Bundala, StudentWolf Bergenheim, Mentor
Point reduction from 40000 to 3000 vertices. Interpolation runs8 times faster while artefacts are reduced
Study: Helena Mitasova
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Available Methods:- cell based statistics- binning- spatial approximation- smoothingUse cases:- topographic analysis- Feature extraction (Separation DEM/DSM)
H. Mitasova, NCSUM. Brovelli, PdM, Como
Lidar data analysis in GRASS GISMulti-returnLidar data
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
LST derived indices relevant for disease monitoring and risk modeling (through time series analysis in GIS):● late frost periods: relevant for masting of trees and
seed production● growing degree days (GDD) for phenological status
Disease vector (ticks, mice, mosquitoes) life cycle parameters:
● hot/cold summers through mean temperature differences● autumnal temperature decrease, spring warming● annual/monthly temperature minima/maxima
Land
Surf
ace
Tem
pera
ture
[°C
]
MODIS LST reconstruction: infection diseases risk mapping
CDC
J. Lindsey
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
MODIS Land Surface Temperature (LST) reconstruction: filtered map
Neteler, in prep.
Northern Italy – Southern Alps
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
MODIS Land Surface Temperature (LST) reconstruction: reconstructed map
Neteler, in prep.
Northern Italy – Southern Alps
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
MODIS Land Surface Temperature (LST) reconstruction: Differences
Neteler, in prep.
Northern Italy – Southern Alps
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
MODIS Land Surface Temperature (LST) reconstruction: Time Series
-2°C
14°C
-2°C
14°C
MODIS LST- original- reconstructed
Meteostation(pixel position)
January 2007Neteler, in prep.
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
MODIS LST reconstruction: data and software
MODIS sensor on Terra and Aqua satellites Data freely available from NASA/USGS
Delivered in HDF format, in SIN projection (product. level V005)
Series of products is made available by NASA:
Land surface temperature (LST)
Vegetation indices (NDVI and EVI)
Snow cover maps
LAI/FPAR ... and 40 further products
Data processing: OSGeo stack
PROJ4, GDAL, GRASS GIS
MODIS processing chain implemented in GRASS GIS (map algebra, raster time series calculations, volumetric interpolation)
Refs: Neteler, 2005. Time series processing MODIS, Intl J Geoinformatics Rizzoli et. al., 2007, Tick-borne Encephalitis. Geospatial Health Carpi et al., 2008, Tick-borne Encephalitis. Epidem. & Infect. Neteler, in prep.
Linux cluster
Batch processingon Grid Engine: 1460 LSTmaps/year for>8 years
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
GIS and physical models: Tangible GIS
“Illuminated Clay” - developed by MIT Media Lab and SENSEable City lab “Tangible GIS” - NCSU VISSTA laboratory
New technologies are combined to gain intuitive physical 3D models of landscapes combined with geodata – improved communication and collaboration
http://skagit.meas.ncsu.edu/~helena/wrriwork/tangis/
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Introduction of a checkdam and creation of a terrain depression, while studying changes of slope and overland flow in real-time
Design with TanGIS
Simulated overland flowwith checkdam
NCSU/MIT, USAhttp://skagit.meas.ncsu.edu/~helena/wrriwork/tangis/
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
htt
p:/
/ww
w.w
hit
eh
ou
se.g
ov/c
han
ge/
Open Source Web mapping meets PA
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Open Source GIS*brought to you by....
* Yes, we mean Free Software here under appropriate license!
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
GRASS GIS
Founded 4 February 2006, Chicagohttp://www.osgeo.org
OSGeo Foundation: Founding members
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Open Source Geospatial Foundation – OSGeo
www.osgeo.org
Mission: To support the development of open source geospatial software and promote its widespread use.
Founding projects (constituted in February 2006): GDAL/OGR, GeoTools, GRASS GIS, Mapbender, MapBuilder, MapGuide Open Source (Autodesk), MapServer, OSSIM
Official members only after graduation from the ”incubator“
Motivation: More that 200 GFOSS projects worldwide... … need for selection and organization: User oriented!
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
GRASS User map
QGIS Usermap
Mapbender User map
http://planet.osgeo.org/
A few of many usercommunities in
OSGeo
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
The OSGeo landscape
Communication via mailing lists (11500 unique subscribers in OSGeo in 7/2009), conferences and hack meetings
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
OSGeo software development: Source Code Control
Legal Aspects● License compatibility (e.g., GRASS: GPL)
● Don't use code from books like “Numerical Receipes in C”!
● Verify that 3rd party contributions are clean
● The employer has to agree if work time shall be used for
Free Software coding
Transparency and „peer review“ help to minimise any legal risk.
OSGeo inspired by Apache Foundation
● Incubator phase
● Graduation
http://incubator.apache.org/http://www.osgeo.org/incubator
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
For a more detailed comparison, see e.g., http://www.spatialserver.net/osgis/
FOSS4G answers to proprietary software
Proprietary vs Open Source/Free Software
Component Proprietary Open Source
Dedicated Viewer
Cartography GMT, GRASS, JGRASS
Analysis
Web Viewer
WMS, WFS
Spatial Database
Virtual Globe
Libraries FME GDAL, FDO
Metadata Catalog CubeWerx WRS GeoNetwork
ArcReader gvSIG, QGIS, uDig
ArcMap/ArcGIS
ArcINFO/ArcGIS, ERDAS, ENVI
GRASS, OSSIM, SAGA, ILWIS
Handheld ArcPad gvSIG mobile
ArcIMS Openlayers, Mapbuilder, Mapbender, Mapfish
ArcIMS Mapserver, Geoserver, Mapguide OS
Oracle Spatial, ArcSDE
PostGIS, (MySQL, SQLite)
Google Earth, Virtual Earth
OSSIM Planet, NASA WorldWind, Ratman
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
http://code.google.com/p/google-summer-of-code-2008-osgeo/
http://wiki.osgeo.org/wiki/Google_Summer_of_Code_2009
Community: recruiting newdevelopers through incentives
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
OSGeo Geodata Committee & Data
http://wiki.osgeo.org/wiki/Geodata_Repository
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
OSGeo Education: Courses Gallery“enable people to teach“
http://www.osgeo.org/educational_content
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
OSGeo meets industry: OGC and OSGeo sign Memorandum of Understanding
http://www.opengeospatial.org/pressroom/pressreleases/944
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Local OSGeo Chapters: The Francophone chapter
Four main goals:
● Legal association with membership (you are welcome!)
● Marketing: what is OSGeo-fr - flyers, logo, website includingthe Francophone wiki: http://wiki.osgeo.org/wiki/Francophone
● Translations: OSGeo Journal in French, translated software application documentation (e.g., QGIS documentation)
● Partnership: collaboration between OSGeo-fr and IGN-fr initiated
Info provided by Yves Jacolin
Likewise: Italy, Germany, Japan, China, … see http://www.osgeo.org/content/chapters/
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
www.mappinghacks.com
http://wiki.osgeo.org/wiki/Library
FOSS4G bookshelf: read more!
www.spatialguru.com
www.grassbooks.org
2005
2008 2009
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
Conclusions
● Almost unlimited possibilities with GFOSS software
● User levels: from newcomers to power users
● Interoperability with other software packages, also inheterogeneous environments
● GFOSS Quality: peer reviewed code, often with academicbackground
● Support: Community – Mailing Lists, companies, freelancer, ...
Markus NetelerFondazione E. Mach (FEM)Centro Ricerca e InnovazioneGIS and Remote Sensing UnitLoc. Viote del Monte Bondone38100 Trento, Italyhttp://gis.fem-environment.euhttp://www.osgeo.org
Mark
us
Nete
ler:
Fro
m a
nic
he t
o a
glo
bal use
r co
mm
unit
y:O
pen S
ourc
e G
IS a
nd
OS
Geo -
Nante
s, 8
-10
July
20
09
License of this document
This work is licensed under a Creative Commons License.http://creativecommons.org/licenses/by-sa/2.5/deed.en
“From a niche to a global user community: Open Source GIS and OSGeo”, © 2009 Markus Neteler, Italy http://www.grassbook.org/neteler/conferences.html [ OpenDocument file available upon request: neteler at cealp it ]
License details: Attribution-ShareAlike 2.5
You are free:- to copy, distribute, display, and perform the work,- to make derivative works,- to make commercial use of the work,under the following conditions:
Attribution. You must give the original author credit.Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under a license identical to this one.
For any reuse or distribution, you must make clear to others the license terms of this work.Any of these conditions can be waived if you get permission from the copyright holder.Your fair use and other rights are in no way affected by the above.