un open gis initiativeunopengis.org/resources/pdf/unopengis-webinar-2016-11-11.pdf · what is the...
TRANSCRIPT
UN Open GIS InitiativeNovember 11, 2016
Kyoung‐Soo Eom, UN ([email protected])Ki‐Joune Li, Pusan National University, Korea ([email protected])
Anthony Calamito, Boundless, USA ([email protected])Diego Gonzalez Ferreiro, UN ([email protected])
Maria Brovelli, Politecnico di Milano, Italy ([email protected])Hae‐Kyong Kang, KRIHS, Korea ([email protected])
November 11, 2016 UN Open GIS Initiative 2
To Unite Our Strength without Barrier
November 11, 2016 UN Open GIS Initiative 3
Empower everyone with open source geospatial
UN Open GIS Initiative
Open Source as an International Machinery
November 11, 2016 UN Open GIS Initiative 4
Open Source Software as a Platform
Equal Technology
Collaboration TechnologyTransfer
TechnologyProgress
November 11, 2016 UN Open GIS Initiative 5
UN Global Service Centre, Brindisi, Italy. 7‐11 March 2016
A Basic Understanding on UN Open GIS
• UN is a International Organization, which functions like government
• UN GIS as a National Spatial Data Infrastructure (NSDI)
• NSDI Framework(Base and Reference) Map System and Services Capacity Institutional Arrangement Standards
November 11, 2016 UN Open GIS Initiative 6
Goal and Scope of UN Open GIS Initiative
November 11, 2016 UN Open GIS Initiative 7
NSDI Solutions
Scope of UN Open GIS
1. System and Services2. Capacity
What is the UN Open GIS Initiative?
GoalTo identify and develop open source GIS software that meets therequirements of UN operations, taking full advantage of the expertise ofmission partners. ‐ from UN Open GIS Strategy Manifesto
Current Members
November 11, 2016 UN Open GIS Initiative 8
Members ContributionsUN Strategy, Requirement Analysis, Deployment, Assessment,
MaintenanceUS DoD, NGA Geo‐Portal (GeoSHAPE/Exchange), Training SupportKRIHS, Korea Geo‐Analysis, Geospatial Data Collection (OpenGDS)GeoSDI, Italy Geospatial Applications and Services (GeoSDI)
OSGeo OS Knowledge, Documentation, Technical supportsGeoForAll Technical Supports, Education
+
UN Open GIS Initiative Structure
November 11, 2016 UN Open GIS Initiative 9
Strategic Board Co‐Chairs
Secretariats
Technical Advisory Group
Spiral One(Geo‐Portal)
Spiral Two(Capacity Building)
Spiral Three(Geo‐Analysis)
Spiral Four(Data Collection)
ContributingBodies
Requirement Advisory Group
Assessment Team
UN
Why Called Spiral? ‐ Incremental Approach
November 11, 2016 UN Open GIS Initiative 10
Enterprise GIS
1. Data Collection
2. Geospatial Data Management3. Geospatial
Analysis
4. Geospatial Services
November 11, 2016 UN Open GIS Initiative 11
IaaS
DaaS
PaaS
SaaS
• Challenges – UN NSDI Very Diverse and Complex Tasks Ad‐Hoc Development of GIS applications Fragmentation
IaaS
DaaS
PaaS
SaaS
UN Data Center
OS Spatial Analysis/
Map Publication
OS Geo‐Portal:Imagery and
Vector (2D/3D)
OS GIS Solutionfor Data Collection
November 11, 2016 UN Open GIS Initiative 12
Geospatial Server andSpatial DBMS
S/W Sharing
Infrastructure Sharing
Data Sharing
Function Sharing
November 11, 2016 UN Open GIS Initiative 13
Capacity for‐ Service Developments ‐ Supporting Requests from Fields‐ Maintenance‐ Technology Transfer to Developing Countries‐ Technology Evolution
Individual CapacityInstitutional Capacity
Geoforall.org
Approach
November 11, 2016 UN Open GIS Initiative 14
Covering the lifecycle
Ad‐Hoc Development
Cost
Migration
Capacity Building
Enterprise GIS
Geo‐Cloud Computing
Open Source GIS
Gradual Migration and Hybrid Structure
OS Capacity Center
Roadmap
November 11, 2016 UN Open GIS Initiative 15
Sustainment Phase ‐Sustainable Capacity
Implementation Phase ‐Solution Delivery
Development Phase ‐Fundamental Setting
Phase 12016
Phase 22017‐2018
Phase 32019‐
IOC(Initial Operating Capability)
Time
UN Capacity
Roadmap – Three Phases
Sustainable Capacity
1. Maintenance2. Development of New Services and Functions
3. Transfer to 3rd Parties
Solution Requirement Analysis Development and Delivery of Solution
SystemInfrastructure
System InfrastructureDeployment
Training Training Structure Setting‐Up
Training and Capacity Building
Capacity Building Center
Governance Governance StructureSetting‐Up
Phase 1Development Phase‐ Fundamental setting
Phase 2Implementation Phase ‐ Solution Delivery
Phase 3Sustainment Phase‐ Sustainable Capacity
November 11, 2016 UN Open GIS Initiative 16
Spirals
• Spiral One Goal – to provide a Geo‐Portal and setup a geospatial information infrastructure in UN
Led by Anthony Calamito from Boundless Base Open Source Software – GeoSHAPE‐Exchange
• Spiral Two Goal – To assist capacity building for the UN by several training programs Led by Maria Brovelli and Diego G. Ferreiro
• Spiral Three Goal – to provide geo‐analysis solutions for UN Led by Hae‐Kyong Kang Base Open Source Software – OpenGDS/Analysis
March 10, 2016 UN Open GIS Initiative 17
November 11, 2016 UN Open GIS Initiative 18
UN Open GIS
Geo‐Portal(SP1)
DataCollection
(SP4)
PC GIS
GeospatialServer
UN Data Center
OGC
Standards
OGC
Standards
Geo‐Analysis(SP3)
GeoSHAPE/Exchange (SP1)
Solutions Data Capture
Geo‐Analysis
Tracking and Sensor
Geo‐Visualization
BISolutionsReady to
Use
GeospatialClients
Architecture ‐ Overview
Spiral 2 - Capacity BuildingMaria Antonia Brovelli(*) and Diego Gonzalez (**)
(*) OSGeo/GeoForAll Politecnico di Milano(**) UN
Spiral 2 stepsDate Official Announcement
7/3/2016 -11/3/2016
Kick-off workshop in Brindisi
9/3/2016 Sharing the UN Workshop GeoforAll presentationhttp://www.slideshare.net/mariabrovelli/geoforall-a-successful-osgeo-initiative
24/3/2016 GeoForAll Call for UN training material6/4/2016 GeoForAll Call for Contributions for revision
6/7/2016-2/8/2016 Survey provided to UN staff asking about their exigencies
19/9/201619/10/2016
First course, first edition: QGIS GeoAcademyFirst course, second edition: QGIS GeoAcademy
9/01/2016 Second course: PostGIS Boundless
Survey
• Divided in three main parts:
About the staff member
About the staff's knowledge of Open Source GIS
About the staff's preferences on training modalities
• It was opened for about a month: 6th July to 2nd August
Summary about the survey OS vs Proprietary Software comparison. OS only wins in
Customization, Open Standards and Overall Costs.
Knowledge of software. The best known are the usual suspects: QGIS, PostGIS, GeoServer, OpenLayers
Only 2 respondents have claimed to have official training on OS
Priority for training: Desktop and database are on top.
Vast majority of people prefer on-site instructor-led training and intensive course for 2-3 days.
The courses should have an exam at the end according to most of the participants.
Collection of potential online training material
• https://wiki.osgeo.org/wiki/UNTraining
• 1QGIS• 2 gvSIG• 3 GRASS GIS• 4 GeoServer• 5 OpenLayers• 6 PostgreSQL• 7 PostGIS• 8 GeoGig
9 GeoNode10 Rasdaman11 OSGeo-Live12 Bringing GEOSS services into
practice13 GeoMOOSE14 GET-IT15 Open Source Geospatial Notebooks16 Developing Training Material
Online training
QGIS GeoAcademy Tutors
Exam and certificate
What's next?
● PostGIS (January 2017)●Geonode●Geoserver●Openlayers
●On-site instructor-led training?● Preparing new ad-hoc courses?
Keep in touch with us!!https://wiki.osgeo.org/wiki/UnitedNations_Committee
Spiral 3: Geo Analysis
2016.11.10 Friday
Spiral 3 Members
Organization Name
UN GSC Cung Thang Co‐Leader Chief, Geospatial Analysis Unit, GIS‐SGITTAeroporto Militare "O. Pierozzi"Piazza Del Vento, 72100 Brindisi, ITALYExt: 158‐6195Tel: +39 0831056195Email:[email protected]
OpenGDS HaeKyong Kang Co‐Leader Research Fellow, Geographic Information Research Division, KRIHS431‐712, 254 Simindae‐ro, Anyangsi, South KoreaH. +82 010 2033 5998T. +82 031 380 0405Email: [email protected]: somakang1
OpenGDS Minpa Lee Key‐Architect Director of R&DMango System inc.Mail : [email protected] : 010‐2030‐7084 Blog : http://onspatial.com
UN Thinley Wangdi (TBD)
OpenGDS Ji‐Hyun Kim Mango System [email protected]
OpenGDS GwangWoo Nam Professor
OpenGDS Ki‐Joune Li Professor and Co‐Chair of UN Open GIS InitativePusan National University
Source. Ki‐Joune Li. August 30 2016. UN OpenGIS Strategic Board Meeting – Review Session. P14.
Spiral 3: Review
• Outcomes : “Agree that Spiral Two will focus on geospatial analysis functions”. (p5)
• Spiral Two: Geospatial analysis (p7)
‐ Once Spiral One is underway, the following development will benefit from lessons learnt and will be
guided by technical choices made for Spiral One.
‐ (Process) The terms of development of this phase will be described at a later stage but the
implementation process should be similar to the one for Spiral One, including technical and operational
validation before a UN final decision.
‐ (Preparation) This second spiral might require more development than Spiral One as all the open source
components might not be immediately available.
‐ (Preparation) The project board will review existing and available components before implementing the
second spiral.
‐ (Approach) It will also be crucial to continue considering the hybrid approach and the business continuity
in this phase of the project.
‐ (Lead) The lead agency will be the Korea Research Institute for Human Settlements (KRIHS) and the UN
mission remains to be determined.
Spiral 3: Review
[Requirement Analysis of Spiral Three : GeoAnalysis]• 4 April 2016 (Mon)
Chung Thang (GSC) requested to share GIS analysis tools demonstrated in Brindisi during conference to Mr. Lim
• 7 April 2016 (Thurs)Mr. Jihyun Kim/Mr. Minpa Lee sent an URL of the demo site and Github as its source code repository
Demo Site : http://mango.iptime.org:58088/wpsol3/ GithubRepository : https://github.com/mapplus/spatial_statistics_for_geotools_udig
GeoServer WPS Document : http://docs.geoserver.org/stable/en/user/extensions/wps/index.html
Spiral 3: ProgressSpiral 3: Progress
• 27 April 2016 (Wed) Remind the demo site and user requests (KRIHS Chung)
• 28 April 2016 (Thurs) Chung Thang (GSC) replied:
….Our team assessed them and look forward to apply in our web mapping services based on ArcGIS environment. As of now, we would like to have the following analysis tools useable in our web map services.
1. Vector Overlay Analysis2. Multiple Ring Buffer3. Point Cluster & Spatial Clump4. Time Series Animated widgets
For UN Open Geospatial Spiral Two, we will compile a list of analysis tools to be in GeoSHAPE. We are also interested in image enhancement tools for raster data analysis.
Spiral 3: Progress
• 12 May 2016 (Thurs)Chung Thang (GSC) gave detail requests
The following list is the analysis tools we would like to have.
In general, using these analysis tools, we would like to perform fairly complex analysis such as monitoring and assessment (flood modeling, change detection), suitability analysis (site selection, helicopter landing zone), network analysis (routing), querying analytic results, etc..
In fact, it would be good to have all 171 WPS processes listed at MANGO system made available for upcoming GeoSHAPE.
Spiral 3: Progress – Requirements from GSC
9
Spiral 3: Progress – Requirements from GSC
No. Analysis Function Tool Reference Applications OpenGDS
1 Summarise DataAggregate Points ArcGIS OnlineSummarize Nearby ArcGIS OnlineSummarize Within ArcGIS Online
2 Find Locations
Find Existing Locations ArcGIS OnlineDerive New Locations ArcGIS OnlineFind Similar Locations ArcGIS OnlineChoose Best Facilities ArcGIS OnlineCreate Viewshed ArcGIS OnlineCreate Watersheds ArcGIS OnlineTrace Downstream ArcGIS Online
3 Data Enrichment Enrich Layer ArcGIS Online ●
4 Analyse PatternsCalculate Density ArcGIS Online ●Find Hot Spots ArcGIS Online ●Interpolate Points ArcGIS Online ●
5 Use Proximity
Create Buffers ArcGIS Online ●Create Drive‐Time Areas ArcGIS OnlineFind Nearest ArcGIS OnlinePlan Routes ArcGIS OnlineConnect Origins to Destinations ArcGIS Online
6 Manage Data
Extract Data ArcGIS Online ●Dissolve Boundaries ArcGIS Online ●Merge Layers ArcGIS Online ●Overlay Layers ArcGIS Online ●
Review results of UN Requests
Spiral 3: Progress – Requirements from GSC
7 Spatial Analysis
Buffer analysis Map Box ●Dissolve Map Box ●Union Map Box ●Merge Map Box ●Centroids and centers Map Box ●Joins Map Box ●Aggregation & statistics functions Map Box ●Triangulated irregular networks Map Box ●Interpolation Map Box ●Concave and convex hulls Map Box ●Simplify features Map Box ●Filter / select by attribute Map Box ●Data classification Map Box ●Grids Map Box ●Distance calculations Map Box ●
8 Map Enhancement
2D Histogram GitHub ??Adjacency Matrix GitHubCircular Brush GitHubContour plot GitHubColor wheel GitHubForce‐directed labels GitHubGeometric primitives, labels, connections GitHubHexagonal binning GitHub ●Horizon chart GitHubIcon array GitHubRollup (PivotGraph) layout GitHub
9 Raster tool
Clipping ●Surface Analyses 2018Masking 2018Composite bandsZonal Statistic 2018Distance analysis 2018Interpolation 2018
Review results of UN Requests
Spiral 3: Progress – Requirements from GSC
Scope of OpenGDS ‐ GeoAnalysis
Spiral 3: Scope and Architecture
GeoServer
GeoTools
uDig Desktop
Development Scope by OpenGDS (Mango System)
Geo AnalysisEngine
Geo AnalysisServer Plugin
Geo AnalysisDesktop Plugin
WPS Services
Process & Process Factory
Processing Toolbox
Widget & Dialog
Graph & Utilities
I18n & Repository
Process Parameter IO
Spatial Statistics Operation
Vector & Raster Operation
Style & Transformation
I18n & Storage
Existing Open GIS SW
140 kindsNew-Development
Scripting & Modeler
Geo Analysis Library
GeoServer WPS extensionBased on Spring Framework
Desktop Processing Plugin
Scope of OpenGDS ‐ GeoAnalysis
Spiral 3: Scope and Architecture
40
Respect the license of original Open Source SW
Products Original License License
GeoTools
GNU LGPL v2.1
- gt-main (BSD License)
- gt-xsd-core (Apache License)
- gt-brewer (Apache License)
- gt-referencing3d (partly NASA)
GNU LGPL v2.1
GeoServer GNU GPL v2.0 GNU GPL v2.0
uDig EPL v2.0/BSD v1.0 EPL v2.0/BSD v1.0
Spiral 3: Licenses
140 functions
Spiral 3: Functions
• 13 May 2016 (Fri) Korean Team reviewed the list of functions. Wait till the architecture of Spiral One will be completed. Communicate on APAN to share a progress with all.
• Spiral Three Board (May 2016) Cung Thang(Geospatial Analysis Unit, GIS‐SGITT) Timur from UN Mr. Jihyun Kim, Mr. Minpa Lee (Mango System Ltd) HaeKyong Kang (KRIHS) Ki‐Joune Li (Pusan National University) Maria
• 12 Aug 2016 Reported
Spiral 3: Functions
Co‐leader will be Cung Thang (UN USG) Analysis user requirements Decide development environment by consideration SI with Sprial 1.
i.e. OS, Compile Language & version, etcs. Analysis user‐requests to design algorithm
Sprial 3 Governance Leader, Co‐Leader
Technical Advisors
Developers
Spiral 3: Functions
OpenGDS team needs additional information
such as {datasets, analysis flows, primitive functions}
for each Geo‐Analysis function in current UN system.
i.e. helicopter landing zone analysis
{Input Dataset(DEM, POIs), AnalysisFlow for Potential Landing Zone, ...}
* Analysis Flow for PotentialLandingZone
Step1: a set of Potential_Landing_Zone = Function1 ( Slob<10% &&Elevation<11,000' && NoOpen Water && No Forest && No Brush)
Step2: a Potential_Landing_Zone = Function2 (step 1 with at least three ContiguousSurrounding Cells with allowable canopy clearance)
Step3: ....etcs.
2. UN Requests and review results
Spiral 3: Functions
Sep. 26 2016
Spiral 3: Functions
UN GSC OpenGDS GeoShape
Functions,Datasets, Analysis flow
Spiral 3 – Future Plan
• Kais Zouabi will design UN application for GeoAnalysis.
• Spiral 4 ‐
November 11, 2016 UN Open GIS Initiative 47
Spiral 4: Geospatial Data Collection
Nov. 10, 2016Ki‐Joune Li, OpenGDS
Pusan National University, South Korea
Spiral 4: Geospatial Data Collection• GoalAims at developing solutions for geospatial data collections as the first step of the lifecycle of geospatial information.
• Scope Data Conversion from Legacy DB to DB for GeoSHAPE/EXCHANGE Quality Control and Field Validations Orthogonal Map Generation from UAV to MAGO3D (live 3D map solution) Geo‐referenced Multimedia Data Collection 3D and Indoor Mapping Map Generalization
Data Collection
Data Management/Sharing
Data Analysis
ApplicationServices
Spiral 4: Schedule (Tentative)
ApplicationServices
Solution Delivery Schedule
Data Conversion from Legacy DB to DB for Open Source Geospatial Software December 2018
Orthogonal Mapping Solution for UAV December 2017
Quality Control and Field Validations December 2018
Geo‐referenced Multimedia Data Collection December 2018
3D and Indoor Mapping December 2018
Map Generalization December 2018
Spiral 4: Architecture
Data Conversion
Simple Feature – GDAL/OGR
Complex Feature – GeoKettle/HALE
Orthogonal Mapping
Cesium/NASA World Wind
GeoServer/3D
GeoTools/3D
WMS/WFS
GeoServer
PostGIS
Quality ControlEvaluation
WMS/WFS
Geo‐Referenced MM
PostGIS/Trajectory
Field Validation (Mobile)
Arbiter
FTP
GeoSHAPEMap Generalization(Web/Desktop)
3D Mapping/Indoor
Unite Our Strength!
November 11, 2016 UN Open GIS Initiative 52
http://unopengis.org will be available soon