![Page 1: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/1.jpg)
Geoapplications development
http://rgeo.wikience.org
Higher School of Economics, Moscow, www.cs.hse.ru
![Page 2: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/2.jpg)
Agenda 2
• What is geospatial data?
• How is it different from other types of data?
• Examples of geospatial data
• What is geoapplication?
• Course goals & organization
• Real-world examples: companies using geospatial data
• Tentative projects to participate in
• Main readings
• Quiz
• Practical lesson: 3D Globes
![Page 3: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/3.jpg)
Geospatial data: 2 types (simplified) 3
VECTOR
What is raster data? http://help.arcgis.com/EN/arcgisdesktop/10.0/help/index.html#//009t00000002000000
RASTER
matrix
![Page 4: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/4.jpg)
The main difference from other data types (simplified) 4
RASTER
matrix
A fundamental difference: the presence of spatial coordinates
each cell has (lat, lon, value)
(lat_i, lon_i) for each vertice
VECTOR
![Page 5: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/5.jpg)
Is that all? 5
![Page 6: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/6.jpg)
is there something strange here?? 6
Hint: areas…
![Page 7: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/7.jpg)
is Greenland larger than Africa?? 7
Let us consult an Encyclopedia or Wikipedia
2,175,600 km2 World size ranking: 14
30,370,000 km2
World size ranking: 2
![Page 8: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/8.jpg)
is Greenland larger than Africa?? 8
https://takeitscienceblog.wordpress.com/2016/08/31/how-big-is-your-country/ http://geoffboeing.com/2015/08/map-projections-that-lie/
![Page 9: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/9.jpg)
Distances 9
Two airplanes are flying …
Plane A: (60ᵒN, 40ᵒE) (60ᵒN, 30ᵒE)
Plane B: (40ᵒN, 40ᵒE) (40ᵒN, 30ᵒE)
40ᵒ - 30ᵒ = 10ᵒ
Both traveled the same distance?
![Page 10: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/10.jpg)
Everything is not so simple… 10
To name a few: * distances between two points with the same longitudes are different for different latitudes
![Page 11: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/11.jpg)
A small caveat 11
longitude range is [ –180 … +180 ] but what if I want to move 10 degrees eastward from 179 degrees? 179 + 10 = 189 …. actually -171
![Page 12: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/12.jpg)
Lesson learned 12
Areas, shapes, angles, distances depend on…
![Page 13: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/13.jpg)
Examples of geospatial data: vector 13
![Page 14: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/14.jpg)
Examples of geospatial data: raster & vector 14
More details are at: http://www.wikience.org/tropical-cyclones/wind-swaths/
![Page 15: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/15.jpg)
Examples of geospatial data: satellite raster 15
![Page 16: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/16.jpg)
Visualization examples 16
Much more examples are at: http://goworldwind.org/demos/
Video on terrain Analytic Surface
Airspaces Extruded Shapes Scankort Denmark Data
We can do more together during course work
NASA World Wind engine
![Page 17: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/17.jpg)
17
Satellites,
smartphones,
GPS
(1): basic theory: geographic coordinate systems, geocoding, vector and raster data types and operations (3): I/O with vector (SHP, KML, GeoJSON, WKT) and raster (GeoTIFF, NetCDF, HDF) formats (4): network protocols for geodata exchange: WCS, WFS, WMS, OPeNDAP (4): frameworks: Mina, Netty that is used by Twitter (3,4,5): spatial databases and servers: PostGIS, SciDB, GeoServer, TDS (5): software libraries for geodata processing: vector Java Topology Suite, Geotoolkit, Apache SIS and raster ImageMagic, GDAL (6): visualizing geodata with NASA WorldWind, Mapbox, Leaflet, CartoDB
Course goals & organization
Topics cover technologies for a complete geospatial data management chain:
![Page 18: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/18.jpg)
18 Course assessment
Code Description Contribution, %
LP Lecture presence 20
PP Work during practical lessons 5
CW Control work 10
HA1 Home assignment 1 30
HA2 Home assignment 2 15
EX Exam 20
TT Total contribution
![Page 19: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/19.jpg)
Geospatial technology stack (not exhaustive) 19
Storage
Transmission
Processing
Visualization
DBMS
Files
Almost all DBMS are geo-enabled
SHP, KML, GeoJSON, GeoTIFF, NetCDF, HDF
network protocols WCS, WFS, WMS, OPeNDAP
Libraries in Java, Python, R, JavaScript, …
![Page 20: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/20.jpg)
Geospatial theory stack (not exhaustive) 20
Notations
Topology
Processing
GPS, WiFi, geohash, …
Projections
ISO/IEC standard
![Page 21: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/21.jpg)
The technologies and theory are building blocks for solving real-world tasks
21
![Page 22: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/22.jpg)
The technologies and theory are building blocks for solving real-world tasks
22
Example task: Because of dramatic traffic increase, the town planners want to widen the main road and add a second lane. The lane width is 20 meters. Find properties that must be demolished.
main road
new lane (its central line)
house
tree
![Page 23: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/23.jpg)
The solution (DBMS, WKT, Buffer, Topology, SQL, …) 23
LINESTRING (290 230, 330 250, 390 260, 440 260, 495 252, 535 238, 560 220, 580 190, 590 150)
main road
house
tree
new lane (its central line)
DBMS SELECT a_geom, address, owner FROM city_database WHERE ST_Intersects ( ST_Buffer( ST_GeomFromText("LINESTRING (290 230,…) ",4326), 10), a_geom)
POLYGON ((325.5278640450004 258.94427190999915, 326.90755828109235, ….))
BUFFER (ST_Buffer)
WKT: ISO/IEC standard
![Page 24: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/24.jpg)
Consumers of geospatial data
24
Who needs geospatial data? How do they process them? What kinds of geospatial data exist?
![Page 25: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/25.jpg)
Consumers of geospatial data: motivating examples 25
http://www.spatial.cs.umn.edu/Book/sdb-chap1.pdf
![Page 26: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/26.jpg)
Geoapps: Marine Traffic 26 Real-time ship tracking
http://www.marinetraffic.com
http://shipfinder.co/ https://www.vesselfinder.com/
![Page 28: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/28.jpg)
EigenRisk 28
Hurricane swaths, flood footprints, assets
Spatial operations
Visualization
Hurricane
Katrina, 2005
![Page 29: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/29.jpg)
Zillow 29
Selling real
estates
Filter, nearby,
etc.
![Page 30: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/30.jpg)
Examples of geoapplications – 2GIS 30
Places
Positioning
Routes
….
![Page 31: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/31.jpg)
Yelp 31
Seek restaurants, hairdressing saloons, etc. + add other
![Page 32: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/32.jpg)
UrtheCast 32
Live video streaming from International Space Station
A platform for imagery processing
![Page 33: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/33.jpg)
Sputnix, Dauria – Skolkovo residents 33
Native satellite manufacturers –
ensure Russian national interests
Д.К. Мозговой и О.В. Кравец «Использование данных MODIS для экологического мониторинга и контроля чрезвычайных ситуаций»
Blooming in Каховском водохранилище
Precision agriculture
![Page 34: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/34.jpg)
UAV: Unmanned Aerial Vehicles
http://www.youtube.com/watch?v=4ErEBkj_3PY
![Page 35: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/35.jpg)
Consumer: 35
Optimize wind farms locations and operation
Data: wind speed and direction reanalysis and forecasts – raster data
For calendar year 2014, the electricity produced from wind power in the United States amounted to 181.79 terawatt-hours, or 4.44% of all generated electrical energy. https://en.wikipedia.org/wiki/Wind_power_in_the_United_States
![Page 36: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/36.jpg)
Wind speed data 36
Energy sector, hazard monitoring, etc.
https://earth.nullschool.net
http://wikience.org
![Page 37: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/37.jpg)
Thermal power stations 37
Optimize load depending on climate/weather forecast
-> reduce penalties
Air temperature is
one of the crucial
factors upon
which the station
load depends
![Page 38: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/38.jpg)
Railroads 38
Qingyun (Jeffrey) Xie, High Performance Raster Database Manipulation and Data Processing with Oracle Spatial and Graph
![Page 39: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/39.jpg)
More examples 39
![Page 40: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/40.jpg)
www.climate.wikience.org
Tentative course work topics
JavaScript: Web GIS (Geographical Information Service) Data compression, processing, visualization, user interaction
![Page 41: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/41.jpg)
Performance evaluation
Tentative course work topics
Evaluate performance of raster data servers
We will develop distributed & multithreaded application to simulate a large load
THREDDS
![Page 42: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/42.jpg)
Tentative course work topics: machine learning https://habrahabr.ru/company/avito/blog/325632/ https://habrahabr.ru/company/ods/blog/325096/
![Page 46: Geoapplications development fileAgenda 2 • What is geospatial data? • How is it different from other types of data? • Examples of geospatial data • What is geoapplication?](https://reader033.vdocument.in/reader033/viewer/2022041422/5e1fab049f92af06935520ba/html5/thumbnails/46.jpg)