natural language understanding in web mapping applications · „zoom to {"location“:...
TRANSCRIPT
© con terra GmbH
Ralf Hackmann
www.conterra.de
Natural Language Understanding in Web Mapping Applications
What if your map talked back to you?
© con terra GmbH
MAKETHE SCREEN
„Hello map.apps,
show me your maps!“
© con terra GmbH
Key Challenge: generate map interaction from spoken (written) words!
Natural Language Understanding
© con terra GmbH
Artificial Intelligence
Machine Learning
Deep Learning
NLU
The context…
© con terra GmbH
0
5
10
15
20
25
30
18 November 2010 01 April 2012 14 August 2013 27 December 2014 10 May 2016 22 September 2017 04 February 2019
Why now? ….Progress of technology!
Google's speech recognition error rate
© con terra GmbH
Speech Controller
Uses SpeechSynthesis (Text-to-Speech)
of the Web Speech API to output the
spoken response.
Rasa Controller
Recognizes the intent and entities. .
Named enitites are real-world objects
like persons or places.
Speech Recognition
Uses SpeechRecognition to
recognize the spoken word
and transcribe it to text
Processor Chain
Calls all processors.
How it works…in 4 basic steps!
{"location“: „Antwerp“}„zoom toantwerp“
Used to zoom in or zoom out orto zoom to a location.
example: ViewProcessor „Here is your location in antwerp“
Zoom toAntwerp „zoom to
antwerp“
© con terra GmbH
SpeechProcessor
Welcomes the user.
GreetingsProcessor
Helps the user.
HelpProcessor
For the amusement of the user.
EasterEggProcessor01
03
02 Enablels and disables layers.
Changes the basemap.
MapContentProcessor
Used to zoom in or zoom out or tozoom to a location.
ViewProcessor
Uses the OpenWeatherMap API toprovide weather information to theuser.
WeatherProcessor05
07
06 Gives the user additional
information.
InformationProcessor
Searches for features close to the user.
NearMeProcessor
Used to determine the user's position.
LocateMeProcessor09
11
10
Thanks the user.
ThankYouProcessor04 Prints the map.
PrintProcessor08 Provides voice output.
12
The Processor Chains
© con terra GmbH
Easy integration of processors in map.apps via “bundles”
Processor-Bundles
© con terra GmbH
„Show mesatellite images“
GIS Newbie„Switch to aerial view“
GIS Expert„Enable the
protected sites layer“
GIS Expert„Show me all protected sites“
GIS Rookie
Challenges: Different users – different wording!
© con terra GmbH
Conversation with Smart Machines will become more and morepart of our interaction with technologie
And why not also in WebGIS, for inst. INSPIRE Applications?
Bring INSPIRE into easy use!
10
And…what about INSPIRE?
© con terra GmbH
MAKETHE SCREEN
Demohttps://youtu.be/E
ItTpN1Ld5I
© con terra GmbH
con terra – Gesellschaft für Angewandte Informationstechnologie mbHMartin-Luther-King-Weg 2048155 MünsterTelefon +49 89 207 005 [email protected]
12
Visit us at our con terra stand G3…and talk to map.apps
Demo-movie (english): https://youtu.be/EItTpN1Ld5ILive-presentation-movie (german) https://youtu.be/okUzHlup10o
© con terra GmbH