siri: a virtual personal assistantontolog.cim3.net/file/resource/presentation/siri...2010/02/25 ·...
TRANSCRIPT
![Page 1: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/1.jpg)
Siri: A Virtual Personal Assistant An Ontology-driven Application for the Masses
Adam Cheyer and Tom Gruber cofounders, Siri
© 2010 Siri, Inc. All rights reserved.
![Page 2: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/2.jpg)
It was imaginable 20 years ago.
Apple's Visionary Video: Knowledge Navigator (1987)
from www.open-video.org
![Page 3: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/3.jpg)
Interaction with the Assistant
Touch screens and cinematic animation Global network for info and collaboration Awareness of temporal and social context Continuous Speech in and out Conversational Interface - assistant talks back Delegation of tasks to the assistant Assistant use of personal data
![Page 4: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/4.jpg)
How Close are we Today?
Touch screens Cinematic effects Global network Location and time awareness Speech out, on demand Isolated speech to text
But where is the interface for assistance?
![Page 5: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/5.jpg)
Location Awareness Conversational Interface
Speech to Text Time Awareness
Text to Intent
Access to Personal Information
Dialog flow Task Awareness
Semantic Data
Services APIs
Task & Domain Models
![Page 6: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/6.jpg)
A Virtual Personal Assistant
![Page 7: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/7.jpg)
The Assistant Paradigm For Human-Computer Interaction
focus on task completion intent understanding via conversation in
context learns and applies personal information
![Page 8: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/8.jpg)
"at your service"
A VPA helps you get things done
TIRED
"at your service(s)" "what do you want to read?"
![Page 9: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/9.jpg)
The Ecosystem of APIs and Online Data
Over 1600 APIs growing at accelerated rate...
![Page 10: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/10.jpg)
Composability amplifies the power of services.
http://www.balaiyer.com/tabid/1475/bid/5036/Cloud-computing-ecosystem-from-an-API-perspective.aspx
![Page 11: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/11.jpg)
Virtual Personal Assistant
Events
Local Search
Weather
Travel
Movies Restaurants
NLP
Dialog Auto-complete
![Page 12: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/12.jpg)
Video: http://siri.com/about/product
![Page 13: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/13.jpg)
I need a romantic place for dinner tonight.
I found these romantic restaurants near you.
Somewhere in soma.
I found these romantic French restaurants with tables available at 7:00 and 9:00
I want a reservation, 2 people.
Book Fleur de Lys at 9:00
The Interface is a Conversation
I found these romantic restaurants in SOMA, San Francisco
I found these romantic French restaurants in SOMA, San Francisco
How about French?
![Page 14: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/14.jpg)
Example Task Automation
Multiple-criteria vertical search
combining multiple sources of information
with integrated transactions
and social communication
I found the following Italian restaurants that reviews say are romantic near your home
Your table is reserved for 2 Saturday night at 8:00pm.
Your invitation has been sent to [email protected]
![Page 15: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/15.jpg)
get me a table for the best italian food in palo alto
Task-oriented NL Understanding
Natural Language matching
Booking a restaurant
“get me a table” “italian food”
Location: Palo Alto
“in palo alto ” Concept
Disambiguation
Request Intent Identification
shopping
“get me a table”
Service Data Gathering
Service Invocation
Results Presentation
RestaurantType: italian “italian food ”
Restaurant
Preference: rating “best italian food”
Restaurant Request
Time: tonight [default]
Restaurant Listing
Availability of Best Italian Restaurants in Palo Alto Il Fornaio 6:30 9:00 9:30
![Page 16: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/16.jpg)
Ontology Unifies all Models
(c) 2009 Siri, Inc.
Ontology
Domains Language
Tasks Services
Dialog User
![Page 17: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/17.jpg)
tool demo
![Page 18: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/18.jpg)
Semantic Autocomplete
Find restaurants, hotels, movies, …
Book a table, a room, a seat, …
Schedule a meeting, an event, …
Remember to a thing to do…
Buy a ticket, a book, a DVD, …
Check a flight, the weather, … |
![Page 19: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/19.jpg)
Offer
Dialog modules organized by generic task and domain
Task-independent
Driven by Generic Task
Domain Specific
Present
Explain
Prompt
![Page 20: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/20.jpg)
Task Models
Plan a Meal
Find something to do
Go to the movies
Find a store
Plan a trip
. . .
![Page 21: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/21.jpg)
Model-driven Service Orchestration
Best lasagna in SF
Menu Item >+ Reviews >+ Preference >+ Rating > Location Restaurants tonight
Availability >+ Hours >+ Preference >+ Ratings
![Page 22: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/22.jpg)
Conclusion
Building an assistant requires the integration of a lot of technology.
But it's no longer an art.
Using ontologies and declarative models transform the problem into (knowledge) engineering.
And it works.
![Page 23: Siri: A Virtual Personal Assistantontolog.cim3.net/file/resource/presentation/Siri...2010/02/25 · A Virtual Personal Assistant The Assistant Paradigm For Human-Computer Interaction](https://reader033.vdocument.in/reader033/viewer/2022053023/605486593a72222dd4080b95/html5/thumbnails/23.jpg)
For More Information
www.siri.com
(c) 2009 Siri, Inc.
Download: http://itunes.apple.com/us/app/siri-assistant