the art and science of computer conversation: talkabot 2016
TRANSCRIPT
![Page 1: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/1.jpg)
The Art and Science of ConversationSarah Wulfeck / @skwulf
Lucas Ives / @lri
www.pullstring.com@pullstringinc
![Page 2: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/2.jpg)
Sarah Wulfeck
• Head of Conversation Engineering (tools, AI, publishing)
• Former Pixar R&D, 2001-2010(ish)
• Technology to help artists achieve their vision
• PullString Creative Director
• Head Writer for Hello Barbie, Hello Dreamhouse
• Former Digital Agency Creative Director
Lucas Ives
![Page 3: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/3.jpg)
Our mission is to develop
lasting emotional connections
between characters and audiences
through the art and science
of computer conversation.
Incorporated in 2011.
San Francisco, California.
Founding team mostly from Pixar’s software group.
![Page 4: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/4.jpg)
Our Creative Process
![Page 5: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/5.jpg)
What We Do: Creative InputScreenwriting, Playwriting and Acting Backgrounds drive the bot-writing process- “Breaking the fourth wall” / Scripted Improv- Asking deliberately worded questions to elicit
responses- Predicting how people will interact and engage, and
honing the narrative around them- Creating empathy in our Characters- Turning human interactions into technical features and
capabilities
![Page 6: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/6.jpg)
What We Do: Characters FirstCharacter Narratives, stakes and motivations and POV
- Who is the character and what is their specific way of speaking?
- What does the character want? (Motivations of the bot)
- What is the character’s relationship to the user?
- What should the character have an opinion or response to and what should they ignore?
- How should the character respond to off-topic, inflammatory or other non-narrative interactions from the user?
![Page 7: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/7.jpg)
Hello Barbie: A Bot Wrapped In Plastic
Underneath all that plastic is the most sophisticated, scripted, interactive conversational experience ever published.
![Page 8: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/8.jpg)
Hello Barbie: “You’re My Best Friend!”
The Goals:Give the illusion of listening, display empathy, and remember information “like a friend” through 8000+ lines of dialogue and conversational tracks
![Page 9: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/9.jpg)
Hello Barbie: All You Can Content
What’s Under The Hood:Known character, long backstory, point of view, areas of expertise, etc.
![Page 10: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/10.jpg)
Hello Barbie: Conversational “Neural Network”
- I remember you said you love horses - have you ever ridden one?
- Speaking of animals, what other pets do you have?
- I always wished my pets could go to school with me.. Do you?
- What class do you like most?- Do you have a best friend at school?- Hey, speaking of.... I’m having a problem
with a friend. Can you help me out?
![Page 11: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/11.jpg)
Hello Dream House: The “Smartest” House Ever
Voice-Controlled, Smart Mansion. Open/Close doors, operate elevator, create lighting concepts, turn the stairs into a slide, create custom sounds for everything, and more! (No, it doesn’t have temperature control. Dolls don’t need that.)
![Page 12: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/12.jpg)
Hello DreamHouse: Your House, Your Rules
The Goal:The user drives the play / experience.
![Page 13: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/13.jpg)
Hello DreamHouse: Anticipation Network
Thousands of extremely specific voice commands and intents the user can say to drive the behavior of the house.
![Page 14: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/14.jpg)
Fast Forward Case Studies
![Page 15: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/15.jpg)
Humani: Jessie’s Story
Millennial adrift in a SF-esque environment
Built to be your friend on the other end of the line
Real events unspooling in pseudo-real time
~3000 lines of dialog
Try it! http://m.me/jessiehumani
![Page 16: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/16.jpg)
Humani: Jessie’s Story
Launch partner w/ FaceBook for f8
First text-only experience
NLP: Text speak vs. natural spoken language — when is a typo not a typo?
![Page 17: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/17.jpg)
Call of Duty: Lt Reyes
Guerrilla marketing / ARG in conjunction with AKQA and Activision
Smaller experience, ~400 lines of dialog
Traffic wise, one of the largest FB Messenger bots
More than 6M conversations on day 1
Most media impressions for a CoD campaign ever
Required a custom scaling solution to be built by FaceBook
![Page 18: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/18.jpg)
Humans
Built in conjunction with Channel 4 UK / 4Creative
~750 lines of dialog
Huge underground marketing campaign in London
Help your synth understand emotion, escape
Try it! http://m.me/PersonaSynthetics
![Page 19: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/19.jpg)
Platform Overview
![Page 20: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/20.jpg)
![Page 21: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/21.jpg)
We now live in the world of computer conversation.
Personality, language, tone, mood, and style are the ways to give
your character a unique and authentic voice.
Content, Intent, and Context together.
The PullString Platform is the world’s best way to author
computer conversation.
![Page 22: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/22.jpg)
Available now.
Professional authoring environment.
Fully integrated AI and machine learning.
Rapid iteration.
Team collaboration workflows.
Enterprise scale, analytics, and extensibility.
PullString Platform
![Page 23: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/23.jpg)
We trade in the atoms of actual human conversation
These are tools for creative professionals
The world’s best way to create organic, natural, believable computer conversation.
PullString Platform
![Page 24: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/24.jpg)
Machine Learning and Rules Based AI
AI EnginePrecision of rules based pattern
matching and the power of machine learned intent
IntentsModel high level user goals or use
built-in libraries to get started quickly
EntitiesExtract entities like names,
addresses, dates, and times and store them in state across conversations
RulesMaintain full control and precision
over the conversation with powerful pattern matching
SynonymsEasily define related concepts and
phrases, and automatically generate suggestions for new synonyms with powerful machine learning
Dialog ManagementEasy access to all the fundamental
building blocks of conversation like time-based responses, interjections, segues, activities, conditions, and priorities
![Page 25: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/25.jpg)
![Page 26: The Art and Science of Computer Conversation: Talkabot 2016](https://reader030.vdocument.in/reader030/viewer/2022011722/58ecd96c1a28ab5c398b4697/html5/thumbnails/26.jpg)
Make anything talk. Anywhere.
Voice-enable IoT devices, apps, games, and other custom integrations
Simple RESTful HTTPS interface
PullString web APIs
External web APIsConnect to other web services
Simple JSON payload protocol
Embed Javascript in your content and we’ll execute it in a secure cloud sandbox