![Page 1: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/1.jpg)
Beyond Mobile Apps
Sascha Wolter (wolter.biz / @saschawolter)Lecture on Next Generation MediaSeptember 2013
Telecommunication meets Super Natural Interaction - from SMS to M2M
![Page 2: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/2.jpg)
Smart something and alike
Developers predict that it is very likely that they will be building mobile
applications for more than smartphones and tablets.
![Page 3: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/3.jpg)
Super-Natural Interaction
Only sometimes scary (but not supernatural) CLI, GUI, NUI, SNI: Beyond Natural Interaction Analog interactions Society of devices Surface anywhere/mixed reality
Images: Supernatural Series, http://www.kitd.com/
![Page 4: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/4.jpg)
Emotion and Mind
Image: Mindflex
![Page 5: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/5.jpg)
Design-Student Robin Southgate (http://en.wikipedia.org/wiki/Toaster#cite_ref-11), 2001
Ubiquitous and
Pervasive Computing
![Page 6: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/6.jpg)
Ubiquitous and
Pervasive Computing
Mario Lukas(http://www.mariolukas.de/2011/09/mach-flott-den-schrott-toilettenpapier-drucker/), 2011
![Page 7: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/7.jpg)
Ambient IntelligenceQuantified SelfPrivacyNext Generation Media will support the user in a smart and connected way at his work and in his everyday life without noticing.
Image: http://mediacup.teco.edu/ Image: HAPIfork
![Page 8: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/8.jpg)
Cow can send SMS
Images: Nike, http://www.medria.fr
![Page 9: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/9.jpg)
Image: http://commons.wikimedia.org/wiki/File:Honeybee-cooling_cropped.jpg / http://www.emsystech.de/
Bees liketo text, too!
![Page 10: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/10.jpg)
Images: Lego, http://www.telekom.com/innovation/connectedcar/80306
starting point
and inspiration
SUBSTITUTE
![Page 11: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/11.jpg)
• Initiate your first text message (SMS) via HTTP
1. Sign-in
2. Activate Telekom Tropo
3. Add an application
4. Create your code
message("Developer Garden rocks!",
{
to:"+14075550100",
channel:"text",
network:"SMS"
}
);
Details at http://www.wolter.biz/?p=1337 (English)
eCall/Hello World!
5. Run your application
https://tropo.developergarden.com/api/sessions?action=create&token=TOKEN
6. Extend
ask, call, conference, record, redirect, say, startRecording, transscripe, transfer…
![Page 12: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/12.jpg)
Interactive System
Tex/SMS Voice DTMF …Gestures
![Page 13: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/13.jpg)
Source: Sascha Wolter
A smatteringof electronics
![Page 14: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/14.jpg)
Sourc: Sascha Wolter
A smatteringof electronics
![Page 15: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/15.jpg)
Embeddedsystem
Embedded and General-purpose
General-purposecomputer
Externaldevices
(sensors andactuators)
A general-purpose computer, such as a personal computer (PC), is designed to be flexible and to meet a wide range of end-user needs. (Wikipedia)
An embedded system is a computer system designed for specific control functions within a larger system. (Wikipedia)
![Page 16: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/16.jpg)
Seperation of Concerns
// the loop routine runs over and over again forever:
void loop() {
// read the input on analog pin 0:
int sensorValue = analogRead(A0);
// print out the value you read:
Serial.println(sensorValue);
// delay in between reads for stability
delay(1);
}
vs
![Page 17: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/17.jpg)
Top platform selection criteria: Reach
• Reach is top platform selection criteria for the majority of developers
• 7.0 Billion humans on earth• 5.2 Billion (100%) mobile phone
subscribers world wide• 4.2 Billion (79%) active users for
SMS– most widely used data application
in the world– more active users of SMS than
total number of FM radios in the world
• 2.1 Billion (39%) active users forMMS
• 1.2 Billion (26%) users withmobile browsing (WAP/HTML)
Source: http://communities-dominate.blogs.com/brands/2011/01/time-to-confirm-some-mobile-user-numbers-sms-mms-mobile-internet-m-news.html
![Page 18: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/18.jpg)
How it works
// Telekom Tropo API (JSON)
{"tropo":[{"say":[
{"value":"Hello World!","voice":"Simon"
}]
}]
}
• JSON Objects:ask
call
conference
hangup
message
on
record
redirect
reject
result
say
session
startRecording
stopRecording
transfer
![Page 19: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/19.jpg)
Latte Macchiato Architecture
Presentation (HTML/CSS, XAML…)
Controller/Mediator(optional)
Business/Application logic(Modells and Commands)
APIs, Services
Image: Coffeefellow (Wikimedia Commons)
![Page 20: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/20.jpg)
DIYBe smart
Image: Bundesarchiv
![Page 21: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/21.jpg)
About me
Sascha is a craftsman for pervasive computing, rich applications and mobile apps. He also works as consultant, trainer and author and contributes articles to a number of magazines. His books are best selling publications. He has been giving lectures at conferences for several few years now. Sascha is also the founder of the German user group flashforum.de with more than 100,000 members and cofounder of the renowned conference “beyond tellerrand”. He works as developer evangelist for Developer Garden enabling developers to efficiently build solutions. If he is not tinkering with new soft- and hardware, he likes playing Lego with his kids in his spare time.
Sascha Wolter | wolter.biz
![Page 22: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/22.jpg)
PrototypingExperimental Model Process Model
Creativity• Developing and Evaluating Ideas
Conception• Prototype for Specifying Requirements
Creation• Prototype as Basis for Implementation
![Page 23: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/23.jpg)
LEGO-based Design Process
1. Choose a problem: Build a LEGO ship. 2. Develop a vision: What sort of ship will it be? How big will it
be? What will it carry? 3. Build: Build the framework of the ship. 4. Fill in the details: Design and build the details of the ship,
ramps, doors, etc. 5. Test: Drive the cars around the ship and sail the ship while
exploring the house. 6. Refine: Take parts of the ship apart and make them better. 7. Learn: Take what you learned from building this ship and use
it to build a better one next time.
Source: http://www.adobe.com/macromedia/events/john_gay/
![Page 24: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/24.jpg)
Curtain Wall Pattern
Presentation (HTML/CSS, XAML…)
Controller/Mediator(optional)
Business/Application logic(Modells and Commands)
Data, APIs, Services and Messaging
![Page 25: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/25.jpg)
Prototyping / FedEX Days
http://www.wolter.biz/2012/11/the-voice-controlled-coffee-machine/ http://www.wolter.biz/2013/01/talk-to-your-vending-machine-in-the-cloud/
![Page 26: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/26.jpg)
think outsidethe box
TOYS
![Page 27: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/27.jpg)
![Page 28: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/28.jpg)
Gorilla arm syndrome
and Ape factor
![Page 29: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/29.jpg)
USABILITY and
ACCESSIBILITYImage: http://itnews.inews24.com/php/news_view.php?g_serial=474508&g_menu=022600
![Page 30: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/30.jpg)
It can´t be easier: Makey Makey
• JavaScript Madness: Keyboard Events– http://unixpapa.com/js/key.html
• Document Object Model (DOM) Level 3 Events Specification– http://www.w3.org/TR/DOM-Level-3-Events/
• jQuery Keyboard Events– http://api.jquery.com/category/events/keyboard-events/
![Page 31: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/31.jpg)
Conclusion: Gulf between Human and Machine
User and GoalsPhysical System (World)
Source: Norman, D. (1986). "User Centered System Design: New Perspectives on Human-computer Interaction". CRC. ISBN 978-0-89859-872-8
![Page 32: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/32.jpg)
Gulf of Evaluation (Interface Feedback)
Source: http://www.youtube.com/watch?v=JZge0Avr8ZU
![Page 33: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/33.jpg)
Image: Big Bang Theory
Gulf of Evaluation (Interface Feedback)
![Page 34: Telecommunication meets Super Natural Interaction - from ...€¦ · Beyond Mobile Apps Sascha Wolter (wolter.biz / @saschawolter) Lecture on Next Generation Media September 2013](https://reader031.vdocument.in/reader031/viewer/2022011820/5ea8ad107cb1262f8b4e82bc/html5/thumbnails/34.jpg)
wolter.biz