the soul in the machine - developing for humans
TRANSCRIPT
![Page 1: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/1.jpg)
The Soul in The Machine - Developing for Humans
Chris Heilmann @codepo8, Confoo, Montréal - February 2017
![Page 2: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/2.jpg)
CHRIS HEILMANN @CODEPO8
HTTPS://CHRISTIANHEILMANN.COM
![Page 3: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/3.jpg)
Today, I want us to think a bit about what we are doing as developers. 🤔
![Page 4: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/4.jpg)
Because, I think we’re wasting a lot of energy on the wrong things…🔋
![Page 5: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/5.jpg)
I remember when writing code for the web was mostly about building interfaces for humans and making sure they work.🤹
![Page 6: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/6.jpg)
But with better computers, less confusing browsers and fast connections we lost that focus.🚀
![Page 7: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/7.jpg)
And this is dangerous and not helpful.🌵
![Page 8: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/8.jpg)
We have become disconnected from our users.✂
![Page 9: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/9.jpg)
Our computers work, our connections are great, we’re always up-to-date and often ahead of the curve.🏁
![Page 10: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/10.jpg)
So we’ve become introspective. Most of the headlines we read and get excited about are about improving our tools.🛠
![Page 11: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/11.jpg)
We seem to be at a break-neck pace to empower ourselves to create more in a shorter amount of time.⏳
![Page 12: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/12.jpg)
Creating more in a shorter amount of time always comes with some cost.🗑
![Page 13: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/13.jpg)
We create for the sake of creation and to cater to a culture of perpetual growth…🎰
![Page 14: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/14.jpg)
Where are we going with this?🤔
![Page 15: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/15.jpg)
For now, we’re good. Our jobs are safe, we have more freedom than we know what to do with and we work in the world others are scared of.😎
![Page 16: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/16.jpg)
Have we created machines that are too clever?
![Page 17: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/17.jpg)
I do not fear computers. I fear the lack of them.
— Isaac Asimov
http://www.zmescience.com/other/economics/china-factory-robots-03022017/
![Page 18: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/18.jpg)
https://www.bloomberg.com/news/articles/2017-02-28/jpmorgan-marshals-an-army-of-developers-to-automate-high-finance
![Page 19: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/19.jpg)
http://www.bbc.com/news/technology-34066941http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf
The robot takeover
![Page 20: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/20.jpg)
http://www.bbc.com/news/technology-34066941http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf
The robot takeover
![Page 21: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/21.jpg)
http://www.bbc.com/news/technology-34066941http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf
The robot takeover
![Page 22: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/22.jpg)
http://www.bbc.com/news/technology-34066941http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf
The robot takeover
![Page 23: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/23.jpg)
http://www.bbc.com/news/technology-34066941http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf
How safe is my job?
Abstract thinking
Working with humans
Images
Words
Numbers
Routine Variety
You’re out
Get nervous
You’re OK
![Page 24: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/24.jpg)
This also applies to us, as the more predictable we get, the easier it is to replace us.
![Page 25: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/25.jpg)
https://www.technologyreview.com/s/603381/ai-software-learns-to-make-ai-software/
![Page 26: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/26.jpg)
http://www.wired.co.uk/article/ai-write-code-microsoft
![Page 28: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/28.jpg)
We’re in a post-production world. We use other people’s products instead of writing new code from scratch…
![Page 29: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/29.jpg)
Which is totally fine. Boring, repetitive and tedious work is where computers excel and humans make mistakes.
![Page 30: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/30.jpg)
So here’s what I think we should be considering…🤔
![Page 31: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/31.jpg)
The saddest aspect of life right now is that science gathers knowledge faster than society gathers wisdom.
— Isaac Asimov
![Page 32: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/32.jpg)
All personal data on the web has been harvested and analysed.
![Page 33: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/33.jpg)
For years we used “free” systems that spied on us - heck, we even bought the devices that recorded our every move.
-
📱
![Page 34: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/34.jpg)
Our data and information has already been recorded and filed. It is almost impossible not to have left a track.
📷✏🎙➡🗄
![Page 35: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/35.jpg)
Technological progress has merely provided us with more efficient means for going backwards.
— Aldous Huxley
![Page 36: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/36.jpg)
The Power of Big Data and Psychographics
https://youtu.be/Yu3Vxy6lQwg
![Page 37: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/37.jpg)
The Power of Big Data and Psychographics
https://youtu.be/Yu3Vxy6lQwg
![Page 38: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/38.jpg)
The Power of Big Data and Psychographics
https://youtu.be/Yu3Vxy6lQwg
![Page 39: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/39.jpg)
The future is already here – it’s just not very evenly distributed.
— William Gibson
![Page 40: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/40.jpg)
Here is where we come in. 4
![Page 41: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/41.jpg)
The interfaces we build today condition the users of now and of tomorrow…
![Page 42: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/42.jpg)
The interfaces we build today condition the users of now and of tomorrow…
![Page 43: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/43.jpg)
It is time for us to see machine learning as a tool in our belt to built great, human interfaces.🌈
![Page 44: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/44.jpg)
There is no such thing as a perfect user - think inclusive.
https://www.microsoft.com/en-us/Design/inclusive
It isn’t about allowing access but about avoiding barriers.
![Page 45: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/45.jpg)
Here are some great examples…🦄
![Page 46: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/46.jpg)
![Page 47: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/47.jpg)
![Page 51: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/51.jpg)
https://qz.com/920857/netflix-nflx-uses-ai-in-its-new-codec-to-compress-video-scene-by-scene/
![Page 52: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/52.jpg)
http://www.theverge.com/2017/2/8/14549798/pinterest-lens-visual-discovery-shazam
![Page 53: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/53.jpg)
https://www.youtube.com/watch?v=XMdct-5bERQ
![Page 54: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/54.jpg)
aipoly.com
![Page 55: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/55.jpg)
https://blogs.office.com/2016/12/02/accessibility-in-office-365-enabling-greater-digital-inclusion/
Cognitive services in Microsoft Office
![Page 56: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/56.jpg)
Facebook’s alternatives…
Image may contain: dog, outdoor and nature
https://code.facebook.com/posts/561187904071636
![Page 57: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/57.jpg)
Adding automated content in context…
https://research.googleblog.com/2016/05/aw-so-cute-allo-helps-you-respond-to.html
![Page 58: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/58.jpg)
https://www.videobreakdown.com/
Understanding and fixing video automatically…
![Page 59: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/59.jpg)
https://www.videobreakdown.com/
Transcripts were just a start…
![Page 60: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/60.jpg)
https://www.videobreakdown.com/
People, topics, sentiments…
![Page 61: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/61.jpg)
https://www.newscientist.com/article/2113299-googles-deepmind-ai-can-lip-read-tv-shows-better-than-a-pro/?sf43896303=1
https://arxiv.org/pdf/1611.05358v1.pdf
46.8% vs 12.4% success rate
![Page 62: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/62.jpg)
It is time for us to go and play!🕹
![Page 63: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/63.jpg)
The question of whether computers can think is like the question of whether submarines can swim.
— Edsger W. Dijkstra
![Page 64: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/64.jpg)
People are freaking out!
![Page 65: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/65.jpg)
https://www.bleepingcomputer.com/news/security/researcher-breaks-recaptcha-using-googles-speech-recognition-api/
![Page 66: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/66.jpg)
Learning from data… http://image-net.org/
![Page 67: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/67.jpg)
Understanding the human aspect… https://github.com/openimages/dataset
![Page 68: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/68.jpg)
Refining the data with language
https://research.googleblog.com/2016/09/show-and-tell-image-captioning-open.html
![Page 69: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/69.jpg)
Compare and enhance…
![Page 70: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/70.jpg)
Detect syntax, mix and match
![Page 71: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/71.jpg)
Add visual information
![Page 73: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/73.jpg)
![Page 74: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/74.jpg)
![Page 75: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/75.jpg)
Verification Result:JSON:[{"isIdentical":false,"confidence":0.01 }]
Verify Faces
![Page 76: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/76.jpg)
Cluster automatically…
![Page 77: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/77.jpg)
![Page 78: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/78.jpg)
Add quality by filtering with context…
https://www.microsoft.com/cognitive-services/en-us/custom-recognition-intelligent-service-cris
![Page 79: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/79.jpg)
Our job right now is to create interfaces that are simple, human and fun to use…
![Page 80: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/80.jpg)
Machines and code are there to help humans communicate better.
The more useful our “intelligent” solutions are, the easier it will be for people to stop fearing innovation…
🎙
![Page 81: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/81.jpg)
We need to use our skills, knowledge and products to give people a sense of interaction and data ownership.
🔬
![Page 82: The Soul in The Machine - Developing for Humans](https://reader031.vdocument.in/reader031/viewer/2022030313/58ce724b1a28abdc578b5b67/html5/thumbnails/82.jpg)
It is up to us to make this revolution one that improves all mankind, and not only makes some quick money and shows us more ads.
9