umang mehta - emotion ai developer day 2016
TRANSCRIPT
Affectiva Emotion SDK for Windows
Umang MehtaSoftware EngineerAffectiva
Agenda
@affectiva
• Overview• Getting Started• Architecture• Sample Applications• Live Demo• Use Cases• Helpful Resources• Questions
SDK Overview
@affectiva
Nuanced facial expressions
@affectiva
A range of emotions
Valence: how positive or negative a person’s facial expressions
Engagement: overall level and intensity of the emotion
@affectiva
A person’s appearance
Gender:identifies the human perceptionof gender expression
Ethnicity: Person’s ethnicity
@affectiva
Age:Estimate age bucket (10 yrs)
Glasses: presence of eye or sun glasses
And emojis
Laughing Smiley Relaxed Wink
Kissing Stuck Out Tongue Stuck Out Tongue and Winking Eye Scream
Flushed Smirk Disappointed Rage
@affectiva
Software and Hardware Requirements
@affectiva
Supported Processor Architecture
• Windows 32 bit (x86)• Windows 64 bit (x64)
Languages Supported
• CSharp• C++
Hardware Requirement (Recommended)
• Processor, 2 GHz• RAM, 1 GB• Disk Space (min) : 950 M
Supported Operating System
• Windows 7 and above
How to get started?
@affectiva
• Download the SDK - http://developer.affectiva.com/
• Run the Installer
Architecture
@affectiva
Detector
Frame Photo Video
Camera
Listeners/ CallBacks
Image Listener • Face Listener Process Status Listener
Life-cycle of Detector Object
@affectiva
• Start the detector• Set the location of the model on disk• Set the classifiers• Process the file/ stream• Callback when something happens• Stop the detector
Sample Applications:
@affectiva
• AffdexMe - Analyzes input camera stream
- Multi-face enabled - Small/Large Face Mode enable - Enabled Classifiers: Emotions, Expressions, Emojis, Gender and Glasses - Github : https://github.com/Affectiva/affdexme-win Download pre-build: http://developer.affectiva.com/sampleapps/
• csharp-sample-app
- Analyzes a photo - Analyzes a recorded file - Analyzes input camera stream - Ability to switch Face Mode - Enabled Classifiers: Emotions, Expressions, Emojis, Gender, Glasses, Age
and Ethnicity - Github: https://github.com/Affectiva/csharp-sample-apps
AffdexMe Demo
@affectiva
Live Coding Exercise
Requirements:• IDE : Visual Studio 2015/ 2013• AffdexSDK : http://developer.affectiva.com/• Integrated Web Camera/ External Web Camera
Camera Detector Demo
USE CASES
@affectiva
Cloverleaf Media, LLCUnique sensory concert experience
Captures real time, crowd-sourced emotive information
Displays data with a dazzling, interactive LED light show to transform the traditional concert experience
Cloverleaf Media, LLC
Gather insightsshopper emotions, age, gender, ethnicity
Personalized experienceAds in digital signage on retail shelves adapt to this data
@affectiva
Helpful Resources
• Online documentation: http://developer.affectiva.com• Q&A on StackOverflow: http://stackoverflow.com/questions/tagged/affdex-sdk• Chat on Gitter: https://gitter.im/Affectiva/sdk• Source code examples: https://github.com/affectiva?q=sample• Emotion-enabled apps: http://developer.affectiva.com/poweredbyaffdex/
Thank You!