like partying? your face says it all. predicting place ambiance from profile pictures
TRANSCRIPT
Like Partying? Your Face Says It All Predicting Place AMBIANCE From
Profile Pictures
Miriam Redi, Daniele Quercia, Lindsay Graham, Samuel Gosling
AN IMAGE IS WORTHA THOUSAND
WORDS
A FACE IMAGE IS WORTH AN ENTIRE STORY
A FACE IMAGE IS BIOGRAPHY
IDENTITY
EMOTIONS
PERSONALITY
COMPETENCE
DEMOGRAPHICS
PLACE’S AMBIANCE
PREFERENCESPREDICTION
COMPUTER VISION
VIS
UA
L
FEA
TU
RES
AMBIANCE
Can the AMBIANCE of a Place be Determined by the User Profiles of the
People Who Visit It?ICWSM 2011
STARTING POINT
STARTING POINT
ON THE SPOT RATINGS
FACE-DRIVENRATINGS
49FOURSQUAR
E PLACES
(AUSTIN, TX)z
25PROFILE
PICTURES
PER PLACE
72 AMBIANC
E DIMENSIO
NS
RESEARCH QUESTION
Can the AMBIANCE of a Place be Determined by an Algorithm based on the
User Profiles of the People Who Visit the place?
25PROFILE
PICTURES
PER PLACE
72 -> 18 AMBIANCERATINGS
25x49PROFILE
PICTURES
REGRESSION
Visual Features
APPROACH
VISUAL FEATURES
1. Aesthetic Features
PHOTOGRAPHIC QUALITY
BRIGHTNESS, SATURATION, CONTRAST
IMAGE ORDER
NUMBER OF CIRCLES
SYMMETRY
2. Colors
RED = Excitement
YELLOW = Cheerfulness
BLUE = Comfort, Wealth
GREEN = Calm, Freshness
3. Facial Expression
ANGRY
NEUTRAL
HAPPY
SMILING
SAD
DISGUSTED
4. Demographics
AGE
GENDER
RACE
Face ++ Software
5. Self-Presentation
PRESENCE OF GLASSES
PRESENCE OF FACE
FACE CENTRALITY
UNIQUENESS
FACE TILT
/CLOSE-UP FACE POSITION (CLOSE-UP)
MACHINE PREDICTION
EXPERIMENTAL RESULTS
5 MOST DISCRIMINATIVE FEATURES, LEAVE-ONE-OUT
HIGHLY PREDICTABLE FRIENDLY, SOCIAL, ATTRACTIVE - low
variability
MODERATELY PREDICTABLE CREATIVE, PARTY - high diversity
AMBIANCE PREDICTION: Man VS Machine
10 8COMPOSITIONAL
STATISTICSDEMOGRAPHICS AND
COLOR
STEREOTYPES: Man and Machine Disagree
FEMALE, BRIGHTNESS
FEMALE
Romantic
Attractive(Pick-Up)
Open-Minded BRIGHTNESS
REDWARMER COLORS
BOTH GENDERS
PRESENCE OF CIRCLES
PLACES FEATURESFEATURES
ALGORITHM HUMAN
STEREOTYPES: Man and Machine Agree
OLDER, READING GLASSES
Studying, Reading
FriendlySMILING
OLDER, READING GLASSES
SMILING
StrangeYELLOW, NO FACE YELLOW
PLACES FEATURESFEATURES
ALGORITHM HUMAN
READING FACES
GLASS -BOXES
CHANGING STEREOTYPES
THANK YOU.
www.visionresearchwitch.com
www.researchswinger.org
www.snoopology.comwww.lindsaytgraham.com/