Building a social networkwith meetup.com

Roland Nelet Insight Data Science

Data channels

Member

Member ID visited

bio

country, city state, lat,lon

name

Member ID

topics

topic name

topic

topic IDURL key

created

event ID

lat,lon

comments

event name

event

event IDtopic nameevent URL

group ID

group

event name

group

event ID

group ID

RSVP

response

Goal : Assess similarity between users

Rich will meetup with Wine Lovers in Phillie in Philadelphia, PA

Jake will meetup with Wine Lovers in Phillie in Philadelphia, PA

Wine Lovers

Rich Jake

RSVP’d RSVP’d

Friends??

Query : Have Rich and Jake attended common meetup events ?How many ?

Data transformation : JSON to CSV

name rating city state ...

SF PHP 4.3 San Franciso CA ...

... ... ... ... ...

[{"rating": 4.3, "topics": [{"name": "PHP", "urlkey": "php", "id": 455}, {"name": "Software Development", "urlkey": "softwaredev", "id": 3833}, {"name": "LAMP", "urlkey": "lampsoftware", "id": 10164}, {"name": "Web Technology", "urlkey": "web", "id": 10209}, {"name": "Technology", "urlkey": "technology", "id": 10579}, {"name": "Web Development", "urlkey": "web-development", "id": 15582}, {"name": "Programming", "urlkey": "programming", "id": 17627}], "timezone": "US/Pacific", "organizer": {"name": "Mike Tougeron", "member_id": 2267793}, "id": 120903, "category": {"shortname": "tech", "name": "tech", "id": 34}, "city": "San Francisco", "lon": -122.4000015258789, "state": "CA", "utc_offset": -25200000, "name": "SF PHP” , ….

API

Data Pipeline

Local File System

PREPROCESSING

JSON CSV HBASE TABLE

BATCH LAYER

QUERIESDATA PRODUCT

recommendations

About me