metalayer presentation at techcrunch disrupt ny 2012
DESCRIPTION
The presentation from metaLayer's API workshop at TechCrunch Disrupt 2012.TRANSCRIPT
![Page 1: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/1.jpg)
NY:DISRUPT API HACKATHON
![Page 3: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/3.jpg)
BIG DATA IS
BIG
![Page 4: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/4.jpg)
PUNY HUMANS ARE
PUNY
![Page 5: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/5.jpg)
![Page 6: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/6.jpg)
![Page 8: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/8.jpg)
by Kate Starbird, Bill Morris, Chris Danforth and GeoSprocket
![Page 9: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/9.jpg)
![Page 10: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/10.jpg)
Data Sets + APIs + Visualizations
Made Simple.
![Page 11: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/11.jpg)
Data Sets + APIs + Visualizations
Made Simple.
![Page 12: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/12.jpg)
We’ve got hoodies (as many as you can take)
Prize! Apple TV for best in show using our Image API
Prize! Kindle for best in show using our Text API
We’re hiring!
SCHWAG ALERT
![Page 13: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/13.jpg)
![Page 14: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/14.jpg)
![Page 15: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/15.jpg)
Using the MetaLayer Text API
![Page 16: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/16.jpg)
Our Text API offers methods for extracting contextual features from text documents using various forms of entity extraction.
•Find place names in documents and turn them into lat/lon coordinates for mapping
•Perform auto-tagging and classification using uncommon keywords
•Utilize our sentiment analysis algorithms
![Page 17: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/17.jpg)
Built using pyNLTK (python natural language toolkit)
Brown Corpus (Brown University Standard Corpus of Present-Day American English)
Extended to deal with short form text like Tweets
Corpus can be extended to optimize the API for specific use cases.
60,000 items per minute on a single server
Scales horizontally for ‘bigger data’ streams
ARCHITECTURE
![Page 18: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/18.jpg)
Sentiment Analysis
Tagging (Uncommon Keywords)
Location Disambiguation
Bundle (a Buffet of Awesome)
FUNCTIONS
![Page 19: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/19.jpg)
Response Example: { "status": "success", "method": "bundle", "service": "datalayer", "response": { "datalayer": { "text": "this is some excellent text that needs to be tagged especially if we can pick the location Philadelphia PA out of it", "locations": [ { "latitude": 39.952300000000001, "confidence": 10.0, "name": "Philadelphia, PA, US", "longitude": -75.162400000000005 } ], "sentiment": 0.63960214906683133, "tags": [ "excellent", "text", "location", "Philadelphia", "PA" ] } } }
FORMAT
Post: “This is some excellent text that needs to be tagged especially if we can pick the location Philadelphia, PA out of it.”
![Page 20: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/20.jpg)
FORMAT
Post: “This is some excellent text that needs to be tagged especially if we can pick the location Philadelphia, PA out of it.”
Response Example: { "status": "success", "method": "bundle", "service": "datalayer", "response": { "datalayer": { "text": "this is some excellent text that needs to be tagged especially if we can pick the location Philadelphia PA out of it", "locations": [ { "latitude": 39.952300000000001, "confidence": 10.0, "name": "Philadelphia, PA, US", "longitude": -75.162400000000005 } ], "sentiment": 0.63960214906683133, "tags": [ "excellent", "text", "location", "Philadelphia", "PA" ] } } }
![Page 21: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/21.jpg)
Using the MetaLayerImage API
![Page 22: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/22.jpg)
Our Image API offers methods for extracting contextual features from photos and image documents.
•Find all the objects in a photo along with their relative coordinates in the frame
•Extract color/histogram profiles•Parse text from the image to make it actionable
![Page 23: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/23.jpg)
Built using Teeseract OCR with a proprietary training set.
Extensible and Adaptive
20,000 items per minute on a single server
Scales horizontally
Parses JPG and PNG documents
ARCHITECTURE
![Page 24: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/24.jpg)
Color Profile (all colors in an image)
Histogram (the distribution of color in an image)
Optical Character Recognition (OCR)
Object Recognition
Bundle (Awesome Reloaded!)
FUNCTIONS
![Page 25: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/25.jpg)
MetaLayer Dashboard API*Coming soon young, Padawan.*
![Page 26: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/26.jpg)
Our Dashboard API offers methods for interacting with MetaLayer Dashboard products through scripting.
•Remotely create and configure dashboard environments•Push data to RESTful Dashboard hook (ex. real-time streams) •Poll/Request data from Dashboard hook (ex. historic data)•Analytics from Dashboard activity streams•Create data mashups, consume the JSON output
![Page 27: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/27.jpg)
Dashboard is build with Python and Django
Adds GUI elements to working with APIs
Drag and drop data science. Anyone can use it to mash up data.
Background tasks distributed across horizontal servers.
ARCHITECTURE
![Page 28: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/28.jpg)
Control Administration & User Roles
Modify GUI Features
Data Acquisition
Data Consumption
Analytics
FUNCTIONS
![Page 29: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/29.jpg)
API.METALAYER.COM
![Page 31: MetaLayer Presentation at TechCrunch Disrupt NY 2012](https://reader034.vdocument.in/reader034/viewer/2022052618/554c0651b4c9053f078b526b/html5/thumbnails/31.jpg)