cortana intelligence suite for projects & hacks
TRANSCRIPT
Lee StottSnr. Technical Evangelist Microsoft
@Lee_Stott
• Personalized, friendly, approachable, natural •
•
•
• Predictive, current, and familiar •
•
• Always available, always contextual •
•
•
Microsoft
Cognitive
ServicesGive your apps
a human side
From faces to feelings, allow your apps to understand images and video
Hear and speak to your users by filtering noise, identifying speakers, and understanding intent
Process text and learn how to recognize what users want
Tap into rich knowledge amassed from the web, academia, or your own data
Access billions of web pages, images, videos, and news with the power of Bing APIs
Cortana Intelligence SuiteIntelligent Apps require Intelligent Solutions
Intelligence
Dashboards &
Visualizations
Information
Management
Big Data Stores Machine Learning
and Analytics
CortanaEvent Hub
HDInsight
(Hadoop and
Spark)
Stream Analytics
Data Sources
Apps
Sensors and devices
Data Intelligence Action
People
Automated Systems
Apps
Web
Mobile
Bots
Bot
Framework
SQL Data
WarehouseData CatalogData Lake
Analytics
Data Factory Machine
LearningData Lake Store
Blob Store
Cognitive
Services
Power BI
microsoft.com/cognitive
Start coding
http://www.microsoft.com/cognitive
Bot Connector Service
Connect your bot(s) seamlessly to text/sms, Office 365 mail, Skype, Slack, Twitter and more
A service to register your bot, configure channels and publish to the Bot Directory
Bot Builder SDK
Everything you need to build
great dialogs within your Node.js
or C# bot
An open source SDK hosted
on GitHub
Bot Directory
Discover, try, and add bots to
conversation experiences
A public directory of bots
registered and approved with Bot
Framework
www.botframework.com
Start coding
Vision APIsAnalyze an Image
OCR
Get Thumbnail
Analyze Image Service
Start coding
OCR Service
OCR – Example
JSON:{"language": "en","orientation": "Up","regions": [{"boundingBox": "41,77,918,440","lines": [{"boundingBox": "41,77,723,89","words": [{"boundingBox": "41,102,225,64","text": "LIFE"},{"boundingBox": "356,89,94,62","text": "IS"},{"boundingBox": "539,77,225,64","text": "LIKE"}
. . .
TEXT:LIFE IS LIKERIDING A BICYCLETO KEEP YOUR BALANCEYOU MUST KEEP MOVING
https://blogs.msdn.microsoft.com/uk_faculty_connection/2016/03/30/using-python-and-project-oxford-vision-api-to-ocr-a-online-image-from-any-url/
Start coding
Face APIsDetection
Verification
Grouping
Identification
Face API – DetectionDetection Result:JSON:[
{"faceRectangle": {"width": 109,"height": 109,"left": 62,"top": 62
},"attributes": {
"age": 31,"gender": "male","headPose": {
"roll": "2.9","yaw": "-1.3","pitch": "0.0"
}"faceLandmarks": {"pupilLeft": {
"x": "93.6","y": "88.2"
},"pupilRight": {
"x": "138.4","y": "91.7"
},...
Verification Result:JSON:[{"isIdentical":false,"confidence":0.01 }]
Face API – Verification
Face API – Grouping
https://blogs.msdn.microsoft.com/martinkearn/2016/03/22/introducing-howhappy-co-uk/
Start coding
Voice Recognition
Language Understanding Intelligent ServiceDetermine Intent
Detect Entities
Improve Models
Language Understanding Intelligent Service
https://blogs.msdn.microsoft.com/uk_faculty_connection/2016/03/29/getting-started-using-microsoft-project-oxford-language-understanding-intelligent-service-luis-3-2/
Start coding
http://cortanaintelligence.com
http://gallery.cortanaintelligence.com
http://www.microsoft.com/cognitive
http://aka.ms/azureforeducation