making your app see with mobile vision api
TRANSCRIPT
![Page 1: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/1.jpg)
RAMON RABELLO CEO @ VISYO
MAKING YOUR APP SEE WITH MOBILE VISION API
![Page 2: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/2.jpg)
RAMON RABELLOabout.me/ramonrabello
Agile Community Active Member
GDG Brasília Organizer
Senior Developer ~10 years
![Page 3: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/3.jpg)
HOW DO WE SEE?
![Page 4: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/4.jpg)
![Page 5: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/5.jpg)
HOW DO MACHINES SEE?
![Page 6: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/6.jpg)
![Page 7: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/7.jpg)
WHAT IS COMPUTER VISION?
![Page 8: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/8.jpg)
HOW MACHINES UNDERSTAND THE WORLD
![Page 9: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/9.jpg)
![Page 10: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/10.jpg)
COMPUTER VISION IS EVERYWHERE!
![Page 11: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/11.jpg)
ON ROBOTICS.
![Page 12: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/12.jpg)
ON SECURITY.
http://www.eecs.qmul.ac.uk/assets/img/uploads/page-image/behaviour.png
![Page 13: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/13.jpg)
ON SOCIAL NETWORKS.
![Page 14: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/14.jpg)
ON MEDICINE.
![Page 15: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/15.jpg)
ON GAMING.
![Page 16: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/16.jpg)
ON CARS.
![Page 17: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/17.jpg)
AND ALSO ON MOBILE.
![Page 18: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/18.jpg)
MOBILE VISION API OVERVIEW
![Page 19: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/19.jpg)
OVERVIEW COMMON FUNCTIONALITY FACE API BARCODE API TEXT API (OCR)
![Page 20: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/20.jpg)
COMMON FUNCTIONALITY EVENT-DRIVEN PIPELINE FACE DETECTOR BARCODE DETECTOR TEXT DETECTOR
![Page 21: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/21.jpg)
FACE API WHAT CAN WE DO WITH FACES?
![Page 22: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/22.jpg)
FACE TRACKING
![Page 23: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/23.jpg)
LANDMARKS DETECTION
![Page 24: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/24.jpg)
FACE CLASSIFICATIONS EYES OPENED
0.0 1.0
![Page 25: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/25.jpg)
FACE CLASSIFICATIONS SMILLING
0.0 1.0
![Page 26: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/26.jpg)
FACE ORIENTATION POSE ANGLE ESTIMATION
Y
ZX
![Page 27: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/27.jpg)
BARCODE API WHAT TO DO WITH BARCODES?
![Page 28: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/28.jpg)
BARCODE TRACKING
FORMATS SUPPORTED
![Page 29: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/29.jpg)
TEXT API READING TEXT FROM IMAGES
![Page 30: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/30.jpg)
READING TEXT FROM IMAGES
18+ LANGUAGES SUPPORTED
![Page 31: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/31.jpg)
TEXT STRUCTURE
![Page 32: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/32.jpg)
MOBILE VISION API USAGE 1. ADD DEPENDENCIES 2. ADD META-DATA ON MANIFEST 3. CREATE DETECTOR 4. CHECK IF DETECTOR IS OPERATIONAL 5. CREATE FRAME 6. DETECT FACES
![Page 33: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/33.jpg)
ADD DEPENDENCIES build.gradle
dependencies {
…
compile 'com.google.android.gms:play-services-vision:{version}'
…
}
![Page 34: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/34.jpg)
ADD META-DATA ON MANIFEST
AndroidManifest.xml
<application…> <meta-data android:name="com.google.android.gms.vision.DEPENDENCIES" android:value="face" />
</application>
![Page 35: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/35.jpg)
CREATE DETECTOR onCreate()
FaceDetector faceDetector = new FaceDetector.Builder(context) .setTrackingEnabled(false) .setProminentFaceOnly(false) .setMode(FaceDetector.FAST_MODE) .setClassificationType(FaceDetector.ALL_CLASSIFICATIONS) .setLandmarkType(FaceDetector.NO_LANDMARKS) .build();
![Page 36: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/36.jpg)
CHECK IF DETECTOR IS OPERATIONAL
onCreate()
faceDetector.isOperational(){
// code to detect faces here
}
downloads a native library, when run for the first time.
![Page 37: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/37.jpg)
CREATE FRAME
Bitmap bitmap = …; // read Bitmap
Frame frame = new Frame.Builder() .setBitmap(bitmap) .build();
onCreate()
![Page 38: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/38.jpg)
DETECT FACES
SparseArray<Face> faces = detector.detect(frame);
// face(s) detected if (faces.size() > 0){
}
onCreate()
![Page 39: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/39.jpg)
DEMO THE FACEMINATOR
/visyo/faceminator/
![Page 40: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/40.jpg)
WHAT’S NEXT? MOBILE VISION GUIDE https://developers.google.com/vision/
![Page 41: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/41.jpg)
WHAT’S NEXT? VISION SAMPLES https://github.com/googlesamples/android-vision
![Page 42: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/42.jpg)
WHAT’S NEXT? DEVBYTES https://www.youtube.com/androiddevelopers
![Page 43: Making your app see with Mobile Vision API](https://reader031.vdocument.in/reader031/viewer/2022021813/586f759a1a28ab10258b6103/html5/thumbnails/43.jpg)
THANKS!
goo.gl/v5D0mg
@visyosolutions
/visyo
goo.gl/VBJTIh
@gdgbrasilia
/gdgbrasilia