wh2014 session: mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”
DESCRIPTION
Wireless Health 2014 Conference Technical Session 4 featuring speaker Adam Samaniego.TRANSCRIPT
![Page 1: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/1.jpg)
WLSACONVERGENCE SUMMIT
SMARTPHONE BASED RETINAL IMAGING
ADAM SAMANIEGO, COMPUTER VISION AND COMPUTATIONAL IMAGING LAB
![Page 2: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/2.jpg)
Adam Samaniego,
Computer Vision and Computational Imaging Lab
Smartphone based retinal imaging
2
Funding: NSF-IIS grant 1116718 and the Norman Hackerman Advanced Research Program
Samaniego, Adam, Vivek Boominathan, Ashutosh Sabharwal, and Ashok Veeraraghavan. “mobileVision: A Face-mounted, Voice-activated, Non-mydriatic Lucky Ophthalmoscope.” Wireless Health 2014.
![Page 3: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/3.jpg)
Billions of Users
3
Src: http://www.emarketer.com/Article/Smartphone-Users-Worldwide-Will-Total-175-Billion-2014/1010536
![Page 4: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/4.jpg)
Billions of Cameras
4
Src: http://www.emarketer.com/Article/Smartphone-Users-Worldwide-Will-Total-175-Billion-2014/1010536
![Page 5: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/5.jpg)
Just an Image
5
Src: http://www.topconmedical.com/products/trcnw8highresolutionnonmydsystem.htm
![Page 6: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/6.jpg)
Overview
• Unmet Healthcare Needs
• mobileVision System
• Emerging W.H. Ecosystem
6
![Page 7: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/7.jpg)
Problem
• Diabetes: the leading cause of new U.S. cases of blindness among adults ages 20–74
• 80% Chance of developing diabetic retinopathy
• Complications are 90% preventable through early detection, but require frequent retinal screening
Src: http://diabetes.niddk.nih.gov/dm/pubs/statistics/#fast, scohen125 and calhoun16 on retinagallery.com
7
![Page 8: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/8.jpg)
Problem
• Macular Degeneration: causes vision loss by destroying macula, ages 60+ at higher risk
• Global cost of over $300 Billion
• Can progress quickly and vision loss is irreversible; can be slowed if detected early, as by retinal screening
Src: http://www.myretinalinstitute.com/images/, https://www.nei.nih.gov/eyedata/amd.asp, http://www.eyeconsultants.net/UserFiles/severe_mac_gen.jpg
8
![Page 9: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/9.jpg)
Topcon TRC-NW8
• ±45°field-of-view
• 24.5kg, > $10,000
• Easy to use
• Representative of clinical retinal imaging standard
Src: http://www.topconmedical.com/products/trcnw8highresolutionnonmydsystem.htm
9
![Page 10: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/10.jpg)
mobileVision
• ±45°(stitched)
• 1kg, w/ smartphone
• Portable, face-mounted
• Algorithmic pipeline
• Improve robustness
• Mitigate artifacts
• Stitch final panorama
10
![Page 11: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/11.jpg)
Optics: Overview
11
Fixation Targets
LED Coupled Fiber
Imaging Lenses
Left Eye
Right Eye
SmartphoneCamera
Illumination Lens
Mirror
CrossedPolarizers
![Page 12: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/12.jpg)
User Interface
12
![Page 13: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/13.jpg)
Example Images
13
![Page 14: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/14.jpg)
Feature Matching
14
![Page 15: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/15.jpg)
Single-view Fusion
15
![Page 16: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/16.jpg)
Fused Views
16
![Page 17: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/17.jpg)
Stitching
17
![Page 18: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/18.jpg)
Stitching
18
![Page 19: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/19.jpg)
Stitching
19
10°
±45°
![Page 20: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/20.jpg)
Resolution Testing
20
Model Eye with USAF-1951 Res. Chart “retina”
![Page 21: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/21.jpg)
Resolution Testing
21
Modulation Transfer Function (As simulated refractive error varies)
• Smartphone auto-focus allows for simulated refractive error between +13D and -6D
(23.5μm line width resolvable at 10% contrast)
![Page 22: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/22.jpg)
Overview
• Unmet Healthcare Needs
• mobileVision System
• Emerging W.H. Ecosystem
22
![Page 23: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/23.jpg)
W.H. Ecosystem
• Bastawrous et al.
• Peek Vision
• Pamplona et al.
• EyeNetra
• Myung et al.
23
Full references on “References” Slide
![Page 24: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/24.jpg)
Not Just a Phone
24
![Page 25: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/25.jpg)
References
• Samaniego, Adam, Vivek Boominathan, Ashutosh Sabharwal, and Ashok Veeraraghavan. "mobileVision: A Face-mounted, Voice-activated, Non-mydriatic Lucky Ophthalmoscope." Wireless Health 2014.
• Peek Vision. (2013). Retrieved October 20, 2014, from http://www.peekvision.org/• EyeNetra - Eye Care for 2.4 billion people in need. (2013, January 1). Retrieved October 20, 2014, from
http://eyenetra.com/product-netrag.html• Myung, David, Alexandre Jais, Lingmin He, Mark S. Blumenkranz, and Robert T. Chang. "3D Printed Smartphone Indirect Lens
Adapter for Rapid, High Quality Retinal Imaging." Journal of Mobile Technology in Medicine 3, no. 1 (2014): 9-15.
25
![Page 26: WH2014 Session: Mobile vision a face-mounted, voice-activated, non-mydriatic “lucky”](https://reader038.vdocument.in/reader038/viewer/2022110309/55842d2dd8b42a785e8b4ef9/html5/thumbnails/26.jpg)
WLSACONVERGENCE SUMMIT
www.wirelesshealth2014.org