vision for the blind. stat 19 sem 2. 263057202. talk 1. vision for the blind. stat 19 sem 2....

15
Vision for the Blind Vision for the Blind . . Stat 19 SEM 2. 263057202. Stat 19 SEM 2. 263057202. Talk 1. Talk 1. Alan Yuille. Alan Yuille. [email protected] [email protected] UCLA. Dept. Statistics and UCLA. Dept. Statistics and Psychology. Psychology. www.stat.ucla/~yuille www.stat.ucla/~yuille

Upload: lynne-malone

Post on 18-Dec-2015

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

Vision for the BlindVision for the Blind..Stat 19 SEM 2. 263057202. Talk Stat 19 SEM 2. 263057202. Talk

1.1.

Alan Yuille. [email protected] Yuille. [email protected]

UCLA. Dept. Statistics and UCLA. Dept. Statistics and Psychology.Psychology.

www.stat.ucla/~yuillewww.stat.ucla/~yuille

Page 2: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

Goal of the Course.Goal of the Course.

• How can technology and neuroscience How can technology and neuroscience help the blind and disabled?help the blind and disabled?

• (A) Artificial Intelligence systems.(A) Artificial Intelligence systems.

• (B) Brain Implants. Neural Prostheses.(B) Brain Implants. Neural Prostheses.

• Introduce and review the state of the Introduce and review the state of the art.art.

• Today, an overview.Today, an overview.

Page 3: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

Course Mechanisms.Course Mechanisms.

• Maximum work load is 3 hours per week.Maximum work load is 3 hours per week.

• Grading: Pass/Fail.Grading: Pass/Fail.

• Requirement. Don’t miss more than 2 Requirement. Don’t miss more than 2 lectures.lectures.

• Reading assignments. Short reports.Reading assignments. Short reports.

Page 4: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

My Research Interests are:My Research Interests are:

• Designing computer vision systems Designing computer vision systems (artificial intelligence).(artificial intelligence).

• Understanding how biological vision Understanding how biological vision systems work. systems work.

• I also work with a company that builds I also work with a company that builds prototype systems for the blind.prototype systems for the blind.

• Collaborate with the Smith-Kettlewell Collaborate with the Smith-Kettlewell Eye Research Institute (San Francisco).Eye Research Institute (San Francisco).

Page 5: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

What is Vision?What is Vision?

• Aristotle “to know what is where by Aristotle “to know what is where by looking”.looking”.

• Vision is information processingVision is information processing. .

• Light rays that reach your eyes carry Light rays that reach your eyes carry information about the external world.information about the external world.

• Vision decodes the light rays and Vision decodes the light rays and reconstructs the world.reconstructs the world.

• Vision is a very complex task. Harder than Vision is a very complex task. Harder than Mathematics? More on vision next lecture.Mathematics? More on vision next lecture.

Page 6: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

What would you miss most if What would you miss most if you went blind?you went blind?

• Probably the ability to Probably the ability to detect and read detect and read text.text.

• NavigationNavigation is possible using a cane is possible using a cane and/or and/or

guide dog. guide dog. Recognize peopleRecognize people by their by their voices. voices. Hear oncoming traffic.Hear oncoming traffic.

ExperimentExperiment:: Spend an hour with your Spend an hour with your eyes closed.eyes closed.

Page 7: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

What can blind people see if What can blind people see if they recover their sight?they recover their sight?

• Mike May is one of the very few Mike May is one of the very few people who attained his sight after people who attained his sight after being blind.being blind.

• (Successful businessman & skier).(Successful businessman & skier).• But how well can he use vision to get But how well can he use vision to get

information about the world?information about the world?• Infant’s vision systems develop in Infant’s vision systems develop in

stages. Some abilities develop at 1 stages. Some abilities develop at 1 month, others at 3 months, etc.month, others at 3 months, etc.

Page 8: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

Mike MayMike May• Mike May can see light, but required Mike May can see light, but required

extensive training before he could extensive training before he could distinguish a cube from a sphere.distinguish a cube from a sphere.

• He cannot recognize faces (even his wife He cannot recognize faces (even his wife and children).and children).

• It took two years before his vision helped It took two years before his vision helped his skiing.his skiing.

• Handout.Handout. Interview with Mike May. Interview with Mike May.• Mike Mays’ Journal: Mike Mays’ Journal:

www.sendergroup.com/mike.htmwww.sendergroup.com/mike.htm• Radio Interview. Radio Interview. http://http://psy.ucsd.edupsy.ucsd.edu/~fine/~fine

Page 9: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

How Big is the Problem?How Big is the Problem?

• Legally Blind population of the US is 600-Legally Blind population of the US is 600-900,000. (20/200 best correctly acuity).900,000. (20/200 best correctly acuity).

• At least, 3,000,000 people have low At least, 3,000,000 people have low vision.vision.

• These numbers are predicted to double in These numbers are predicted to double in the next ten years!the next ten years!

• Eyesight gets worse with age – and Eyesight gets worse with age – and people live longer.people live longer.

Page 10: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

Artificial Intelligence Artificial Intelligence Solutions.Solutions.• Navigation: Global Navigation: Global

Positioning Positioning Satelites (GPS). Satelites (GPS). (Loomis. UCSB).(Loomis. UCSB).

Page 11: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

Computer Vision Computer Vision

• Digital Camera + Digital Camera + Portable Computer Portable Computer + +

Speech Speech Synthesizer.Synthesizer.

Page 12: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

Brain Implants.Brain Implants.

• Artificial Retina:Artificial Retina:

• Connected to (i) Connected to (i) the retina, (ii) the the retina, (ii) the optic nerve, or (iii) optic nerve, or (iii) the cortex.the cortex.

• Dr. Dobelle.Dr. Dobelle.

• Portugal.Portugal.

Page 13: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

Vision to Tactile.Vision to Tactile.• Dr. Bach y Rita. (Ex: Smith-Dr. Bach y Rita. (Ex: Smith-

Kettlewell).Kettlewell).

• 1970. Project an image 1970. Project an image onto the back of a blind onto the back of a blind person. Claim: could person. Claim: could recognize faces.recognize faces.

• Few tactile receptors on Few tactile receptors on back. Better to use back. Better to use fingertips, lips, or tongue.fingertips, lips, or tongue.

• Erik Weihenmayer. Erik Weihenmayer. Climber.Climber.

Mt. Everest.Mt. Everest.

Page 14: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

Neural Prostheses: Neural Prostheses:

• Control by Control by Thought. Thought.

• Movement Movement Planning Neurons.Planning Neurons.

• Clint Eastwood Clint Eastwood film. Firefox.film. Firefox.

Page 15: Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Vision for the Blind. Stat 19 SEM 2. 263057202. Talk 1. Alan Yuille. yuille@stat.ucla.edu UCLA

Summary.Summary.

• The course will describe these artificial The course will describe these artificial intelligence and biological techniques.intelligence and biological techniques.

• Can describe other topics: e.g. Cochlear Can describe other topics: e.g. Cochlear implants.implants.

• Mike Mays’s handout. Web journal:Mike Mays’s handout. Web journal:

• www.sendergroup.com/mike.htmwww.sendergroup.com/mike.htm

• Radio Interview: Radio Interview: http://http://psy.ucsd.edupsy.ucsd.edu/~fine/~fine

• Contact information: [email protected] information: [email protected]