総務省 2018 11 07 · 2020-03-18 · kacorri, hernisa, et al. "people with visual impairment...

23
AI ! 20181115 IBM Research, IBM Fellow

Upload: others

Post on 16-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

AI ��������

�� ���������!

2018�11�15�

�����

IBM Research, IBM Fellow

Page 2: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

����� �����

%

(

)

% )

% %%

% %)

%

% )

6 7 4

598

.

0

1

2

3

2

Page 3: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

8&4�����

World Robot Summit:31<WRS; ��6�����".�$ ���/�(-�)9���/������%*�7��5���2,���

Page 4: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

Money Reader

Page 5: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

������ �� ������ ������� �����

Real-world Accessibility

Page 6: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

Cognitive Assistant

$%�#�������" ���� ���AI���!������������� ��

Page 7: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

NavCog���� ���������

Page 8: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

Think CityName / DOC ID / Month XX, 2018 / © 2018 IBM Corporation 8

Page 9: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

����

Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 2017. Honorable mention

“��������” “$����” “������”

����� "�� �������

! #��

��

Page 10: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

“T-shirt” “Cup”“IBM Research

T-shirt from a women conference.”

“a cup from a conference when I did keynote speech

at San Sebastian.”

���������

Page 11: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

Personal Object Recognizer

Page 12: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

“A green bird sitting on top of a bowl”

Scene Captioning

IBM Research has top entry to MS-COCO Image Captioning Challenge (April 2017)

“�����������”

Page 13: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

“A blue boat is sitting on the side of a building”

“A green bird sitting on top of a bowl”

Scene Captioning

IBM Research has top entry to MS-COCO Image Captioning Challenge (April 2017)

“� ���������������”

“����� ������”

Page 14: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

AI Suitcase

Page 15: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

AI Suitcase

Page 16: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

������������ �

"D6D/

19Fnb�Er�Up�m{]c���h`�w^�h`�uN�

�O~�

2010X��Mj�yz�Up�*D%+.����h

sK��sK�

18th

20th

21st

�ON\ + _R~�

1970XH�yz�Up��avo���TfL

qz�Up����h��RW��;?!�(7D,2D�t��J����kd�� Q|�

-A3��RW �OV}

2011X�(8D.4�B����OV}'(-:

eH^S

18Fn�P^Sp �>D�yz�Up������J����I�a�YxZ�g[�5(.)>D�

�}

1876X�#>1:C5@�qz�Up��&9<0$D'=B]c�il�G��h`

Page 17: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

������������ �

Artificial Intelligence

"D6D/

19Fnb�Er�Up�m{]c���h`�w^�h`�uN�

�O~�

2010X��Mj�yz�Up�*D%+.����h

sK��sK�

18th

20th

21st

�ON\ + _R~�

1970XH�yz�Up��avo���TfL

qz�Up����h��RW��;?!�(7D,2D�t��J����kd�� Q|�

-A3��RW �OV}

2011X�(8D.4�B����OV}'(-:

eH^S

18Fn�P^Sp �>D�yz�Up������J����I�a�YxZ�g[�5(.)>D�

�}

1876X�#>1:C5@�qz�Up��&9<0$D'=B]c�il�G��h`

Page 18: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

AI ������

��: PBS.org article “Ghosts in the Machine”

MIT ��������� ��� ���������

��: TED, Talk by Margalet Michell ��: AI's problem with disability and diversityCBC Radio · September 23, 2017

AI �“!�����$.�%.”���"� �'�����

+�� ,�)���#�-*#�) &(�����

Page 19: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

AI!�����5�

“AI!���G+/H�1��0D���������!����;�AI���<�:���”

�&# �(�)

927.

'$� F4C

!����;�AI

B2�("%)��(�

Watson�E=,@A�*>�+��;�����)���� -?�

201832866https://www.ibm.com/blogs/research/2018/02/mitigating-bias-ai-models/

1

2

3

4

5

Page 20: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the
Page 21: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

;�)CHN'

4.��>�' ;�6FK7�

�������'

�R+!&$ �ROGJ/A �R 8DEM*@ %�0(19��

���=70%�PQ@*

*2007-0(��129<"�I3� �

12�#1�2800��

8DEM*@0(�#19��

NavCog�+!&$�?LB:� 2015-5,TED����

Page 22: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

�������� ���

2010 20302020Cognitive Assistant Lab @ CMU

�&,!%�*+����#) �

標準化?発展期

Apple Siri

Microsoft Seeing AI

�* )��*!+�$,�,

NavCog ������

Watson Vision API

普及?初期

2018

2020��)*$��"()*$��

����� ��������-�',�.

Page 23: 総務省 2018 11 07 · 2020-03-18 · Kacorri, Hernisa, et al. "People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges." Proceedings of the

AI for AccessibilityAI for Accessibility