ml ops on aws - amazon s3© 2018, amazon web services, inc. or its affiliates. all rights reserved....
TRANSCRIPT
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Makoto Shimura
Analytics Specialist SA, Amazon Web Services Japan
2-H1-3-16
ML Ops on AWS
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
About Me
��� (Makoto Shimura)
• �������� �������� ������• ���.'�!��%"�����)+• (&����' -$*����.',• #������
• Amazon Athena• AWS Glue• Amazon SageMaker
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Key Take AwayML ���������5������5���)�(�$�5��"'%��1�7��;=���
�� ��� ��� �6�2���8��+<�:4�AWS ���� ��9.�?����
������������&�)�0,�3/��������*#�!* �->
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda• ML �������������
• ML��������������
• ������������� ����
• ML ������� ����
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML����� �������
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
�����
����
�������ML
���������
�����������
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML =:�8� 3�5������
1. ���+,���&!%"*4��19 �
2. ML �'$( -6 ������?/�$�#� ��2;�����<>���
3. ML '$(�)7.��0����,����
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1.
M
L
L
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
2. ML �$!&/<��I1�!� �A(.ML ��:J�)-!� ������DG�;�E8����,C�������!� �23
!� �=5�����+H����@F���#� !� �%"&�BK�9>���
3� !� �74H��B6�(0'?������7�����!� �H*��
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
3. ML �($)�*.3��7������<��64�1�������/?�($)���&����EF�8��
5:�;0�G,��������C ($)�=B�9��A+���
<��'"%#-@�8�����<��!� )�2>�1��������DH���
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
�����
����
�������ML
���������
�����������
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
�����
ML
� ��������� Kinesis S3
EMR Glue
Redshift Athena QuickSight
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
����&0
ML
�� ����#���� Kinesis S3
EMR Glue
Redshift Athena QuickSight
�� .�$1�!���'������"���(),2�3+���6/*%�-�����45
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML ����� ������
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
�����
����
�������ML
���������
�����������
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
��
����
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
0B• 6?��ML (#)����-��0B23�FI���%*�',����"&#�$���D��0B239>�5<�8�@�GE�B=
• ����0B23�6?&+ ��9A. ��FI���
• ���6?7��#�!*����FI�#�!�C�;�/4�1:H�#�! "$�8�FI���
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
6A• ����.(0�����PD�.(0"6A����EK"N5� ���L�.(0���*#+�+/-�'�Q��3 H �=J�G"F?�
• ��.(0�Q�����C �(�'�I2�!�>�<6A";������
• �� �8�R �6A,1&%"�=B9�@7$%)�4M$%)�:T�;� OS��
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DQ�=6A• 6A��:4�'+/����:4�,)$-0!�8OH��
AB &"(�<���EI�B�������/�.*% ���
• K�,'.���'�$�G3�M��'+/���� ���������'+/�+/#"�?J2
• :4�1��,'.�=6A��C��@N�> ���5L79�=;F�P���
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
��
����
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
��� ������������
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML ����/����G:F�K�• �%���'&����������
• 4M69�?BN� Tensorflow��PO69� 1.4 ���• PO69�3E-�)-.�L2������
• �%���'&��"���!$�����• %�#���1$�"&� R �A���'���1!(��PO69R� Java �>@D
• #������ ���� �������• PO69��1!(��75��QH�8���� ����• ML +%/��*.�� ,1���'J�C�=������I<$"&�;�� %*0�����
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML �%"$5���V@U�Z� cont.• ������ ��� �����%�������
• [L%�.'�2*5!Y9 API %�-I�0'+����• E\�K��2*5!X����� CUDA -�&37!I������S%�.'�2*5�#4�!W���
• �&�"����� ����• Y�*�(�Y�2*5!=G �������8�B<�…
• #������������'!�)$�(����• =GD�OH^!>8���QP)1�2*5!=G����• F;�TN:?��JC�.&,'R�_A��*/6"/ M�]�!��� ������
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DevOps ���%����H�\• Infrastructure as Code: KXA�3�*8=E^�/+1�GQW$=/';�)8=��")+/6E^�?]��#5<�.�����E^@������immutable �NR�)+/6"[����CY
• Microservices: #�%/&.7+-$:��������L��(�4+�P�I!����S>�DZ��#5<�.
• Continuous Delivery: KXA� �99�+5<,+"U���O �3�*8=�JP�"05<$��4*2+M�BT"VF��
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DevOps �rV��ML �*&'9$L�!• Infrastructure as Code:
ML �P�7&278�iO�<XDF$Q�����@c�ne�b�CE$l�����5.9W_^ �aN������7&278�1�,6;gd�k#!���o?S��CE$K\�!mBR
• Microservices: %38(�+6;U[�]��ML 5.9�hj�Y);4�0;/�3:-'/�JS*&'9�fp� "!HI�CE`�=�!��Z�
• Continuous Delivery: S��5.9RM�q�T>$��!����RM�neCE��"�����#����W_A�G>��!������!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
[T� DevOps �ML Ops �?�"]• C`FI�����fU�8.<���3:7+$gn�B��cD$L�����5=*)�WP
• 2�(9>Gm$�"O��'�0�FI�������ES.�+�M#��Gm$�"ek�"�� ���� ES.�+$X�8.<��Nlj���
• .�+Vd�8.<KZ�%5;C`�Aj����4(1)�fU,�6H_�"J��" �Y�
• ibFI�fU8.<� AB -)/$RQ�"�@a\��!h��fU8.<$@^�.5=&�"ek�"
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML Ops ���$&<F�2• Infrastructure as Code:
ML A4E�,�6!K[/B;YUW�9C@1�YULO�Tah����8�/BGMr�YU��K[/B;Xe Mr���4�1 DWH h�"Zj�$)(D!�4�1Xe 1*%���iHg�Mr
• micsoservices: ML �`t]r%=')F-�:0���ks��$�ML lm�2�?�&<D+�.BG�2�?%n���J��R�1'>G*�DD�0
• Continuous Delivery: _�aI%\Q�$Vc������AB 305_�d"�$P�^���oS����:/70�qf�N ��"��b#p�
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML Ops �����C<�)/��• Infrastructure as Code:
• *>,-�B?,-�"��"#�&�C<• '=+7�!�$�20����C<
• micsoservices: • *>,-�B?,-�61,-5;����&�C<• 8�!�$�3 ������ %�����C<• �������!�$�� %��:�����(.��C<
• Continuous Delivery: • 8�!�$�� %���@4�D9�A�����C<
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML Ops � ������ AWS ���
Infrastructure as Code microservices Continuous Deploy
AmazonECR
AWSCodeBuild
AWS StepFunctions
AmazonSageMaker
AWSGreengrass
AWSCodeCommit
AmazonECS
AmazonSageMaker
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
��
����
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SageMakerML
P
D
I
I BA D S
A aI M
/
/ /
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML ���������
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML ����� ��������� ��
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
��������� �� �������������������� ��������
Kinesis Firehose
S3
SageMaker
Glue
Athena QuickSight
AppServers
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
����������� EC ���������������������� ������
Kinesis Firehose
S3
EMR
Glue
Athena QuickSight
AppServers DynamoDB
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
��� �������(������������ "�������!��&'%�$#
Camera Device
Detection App
GPU
Greengrass Core
Camera
AWS IoT
Glue
Athena QuickSight
S3 SageMaker
Greengrass
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML �����������
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
StepFunctions���ML � ������
Start
CodeBuildStartBuild�����
SageMakerCreateTrainingJob
CodeBuildStartBuild�����
SageMakerCreateModel
SageMakerCreateEndpointConfig
SageMakerCreateEndpointUndateEndpoint
wait
wait
wait wait
SNS�����
SNS����
GreengrassCreateDeployment
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
���%,;= *�� StepFunctions�)@
RDS
S3
RedShift
Glue(2>9B���.4
S3
Glue�������)@
RDS������
��� $*��)@
SageMaker(2� �1-���!��"�
�������<3+'(2����87A�0���/5�
�6#���"��$�$�?>���� &:
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
#��ML ���������"�
Start
SageMakerCreateTrainingJob
CloudWatchLogs��������
Lambda������� ��
DB �����
QuickSight������ #�����!�
SageMakerCreateTrainingJob
SageMakerCreateTrainingJob...
...
RDS
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
*#-�2�,���4�1H
08G#� �6<�������1H#� F>� S3 �@� ���"�1H#� �:���;��#� �A/���) #� �EC RDS �9����
Start
������"���!�����"�1HCreateTrainingJob� CreateModel�?����7B�������� � JSON (��-D�5�1H
08�G���������� ID �1H�."%�)���'-$���� Dockerfile�1H
CodeCommit
S3
SageMaker
ECR
DVCGit LFS
3=�#� �&��+.1H!�-
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
=9"%�� AB ����(!/6
���>�?/1;$
83A� ���
���>�?/1�'!+,
Elasticsearch Service���'!�
����� )�
Lambda���'!�,&
SNS���52
�1���'!
S3���'!�@B<0
Athena & QuickSight4#7�����,&�� )�
SageMaker:.�������-* AB ���
AppServers
Kinesis
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
���� / �#�"��� ��
�#�"10&)
ML ��!�(� ������� AWS /�'2S3 �%�� AWS ��#�"�3*
�#�"10&)
-.,�ML ��!���� ���$+� SageMaker�'2S3 �%���#�"� AWS �3*
SageMaker S3CodeBuild
SageMakerS3
Direct Connect
Direct Connect
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
���
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
���ML ���������6�� ���6���*�)�%�6��#(&��2�8��<>���
�� ��� ��� �7�3���9��,=�;5�AWS ���� ��:/�@����
������������' *�1-�40��������+$�"+!�.?
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
k W 3R SF a bW A
Q b F A
a bW c e b W 3 d
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.