development, use cases, and prospect intro to data science · 5/26/2018  · chatdanai lumdee...

67
Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group (and a physicist -- optics, nanotechnology) May 26, 2018 Thammasat University Intro to data science Development, use cases, and prospect

Upload: others

Post on 01-Jun-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

Chatdanai Lumdee (Tua/ตั้ว)Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

(and a physicist -- optics, nanotechnology)

May 26, 2018Thammasat University

Intro to data scienceDevelopment, use cases, and prospect

Page 2: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

Intro to data scienceDevelopment, use cases, and prospect

Page 3: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

3

Page 4: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

4

Page 5: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

5https://thematter.co/pulse/lottery/34916

Page 6: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

6

Page 7: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

7https://www.optimizely.com/optimization-glossary/ab-testing/

Page 8: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

8http://rpsychologist.com/d3/NHST/

Page 9: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

9

Page 10: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

10Reported in 2012

Page 11: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

11

Beginning (~1996) Now

Page 12: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

12

Page 13: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

13

Page 14: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

14

CodingDatabaseInfrastructure

Page 15: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

15

Page 16: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

16

https://www.datameer.com/product/industries-use-cases/https://datafloq.com/read/8-industries-benefit-big-data-infographic/402https://www.simplilearn.com/big-data-applications-in-industries-article

Finance Retail Health Media

Sports Logistics Education Government

Page 17: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

17

Page 18: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

18https://blog.walmart.com/innovation/20170807/5-ways-walmart-uses-big-data-to-help-customers

Page 20: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

20

Page 21: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

21

Page 22: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

22

Page 24: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

24

Page 25: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

25

Page 26: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

26

Page 27: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

27https://datafloq.com/read/big-data-will-revolutionize-learning/206

Page 29: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

29

Page 31: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

31

Page 32: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

32

Page 33: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

33

Page 34: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

34

Page 35: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

Intro to data scienceDevelopment, use cases, and prospect

Page 36: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

36

Page 37: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

Intro to data scienceDevelopment, use cases, and prospect

Page 38: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

38

Page 39: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

39https://www.voanews.com/a/tesla-model-3-assembly-line-strategy/3823841.html

Page 41: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

41https://www.engadget.com/2017/05/25/google-alphago-ai-deepmind-ke-jie-go-win/

Page 42: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

42

Page 43: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

43

Page 45: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

45

Page 46: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

46

Page 47: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

47

Page 48: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

48

Page 49: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

49https://blog.lawgeex.com/ai-more-accurate-than-lawyers/

Page 51: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

51https://www.kdnuggets.com/2017/01/generative-adversarial-networks-hot-topic-machine-learning.html

Page 53: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

53https://hothardware.com/news/nvidia-neural-network-generates-photorealistic-faces-disturbing-results

Page 54: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

54

Page 55: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

55

Page 57: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

57http://www.parorobots.com/

Page 58: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

58

Page 60: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

60

Page 61: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

61

Page 63: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

63

Page 64: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

64

Page 65: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

65Find me @ https://clumdee.github.io/

Page 66: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

66

Page 67: Development, use cases, and prospect Intro to data science · 5/26/2018  · Chatdanai Lumdee (Tua/ตั้ว) Data scientist at Kasikorn Labs, Kasikorn Business-Technology Group

67

Data collection

Exploratory data analysis

Data cleansing + Feature engineering

Model building

Validation and prediction

Data science workflow