video activity recognition and nlp q&a model example

59
Video

Upload: nervana-systems

Post on 19-Feb-2017

209 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: Video Activity Recognition and NLP Q&A Model Example

Video

Page 2: Video Activity Recognition and NLP Q&A Model Example

Applications

Page 3: Video Activity Recognition and NLP Q&A Model Example

Internet Video

Page 4: Video Activity Recognition and NLP Q&A Model Example

Security

Page 5: Video Activity Recognition and NLP Q&A Model Example

Medical Imaging

Page 6: Video Activity Recognition and NLP Q&A Model Example

Challenges

Page 7: Video Activity Recognition and NLP Q&A Model Example

Storage

Page 8: Video Activity Recognition and NLP Q&A Model Example

Bandwidth

Page 9: Video Activity Recognition and NLP Q&A Model Example

Processing

Page 10: Video Activity Recognition and NLP Q&A Model Example

neon

Page 11: Video Activity Recognition and NLP Q&A Model Example

UCF-101

Page 12: Video Activity Recognition and NLP Q&A Model Example
Page 13: Video Activity Recognition and NLP Q&A Model Example

Field Hockey Penalty

Page 14: Video Activity Recognition and NLP Q&A Model Example

Convolutional Neural Networks

Page 15: Video Activity Recognition and NLP Q&A Model Example
Page 16: Video Activity Recognition and NLP Q&A Model Example

Input Hidden Hidden Output

Page 17: Video Activity Recognition and NLP Q&A Model Example
Page 18: Video Activity Recognition and NLP Q&A Model Example

Fully Connected

Page 19: Video Activity Recognition and NLP Q&A Model Example

3D Volumes

Local Connectivity

Page 20: Video Activity Recognition and NLP Q&A Model Example

3D Volumes

Page 21: Video Activity Recognition and NLP Q&A Model Example

Local Connectivity

Page 22: Video Activity Recognition and NLP Q&A Model Example
Page 23: Video Activity Recognition and NLP Q&A Model Example

Demo

Page 24: Video Activity Recognition and NLP Q&A Model Example
Page 25: Video Activity Recognition and NLP Q&A Model Example

github.com/NervanaSystems/neon

Page 26: Video Activity Recognition and NLP Q&A Model Example

Question Answering

Page 27: Video Activity Recognition and NLP Q&A Model Example
Page 28: Video Activity Recognition and NLP Q&A Model Example

Applications

Page 29: Video Activity Recognition and NLP Q&A Model Example

Personal Assistants

Page 30: Video Activity Recognition and NLP Q&A Model Example

Connected Devices

Page 31: Video Activity Recognition and NLP Q&A Model Example

Challenges

Page 32: Video Activity Recognition and NLP Q&A Model Example

Ambiguity

John went to the bank.

Page 33: Video Activity Recognition and NLP Q&A Model Example

Sarcasm

Page 34: Video Activity Recognition and NLP Q&A Model Example

Sarcasm

Can I help you?

Page 35: Video Activity Recognition and NLP Q&A Model Example

Sarcasm

Can I help you?

No, I just waited in line for 30 minutes to say “hi”.

Page 36: Video Activity Recognition and NLP Q&A Model Example

bAbI

Page 37: Video Activity Recognition and NLP Q&A Model Example

bAbI

Stories

Page 38: Video Activity Recognition and NLP Q&A Model Example

bAbI

Stories Questions

Page 39: Video Activity Recognition and NLP Q&A Model Example

bAbI

Stories Questions Answers

Page 40: Video Activity Recognition and NLP Q&A Model Example

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Page 41: Video Activity Recognition and NLP Q&A Model Example

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Where is John located?

Page 42: Video Activity Recognition and NLP Q&A Model Example

Recurrent Neural Networks

Page 43: Video Activity Recognition and NLP Q&A Model Example

Sequences

Variable Length Inputs

Page 44: Video Activity Recognition and NLP Q&A Model Example

Where is John located?

Page 45: Video Activity Recognition and NLP Q&A Model Example

Where is John located?

Word Sequence

Page 46: Video Activity Recognition and NLP Q&A Model Example

Where is John located?

Variable Length

Page 47: Video Activity Recognition and NLP Q&A Model Example

Where is John located?

Page 48: Video Activity Recognition and NLP Q&A Model Example

isWhere John located?

Page 49: Video Activity Recognition and NLP Q&A Model Example

Where

Page 50: Video Activity Recognition and NLP Q&A Model Example

Where is

Page 51: Video Activity Recognition and NLP Q&A Model Example

Where is John

Page 52: Video Activity Recognition and NLP Q&A Model Example

Where is John

Parameter Sharing

Page 53: Video Activity Recognition and NLP Q&A Model Example

Where is John Located

Page 54: Video Activity Recognition and NLP Q&A Model Example

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Where is John located?

Page 55: Video Activity Recognition and NLP Q&A Model Example

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Where is John located?

Florida

Page 56: Video Activity Recognition and NLP Q&A Model Example

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Where is Mary located?

Page 57: Video Activity Recognition and NLP Q&A Model Example

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Where is Mary located?

Florida

Page 58: Video Activity Recognition and NLP Q&A Model Example

github.com/NervanaSystems/neon