video activity recognition and nlp q&a model example

Post on 19-Feb-2017

209 Views

Category:

Technology

1 Downloads

Preview:

Click to see full reader

TRANSCRIPT

Video

Applications

Internet Video

Security

Medical Imaging

Challenges

Storage

Bandwidth

Processing

neon

UCF-101

Field Hockey Penalty

Convolutional Neural Networks

Input Hidden Hidden Output

Fully Connected

3D Volumes

Local Connectivity

3D Volumes

Local Connectivity

Demo

github.com/NervanaSystems/neon

Question Answering

Applications

Personal Assistants

Connected Devices

Challenges

Ambiguity

John went to the bank.

Sarcasm

Sarcasm

Can I help you?

Sarcasm

Can I help you?

No, I just waited in line for 30 minutes to say “hi”.

bAbI

bAbI

Stories

bAbI

Stories Questions

bAbI

Stories Questions Answers

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Where is John located?

Recurrent Neural Networks

Sequences

Variable Length Inputs

Where is John located?

Where is John located?

Word Sequence

Where is John located?

Variable Length

Where is John located?

isWhere John located?

Where

Where is

Where is John

Where is John

Parameter Sharing

Where is John Located

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Where is John located?

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Where is John located?

Florida

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Where is Mary located?

Mary journeyed to Texas. John went to Maryland.

Mary went to Iowa. John travelled to Florida.

Where is Mary located?

Florida

github.com/NervanaSystems/neon

sathish@nervanasys.com

top related