progress report - nict...progress report asean-ivo: event analysis project roadmap present by:...

Progress Report

Asean-IVO: Event Analysis Project Roadmap

present by: Somnuk Phon-Amnuaisuk

28 November 2018, Jakarta, Indonesia

Asean-IVO: Event Analysis Project Roadmap Progress Report

Event Analysis: Applications of CV & AI in ST industryThe term Event Analysis is used here as the focus of the analysis ison the events and generic descriptive actions.

Asean-IVO: Event Analysis Project Roadmap Progress Report

Target ApplicationsI Smart museum: profiling museum visitors (UTB)I Smart building: summarizing content in a video footage

(NTU)I Smart surveillance: identifying a target person (MUT)I Smart pedestrian safety monitoring: profiling pedestrian and

traffic scene (NUOL)

Asean-IVO: Event Analysis Project Roadmap Progress Report

Visions - contributions

Asean-IVO: Event Analysis Project Roadmap Progress Report

Visions - contributions

Asean-IVO: Event Analysis Project Roadmap Progress Report

Visions - contributions

Asean-IVO: Event Analysis Project Roadmap Progress Report

Tasks

I Year 1I Detection & TrackingI ID tracking & profiling e.g., countI Physical characteristic profiling, e.g., age, gender, height, etc.I Port to HpVT.

I Year 2I Physical characteristic profiling, e.g., age, gender, height, etc.I Port to HpVT.I Activity recognition from skeleton data

Asean-IVO: Event Analysis Project Roadmap Progress Report

Event Analysis

Asean-IVO: Event Analysis Project Roadmap Progress Report

Tasks: Detection, Tracking, ID Tracking & Profiling

I Detect, Track

I Assign ID

I Count

I Profiling

Asean-IVO: Event Analysis Project Roadmap Progress Report

Activities Recognition & Summary

I Image captions:I A man and a woman standing in a living room.I A man and a woman standing next to each other.

I Large training dataset, Frame problem, etc.

Asean-IVO: Event Analysis Project Roadmap Progress Report

Activities Recognition & Summary

I Explicitly infer activities from skeletons.

I Issues: Frame problem and View point variants.

Asean-IVO: Event Analysis Project Roadmap Progress Report

Activities Recognition & Summary

I Detecting human figures can be applied to various domains

Asean-IVO: Event Analysis Project Roadmap Progress Report

Thank You, Q & A

Asean-IVO: Event Analysis Project Roadmap Progress Report