april webinar enhancing intelligent video analytics with artificial intelligence · 2020-04-08 ·...

April WebinarEnhancing Intelligent Video Analytics with Artificial IntelligenceAaron Saks | Product & Technical Manager

Boston, MA

ⓒ 2019 Hanwha Techwin Co.,Ltd. All rights reserved.

• Introduction• Introduction of AI / Analytics• Enhanced features

• Improved accuracy• Feature Extraction• Improved Business Intelligence

• VMS Integration• Q&A

Notes: This webinar is being recorded and will be available for replaying. The presentation materials will also be available in

PDF format.

Please visit https://www.hanwhasecurity.com/trainings/webinars/ to view webinars & sign up for future webinars.

We will take Q&A time permitting. In case there is not time to get to all of the questions, we will reply to you individually afterwards. Please use the Chat or Q&A section.

All participants have been put in to listen only mode.

Agenda

Manufacturing & Compliance

• All IP cameras, analog cameras, NVRs, DVRs and encoders sold and distributed in North America are manufactured in Hanwha’s facilities in South Korea and Vietnam.

• Most Hanwha products qualify for GSA Schedule Contracts and other government opportunities because they are TAA / NDAA compliant.

• All new products are compliant with the “California IoT” Law.

ⓒ 2020 Hanwha Techwin America. All rights reserved.

What are Analytics?

an·a·lyt·ics/anlˈitiks/

“the systematic computational analysis of data or statistics.”

Intelligent Video Analytics or Video Content Analysis is the capability of automatically analyzing video to detect and determine events.

What Can Analytics Do for me?•Easier reviewing of events•Guards do not need to watch so many cameras all the time. •They can respond to events easier•Save bandwidth needs for remote locations•Less reliance on traditional Video Motion Detection, and its’ inherent problems

•False detection due to trees, windows, animals, etc.•Sensitivity settings•Changing of lighting conditions throughout the day•Locations with changing activity levels.


Why do I need Intelligent Video Analytics?

Research in the U.S. has shown human observers (of CCTV) start showing signs of viewing fatigue after as little as 12 minutes, overlooking up to 45 percent of all activity in the scenes. After 22 minutes, they overlook up to 95 percent.

Robert Moore, citing a 2002 study published in Security Oz Magazine in his article“What are the latest trends in intelligent video and analytics?” SP&T News, June 6, 2008. See: www.sptnews.ca/index.php/Editorials/Ask-the-Expert-Smarter-AI/menu-id-106.html

http://www.matrox.com/graphics/f1


Detecting objects in difficult situations

Definition of Artificial Intelligence• The theory and development of computer systems (SW & HW) to perform tasks that

normally require human intelligence, such as visual perception, speech recognition, decision-making, and translation between languages

[ Turing test: 1950s ]

Developing machines that mimic human intelligence

ⓒ 2020 Hanwha Techwin America All rights reserved.

Why AI:New Object Detection and classification

Reducefalse alarm

AccurateBI result

Attribute

Object classification(person/vehicle)

Forensic search on back-end

Object Detection provides the following functions:

1. Enhance IVA events based on the AI algorithm2. Detection of four object types simultaneously

(Person/Vehicle/Face/License plate) 3. Real-time event trigger (new SUNAPI protocol)

False alarm reduction through Wisenet’s deep learning based algorithm, which supports object classification, it can discard waving trees, video noise, raining, moving shadow, irrelevant objects (dog, plastic bag, etc.)

New Deep Learning based Analytics TechnologyWisenet AI Camera

False Alarm ReductionTraditional Motion Detection is based on pixel change of video image, it makes continuous alarms. . The new Deep learning based VA can only focus people, discard the others(wave, video noise, moving shadows.

• Demonstration (Webviewer)

Traditional VA Deep learning VA

Wisenet AI Camera

Feature | False Alarm ReductionTraditional Motion Detection is based on pixel change of video image, it makes continuous alarms.

Deep learning based VA can only focus people, discard the others(wave, video noise, moving shadows.


Feature | False Alarm Reduction

• Demonstration


New AI-based IVA for improved accuracy and False Alarm Reduction

• The Wisenet AI engine can recognize the object type and can more accurately filter out false alarms

• Only detecting valuable object type, ignoring non-important object type• Waving trees / Video noise / Moving shadow….etc.

False Alarm Filtering by Object Classification

Object select option

New AI-based IVA for improved accuracy• New AI algorithm

• New “Object select option” on setting, Real-time event trigger

• Alarm accuracy improvement based on the object classification

• Directional detection, Intrusion detection, Enter/Exit, Loitering (duration up to 10min)

• Wisenet AI camera has applied new AI algorithm built-in.• Alarm accuracy improvement based on the object classification

Intelligent Video Analytics

• AI camera sends metadata including attributes of objects, coordinates information and setting value to backend server/NVR/VMS.

• Person, Face, Vehicle category and so on.

Object Capture & Feature Extraction

Face(gender , age)

Glasses

Top wearColor

Bag

Vehicle color

Type of vehicle(Car, bus, motorbike)

License plate

Human Attributes Vehicle Attributes

Bottom wearColor

• Capturing image of Person(Human Body), Face, Vehicle, & License Plate.

• Gathering metadata for specific attribute so system can use the data for advanced search

사람

Object Capture & Attribute Extraction

CARH

UM

AN

20190225_10:30:3320190225_10:30:3220190225_10:30:29

20190225_10:30:3320190225_10:30:3220190225_10:30:29

NO License Plate

Object Capture Attribute

CARH

UM

AN

Type : Bus, Truck, Bike…Color : Black, White, Red, Blue…

Gender : Female, MaleClothing Color : Upper, LowerAccessory : Hat, Backpack, Bag, Glasses

Feature | Object Capture & AttributeAttributes Objects Attributes Supported attributes items

Person Gender Female, Male

Upper (Color) Black, Gray, White, Red, Orange, Yellow, Green, Blue, Purple(up to 2 colors at the same time)Lower (Color)

Bag Wear Glasses or Not

Vehicle Type Car(Sedan/SUV/Van…etc), Bus, Truck, Motorcycle, Bicycle, Train

Color Black, Gray, White, Red, Orange, Yellow, Green, Blue, Purple(up to 2 colors at the same time)

Face Gender Female, Male

Age Young/Adult/Middle age/Senior

Glasses Wearing Glasses or Not

• BestShot : Best cropped image of “Person, Vehicle, Face, License plate” in the scene transmitted as a JPEG snapshot within the metadata

• This function helps to load distribution of backend analyzing server• Useful with license plate analyzing or face recognition server

Real-time object Image capture for re-identification


Overhead view only

Rule based detection – Moving object

Counting visitor

Normal view, useful for normal surveillance

People Object based detection for increased

accuracy

Additional metadata including gender & age

Improved Business Analytics:

Non AI Wisenet AI

• Applied new AI algorithm • Not limited to top-down view• Accuracy improvement based on people classification. • Add Gender counting, Age counting

[People Counting] [Heatmap]

Business Intelligence Functions

• Deep Learning AI algorithm applied to Queue Management• Accuracy improvement based on person movement, allows flexible installation environments• Duration : from 1 minute up to 10 minutes

[ Queue management setting] [ Deep learning Wisenet AI]

Queue management from side-viewMinimum duration up to 10minutes

Analytics improvement : Queue management

• Wisenet AI cameras have 2 channels, Channel 1 for the full image, Channel 2 for digital auto-tracking

• Smart Digital Auto-tracking with new AI algorithm : provide option of Person/Vehicle• Automatic cropping, up to Full HD (1080p) for easy monitoring

Digital Auto-Tracking Channel

Demonstration videoDigital auto-tracking channel

• DC Output for external devices• Use case #1 : When “Object Detection” event trigger, LED “on”• Use case #2 : PIR sensor, glass break detectors

Feature | Enhanced DC Output

AI Camera Note

1: Alarm 1 Input

2: Alarm 2 Output

3: GND

4: Alarm out 12V DC, Max load ~ 50mA

5: GND(DC) 0V DC


Wisenet AI Cameras

• 4K / 8MP @ 30fps, H.265, WiseStreamII• 1/1.8” image sensor for low light sensitivity 0.05lux (0.03lux box)• X-Plus Mechanical Design (Dome/Flush)• USB/Analog video output for installation• 120dB True WDR• 4.5~10mm (2.2x) Motorized Vari-focal lens• Built-in 30m IR• Gyro-sensor based DIS• 10/100/1000 PoE+ / 12v DC• IP67/IP66, IK10 outdoor, bullet• IP52, IK10 indoor domes• Dual SD card slots• ONVIF S/G/T profiles• Operating temperature range -40°F ~ +131°F• Object Classification / Attributes Extraction• AI-based Video AnalyticsModel # PNx-Axxxxxx – Specs may vary by model

Key Specifications:

Dome TypeAI Product Lineup

PND-A9081RV/A9081RF

• Lens• 4.5~10mm(2.2x) motorized varifocal

• Video/Network• Codec : H.264, H.265, MJPEG • Resolution : 4K

• Features• 0.05 Lux low light sensitivity• 30m IR• WDR : 120dB• New Wisenet AI algorithm included

• Object detection• BestShot• Attributes

• Retail Insight integration

• Environment• IP52, IK10• 2 SD slots• USB&CVBS for installation• Audio In/Out, Alarm In/Out• PoE+, 12VDC• DC12V for external device

PND-A9081RV

SBC-160B (Skin Cover)

PND-A9081RF

Vandal Dome TypeAI Product Lineup

PNV-A9081R

• Lens• 4.5~10mm (2.2x) motorized varifocal





• Environment• IP66, IP67, IP6K9K, IK10+, NEMA4X• 2 SD slots• USB&CVBS for installation• Audio In/Out, Alarm In/Out• PoE+, 12VDC• DC12V output for external device

PNV-A9081R

SBC-180B (Skin Cover)


PNO-A9081R

• Lens• 4.5~10mm(2.2x) motorized varifocal





• Environment• IP66, IP67, IK10, NEMA4X• 2 SD slots• Backbox (XNO-8080R Design)

• USB&CVBS for installation• Audio In/Out, Alarm In/Out• PoE+, 12VDC• DC12V for external device

PNO-A9081R


PNB-A9001

• Lens• i-CS lens support


• Features• 0.03 Lux low light sensitivity• WDR : 120dB• New Wisenet AI algorithm included



• Environment• 2 SD slots• USB&CVBS for installation• Audio In/Out, Alarm In/Out• RS-485 for remote control• PoE+, 12VDC• DC12V for external device

PNB-A9001

TNB-9000 –8K box camera with AI

• 43 megapixel full-frame sensor with 33MP / 8K streaming output

• Triple CODEC supporting H.265 / H.264 / MJPEG

• RJ-45 (10/100/1000 BASE-T), SFP slot (100/1000Mbps)

• HPoE (IEEE802.3bt, Class5), 12VDC powered

• Operating Temperature Range 32°F ~ +122°F

• Supports optional Canon EF mount lenses

• Plugin-free for easy installation & configuration

• RS-485 / 422 for PT Head integration

• Simple Focus for perfect 8K resolution back focus

• AI-based analytics for accurate detection (Object Detection, Directional detection, Enter/Exit, Loitering, Virtual line)

• Object classification (Person/Face/Vehicle/License) with metadata & BestShot

Accessory (White)

SBP-167HMW

SBP-300CMW

SBP-300WMW1

SBP-300WMW

Hanging Mount Ceiling Mount

Wall Mount

Wall Mount(Swan-neck)

Dome

Vandal

SBP-187HMW

Hanging Mount

SBP-300PMW

SBP-300KMW

Pole Mount

Corner Mount

SBC-180B

SPC-100AC

AC Power Module

Skin Cover

Skin Cover

SBC-160B

Installation box

SBP-300NBW

SBP-300BW

Wall Mount Base

http://www.samsungsecurity.com/_inc/download.asp?idx=45926&fde=614fb727c6116dbdffe0d92c13b9f425155424995e9a53940b495efcaa51558b

http://www.samsungsecurity.com/_inc/download.asp?idx=45926&fde=614fb727c6116dbdffe0d92c13b9f425155424995e9a53940b495efcaa51558b

Accessory

SBP-302PM

Pole MountBullet

Box

SHB-4300HP –PoE housing

Fixed Housings


AvailabilityHanwha AI Cameras are scheduled to be released in April (TNB-9000) / June 2020 (PNx-90xx).

Demo cameras are available for Project opportunities. Please contact your local Hanwha Regional Sales Manager.

hanwhasecurity.com

Major VMS support will be released in Q2

hanwhasecurity.com

WAVE Forensic Search Plugin WAVE version 4.1 ~ July 2020

hanwhasecurity.com

WAVE AI Camera Plugin is Embedded / No additional setup is required

System requirements:• WAVE System Version – WAVE 4.1 or higher

• Server & Client plugins are built-in

Embedded

EmbeddedWAVE Server

• All VA/AI can be configured in WAVE UI including area/line configuration.

• All VA/AI event can be received.

• All metadata will be saved in accordance with video.

• VA rule configuration will be shown in the live tile.

• Object bounding box and type/attributes will be drawn in the live tile.

• When new object is detected, it will be triggered on the object tab at the right side.

• Forensic search by type / attributes will be supported

WAVE AI features:

WAVE Forensic Search

hanwhasecurity.com

Step 1. Right click on the AI camera (Channel 1).

Step 2. Select [Camera Settings]

Step 3. Select [Object detection [AI]] General

Step 4. Check Enable and Select Object Types / BestShot

WAVE Forensic SearchAI Camera Plugin configuration

hanwhasecurity.com

WAVE Forensic Search• WAVE AI Camera support:

Yellow Spots indicate Object

detection

Live Tile

hanwhasecurity.com

Step 1. Click on Objects tab

Step 2. Select [Time]

Step 3. Select [Camera/Layout]

Step 4. Select [Type of Object]

Step 5. Select [Area]


hanwhasecurity.com

Forensic Search Results example:

Right Click on AI camera Ch1 and select [Object Frames and Info] to change how

the Search results are displayed


Object Search Panel & Frames

Selecting objects


Questions?

Thank You!

Aaron [email protected]

april webinar enhancing intelligent video analytics with artificial intelligence · 2020-04-08 ·...

Documents