ibm’s intelligent video analytics ibm intelligent public safety · 900 million number of events a...

IBM’s Intelligent Video Analytics&

IBM Intelligent Public Safety

© 2014 IBM Corporation© 2015 IBM Corporation

Using technology as a force

Fewer frontline staff and lower budgets are driving departments to seek out innovative methods of reducing operational gaps

More efficient ways are needed to deal with crime prevention, removing criminals from the streets & creating safer neighborhoods

Disjointed legacy systems are becoming an expensive weakness in the policing system due to the system sophistication requirements

Constraints

Disjointed legacy systems

Efficiencies

Pain points managing Safety and Security and Operations

© 2015 IBM Corporation2

Using technology as a force

multiplier

A growing requirement to employ advanced analytics and threat detection

The industry areas who are looking at the force mul tiplier of advanced analytics to help close their operational gap are going to be th e ones who will be best placed to manage safety security and efficiently manage op erations.

legacy systems

Need for analytics

Analytics can provide value across many areas: Public Safety and Security, Public Transportation, Traffic Management, Corporate Security, Operational efficiency, Buyer Patterns, Emergency Response, Event Management

Why Video?

Real-Time Traffic Cameras in


Cameras in New York City

900 millionNumber of events a security

operator has to review on a

monthly basis in one city

22 minutes

The time before the average

Market Facts

Today there are ~72 Mil surveillance

cameras in use globally

Human’s ability to detect an event


The time before the average

attention span of a security

operator monitoring two cameras

drops by 95%

57 percentof city expenditures

that can be attributed to public

safety

~1.5M new surveillance cameras are

being deployed annually

Only 3% of those cameras have

intelligence

Humans can not monitor these

devices.

Large opportunity to provide asset to

make these devices intelligent

Drops by

95%

Improves the ability to understand and respond

Rapid investigationOperational optimization Situational awareness


Combine alerts to reduce false

notifications to personnel to

improve taking action

Advanced analytics developed

for urban environments and

mass transportation to identify

individuals versus “blobs”

Months to hours

Reduce the investigation time from

months to hours based on finding

matches to indexed data

Power Substations

Public

Streets/Traffic

Business/Retail

To improve the coordination and safety in urban environments, cities need the benefits provided by video analytics

Water supplies

Scope of areas requiring intelligentvideo monitoring

1. Prevent incidents by providing notification of potential incidents and hazardous situations especially in crowded environments

2. Deploy resources faster to stop unruly

Video analytics can enable you to…

CitySupportInfrastructure

Schools/Hospitals


Stadiums

Parks & Recreation

Tunnels

PublicTransportation What

Needs

protection

Bridges

Airports/Seaports

2. Deploy resources faster to stop unruly crowds before they grow and to apprehend suspects before they leave the scene

3. Improve operational efficiency by developing awareness of traffic flows and areas prone to pedestrian loitering

Infrastructure

RemoteInfrastructure

Large Venues

Infrastructure

Events/Conventions

� Enable effective response to inquiries, requests fo r services and investigative actions in a timely mann er thus increasing overall customer satisfaction.

� Deliver a foundation for more proactive safety and security.

� Provide greater predictive analysis and data mining from disparate data sources.

Prediction and Prevention

What Video Analytics Can Do For You:


disparate data sources.

� Increase quality of decisions by providing more insightful, actionable reporting.

� Optimize resources to effectively meet objectives that evolve over time.

� Reduce operational and IT costs by providing self-service reporting and analysis to users.

CAPTURE ANALYZE DECIDE ACT

• Acts as a force multiplier • Reduce false alarms • Facilitates faster forensic • Improves “time to

Delivering on the Value Proposition


• Acts as a force multiplier

• Leverages existing

infrastructure

• Increases Threat Deterrence

• Optimizes Infrastructure

• Reduce false alarms

• Minimizes manual data

correlation

• Provides real-time analysis

• Facilitates faster forensic

retrieval

• Decreases “time to decision”

• Provides real-time

situational awareness

• Improves “time to

threat elimination”

• Increases responder

safety

Client value examples: � Investigation time moves from days to minutes �Automatic alerting for immediate response�Determine quickest response route

�Determine malicious events in planning phase�Ability to monitor broad areas with limited staff

� Bigger

� High scalability able to capture and

process billions of events monthly

� Advancements to address challenges in

urban environments and crowded scenes

� Faster

� Easy to use attribute search capabilities

� Rank Ordering of Search results based on


� Rank Ordering of Search results based on

Confidence Scoring

Intelligent Video Analytics Features and Differentiators

Behavior analytics• Classification - size, speed, trajectory, color, time, duration, shape, features• People Search• Vehicle Search• Tripwires• Directional motion• Region of interest & un-interest• Object removal• Abandoned object• Face capture, facial search• Crowd behavior


• Crowd behavior• Counting• Loitering• Speed detection

Differentiating features• Full event indexing• Compound alerting • Crowded scene analysis• High scalability able to capture and process billions of events monthly• Easy to use attribute search capabilities • Advanced color recognition

Provides real-time alerting and rapid forensic searching with event playbackIntegrated with multiple VMS providers

Analytics indexing events

Real-timeAlerting

People Search� Single attribute and combined attribute search

capability on physical features:– Baldness, – Eyeglasses/Sunglasses, – Head Color, (hair color, hat color,…)– Skin Tone– Tri-color torso via 13-color palette– Torso Texture

� User interface to rank ordering search results based on attribute confidence levels

� Integration with 3rd party Facial Recognition


� Integration with 3 party Facial Recognition Engines for real-time identity alerting

� People Search Framework allows ability to add new physical attribute (i.e. shoe color)

� Provides Color Calibration Tool to manually calibrate color using artificial object colors and existing scene objects or automatic color correction.

Near Field People Search Supports 13 color palette

Red

Orange

Yellow

Green

Cyan

Blue

Magenta

Brown

Beige

Black

Dark Gray

Light Gray

WhiteFind all people on 4/26/2014 between 12pm and 4pm i n

rank order by eyeglasses, patterned green & yellow shirt

� Channel Selection

� Time Criteria

IVA In Action – Nearfield People Search


� Search Criteria– Head

� Search Criteria– Torso



� Query Summary

� Search Results

� Ranked by

Confidence




� Video Review


� Detailed

Metadata


� 30 Minutes of video

� 91 People

� Search Time without IVA


� Search Time without IVA

� 10-30 Minutes

� Search Time with IVA

� ~1 Minute

Targeted Cameras/Use Cases for Vehicle SearchExample

� Detection of vehicles within crowded scenes

� Search attributes for vehicle width, height, length, and speed

� Search capability on visible vehicle appearance with 6-color Palette

� Color Calibration Tool to


� Color Calibration Tool to calibrate color

• artificial object colors• existing objects with FOV• automatic color correction

� World Metric calibration tool to enable true object measurements.

� Size-map and Pose-map Calibration tool to automatically learn vehicle size and pose distribution in a scene and perform manual adjustment if needed

IBM’s Video Analytics provides real-time alerting based on complex activity and event detection


IBM’s Video Analytics Building Management Example Building Entrance camera: Person Entering Statistics

� Shows distribution of people entering the building during the day

– Camera contains two Directional Motion alerts named “Person Entering” that trigger when people approach the building doors

� Select Building Entrance camera� Go to Alerts->Search� Enter the following parameters


� Enter the following parameters– Display:Stats– Statistical Bin Size: 1 Hour– KeyWords: “Person Entering”– Time Period: 7am to 7pm the

previous weekday

� The results should show a histogram similar to what you see here with peaks when people arrive in the morning and return from lunch.

– Only a few results show in the afternoon because this alert only records people *entering* the building

Historical Visualization

Activity Histogram Heat MapTrack Summary


Activity Histogram Heat MapTrack Summary

Distribution of events over time

How long objects spent in different places

Show tracks of all objects returned from search

Maturity Curve – building on existing investment


Backdrop

The customer has a basic video monitoring system which records video, but needs the human eye to monitor significant events and coordinate responses.

Objective

Use intelligent video analytics to alert on

Garbage

Monitoring

via Video

Analytics

Crime investigation and prevention


Objective

Use intelligent video analytics to alert on potential threats, index events for investigations and define where malicious activity is being planned.

The security officers can

•Prevent Incidents •Deploy resources faster•Improve operations

Security Officer

is alerted to

the event

Response is

managed

Backdrop

Certain individuals have been barred from sensitive areas. Intelligent Video Analytics can be setup to look for individuals as they are channeled into a controlled

GraffitiGarbage

Intelligent Video

Analytics captures

the best few of a

face

Sent to the i2 Facial

Recognition module

Facematch

Law Enforcement


are channeled into a controlled environment.

Objective

Individual's faces are monitored The best view of their face while in the field of view is captured and forwarded to facial matching. Once the suspects

have been

identified this can

be sent to the

security analyst

Facial match generates a

list of potential suspects

Backdrop

The ability to identify and respond to an issue as soon as possible can be critical to ensuring the event is kept safe and secure

GraffitiGarbagePaving Stone

Critical

areas are

monitored

Information from

video analytics

solution is sent to the

Events or Large Facility Operations


and secure

Objective

The Intelligent Video Analytics + Intelligent Operations Center can monitor, alert and manage crowd build up, security threats

solution is sent to the

Intelligent Operations

control center

SOPs can deliver an intelligent response to issues that have

be Identified by Intelligent Video Analytics

Backdrop

Transport environments can be monitored for Safety, Security threats as well as operational efficiency.

GarbagePaving Stone

Event

monitoring and

Indexing

Abandoned

Package AlertPeople Counting

Transportation


efficiency.

Objective

To alert station masters, bus / tram inspectors to unsafe events, security threats and to improve the efficiency of operation.

Platform Crowding People obstacles

and on tracks

Intelligent

response

via SOPS

Backdrop

A serious bombing event has gone off and the city needs to analyze all footage before the incident.

Paving Stone

Video from

many

different

sources is

analyzed

Emergency Management

Events of

concern are


Objective:-

Intelligent Video Analytics can be configured to look for evidence across all cameras. Vehicles: color, speed, location. People: clothing color, facial attributes.

concern are

identified

Mobile command

posts are dispatched

to the hot-spot areas

to support the

investigation

Video

Video Capture

Video ArchiveVideo Management

Sensors Prediction

IVA IOC

High level Architecture - Full solution how it works


1

Alerts

Events

Analytics Engine

Metadata Engine

Intelligent Video Analytics

Intelligent Response

Citizen Collaboration

Social Media

*IVA – Intelligent Video Analytics

*IOC – Intelligent Operations Center

IBM’s Intelligent Operations Center


IBM’s Intelligent Operations Center

Intelligent Operations Center

DirectivesAlerts

Reports/Analysis

Advanced Visual Features

Integration with IBM Intelligent Operations Center

CAPs Events

Intelligent


Gateway

Domain

Sensors

Service Bus

PublicSafety

Transport Water Building

Interconnected

Instrumented

Analytics are key to converting data to information to insight by Integrating with the Intelligent Operations Center

Event Captured, video analytics / image stored locally

Captured data converted to Common Alert Protocol (CAP) message

CAP stored , and processed

Video


Charting, Geo Spatial

VideoAnalytics

Data Analytics

Data Processing

High Level Insight

Video Capture -> Data Processing -> Insight -> Playback ( Video / Charting )

Select On Demand based on significance

Store and Playbackfrom

Intelligent Operations Center as event or trend deemed

significant


Select On Demand based on significanceAll events stored and enabled alerts displayed

Building Management: Inside Doorway camera: Face Capture

• Inside Doorway camera shows the elevator lobby and a door coming from the Inside Lobby.

• This view is running the Face Capture profile• Faces are captured both as Events and as Alerts.

• Alerts also appear in the Instant Alerts section of the UI

© 2015 IBM Corporation32Intelligent Buildings

Operation Center Summary View

Smart Government, Customer References Strengthening Public Safety.

City Government of Davao: The solution helps the City more effectively manage public safety, plan and predict

needs based on KRIs and near-real-time event monitoring and drastically improve the overall operating

and management efficiency of its security agencies.

A Free Economic Zone in Asia: Is planned to be a self-contained living and business district. We are providing

intelligent physical security systems..


Public Safety Department in Puerto Rico: Implemented a wireless mesh-based intelligent video

surveillance system leveraging IVA to detect and prevent crime on major San Juan thoroughfares

ibm’s intelligent video analytics ibm intelligent public safety · 900 million number of events a...

Documents