cps isip 20161104-adachi-2 · 2016. 11. 15. · official road information ... integration of...

National Institute of Informatics

SocialCPS:ItsConceptandPracticalExperienceAcquiredinthe

DemonstrativeExperiments

JunAdachiNovember4,2016

NationalInstituteofInformatics,Japan

ISP2016Lyon,FranceNovember,3-4,2016


ASocialSystemServiceAfteraSevereDisaster

Informationprovidedbyautomobilecompanies

TheabovefigureisofficiallyprovidedonMarch20,2011bytheMinistryofLand,Infrastructure,TransportationandTourism

OfficialroadinformationTherealtimeinformationoftravelableroadsasofMarch20,2011basedonvehicletravelinformationjointlyprovidedbyHonda,Pioneer,ToyotaandNissan.

OnlineinformationofpassableroadsaftertheGreatEastJapanEarthquake ofMarch11in2011

2


Social Systems

Cyber-PhysicalSystemforSocialSystemsOptimization

State

Energy/Environment

Community

Graspthephysicalworldinrealtimeviasensor data.Givefeedbackwithanoptimalsolutionforthesocialsystems

Behavior

Physical world Cyber worldSensordata

IntegratedITPlatform

Socialdata

VisualizationSimulation

Data Analytics

Context data

Solutions

Optimizationandnewvaluecreationmethodology

Healthcare

Weather/Disaster

Traffic/Transportation

IoT

Big Data

3

DecisionMakingCrowdSourcing


CPS-IIP:IntegratedITPlatformsforCyber-PhysicalSystemstoAccelerateImplementationofEfficientSocialSystems

September2012-- March2017fundedbyMEXT

•Multi-streamdatacollection& analyses

• PervasiveSensing

• SmartFederatedAnalyticEnv

• CPS datamanagement

NII HokkaidoUniv.

OsakaUniv.

KyushuUniv.

4


Goalsof theCPS-IIPProject

5

• Pervasivedatasensingmechanismfordiversedatastreamsandreal-timefeedbackfunctions

• Scalable& securedatamanagementPlatform

• Complexdataanalytics&decisionmakingsupportplatform– Exploratoryvisualanalyticsutilizingflexiblecombination

ofvariousdatasourcesandanalyticstools

“TounderstandlargecomplexsystemsintherealworldviaBigData andprovideoptimalsolutionsbasedontheircontext”Realworld:Building,Campus,City��


Things,Environment

PhysicalWorld

Controllable System

Cyber Space

GeneralIssuesinCSP/BigData

CPS Cloud

Actuation(where,when,how)

Avarietyofdatasensordata�systemsdata,usergeneratedcontent,etc.invisible(stress-free)datacollection

sensornetworking

Evaluationofvalues

DatacleansingPrivacyprotection

Multistructureddatastore

Masterdatamanagement

Sensor,Transducer

Sensors,UGC

PrivacyReliabilityissues

Gapinvalues

datamining,machinelearning,complexevent&mediaprocessing

wellcontrolleddatasecurity

1.datasensing,collection

2.datastore,pre-processing

3.dataanalytics

4.feedback

wellcontrolledoutput

ComplexStreamingissues

Human

6


DataAnalytics&ServicePlatformDataManagementPlatform

ServiceC ��

Real–worlddatasensing

SensorNetworks

StatisticalAnalysis,KnowledgeProcessing

Visualization

Simulation

Planning/Hypothesistests

DecisionMaking

SocialSystemServices

DataCapture

Preliminarydataanalysisandprocessing(filtering,cleansing,clustering,Compressing,etc.)

DataAccess/SharingControl

CPS-IIPStructure

7

Actuating structurePhysical world

ServiceBServiceA

Cyber World (CPSIntegratedPlatform)

Externaldatasources(scientificdata,economy,society,etc.

State Capture

Dataselection/combination

DataStorage

Multi-dataStreamcapturing

Libraryfordata,datahandlingtools,analysisscenarios

Visualanalyticenvironmentwithimprovisationalfederationofresources

Kyushu UOsaka U

Hokkaido U

NII


RealworldDataCollectionsforCPS-IIP

8

Category Data&source

Locationinfo ofvehicles Probecardata,Taxiprobedata

Locationinfoofhumans- GPSinformation- Incoming/outgoinginfoatstations

Location informationfromsmart phoneapplicationUsageinformationofICcardsinsubwaypassengers

Broadcastingmediainfo TVprogramarchiveof7majorTokyostationsof200khoursfor3years(150TB)

Studentbehavior info- ICcardusage

CapturedinKyushu Univ.campas

Environmentalandweatherinfo Snowfall, snowremovalfromSapporocityandJapanweatherassociationReal-timeweatherinfofromthesatellite

Power consumptioninfo Smart metersincampusesofKyushuandOsakaUniv.

Communication trafficinfo NII’sSINET


ServiceField CapturedData Analytics Feedback/Value

Snowplowing andremovinginalargecity

- movementofhumansandvehicles(GPS)

- complaintsfromcitizens

- snowplowing state(reporting)

- Visualizationof trafficconditionsundersnowfallandsnowplowing

- Method:Opensmartfederationarchitecture

- OpenLibrary w/softwarecomponentsanddatasets

- InfodisseminationthruSNStocitizens

- Snowremoval operationmanagement:Optimization ofthetimeandplaceforclearance.

ITS - movement ofhumansandcarsusing GPSandothersensors

- Vehiclebehavior →roadcongestionandaccidentdetection

- integrationontoGIS

- Trafficmanagementviasignalcontrol

- navigationfor CO2

reduction

Disaster Management - Socialsystems sensing- Humanbehaviorsensing

- Simulationofhumanactivitiesinthecity

- Evacuationsupport- Rescuesupport- Aid deliverycontrol

Personalizedenergysavingoncampus

- Visualsensor- Energyconsumptionsensors- ICcardinfo

- Modelingofhumanandvehiclemovement

- Powerconsumptionmodeling

- Visualizationofhumanbehavior

- Visualizationofpersonalpowerconsumption

- Community energymanagement

PotentialServiceApplicationsofCPS-IIP

9


Five-yearResearchPlan

ComponentSelection,

IntegratedSystemDesign

�CPSDataManagement

� Smart FederatedAnalyticEnvironment

�Multi-stream DataCollection andanalyses

�PervasiveSensing

FY2016FY2015FY2014FY2012 FY2013

Functionaldesign,Systemsdesign,Testimplementation

InternationalSymposium

Finalreportsessionmid-termevaluation2nd conference1st conference

Basicdesign,LibraryExpansion,Implementations

SimulationmodelReal-timefeedbacksystemsarchitecturedesignTestdatacollection atatrialsite

HybridsensornetworkdesignDatacollectionviamultiplesensorsPreliminarysensordataanalytics forbehaviormonitoring

Systemsevaluation,ExperimentEvaluations

Demo Subproject �SmartSnowPlowing

Demo Experiment2�HumancentricEnergyManagement

10

National Institute of Informatics11





NII HokkaidoUniv.

OsakaUniv.

KyushuUniv.


CPS-IIPDataManagementandAnalyticsPlatform

DB DB DB

Real World

High-speed retrieval of spacial data

DB import

Sensing

Alert

Analytics & Visualization

Parallel data analysis

12


InfrastructureforStreamData Management and Analysis

Probe-CarData(PCD) RoadMap Data

CPSDatabase

TokyoYoga

SangenjayaIke

jiri

Ohashi

Shibuya

Shibuya

Takagicho

Tanimachi

Route −→

0.0

0.2

0.4

0.6

0.8

1.0

Mixi

ngco

effic

ient

Smoothtraffic

Slowtraffic

TanimachiJCT

OhashiJCT

TokyoIC

0.0 0.2 0.4 0.6 0.8 1.00.0

0.2

0.4

0.6

0.8

1.0

True

Pos

itive

Rat

e

Proposed methodBaseline

0.0 0.2 0.4 0.6 0.8 1.0False Positive Rate

0.0

0.2

0.4

0.6

0.8

1.0

Pre

cisi

on Proposed methodBaseline

- E D C EH JC A J C D E D JJ J

H SCEHJ C J EH J C B 9RB D :

1 CE J C H C JC C B

J AE J E 5/0 SJ C D H J P J C J / /

DD A

Real Time Traffic Incident Monitoring System

Incident detection

11101111111111111001010110101010

C J J J H C D

S0 CR , %5J C A C C , CE J

Compressed Spatial Index

Traffic Flow Model

H C EH J D JC A J

C ( ) . DC A J BD AC %D C J CE EH

6 E H B D H

C A C AJ C B 5/0

DistributedQueryProcessor ParallelProcessingFramework

. J

D CDCBPC C A

E B

C J C PC A

J C JCI J HJ C A S

BC P J

B H C D2 HR-tree

13


VisualizationandIntegrationofscientific,social,andparticipatorydatastreamsforsmartsnowremoval

14

Streamreal-timeprocessing

Weatherdata

Multi-stream

Massmedia SocialmediaOneofthelargest

DBinJapan

Spatialinformationprocessing

Visualinformationprocessing

CPSDataManagementInfrastructure

Verifysocialmediabasedonotherstreams

Multimediadatabaseand

queries

Alerts forrapid

response

Spatio-temporal

visualization

Activeresponsebyamobileapp

Crowd-reporting


Crowdsourced MobileSensing

DriversPedestrians

Privatesector

Publicsector

MobileSensingPlatform

MobileSensingApplication

MobileApplicationforBusiness

ToolsforInteractiveAnalysis

Cloud• AnalysisofTrajectories• EventDetection

• informationcityroundupandrecommendations

• sensing

• collect sensor data• provide roadside event

information

Integration of Sensing Dataand Social Big Data

“crowdsourcing”– theactoftakingatasktraditionallyperformedbya

designatedagentandoutsourcingitbymakinganopencalltoanundefinedbutlargegroupofpeople([Howe2006]).

– cantaketheformofpeerproduction– isalsooftenundertakenbysoleindividuals

(“collectiveknowledge”)

motivatingcitizenstoparticipateintheservicebyprovidingusefulfunctionsandinformation

DrivingRecorderApplication

[sensing]• recordingsensordataandmoviewhileusersdrive• sendingdrivelogsandmoviestotheserviceplatform• enablinguserstoposteventsthattheyrealize

[showinginformation]• eventinformationcollectedfromusers

SystemOverview

• Location– latitude,longitude,altitude

• Move– acceleration(x,y,z)– gyro(x,y,z),– course,speed

• Scene– movie(1280x720,mp4)

CollectedData

CrowdsourcedMobileSensing

15

National Institute of Informatics16





NII HokkaidoUniv.

OsakaUniv.

KyushuUniv.


SocialCPSSmartFederationIntegratedPlatformanditsSoftwareTechnologies

��

Goal �SocialCPSSmartFederationIntegratedPlatformTechnologiestodevelop�v Federationtechnology/visualanalyticsplatformarchitecture/smartphone-basedcrowd

sourcingofrealtimelocationdataandimagedatav LargescalesocialCPSdatawarehouse/mobileSNSv SocialCPSIntegratedPlatformArchitecture

Smart federation platform architectureOpen publication of Web-top meme media system WebbleWorld

Smartphone-basedcrowdsourcingofrealtimelocationdataandimagedataRealtimecapturingoflocationsofbusesandsnowremovalvehicles

map

Patternmining

Speedheatmap

3Dmeasurementvisualization

ExploratoryvisualanalyticswithGeospatialDigitalDashoboard todetecttrafficobstaclesforpinpointsnowremoval

Large-scalesocialCPSdatawarehouse- NoSQLdatabase anditsinterface- Web-baseddataacquisitionanddatavisualizationviewer

Federationg 10toolsandserviceswithin10min.

VisualAnalyticsPlatformArchitecture- GeospatialDigitalDashboardwithaccesstorealdata- Coordinatedmultipleviewsandanalysesframework

Locations of snow removal vehicles

Bus:Location / acceleration 3D measurement of roads with LRS

Datasharingamong4researchgroups

Snow removal trajectory

Bus trajectory 3D measurement of roads


Large-scalesocialCPSvisualanalyticsservicelibrary

18

Goal�Toenrichthelarge-scalesocialCPSvisualanalyticsservicelibraryTechnologiestodevelop�v Registrationofexistinganalysisandvisualizationtoolsandservicesv Developmentofnewanalysisandvisualizationtoolsandservicesv Implementationofreal-timeanalysistools

High-speed trajectory mining and flock pattern discovery

Spatial analysis of behavioral obstacles

Datastreamcompressionforpatternminingwithoutdecompression

Summerred�winterblueIdentification of winter time obstacles

Visualization of traffic jam, weather radar data,

estimated amount of snow removal, and snow removal trajectory

Clustering analysis of road links

(Gudmundsson et.al.AGIS2006)

flockpattern

Rajectory data

�

� �

�

�

� �

� �

�

� �

� �

� �*� �� ( '�� ')' � � $ � � � )! � �� '� � � � %�( '�%& � � � �

�#

!$

%�&

&�#

"�%

�'�

#��

��

�� %��&'

�� %��

�� %

�( " &'�

��

� *�$

�

��

��

��

��

� ��

��

!��! �

��

��

��

��

�!��

� "��

BettercompressionthanGzip

750timefaster

Twotimesfasterretrievalthan

Zgrep

�compressionandretrievaloftrajectorydata�compressionoflogstreamdata

Typicalroutechangedscovery oftraffic�Applicabletoanonimous trajectorydata

Smartphoneapplication�evacuationlogacquisition

Spatialanalysisofevacuationobstacles

AftersnowfallDailychangeofaveragespeed

ineachroadlink

Beforesnowfall

Identifyingtrafficjamsaftersnowfall

GenericwrappingofanalysistoolsinR,Octave,Rubyintocomponents






NII HokkaidoUniv.

OsakaUniv.

KyushuUniv.

19


Modeling,SimulationandVisualizationforConstructingSmartCities/Buildings

1 0ENR @AG 0L @ /AD E L :A ME C

0 0 0 0D0

3 5 0 0 3 3 0E 0 3 3 0 5

0 10 3 2 3

3 5) 0 3 ( 0 0

02 0 0 00 0 3 3 0

v Urbansensingforprecisere-productionofpedestrian/vehicularmobility intargetareas

v Usageofsimulationforfuturecityplanningandevacuationplanningatemergencysituations

v Visualizationofsimulationresults

EMO GES NE

Pedestrian flow Simulation

# of visitors for buildings

Laser Range Scanner

Security Camera

Urban Sensing/Simulation Technology

20

OH 0A NLE /2 :0 A N . DEA AHA N

1.HumanTrackingandEnvironmentalSensingTechnologies

2.BEMS2.0ConceptEstablishment(NewMetricsDesignandFeedbackControl)

3.BEMS2.0ProofofConcept

• productivity-basedenergyefficiency

• human-orientedthermalcomfort

• CFD-basedfeedbackfunction

demonstrationfor33months

• 2LIDERsand52Temp.Sensorsin“KnowledgeSalon”

• CloudUploading&SmartphoneApp

CA: ALH )+ T"

Toohothere?

Wonderful!

Cometoseeus!(>_<)

:H LN D AM

1ECEN G:EC CA1EM G R

DEN E- M M LCDNN && M M LC&DEN E&

0L @ @ :7:EMO GES NE

DA E3L @BL N MME A . L ) ( "

2 ALCR EN L .EL :A M LM

.EL @ 2 ALCREMO GES NE

EN E

CA: ALH )+ T"






NII HokkaidoUniv.

OsakaUniv.

KyushuUniv.

23


PervasiveSensing- AdaptiveSensorNetworkonCampus-

Objective : Constructionofreal-timesocialsensingsystemIssues :v Measurementofthepositionforeachpersonbycamera,Wi-FiAP,IDcardreaderv Measurementofenvironmentalinformationsuchastemperaturev Integrationofsensingdataforgraspinghumanactivity

Integratedserver

Sensing�Personposition�Powerusageofappliances

Integration�Persontrajectory�Personalpowerusage

Cameraserver IDcardserver Smartplugserver

ProvideAPI

VisualizationMiningFeedback

Outdoorsensornode• Selfpowergeneration• Over6Mbps

Ad-hocprivatenetwork• High-throughputmultistagerelay• Easyextensionofsensingareaandsensors

24


• Peakshiftbasedonschedulechange• Balancingbetweenefficiencyofpeakcut

andtimechangeofschedule

DataAnalysisandFeedbackforEfficientEnergyUsage

Objective : ConstructionoffeedbacksystemforefficientenergyusageIssues :v Analysisoftherelationbetweenpersonbehaviorandpowerconsumptionv Visualizationofsensingdataforanalysisandindicationtouserv Supportsystemconsideringacceptabilityforefficientenergyusage

Feedbacksystem

VisualizationforadministratorAdvancedanalysis

VisualizationforuserSimple,easytounderstand

Inputschedule

Powerdemandestimation

Peakshiftplanning

Requestformodifyingschedule

Peakshiftsystem

0

500

1000

1500

11-Jan 12-Jan 13-Jan 14-Jan 15-Jan 16-Jan 17-Jan 18-Jan

Power

[W]

Powerdemandestimationbasedoninputschedule

Estimatedpowerdemand

Groundtruth

Estimated

Cooperativepeakshiftbetweencommunity

FutureworkWhatkindofincentiveisappropriate?

25






NII HokkaidoUniv.

OsakaUniv.

KyushuUniv.

1. SmartSnowRemovalOperations

2. Productivity-basedEnergyEfficiency

26


Improvementon• Averagespeedofthetraffic /Averagedelayoffixed

routebuses /Arrivaltimeofemergencyvehicles• CO2emissionfromtrafficjams• Annualcostofsnowremoval• WintertrafficaccidentsEvidence-basedquantitativeaccounton• Trafficdisturbancebysnowfalls• SnowremovaleffectInformationsharingbetweenthecitygovernmentandcitizensCitizen→ ��

• Complaints /roadconditionsandaccidents�� → ��

• Conditionsofroad/traffic/snowremoval/weather

DEMO1:Evidence-basedImprovementofSnowRemovalinSapporo

27


RoadMeasurementwithReal-timeDatan Detectionandanalysisoftrafficjamsandthecauses

T Pinpointsnowremovalreducesjamsn Detectionandestimationofjamsandfrozenroadsurface

T Informationdisseminationtocitizensn Evaluationofmeasuresbyanalyticsandsimulation

T Prioritizationofoperationswithpreventiveactionsn Effectevaluationofprovecardata

T Decisionmakingbyevidence

DataAnalytics&Simulation

Overview ofthesystem

Probe car data Weather data

• Laser range scanner• ABS functioning

position info.• VICS data• Traffic accidents info.

Exploratoryvisualiztion andanalytics

CPS data management platformMulti-stream data processing, data store, access control

28


3Dmeasurementofroadsnowfallbylaserrangescanner

Deviceattachedtoabus

MeasurementofroadsnowfallincooperationwithSapporocity’ssnowcontroloperationsforimportantbusroutes

29


TrafficjamanalysisthroughExploratoryvisualizationandanalytics

• Interactiveanalysisbyimprovisationalcombinationofmapanddatamintinglibrarytools

• Evidence-basedanalysisoftrafficjamcausesT Effectivepinpointsnowremoval 30


Measurementofroadconditionsusingcrowd-sourcingAPPsfordriverecorders

SensingØ Recordingandtransmitssion of

sensorlogandimagesØ Submissionofeventdetections

(construction,jam,...)Informationdisplay

DataacquisitionusingmobileAPPs

Dataprocessingandserviceplatform

DriverecorderAPP

Ø GPSpositioninfo.Ø image 1280×720 px mp4Ø Accelaration,gyroscopic,directional

Portalsite

Feedback through processing acquired dataReal-time traffic info, road condition, event detection

Variousimagesofaparticularpoint

31


Simulationofsnowfalleffectstoroadtraffic

Measurement of effective road width by car-mounted cameras

ObstacledetectionVehicledetection

32


SummaryofEvidence-basedImprovementofSnowRemovalinSapporo

Cyber Space

Probe car dataDrive recorderWeather informationClaim informationetc.

Major roads of the city

Real-time sensing of road and snow conditions

Real world sensors

Maximization of snow removal results

Supports for snow removal operations

and feedback of related informationweather×roads×traffic

×humans

Acquisitions of weather and road conditions and optimization of

snowfall managementCyber World

Physical World

Monitoring of conditions and results

Reduce traffic jams, accidents and snow removal cost

33






NII HokkaidoUniv.

OsakaUniv.

KyushuUniv.

1. SmartSnowRemovalOperations

2. Productivity-basedEnergyEfficiency

34


DEMO2:HumancentricEnergyManagement

Sensing

Utilization

Controlofairconditionerandillumination

Congestion-awareventilationforeachzone

Co-operativepeakshiftbetweenmultiple community

Navigationforpreventingheatstroke

Indicationofecologicalbehavior

Buildingcontrol&support

Planningsupportforlayoutdesignofappliances

Behaviorsupport

Mobilesensing(Acceleration,position,tweet,temperature)

EnvironmentEstimationofcomfort

HumanbehaviorActivity,congestion

Infrastructuresensing(Camera,Wi-Fi,IDcard,power,temperature,CO2)

Productivity-basedEnergyEfficiencyØ Energyper‘productivity’insteadofthephysicalsize

Evaluationof‘comfort’asproductivity

Privateorofficespace

Kyushu universityItocampus

Publicspace

GrandFrontOsaka DIAMOROSAKA

35


Conventionalenergysavingmeasures

• Coarse sensing • Coarse feedback

On a building and daily basis No use of acquired data, uniform directives

36


Powerconsumptionmeasurementbyindividualpowersensors

37


Humanlocationsensingbylaserrangescanners

502 20

0 20

38


HumanmovementmeasurementbyICcards,camerasandWiFi APP

39


Sensordataintegrationinvirtualenvironment

40


Comfortestimationmodelbasedoncongestionandenvironmentaldata

Comfort control based on ambience of people and air flow

41


Smartcampusexperimentat

KyushuUniversity

ExperimentatKnowledgeSalonofGranFrontOsakabyOsakaUniversity

2cases:smartcampus&commercialbuilding

42


BEMS2.0HumancentricBEMScompatiblebothwithcomfortablenessandenergysaving

human×ambience×energy

Air control, congestion information and feedbacks

Shopping and office buildingsReal world sensors

Cyber Space

Compatibility of comfortableness and energy saving

Fine sensing on a individual basis

Optimal control and analysis of individual comfortability

Cyber World

Physical World

Monitoring of conditions and results

43


ChallengesinCSPStudies

Real World

Sensor

Actuator

Controllable MachineCyber World

��

MobilePhone

realworldunderstanding

content

Serviceapplications

contentcontentcontent

ServiceapplicationsService

applications

�HowtogetrealworldData?�Corporationsarereluctanttodisclosetheirdata.Security,privacyissues,corporateconfidentiality�Valuevs.efforts;C/Phardtobalanceinitially.achickenandeggproblemexists�Limitedknowledgeineachphysicaldomain

Biginternetplayersleaddatacollection,dataanalyticsandevenITinfrastructuredesignitself.

Collaborationwithindustryisakey.But,withwhom,inwhatway?

HowshouldacademiacontributetotheprogressofICTviaCPSstudies?

44


Summing-up: CPSto“Scoal CPS”

Social and human aspects are important in order to correspond to societal dynamics.

AimingatanewCPSconceptthatisapplicabletochangevarioussocialsystems

Effective social activities to improve citizens’ comfort

Abstraction and modeling of societies

Management of social resourcessocial systems

Sensors, Actuators, Networks, Computers, DB Operating System (OS)

Social CPS as an operating system of society

45

cps isip 20161104-adachi-2 · 2016. 11. 15. · official road information ... integration of...

Documents