arpan pal besu
TRANSCRIPT
1
Intelligent Infrastructure using Human-in-Loop Cyber-physical Systems- Social Network as a Soft SensorDr. Arpan PalHead of ResearchInnovation Lab, KolkataTata Consultancy Services Ltd.
OutlineIntelligent Infrastructure and Human-centric Cyber-physical Systems
ArchitectureSocial Media as a Soft Sensor
Application Use CasesPublic SafetyTransportationHealthcare
Technology for Social Media Soft SensingAccess TechnologiesNatural Language Processing and Emotion MiningRIPSAC – a generic platform for Internet-of-Things
Innovation @TCS
Intelligent Infrastructure and Human-centric Cyber-physical Systems
4
Human-in-Loop Cyber-physical Systems
Humans
Computing Infrastruct
ure
ICT Systems
5
Human-in-Loop Cyber-physical Systems
Humans
Physical Objects
and Infrastruct
ure
Computing Infrastruct
ure
Cyber-physical Systems
6
Human-in-Loop Cyber-physical Systems
Humans
Physical Objects
and Infrastruct
ure
Computing Infrastruct
ure
Human-in-loop Cyber-physical Systems
Personal
Context
Discovery
Physic
al
Conte
xt
Disco
very
Social Media
What we talk aboutthe physical world
around us
Social Media
What we talk about ourselves
7
Signal
Processing
Intelligent Infrastructure
Sense
Extract
Analyze
Respond
Learn
Monitor
IntelligentInfra
@Home
@Building
@Vehicle@Utility
@Mobile
@Store
@Road
“Intelligent” (Cyber) “Infrastructure” (Physical)
APPLICATION SERVICES
BACK-END PLATFORM
INTERNET
GATEWAY
Internet-of-Things (IoT) Framework
Sense
Extract
Analyze
Respond
Communication
8
Intelligent Infrastructure Architecture
People Feedback & Emotions
Social Media
Integrated Services
Sensors & IoTPlatform Traditional Monitoring & Control Systems Citizen Data
Smart Integration Platform
Transportation Healthcare Electricity
WaterPublic Safety Tourism
Smart Domain Services
Community
etc.
Sense: People Activity, Appliances, Vehicles , Road, Home/Bldg, Utility Infrastructure
Integration Platform
9
Social Media as a soft sensor?
Incoming data is not from any physical measurement but from the social media expressions from people
People either talk about themselves or they talk about what is happening in their surrounding
Both have rich information content
Can be converted into meaningful soft sensor observations through Text Processing and Natural Language Processing (NLP) of the social media posts
10
Source of Data
Text data that gives rise to sensor readings
– Mail chains
– Public discussion forums
– Crowd-sourced wikis
– Blogs / Microblogs / Social network status updates and comments
Application Use Cases
12
Public Safety Continuosly collect tweets based on location
and keywords
Create keyword lists for each calamity using synonyms of the calamity word.
(e.g.) burglary, theft, arson for burglary.
Detection of abnormal activities related to public safety like burglary, fire, gunshots, earthquake etc. from geo tagged tweets
Cluster classified tweets based on geo location to determine sense of intensity and extensiveness of calamity such as earthquake in a region
13
Transportation
Sentiment analysis on public tweets during a sporting/entertatinment event and predicting the time and route of departure of the huge crowd (e.g. traffic and crowd control around a sports stadium)
Finding occurences of traffic jam from geo-tagged tweets and finding the best route from crowd-sourced data
Creating a pothole map of the city
14
Healthcare
Find out the set of people who can form a self help group amongst themselves for support and advice for a given disease. – Use hidden community detection by applying
NLP on posts to create the social graph to identify the undeclared community
Monitoring health by inferring from social media such as blogs, micro-blogs, posts, comments with possible extension to disease onset detection like dementia or Alzheimer's disease from social network posts– Search for patterns in posts to detect possible
symptoms to diseases– E.g. - sentiment analysis on posts will give
whether the given post’s emotion is positive or negative. If the emotions are cycling between positive and negative extremes with some periodicity, probably the person has bipolar disorder
Technologies for Social Media Soft Sensing
16
Access Technologies
Source: Moo Num Ko et. al., IEEE Computer Magazine, Aug 2010http://www.profsandhu.com/journals/computer/computer1008.pdf
17
Access Technologies (Contd…)
Authentication and Authorization– OAuth
o Twitter and Facebook currently use OAuth version 2.0
– OpenIDo Used to create a user name and password to be
used across different sources of social network posts
Streams– Open Stream used by facebook– Open Social used by Google and MySpace
Application APIs– Rest API– Streaming API
o Twitter Firehose – real time streaming of all tweets
o Twitter Gardenhose access level
18
Natural Language Processing
Language identification and translation
Spelling correction
Segmentation of different Parts of Speech– Named entity recognition – to identify
proper nouns
Classification – To classify text into categories– Dynamic language model classifier / Naive
Bayes classifier – Requires manual annotation for training
Word sense disambiguation– Dictionary based
19
Emotion Mining
Classify text as either ‘positive’ or ‘negative’ emotions– Use AFINN to find the amount of +ve or –ve
of emotions in each sentence
Use Dictionary like Wordnet – Use word sense disambiguation to
disambiguate each word in the sentences of a post into its corresponding synset id
– Map them to the type of emotion that that synset id represents
Observe the flow of emotions as a function of time and users – track at individual and group level
20
TCS IoT Platform - RIPSAC
Internet
Inte
rnetInte
rnet
Sensor Services
Analytics
StorageServices
RIPSAC Platform
App Developers
PaaS Provider
End User
Sensors
Sensor Providers
RIPSAC – Real-time Integrated Platform for Services & AnalytiCs
21
RIPSAC Architecture - mapping to Social Media Analytics
Internet
End Users Administrators
Device Integration & Management Services
Analytics Services
Application Services
Storage
Messaging & Event Distribution Services
Ap
plic
ati
on
Serv
ices
Presentation Services
Application Support ServicesM
iddle
ware
Edge Gateway
Sensors
Internet
Back-end on Cloud
RIPSAC – Real-time Integrated Platform for Services & AnalytiCs
TraditionalInternet
Service Delivery Platform & App Development Platform
Security/Privacy Framework
Lightweight M2M Protocols
Analytics-as-a-Service
Social Network Integration
SDKs and APIs for App developer
Access Technology Library
NLP and Emotion Mining Library
Innovation @TCS
23
Innovation@TCS - Innovation Labs
Bangalore, India1
TCS Innovation Labs - Bangalore
Chennai, India2
TCS Innovation Labs - ChennaiTCS Innovation Labs - RetailTCS Innovation Labs - Travel & HospitalityTCS Innovation Labs - InsuranceTCS Innovation Labs - Web 2.0TCS Innovation Labs - Telecom
Cincinnati, USA3
TCS Innovation Labs - Cincinnati
Delhi, India4TCS Innovation Labs - Delhi
Hyderabad, India5
TCS Innovation Labs - HyderabadTCS Innovation Labs - CMC
Kolkata, India6
TCS Innovation Labs - Kolkata
Mumbai, India7
TCS Innovation Labs - MumbaiTCS Innovation Labs - Performance Engineering
Peterborough, UK8
TCS Innovation Labs - Peterborough
Pune, India9
TCS Innovation Labs - TRDDC - Process EngineeringTCS Innovation Labs - TRDDC - Software EngineeringTCS Innovation Labs - TRDDC - Systems ResearchTCS Innovation Labs - Engineering & Industrial Services
1 2
3
4
597
6
8
2000+
Associates in Research, Development and Asset Creation
19 Innovation Labs
24
Academic Co-Innovation Network (COIN )
Fostering joint research and innovation through a mutually beneficial alliance between TCS and academia
Academic context
Thoughts and research towards disruptive InnovationKnowledge exchange and people development
Industry-oriented Business context
innovation scalability of academia context of real-world problems
Collaborativeresearch
environment
Collaboration Mechanisms•MoU based Alliances•Sabbaticals – Academia to TCS Innovation Lab and TCS Innovation Lab to Academia•TCS Research Scholar Program•Masters and PhD Internships
Joint publications and IPRs
25
Innovation Lab, Kolkata
Research Areas• Sensor Signal Processing• 2D/ 3D Image / Video
Processing • Protocols, Security and
Privacy• Parallel and Distributed
Computing• Stream Processing and
Reasoning• System Modeling and
Identification• Sematic Sensor Web• Social Media Analytics
Academic Collaborations• Singapore Management University (iCity
Platform)• Indian Statistical Institute (Protocol/Privacy,
Image / Video Processing)• IIT Kharagpur (Analytics, Personal Context
Extraction)• IIT Bombay (Energy and Utilities)• Jadavpur University (Signal Processing)
Application Areas• Wellness and
Healthcare• Energy and Utilities• Transportation
