hurricane sandy data analytics han dong shujia zhou iab meeting 2013
TRANSCRIPT
![Page 1: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/1.jpg)
Hurricane Sandy Data Analytics
Han DongShujia Zhou
IAB Meeting 2013
![Page 2: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/2.jpg)
Outline
• System Overview• Data Collection and Cleaning• Bag-Of-Words Model• Topical Model Visualization• Twitter Activity Graph• Heat Map• Conclusions• Future Work
![Page 3: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/3.jpg)
System Overview
![Page 4: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/4.jpg)
Data Collection and Filtering
Location Size of Data (MB)Florida 100
South and North Carolina 200
Georgia 80
Virginia 100
Maryland / Washington DC 60
New York City 40
New York 100
Massachusetts/Rhode Island 50
~360,000 unique Twitter comments~600 Mbytes of data
![Page 5: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/5.jpg)
Bag-Of-Words Model
![Page 6: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/6.jpg)
Topical Model Visualization
![Page 7: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/7.jpg)
Twitter Activity
26-Oct-12 27-Oct-12 28-Oct-12 29-Oct-12 30-Oct-120
500
1000
1500
2000
2500
3000
3500
4000
4500
EvacuateNot Evacuate
Num
ber o
f Tw
eets
26-Oct-12 27-Oct-12 28-Oct-12 29-Oct-12 30-Oct-120
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0.45
EvacuateNot EvacuateRa
tio
![Page 8: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/8.jpg)
Heat Map
![Page 9: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/9.jpg)
Conclusion
• Implemented a system to automate social media data extraction, processing and visualization.
![Page 10: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/10.jpg)
Future Work
• Apply the current data and system in another major hurricane this year.
![Page 11: Hurricane Sandy Data Analytics Han Dong Shujia Zhou IAB Meeting 2013](https://reader038.vdocument.in/reader038/viewer/2022102900/551c1c84550346b24f8b59a4/html5/thumbnails/11.jpg)
This work was funded by NSF CHMPR through NOAA. We thank Ben Kyger for helpful
discussions.