1

Data Science for Conservation

International's Big Ecosystem Data

Dr. Brand NiemannDirector and Senior Data Scientist/Data Journalist

Semantic Communityhttp://semanticommunity.info/

http://www.meetup.com/Virginia-Big-Data-Meetup/ http://www.meetup.com/Federal-Big-Data-Working-Group/

http://www.meetup.com/Northern-Virginia-Semantic-Web-Meetup/ http://semanticommunity.info/Data_Science/Federal_Big_Data_Working_Group_Meetup

May 25, 2015

2

Overview

• I am looking for the best datasets to visualize in Spotfire that come from Vertica and the TEAM Site.• For example I see at: http://www.teamnetwork.org/products/gis

• GIS Datasets I could download by agreeing to the Agreement (which I did) and others that say:• Supplementary GIS Data (for select sites)• TEAM Network Members only• Your account does not currently have Network Member privileges.• So should I request permission to work with those?

• Riwanda: http://www.teamnetwork.org:28080/gridsphere/gridsphere?cid=download• Got a few examples of spreadsheets

• Lidar: http://www.teamnetwork.org/data/lidar• Got a few examples of images and PDF Metadata

• Camera Trap: http://www.teamnetwork.org/camera-trap-downloads• Got an example of JPEGs

• I tried: http://www.teamnetwork.org/gridsphere/gridsphere?cid=search• And got a popup message that said the file was 132 MB and an email would be sent to download it. I got the 10 MB ZIP

download file just now and it looks useful.

• Did I miss anything here and are there any other data download sites like TEAM?

3

TeamNetwork.Org: Web Page

http://www.teamnetwork.org/

Download Team Data

4

Data Query and Download: Web Page

http://www.teamnetwork.org/data/query

• TEAM Protocol Data• Monitoring Ecosystem Services,

Agriculture, and Livelihoods in Rwanda

• Lidar Data• GIS Data• Historic Camera Trap Data

Got an example of Each: See Next Slide

Search

5

Data Query and Download: Files

6

Earth Insights from Big Data:MindTouch Knowledge Base

Earth Insights from Big Data

7

Earth Insights from Big Data:Spotfire Cover Page Lidar Data

Web Player

8

Earth Insights from Big Data:Spotfire CI Biodiversity Hot Spot Lines

Web Player

9

Earth Insights from Big Data:Spotfire CI Biodiversity Hot Spot

Polygons

Web Player

10

Earth Insights from Big Data:Spotfire Ground Truth

Web Player

11

Earth Insights from Big Data:Spotfire BBS

Web Player

12

Earth Insights from Big Data:Spotfire Rwanda Terrestrial

Vertebrate 2013

Web Player

13

Earth Insights from Big Data:Spotfire AV-20150522043510_4688

Web Player

14

Conclusions and Recommendations

• I Data Mined for the best datasets to visualize in Spotfire that come from Vertica and the TEAM Site.• The data sets, and their metadata, required extraction from ZIP files and

some reformatting for input to Spotfire.• I built a MindTouch Knowledge Base and a Spotfire Dashboard to analyze 12

data sets in CSV, Excel, and Shape file formats.• The results are shown in 7 Spotfire Tabs with dynamically linked adjacent

visualizations.• I need Conservation International Subject Matter Expertise to help interpret

the Spatial Data and suggestions for more data sets for Data Science.