bird game app - rhok trento december 2011
TRANSCRIPT
PowerPoint Presentation
Bird Game App
Egidio Caprino
Filippo Del Frari
Carlo Mariangeli
Ermanno Moser
Nicola Perantoni
Gloria Zen
Trento, December 3rd, 2011
Project Page: http://code.google.com/p/happybirds
Migration Birds Assessment
one of the world's prime outposts for observing the spring migration of birds
issue: project (lead by World Bank) of building a channel to bring water from the Red Sea to the Dead Sea on bird migration
environmentalists accuses this would affect migration phenomenon
proof supporting this claim is needed!over 500 million birds cross Israel's airspace, heading south to warming weather in Africa.
Every autumn, million of birds migrate toward Southern warm areas of the world.
Human activities and climate/landscape changes are affecting this natural phenomenon
Goal = to identify the routes and the species that are in danger.
Case study: Israel
/
Bird Game App
Exploit crowdsourcing to collect information data on the flocks' migratory phenomenon
Collection of image data with time + GPS location of Flocks of Birds
Information about bird species + number of individuals can be automatically extracted from image.
Information about routes can be reconstructed/inferred from time+GPS discrete data.
Solution
Challenge
To build a funny + easy-to-use web game application to involve as many users as possible
Extract significant data
/
Solution flowchart
Data uploading- image- GPS×tamp- user id- (user's label)
SERVERImage processingdata+GPS+Time processing
Data Analysis
users' scores
= ?
= ?
birds/flocks data
image processing
users labeling
Estimation of- migration routes- birds population statistics
unlabeled images
/
Involving users
How to access to new users
Marketing our application within birdwatchers' community
Position information signs in strategic birdwatching hotspots
Marketing the initiative within local environmental associations (wwf, national parks, etc.)
Extend application to users with Smartphone + GPS camera
How to involve users
To build a geographical-time map for migrating birds that is a reference for the community.
Users are allowed to look through images and data on this map (e.g.)
Create a score system where user gets new points for each new image loaded or labeled
Send reminders (e.g. from year to year) to users who already participated and return in the areas of interest.
/
Smartphone
Download application
Users can download the Bird Game APP from Android Market or Apple's App Store for free.
Register to service
with a simple registration form, user obtains a unique identifier
Upload data (images & info)
user takes a photo of a bird and uploads it on the server. Photo contains info about:- GPS position- timestamp- (eventually) user's tag or comment
Interact with Server database
User can look through data on the server.Images are geo-tagged so they can be found directly on Google Maps or OpenStreetMap.Users can add new tags/labels to data.
/
Smartphone
Download application
Users can download the Bird Game APP from Android Market or Apple's App Store for free.
Register to service
with a simple registration form, user obtains a unique identifier
Upload data (images & info)
user takes a photo of a bird and uploads it on the server. Photo contains info about:- GPS position- timestamp- (eventually) user's tag or comment
Interact with Server database
User can look through data on the server.Images are geo-tagged so they can be found directly on Google Maps or OpenStreetMap.Users can add new tags/labels to data.
/
Smartphone
User can look through the data on the server
Query example:
show me pictures uploaded by user_id in the area around GPS_coordinate position
User input example:
This bird sighted at this GPS_coordinate position is a swallow
= ?
/
`Not only from Android, images with GPS position can be uploaded from the website!
Image Analysis
What can we infer (automatically or semi-automatically) from images?
/
Image Analysis
Flock's Cardinality = 8 individuals
Bird shape
Flock's V-Formation
What can we infer from Long-distance images?
Bird Species = ?
How can we infer this automatically?( opencv.willowgarage.com image processing library )
Thres-holding
Blob detection
original image
binary image
results (birds localization)
/
Image Analysis
Easy cases
Challenges
well defined silhouettes
homogeneous background
overlapping
low contrast
heterogeneous background
(swallow flock)
/
Image Analysis
What can we infer from Short-distance images?
= ?
Info about sighted Species
where/when different species stops by
= ?
/
Mining data
/
Estimation of species migration routes
Estimation of risk species
1 5 10 15 20 25 30
Birds Hotspots
1 5 10 15 20 25 30
1 5 10 15 20 25 30
Example of data:storks sighting in the month of October
Conclusions
/
We developed a system to monitor birds migration phenomenon
We want to exploit crowdsourcing. Target users are birdwatchers.
Through this system we want to create an open map migratory birds, containing information about the presence of which bird species + in which period of the year.
We show our demo implemented on a platform Android....
Solutions available at:
http://www.rhok.org/node/20752
http://code.google.com/p/happybirds/