icos big data camp may 19-22 and 29, 2014 co-sponsored by icos, arc, and lsa
TRANSCRIPT
![Page 1: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/1.jpg)
ICOS big data camp
May 19-22 and 29, 2014Co-sponsored by ICOS, ARC, and LSA
![Page 2: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/2.jpg)
Who is everybody?
• Executive producer:~ Matt Burton
• Producers:~ Jerry Davis, Cliff Lampe, Brian Noble, Jason
Owen-Smith
• Code Concierges (CoCons):~ Khevna Shah, Nick Repole, Guarav Singhal,
Tyler Markvluwer, Jonathan Pevarnek, Deep Patel, Matt Baumgartner
![Page 3: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/3.jpg)
What are we up to this week?
• Monday: overview, hero’s journeys, forming groups for projects
• Tuesday: SQL• Wednesday: Python• Thursday: using APIs• Friday: write “Social capital asset
pricing model (SCAPM)” app for iPhone, sell to Facebook for $10B, quit grad school
![Page 4: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/4.jpg)
What does social life look like today?
Consultant running meeting on Google Hangouts
Real estate agent checking listings Journalist applying for
job
Student writing paper for class
Professor grading papers
Activist uploading files to Wikileaks
![Page 5: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/5.jpg)
![Page 6: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/6.jpg)
Thanks to ICTs, economics today is “roughly where astronomy was when the telescope was invented or where biology was when the microscope was invented.” (Robert Shiller, smart guy)
![Page 7: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/7.jpg)
HOW SHOULD THE PERVASIVE “MEDIATION” OF CONTEMPORARY SOCIAL LIFE AFFECT SOCIAL SCIENCE?
![Page 8: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/8.jpg)
Google Trends: the gateway drug for big data
![Page 9: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/9.jpg)
NEW INSIGHTS INTO TRADITIONAL TOPICS
![Page 10: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/10.jpg)
Does racism influence voting?
![Page 11: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/11.jpg)
Does racism influence voting?
![Page 12: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/12.jpg)
NEW INSIGHTS INTO NEW TOPICS
![Page 13: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/13.jpg)
E.g., ICTs and social movements
![Page 14: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/14.jpg)
What do these organizations have in common?
![Page 15: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/15.jpg)
![Page 16: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/16.jpg)
![Page 17: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/17.jpg)
![Page 18: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/18.jpg)
![Page 19: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/19.jpg)
![Page 20: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/20.jpg)
![Page 21: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/21.jpg)
![Page 22: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/22.jpg)
Surprising sources of network data
![Page 23: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/23.jpg)
![Page 24: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/24.jpg)
![Page 25: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/25.jpg)
![Page 26: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/26.jpg)
![Page 27: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/27.jpg)
![Page 28: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/28.jpg)
![Page 29: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/29.jpg)
Some big data questions
• Where do I get “big data”? Is there some secret handshake I need?
• What does it look like?• How do I make gigabytes of words
and numbers into something meaningful?
• If I can’t learn to do everything I need about big data in a week, where can I go next?
![Page 30: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/30.jpg)
How big is big data?
• Visit your favorite website (e.g., www.umich.edu)
• Right-click and “View page source”• Wait, what is all this stuff?• Search for http://• Is there some convenient way to search
through all this junk online, copy it, and drop it into a database for future use? (Will the site’s owner get mad?)
• Is there an easier way to just download all this stuff in bulk?
![Page 31: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/31.jpg)
A method and three tools to start
• The method: learning in groups (cf. “agile software development”)
• The tools:~ SQL: how to manipulate those
databases underlying what you see on the Web
~ Python: a pretty good open-source programming language
~ APIs: how to get them to talk to you
![Page 32: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/32.jpg)
The deliverable
Find one interesting true thing to say about your group’s topic by one week from Thursday afternoon, and explain how you got there
![Page 33: ICOS big data camp May 19-22 and 29, 2014 Co-sponsored by ICOS, ARC, and LSA](https://reader036.vdocument.in/reader036/viewer/2022062518/56649edd5503460f94bedb99/html5/thumbnails/33.jpg)
Group formation processGroups will be formed on the basis of shared
interest in a topic1. Head to the area with the topic that most interests you2. Discuss prospects with other people there3. After 10 minutes: BREAK and go back to your seat4. Repeat Step 1; you may choose to go to another area5. After 7 minutes: BREAK and go back to seat6. Final round; groups finalized
Constraints:1. Groups must have at least 3 people, and no more than 62. Aim to have at least 3 departments/areas represented;
good to have at least one person who knows what “API” means