data visualization and digital humanities research
DESCRIPTION
A presentation given at LITA National Forum 2011 in St. Louis. The presentation, by Erik Mitchell & Susan Smith, was about a project that was supported through a Wake Forest U Summer Technology Exploration GrantTRANSCRIPT
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ry
Data visualization and digital humanities research:
a survey of available data sets and tools
LITA National Forum 2011St. Louis, MO
Friday, September 30, 2011Erik Mitchell, University of Maryland
Susan Sharpless Smith, Wake Forest University
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryMotivation
“Digital humanities needs gateway drugs. Kudos to the pushers on the Google Books team.”
- Dan Cohen http://www.dancohen.org/2010/12/19/
“Linked open data could have the same leveraging effect that the World Wide Web had on computing, said Micki McGee, an assistant professor of sociology at Fordham University”
-Steve Kolowich, The Promise of Digital Humanities, Inside HigherEd
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryBirth of a word
“Imagine if you could record your life, everything you said, everything you did available in a perfect memory store at your finger tips. “
- Deb Roy – The Birth of a Word http://www.ted.com/
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryOverview
• Discuss examples of data-focused research tools
• Explore tools• Consider roles for librarians• Wrap-up/Q & A
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryTaxonomy of uses
Resource type Research methods
Discovery Text searching, citation chaining, concept exploration
Visualization Mapping, graphing, charting
Analysis / publishing Dataset publishing, statistical analysis, annotation
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
rySearching and Discovery
Examples: BYU Corpua http://corpus.byu.edu/
WOK Citation Mapping WOK
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryVisualization
Free Visualization Tools
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryAnalysis and publishing
NodeXL http://nodexl.codeplex.com/
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryTool Comparison - linguistics
Evaluation areas Tool features
Index approach features Concordancing, lemmatization, semantic relationships, collocation/KWIC, sense disambiguation
External links / interoperability Links to lexical databases (e.g. wordnet), data export, metadata structures, common search features
Dataset population Population definition, open or closed, data source, syncronic/diacronic, mono, bi, pluralingual?
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryTool exploration
• Discover / Search• What kinds of discovery tools exist and how
common are the discovery features across different datasets / systems?
• Visualization• What visualization features exist, are there products
that are easy to use, are the skills transferable?
• Analysis / Annotation• What analytical tools are included, what analysis
techniques are common?
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryPerseus
http://www.perseus.tufts.edu
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryJSTOR Data For Research
http://dfr.jstor.org
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryWordseer
Aditi Muralidharan Marti Hearsthttp://bebop.berkeley.edu/wordseer
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryGoogle’s Ngram Viewer
books.google.com/ngramsculturomics.org
But here's the rub. Google Books, as others point out, wasn't really built for research. . . That means Google Books didn't come with the interfaces scholars need for vast data manipulation . . . http://chronicle.com/article/The-Humanities-Go-Google/65713/
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryTed talk on Google NGRAM viewer
http://www.ted.com/talks/what_we_learned_from_5_million_books.html
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryConcordancing
Eric Lease Morgan - http://dh.crc.nd.edu/sandbox/cyl/catalog/
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryGoogle’s public data explorer
http://www.google.com/publicdata/
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryData analysis - NodeXL
http://nodexl.codeplex.com/Analyzing Social Media Networks with NodeXL: Insights from a Connected World
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryData cleaning – Google Refine
http://code.google.com/p/google-refine
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryData visualization – Google Fusion Tables
http://google.com/fusiontables
http://www.google.com/fusiontables/DataSource?dsrcid=332788
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryResearch/teaching need
• Researcher needs vary from advanced linguistic analysis and IT support to need for basic digital content/infrastructure
Corpus-based research
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryLibrarian contributions
• Domain specific, tool-type specific comparisons
• IT and research support – data analysis, data curation, tool/data sources identification
• Shift from “reference” to “research” in sync with move from resource discovery to thematic analysis
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
ryNext steps
• Build new skills, develop new systems• Create tutorials guides• Explore connections between data/curation
and publishing and these tools – so is there a connection
• Explore role of library discovery systems and consider new feature implementation.
1011
00LI
tera
ryCr
itici
sm01
0111
0100
01Sh
akes
pear
e010
1Tra
nsla
tion1
0Lin
guis
tics
1110
1Dig
tial
Colle
ction
s010
10To
pic
Ma
pp
ing
01H
isto
rySites of interest
Data analysis• Google Refine• Rapidminer• Lingua tools
(http://search.cpan.org/~emorgan/)
• http://alias-i.com/lingpipe/web/competition.html
• Digital Resource Tools
Visualization• NodeXL• Google Public Data Explorer• Google Fusion Tables• http://bit.ly/lita_datatools• Projectbamboo.org
Data publishing• Corpus of Contemporary
American English• British National Corpus• http://corpus.byu.edu/• JSTOR DFR• digitalresearchtools.pbwor
ks.com
Discovery• Wordseer• Perseus (Tufts)• Google Ngram Viewer• Corpus.byu.edu