Text Mining and the Research Library: The Humanities and Beyond

Bernard F. ReillyNovember 18, 2015

Text Mining:

Text Mining:

Generally:

Text Mining:

Generally:

Is the automated processing of large bodies of digital text content for purposes of information retrieval, extraction, interpretation, and analysis.

Text Mining:

Generally:

Involves the processing and, often but not always, normalization of unstructured text to enable pattern-recognition, topic spotting and modeling, and other types of content analysis.

Text Mining:

Sometimes:

Involves the downloading of the body of text and local processing and analysis, using tools and applications employed locally.

Text Mining:

Sometimes:

Involves the use of third-party APIs or other applications to interact with the hosted content, often crawling and extracting relevant content or metadata.

Paper Machines: a text-mining visualization plug-in for Zotero from Harvard’s MetaLab

Matthew Jockers: 500 Themes from a corpus of 19th-Century Fiction

Macroanalysis: Digital Methods and Literary History (UIUC Press, 2013),

http://www.matthewjockers.net/macroanalysisbook/macro-themes/

www.crl.edu/node/11375

Mathew Gentzkow and Jesse M. Shapiro

What Drives Media Slant? Evidence From U.S. Daily Newspapers. Econometrica January 2010

Maximilian Haeussler, UC Santa Cruz

History Lab

JISC. The Value and Benefits of Text Mining, JISC, Report Doc #811, March 2012

http://www.jisc.ac.uk/publications/reports/2012/value-and-benefits-of-text-mining.aspx

ARL’s 2012 “Code of Best Practices in Fair Use for Academic and Research Libraries”

“It is fair use for libraries to develop and facilitate the development of digital databases of collection items to enable non-consumptive analysis across the collection for both scholarly and reference purposes.”

Regents of the University of California Standard License Agreement 2011:

“Authorized Users may use the licensed material to perform and engage in text mining /data mining activities for legitimate academic research and other educational purposes.”

Liblicense Model License, 2014:

“Authorized Users may use the Licensed Materials to perform and engage in text and/or data mining activities for academic research, scholarship, and other educational purposes, utilize and share the results of text and/or data mining in their scholarly work, and make the results available for use by others, so long as the purpose is not to create a product for use by third parties that would substitute for the Licensed Materials. “

Liblicense Model License, 2014:

“Licensor will cooperate with Licensee and Authorized Users as reasonably necessary in making the Licensed Materials available in a manner and form most useful to the Authorized User. If Licensee or Authorized Users request the Licensor to deliver or otherwise prepare copies of the Licensed Materials for text and data mining purposes, any fees charged by Licensor shall be solely for preparing and delivering such copies on a time and materials basis.”

http://liblicense.crl.edu/licensing-information/model-license/

reilly@crl.edu