future of text analysis forrester briefing
DESCRIPTION
A fall 2011 briefing for personnel at Forrester in Cambridge MA.TRANSCRIPT
![Page 1: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/1.jpg)
The Future of Text AnalysisDr. Stuart Shulman
Texifter, LLC
Thursday, April 13, 2023
![Page 2: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/2.jpg)
Briefing Agenda
• R&D in Annotation and Public Comments• “The Future of Text Analysis” – The vision• “What is DiscoverText?” – The software• The Features – The basics– Capturing social media importing other text– Creating archives, buckets and datasets– Coding a dataset or training a classifier
![Page 3: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/3.jpg)
Dr. Stuart W. ShulmanFounder & CEO, Texifter, LLCAssistant Professor, Department of Political ScienceUniversity of Massachusetts AmherstDirector, Qualitative Data Analysis Program (QDAP)Associate Director, National Center for Digital GovernmentEditor, Journal of Information Technology & Politics413-545-5375 [email protected]://people.umass.edu/stu/
![Page 4: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/4.jpg)
![Page 5: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/5.jpg)
![Page 6: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/6.jpg)
![Page 7: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/7.jpg)
Major Project Components
Credentials
The Future of ProjectsProjects leverage users’ credentials to control
access to documents, tools, and resources
Documents Peers
Advanced ‘Social’ Search
Tools for Tagging Shared Analysis
Metadata Networks Filtering
Qualitative & Quantitative Findings
![Page 8: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/8.jpg)
The Future of DocumentsImport & archive data from multiple sources into a single, searchable, unified repository
Files Web
![Page 9: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/9.jpg)
The Future of SearcheDiscovery will search, merge, filter & classify
unlimited amounts of text and other data
Filter
Search
Classify
Report
![Page 10: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/10.jpg)
Well Worth Reading
![Page 11: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/11.jpg)
The Future of Tools
Duplicate & near duplicate
detection
Dynamic user-seeded tag clouds
Adaptable, intuitive and
reusable topic models &
shared memos
Sentiment detection,
redaction & seamless
adjudication
Text processing tools will enable quicker processing and more accurate results
![Page 12: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/12.jpg)
The Future of Peer RelationsUtilize trusted peers to scale your knowledge resources,
increase productivity & lower total project costs
![Page 13: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/13.jpg)
Peers GroupsSecurely segment your peers into project groups by
agency, firm, department, location, or affiliation,while controlling their access via credentials
![Page 14: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/14.jpg)
Security & CredentialsData will be encrypted, secure and accessible by only peers who are granted specific permissions via their credentials
![Page 15: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/15.jpg)
Coding, Tagging or LabelingAnnotation enhances your analysis by applying
human interpretation to machine results
![Page 16: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/16.jpg)
Coding in Flexible Teams
![Page 17: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/17.jpg)
Crowdsourcing
- MIT professor Eric von Hippel, specialist in innovation management“This is really the biggest paradigm shift in innovation since the Industrial Revolution”
Crowdsourcing will bring widely distributedwisdom to process of text analysis
![Page 18: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/18.jpg)
Active Machine Learning
Search
Code
ValidateShare
Analyze
By utilizing information and decisions previously captured, we can enhance future machine-based decisions
Active Learning
Loop
![Page 19: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/19.jpg)
What is DiscoverText?DiscoverText is a:• personal or organizational archive in the cloud• search engine for eDiscovery • social media comment aggregator• de-duplication and near duplicate clustering engine• FOIA redaction toolkit• coding, reporting and validation team workbench• repository of human annotation (text about text), and• customizable machine-learning classifier
– (beta launched April 2011)
![Page 20: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/20.jpg)
![Page 21: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/21.jpg)
![Page 22: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/22.jpg)
![Page 23: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/23.jpg)
![Page 24: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/24.jpg)
![Page 25: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/25.jpg)
![Page 26: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/26.jpg)
![Page 27: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/27.jpg)
![Page 28: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/28.jpg)
![Page 29: Future of text analysis forrester briefing](https://reader033.vdocument.in/reader033/viewer/2022052621/557cb4d2d8b42abf328b4ea9/html5/thumbnails/29.jpg)