visualising topic modelling.....make better decisions faster overview - landscape . make better...

17
Make better decisions faster Visualising topic modelling.. Simplifying or complexifying? Hélène Draux

Upload: others

Post on 19-Aug-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Visualising topic modelling..

Simplifying or complexifying?

HélèneDraux

Page 2: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Page 3: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

The Consultancy TeamProfJonathanAdamsChiefScientist

FormerDirectorofResearchEvaluationatThomsonReuters

Advisedonresearchmetricstogovernmentsaroundtheworld

SimonPorterVPAcademicRelationshipsandKnowledgeArchitecture

FormerlyofUofMelbourne

WorkedinResearchadministration,library,IT

DrMartinSzomszorConsultantDataScientistOneofTop50UKInformationAgedataleaders2015

DrPhillJonesDirectorofPublishingInnovation

FormeracademicscientistandscholarlypublisherWorkswithSSP,theSTMassociation,ALPSP

MikeTaylorHeadofResearchMetrics

FormerSeniorProductManager,InformetricsatElsevierWorkswithFORCE11,RDA,andNISO

AaronSorensonBibliometricsEngagementLeader

FormerlyofTempleUandGEHealthcare

ScientometricseditorofJournalofAlzheimerDisease

DrHélèneDrauxDataScientist–ResearchDatamanagementandvisualizationexpert

Geodataspecialty

Page 4: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Our Customers and Collaborators

Page 5: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Digital Research Reports

Page 6: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Aggregating similar documents together (= unsupervised classification)

Page 7: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Corpusofdocuments

Page 8: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

1.Cleantext(copyright,..)

2.Findcompoundse.g.“climatechange”

Pre-processing

Page 9: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Pre-processing

Bagofwords

Findmostcommonwords

Page 10: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

SongJazzInstrument

ProcessKnowledgeResearch

HistoryHeritageGallery

Groupbytermfrequency

Page 11: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Challenges Howmanytopics?

Largedatasets

Page 12: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Number of topics

Dependsonthepurpose

Dependsonthehomogeneityofthedata

Page 13: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Explore transition – Alluvial diagram

•  Followtheterms

•  Termsinmodelwith:•  25topics•  26topics•  27topics

Page 14: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Hard to scale up

•  145to146to147

Page 15: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Clusters of topics - Dendrogram

Page 16: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Overview - Landscape

Page 17: Visualising topic modelling.....Make better decisions faster Overview - Landscape . Make better decisions faster Visualisation of topic models Simplifies the models .. but some visualisaons

Make better decisions faster

Visualisation of topic models

Simplifiesthemodels

..butsomevisualisaYons

makethemmorecomplicated