This is your presentation title

Using Bibliometricsto Keep Up withthe JonesesChristina K. Pikas, BS, MLS, PhDJohns Hopkins University Applied Physics Laboratory

Nebulous Connections, April 4, 2017

How do you know whats going on in the world?

NASA via unsplash

How do you understand a technology landscape outside your own?

Rob Morton on unsplash

You could interviewlots of people, makesite visits, and/or use bibliometrics!

wocintechchat.com

https://www.flickr.com/photos/wocintechchat/21910900553/

AgendaQuestions to answerGeneral approachTips and techniquesVerification & validation

1.Questions to Answer

Given a topicWhat is the volume of work and how is it trending?

What are the top venues?

Where is the work being done?Countries?Organizations?

Who funds this work?

What methods, models, etc. are used?

How is this field related to otherfields?

Who are the top researchers/ groups?How well connected are they?

Given an organizationOver what distribution of topicsdo they publish?

With whom do they collaborate?Who funds their work?

How well cited is their work? Is it taught in schools?Does it have clinical applications?

Are there clinical or practical implications/spin-offs/products?

Are there regulatory or policy implications?

Is the work discussed in the news? By Congress?

2.General Approach

Define TopicNot too big, not too smallBest to do this with the end user of the report Work iteratively with a subject matter expert if possibleReference interview!

SearchCitation databases BUT ALSODomain databases with high quality metadataTechnical report serversGoogle Scholar, Microsoft AcademicFunding databases (NSF, Reporter, URED if you are DoD)Document your searches as you go!

Clean

Validity & ReliabilityCount all the thingsAssociate correct termsShow accurate trendsTool SelectionCorrect input for the toolBe able to answer the desired question with the toolMerge multiple sources

Note: This slide is from Mondays talk about data preparation

AnalyzeRelevant to the questions you are answering, not what your favorite tool can do

ReportSometimes tables are better than visualizationsInclude narrative with resultsTake time to include a backup section with a clear description of what methods you used and searches you performed

3.Tips & Techniques

GeographyGeocoding correspondence address is actually doable!

Sci2 and R are two paths.

Done with R

VantagePoint ($)

TextVOS viewer does co-word graphing using the abstract free!Can do in Gephi, but need to do pre-processing elsewhereRRemember to remove copyright statements from abstracts first to avoid publisher names being your top result!

PNNL In-Spire (free to US Government & contractors)

PNNL In-Spire (free to US Government & contractors)

NetworksCo-authorshipNodes as: authors, groups, organizations, countriesCitationCiting/Cited, co-citation, bibliographic couplingFunder ResearcherSupplier BuilderCo-word, semantic, topic, etc.

Gephi, Pajek, VOS viewer, Sci2, CitNetExplorerAnd more

A.Q. Rogers et al. (2015) You get what you pay for: examining the true cost of delivering utility with small satellites. 31st Space Symposium. Colorado Springs, CO

Done in R

Patent network with 1528 patents. Colored by clusters. Sized by degree. Labeled by clusters.Done in Quid ($$$)

Data CleaningEnterprise Resource PlanningData AcquisitionData Integration & TransmissionImage & Visual DataVehicle DataSignal ProcessingPrinting ApplicationsData Cleansing (records)Power Grid ApplicationsMulti-Dimensional DataMulti-Media DataData Production & MetadataEquipment ControlMobile DevicesTest Data IntegrationData EnrichmentSensor NetworksElectronic PaymentsSewing and EmbroideryData Integration ManagementData Preparation AssistanceMedical ApplicationsData Integration (business processes)Mask Data Preparation (electronics manufacturing)

VantagePoint ($$)

4.Verification & Validation

Sounds more official than it probably is!Check with subject matter experts:What is missing?Does anything look amiss?For results, check for competing hypothesesPut it in to GoogleRe-check for citing articles (recent or other)Carefully review all visualizations for weirdness

Conclusions

Bibliometrics can provide a useful tool for looking at a research landscapeBest done iteratively with subject matter expertsLibrarians can provide this service best because of the searching and analyses requiredBe sure to not overstate results!

Questions?

You can find me at:@cpikasChristina.Pikas@jhuapl.eduhttps://www.slideshare.net/cpikas http://christinaslisrant.scientopia.org/

CreditsSpecial thanks to all the people who made and released these awesome resources for free:Presentation template by SlidesCarnivalPhotographs by Unsplash & Death to the Stock Photo (license)