connecting researchers and research organisations with ...feb 04, 2013 · csiro information...

Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics systems

CSIRO INFORMATION MANAGEMENT & TECHNOLOGY

Dominic Hogan & Anne Stevenson | Research Data Services Support

24th October 2013

Image: http://xkcd.com/285/

http://xkcd.com/285/

Metrics – what’s available

• Data Citation Index – flexible DOI searching with citation data. Hoping for ANDS ingest in the near future.

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson 2 |


• Scopus – you might get excited when searching for a DOI prefix in “references”, e.g. the ANDS DOI prefixes:


…but then you have to remember the correct syntax for an exact phrase.

At least it works in principle, even if there’s nothing worth showing off yet.


• Google Scholar – am I doing it correctly?


(Incidentally, neither the DAP nor RDA records for this show up in GS)


• For comparison, here’s a similar search in Google



• Microsoft Academic Search • DOI search does not allow truncation, so full DOIs only

• General search will retrieve many false positives

• Exact phrase may prove useful for DOI prefixes


Altmetrics

• What Google Trends has to say about this


Altmetrics

• Roberta Kwok points out the difference between the “views” and “citations” of this article:


Hull, D., Pettifer, S. R., & Kell, D. B. (2008). Defrosting the Digital Library: Bibliographic Tools for the Next Generation Web. PLoS Comput Biol, 4(10), e1000204. doi: 10.1371/journal.pcbi.1000204 Kwok, R. (2013). Research impact: Altmetrics make their mark. Nature, 500(7463), 491-493. doi: 10.1038/nj7463-491a

http://doi.org/10.1371/journal.pcbi.1000204

http://doi.org/10.1038/nj7463-491a

http://doi.org/10.1038/nj7463-491a

http://doi.org/10.1038/nj7463-491a

Altmetrics

• Impact Story: • CSIRO datasets showing up as “items with no metrics”

• Dryad and figshare datasets showing up in a “dataset” category

• Tracking DOIs from DataCite is on the roadmap, but timeline unknown

• Search by creator is also on the roadmap


http://impactstory.org/HeatherPiwowar

Altmetrics

• Altmetric.com: • We tested out tweeting a DOI,

Altmetric.com did pick it up

• No real activity for the ANDS DOI prefix

• Altmetric badges embedded in Scopus


http://www.altmetric.com/details.php?doi=10.1371/journal.pone.0018657

Altmetrics

• Plum Analytics: • Specifically mentions that metrics are

gathered for datasets

• Can currently add figshare and Dryad records to a profile

• Some issues with what gets listed (although it’s uncertain whether this was just the way the profile was created)


Altmetrics

• Some publishers are displaying altmetrics in their pages


http://datadryad.org/resource/doi:10.5061/dryad.7996

Altmetrics

• The paper itself doesn’t cite the data in the reference section


http://dx.doi.org/10.1086/658341

Project Columbus

The steps: • Weekly report on new collections from the DAP. • New collections with DOIs identified. • We search our publications systems for the data collection

authors, looking for papers that aren’t published yet. • We then contact the authors that match to talk about data citation

generally, and Project Columbus specifically.

Results so far: • Very early days. 4 candidates identified. • Candidates are extremely keen, however. • Additional datasets have been deposited by candidates


Project Columbus

• Use available tools to report metrics back to authors.

• Current: • Google Analytics reports

• Analysis of server logs

• Providing data for inclusion in annual reports

• Manual searching for DOIs in the wild

• Use of metrics tools on the citing papers

• Future: • Data Citation Index

• Impact Story search-by-creator

• Science reviews / internal assessments


Case study: what DOIs do we have?


• At EOFY 2013 CSIRO had under 100 DOIs for data collections in the DAP

0

50

100

150

200

250

300

350

400

450

Nu

mb

er

of

DO

Is

Date

Total DOIs minted for DAP collections

Total DOIs minted

Australian Telescope National Facility

• But wait…


What’s this?

Australian Telescope National Facility

• Publications which include archived Parkes pulsar data should include an additional statement as follows:

– This paper includes archived data obtained through the Australia Telescope Online Archive and the CSIRO Data Access Portal (http://data.csiro.au).

• So will anybody cite the DOI?


Nothing from either list matches with the other – at least the list is small enough to manually check

Anywhere…?

• By excluding the two main suspects, we get a sane number of results to browse

• Definitely some false positives • Compared to searching for a

handle… • ANDS PID handles have the prefix

“102.100.100” – more false hits

• The prefix is not organisation specific, so it’s harder to filter out parent organisations


Roll your own

• Google Analytics

• Server logs


0

100

200

300

400

500

600

700

800

900

1000

Nu

mb

er

of

do

wn

load

eve

nts

Date

DAP downloads (ATNF spikes are off scale)

Manual_other

REST_other

ATNF

ATNF_REST

ATNF downloads


Atlas of Australian Acid Sulphate Soils


DAP Visitors


Challenges

• It’s early days for altmetrics, there are no standards. There’s capacity to innovate or collaborate with altmetrics providers.

• What sort of metrics would you be interested in seeing?

• What sort of metrics would your researcher or organisation be interested in?


Thanks to

• Sue Cook

• David Benn

• Cynthia Love


Acknowledgementsyou

CSIRO Information Management & Technology Dominic Hogan Research Data Service Support

t 1300 363 400 e [email protected] w www.csiro.au

CSIRO Information Management & Technology Anne Stevenson Research Data Service Support

t 1300 363 400 e [email protected] w www.csiro.au

CSIRO INFORMATION MANAGEMENT & TECHNOLOGY

Thank you

connecting researchers and research organisations with ...feb 04, 2013 · csiro information...

Documents