connecting researchers and research organisations with data publication metrics the visibility and...

26
Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics systems CSIRO INFORMATION MANAGEMENT & TECHNOLOGY Dominic Hogan & Anne Stevenson | Research Data Services Support 24 th October 2013 Image: http://xkcd.com/285/

Upload: antony-gallagher

Post on 14-Dec-2015

225 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Connecting researchers and research organisations with data publication metricsthe visibility and value of data publications in bibliometrics and altmetrics systems

CSIRO INFORMATION MANAGEMENT & TECHNOLOGY

Dominic Hogan & Anne Stevenson | Research Data Services Support 24th October 2013

Image: http://xkcd.com/285/

Page 2: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Metrics – what’s available

• Data Citation Index – flexible DOI searching with citation data. Hoping for ANDS ingest in the near future.

2 |

Page 3: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Metrics – what’s available

• Scopus – you might get excited when searching for a DOI prefix in “references”, e.g. the ANDS DOI prefixes:

3 |

…but then you have to remember the correct syntax for an exact phrase.

At least it works in principle, even if there’s nothing worth showing off yet.

Page 4: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Metrics – what’s available

• Google Scholar – am I doing it correctly?

4 |

(Incidentally, neither the DAP nor RDA records for this show up in GS)

Page 5: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Metrics – what’s available

• For comparison, here’s a similar search in Google

5 |

Page 6: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Metrics – what’s available

• Microsoft Academic Search• DOI search does not allow truncation, so full DOIs only• General search will retrieve many false positives

• Exact phrase may prove useful for DOI prefixes

6 |

Page 7: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Altmetrics

• What Google Trends has to say about this

7 |

Page 8: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Altmetrics

• Roberta Kwok points out the difference between the “views” and “citations” of this article:

8 |

Hull, D., Pettifer, S. R., & Kell, D. B. (2008). Defrosting the Digital Library: Bibliographic Tools for the Next Generation Web. PLoS Comput Biol, 4(10), e1000204. doi: 10.1371/journal.pcbi.1000204Kwok, R. (2013). Research impact: Altmetrics make their mark. Nature, 500(7463), 491-493. doi: 10.1038/nj7463-491a

Page 9: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Altmetrics

• Impact Story:• CSIRO datasets showing up as “items with no metrics”

• Dryad and figshare datasets showing up in a “dataset” category

• Tracking DOIs from DataCite is on the roadmap, but timeline unknown• Search by creator is also on the roadmap

9 |

Page 10: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Altmetrics

• Altmetric.com:• We tested out tweeting a DOI,

Altmetric.com did pick it up• No real activity for the ANDS DOI prefix• Altmetric badges embedded in Scopus

10 |

Page 11: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Altmetrics

• Plum Analytics:• Specifically mentions that metrics are

gathered for datasets• Can currently add figshare and Dryad

records to a profile• Some issues with what gets listed

(although it’s uncertain whether this was just the way the profile was created)

11 |

Page 12: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Altmetrics

• Some publishers are displaying altmetrics in their pages

12 |

Page 13: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Altmetrics

• The paper itself doesn’t cite the data in the reference section

13 |

Page 14: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Project Columbus

The steps:• Weekly report on new collections from the DAP.• New collections with DOIs identified.• We search our publications systems for the data collection

authors, looking for papers that aren’t published yet.• We then contact the authors that match to talk about data citation

generally, and Project Columbus specifically.

Results so far:• Very early days. 4 candidates identified.• Candidates are extremely keen, however.• Additional datasets have been deposited by candidates

14 |

Page 15: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Project Columbus

• Use available tools to report metrics back to authors.• Current:

• Google Analytics reports• Analysis of server logs• Providing data for inclusion in annual reports• Manual searching for DOIs in the wild• Use of metrics tools on the citing papers• Future:

• Data Citation Index• Impact Story search-by-creator• Science reviews / internal assessments

15 |

Page 16: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Case study: what DOIs do we have?

16 |

• At EOFY 2013 CSIRO had under 100 DOIs for data collections in the DAP

Jul-2012

Aug-2012

Sep-2012

Oct-2012

Nov-2012

Dec-2012

Jan-2013

Feb-2013

Mar-2013

Apr-2013

May-2013

Jun-2013

Jul-2013

Aug-2013

Sep-2013

Oct-2013

0

50

100

150

200

250

300

350

400

450

Total DOIs minted for DAP collections

Total DOIs minted

Date

Num

ber o

f DO

Is

Page 17: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Australian Telescope National Facility

• But wait…

17 |

What’s this?

Page 18: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Australian Telescope National Facility

• Publications which include archived Parkes pulsar data should include an additional statement as follows:

– This paper includes archived data obtained through the Australia Telescope Online Archive and the CSIRO Data Access Portal (http://data.csiro.au).

• So will anybody cite the DOI?

18 |

Nothing from either list matches with the other – at least the list is small enough to manually check

Page 19: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Anywhere…?

• By excluding the two main suspects, we get a sane number of results to browse• Definitely some false positives• Compared to searching for a

handle…• ANDS PID handles have the prefix

“102.100.100” – more false hits• The prefix is not organisation specific,

so it’s harder to filter out parent organisations

19 |

Page 20: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Roll your own

• Google Analytics• Server logs

20 |

1/10/2

012

14/10/2

012

27/10/2

012

9/11/2

012

22/11/2

012

5/12/2

012

18/12/2

012

31/12/2

012

13/01/2

013

26/01/2

013

8/02/2

013

21/02/2

013

6/03/2

013

19/03/2

013

1/04/2

013

14/04/2

013

27/04/2

013

10/05/2

013

23/05/2

013

5/06/2

013

18/06/2

013

1/07/2

013

14/07/2

013

27/07/2

013

9/08/2

013

22/08/2

013

4/09/2

013

17/09/2

013

30/09/2

0130

100200300400500600700800900

1000

DAP downloads (ATNF spikes are off scale)

Manual_otherREST_otherATNFATNF_REST

Date

Num

ber o

f dow

nloa

d ev

ents

Page 21: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

ATNF downloads

21 |

Page 22: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Atlas of Australian Acid Sulphate Soils

22 |

Page 23: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

DAP Visitors

23 |

Page 24: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Challenges

• It’s early days for altmetrics, there are no standards. There’s capacity to innovate or collaborate with altmetrics providers.• What sort of metrics would you be interested in seeing?• What sort of metrics would your researcher or organisation be

interested in?

24 |

Page 25: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson

Thanks to• Sue Cook• David Benn• Cynthia Love

25 |

Acknowledgementsyou

Page 26: Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics

CSIRO Information Management & TechnologyDominic HoganResearch Data Service Supportt 1300 363 400e [email protected] www.csiro.au

CSIRO Information Management & TechnologyAnne StevensonResearch Data Service Supportt 1300 363 400e [email protected] www.csiro.au

CSIRO INFORMATION MANAGEMENT & TECHNOLOGY

Thank you