altmetrics for research impact actuation (aria)

33
Altmetrics for Research Impact Actuation (ARIA) Aarthy Nagarajan, Aravind Sesagiri Raamkumar, Feiheng Luo, Harsha Vijayakumar, Mojisola Erdt, Edie Rasmussen, Yin-Leng Theng Altmetrics Project of Centre for HEalthy & Sustainable CitieS (CHESS) Wee Kim Wee School of Communication & Information 27 September 2017 1

Upload: aravind-sesagiri-raamkumar

Post on 23-Jan-2018

249 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: Altmetrics for Research Impact Actuation (ARIA)

Altmetrics for Research Impact Actuation (ARIA)

Aarthy Nagarajan, Aravind Sesagiri Raamkumar, Feiheng Luo, Harsha Vijayakumar, Mojisola Erdt, Edie Rasmussen, Yin-Leng Theng

Altmetrics Project of Centre for HEalthy & Sustainable CitieS (CHESS)Wee Kim Wee School of Communication & Information

27 September 20171

Page 2: Altmetrics for Research Impact Actuation (ARIA)

Introduction to ARIA

• Main Objectives:

– To develop a prototype called “Altmetrics for Research Impact Actuation” (ARIA) to measure research impact for researchers, universities, research institutes and policy-makers

– To compute cross-metric validation between traditional metrics and altmetrics for the “hard sciences” disciplines, the “non-hard sciences” disciplines, and “innovation and commercialization”

2

Page 3: Altmetrics for Research Impact Actuation (ARIA)

ARIA Data Sources

3

Social Media Sources:

Academic Sources:

Data collection frequency is currently once a month

Page 4: Altmetrics for Research Impact Actuation (ARIA)

ARIA Data Extraction Methodology

1. Public Scopus API: Publications metadata extracted from Scopus using NTU Affiliation ids

2. Public Crossref API: Publications metadata extracted using Scopus DOIs. Crossref provides all author names from each publication

3. Restricted WoS API: Basic citations data extracted using Scopus DOIs

4. Google Scholar Profiles: Basic citations data scraped from profiles with NTU affiliation

5. Restricted Altmetric.com: Altmetrics data extracted using Scopus DOIs

6. Public PlumX API: Altmetrics data extracted using Scopus DOIs

Page 5: Altmetrics for Research Impact Actuation (ARIA)

ARIA Dataset for NTU Researchers

Data collection• 4,207 teaching and research staff

• 2,637 researchers with publications (mainly Scopus)

• Approximately 86K publications extracted

• Metrics only for publications with DOIs

• Use of in-house author name disambiguation algorithm for identifying relevant publications

Page 6: Altmetrics for Research Impact Actuation (ARIA)

ARIA Metadata and Metrics

Paper Metadata• Paper Title• Publication Timestamp• Publication Venue• Author(s)• Paper Type• References Count• Affiliation

Bibliometrics• Publications Count• Scopus Citation Count• QS Citation Count• WoS Citation Count• Journal Impact

Factor/Quartiles

Altmetrics• Tweet Count• Views Count• Downloads Count• Mendeley Readers Count• Altmetric Attention Score

Frequency• Monthly• Quarterly• Half-Yearly• Yearly

Aggregation Level/Metrics• School• Research Centre• Top 5%, 10%, 20% (Average)• Bottom 5%, 10%, 20% (Average)

Page 7: Altmetrics for Research Impact Actuation (ARIA)

ARIA Researcher Profile• A researcher account has a

researcher dashboard

• This profile will have access to own artifacts, bibliometric and altmetric visualizations

• This profile can cross-compare metrics as a time-series chart, for various time intervals

7

ARIA Admin Profile

• Has access to both researcher and admin dashboards

• Has access to own artifacts, bibliometric and altmetricvisualizations from the researcher dashboard

• Can also view the artifacts and metric visualizations at college/school/university level from the admin dashboard

• This profile can cross-compare metrics as a time-series chart, for various time intervals at both researcher and admin level

Page 8: Altmetrics for Research Impact Actuation (ARIA)

ARIA Screenshots

8

Page 9: Altmetrics for Research Impact Actuation (ARIA)

Home Page

9

Researcher Dashboard

Admin Dashboard

Page 10: Altmetrics for Research Impact Actuation (ARIA)

Entity Selection (for admin dashboard)

10

Page 11: Altmetrics for Research Impact Actuation (ARIA)

Bibliometrics (Publication Vs Citation Trend)

11

Page 12: Altmetrics for Research Impact Actuation (ARIA)

Bibliometrics (Publication Vs Citation Trend)

12

Page 13: Altmetrics for Research Impact Actuation (ARIA)

Bibliometrics (Publication Vs Citation Trend)

13

Page 14: Altmetrics for Research Impact Actuation (ARIA)

Bibliometrics (Bibliometric Time Series)

14

Page 15: Altmetrics for Research Impact Actuation (ARIA)

Bibliometrics (Bibliometric Time Series)

15

Page 16: Altmetrics for Research Impact Actuation (ARIA)

Altmetrics (Publication Vs Altmetrics Trend)

16

Page 17: Altmetrics for Research Impact Actuation (ARIA)

Altmetrics (Publication Vs Altmetrics Trend)

17

Page 18: Altmetrics for Research Impact Actuation (ARIA)

Altmetrics (Altmetric Time Series)

18

Page 19: Altmetrics for Research Impact Actuation (ARIA)

Altmetrics (Altmetric Time Series)

19

Page 20: Altmetrics for Research Impact Actuation (ARIA)

Artifacts

20

Page 21: Altmetrics for Research Impact Actuation (ARIA)

Artifacts (Papers)

21

Page 22: Altmetrics for Research Impact Actuation (ARIA)

Artifacts (Journal Papers)

22

Page 23: Altmetrics for Research Impact Actuation (ARIA)

Artifacts (Journal Papers)

23

Page 24: Altmetrics for Research Impact Actuation (ARIA)

Artifacts (Journal Papers)

24

Page 25: Altmetrics for Research Impact Actuation (ARIA)

Artifacts (Journal Papers)

25

Page 26: Altmetrics for Research Impact Actuation (ARIA)

Artifacts (Books)

26

Page 27: Altmetrics for Research Impact Actuation (ARIA)

Cross-metric Explorer

27

Page 28: Altmetrics for Research Impact Actuation (ARIA)

Cross-metric Explorer

28

Page 29: Altmetrics for Research Impact Actuation (ARIA)

Cross-metric Explorer

29

Page 30: Altmetrics for Research Impact Actuation (ARIA)

Cross-metric Explorer

30

Page 31: Altmetrics for Research Impact Actuation (ARIA)

Map View

31

Page 32: Altmetrics for Research Impact Actuation (ARIA)

AROSIM 2018 Workshop@NTU

• Our team is conducting an international workshop on Altmetrics for Research Outputs Measurement and Scholarly Information Management (AROSIM 2018) on January 26th 2018

• Workshop Theme: "The best of both worlds: cross-metric exploration and validation of Altmetrics and Bibliometrics“

• Participants include researchers, librarians, publishers and research agency personnel

• Keynote Speakers: 1) Dr. Mike Thelwall, University of Wolverhampton

2) Stacy Konkiel, Altmetric.com

• Submission deadline is 10th October 2017

32For more information, please visit www.altmetrics.ntuchess.com/AROSIM2018/

Page 33: Altmetrics for Research Impact Actuation (ARIA)

33

This project is supported by NRF SRIE Grant: NRF2014-NRF-SRIE001-019