www.gu.se karin henning bibliometric services gothenburg university library bibliometri@ub.gu.se...

www.gu.se

Karin Henning

Bibliometric Services

Gothenburg University Library

bibliometri@ub.gu.se

Bibliometrics – an introduction to indicators and analysesSahlgrenska Academy, Research Education, 2011-05-12

www.gu.se

• Introduction to bibliometrics

data used, citation theory

• Research evaluation indicators

• Allocation systems for university funding

www.gu.se

What is bibliometrics?

"Bibliometrics can be defined as the quantification of bibliographic

information for use in analysis “

E. GARFIELD, M, V. MALIN, H. SMALL

www.gu.se

Metadata

www.gu.se

Collaboration Sahlgrenska Academy, 2006-2010Countries, quotas per department

www.gu.se

Metadata

• Authors, affiliation – collaboration analyses, internationalization

• Journal, publisher – publishing patterns

• Title, Abstract, Keywords – “science mapping”

www.gu.se

Metadata

• Authors, affiliation – collaboration analyses, internationalization

• Journal, publisher – publishing patterns

• Title, Abstract, Keywords – “science mapping”

• References – citation analyses

www.gu.se

Reasons for citing...

1. Paying homage to pioneers.

2. Giving credit for related work (homage to peers).

3. Identifying methodology, equipment, etc.

4. Providing background reading.

5. Correcting one's own work.

6. Correcting the work of others.

7. Criticizing previous work.

8. Substantiating claims.

9. Alerting to forthcoming work.

10.Providing leads to poorly disseminated, poorly indexed, or uncited work.

11.Identifying original publications in which an idea or concept was discussed.

12.Identifying original publications or other work describing an eponymic concept or term.

13.Disclaiming work or ideas of others (negative claims).

14.Disputing priority claims of others (negative homage).Eugene Garfield / F. Osareh Libri 1996, 46, 149

ImpactDemandQuality?

www.gu.se

Bibliometri

www.gu.se

Citation rate of different fields (source: VR)

www.gu.se

Research evaluation indicators

• Productivity (number of publications, number of collaborators, …)

www.gu.se

0

0,5

1

1,5

2

2,5

HHN HFN IT KFN NFN SA SFN UFN

Publikationer/helår

Författarandelar/helår

Whole counts vs. fractionalized

Publications / FTE 2009

www.gu.se

Quality judgements in the publishing process

•Before publishing – the peer review process

•After publishing – usage (citations, downloads etc)

www.gu.se

Research evaluation indicators

• Productivity (number of publications, number of collaborators)

• Demand, impact, “quality” (number of publications in quality channels, number of citations)

• Excellence (compared to the field, ratio top5% cited publications)

www.gu.se

Field normalized citation (”crown indicator”)

CPP (cites per publication) _____________

FCS (Field Citation Score)

world average for a specific field,

year and article type

’

www.gu.se

Field normalized citation (”crown indicator”)

Endocrinology Letter 2003

C (number of citations) 10_____________ ________

FCS (Field Citation Score) 10

world average for a specific field,

year and article type

C/FCS 1

www.gu.se

Field normalized citation (”crown indicator”)

Endocrinology Letter 2003 Oncology Review 2004

C(number of citations) 10 20_____________ ________ ________

FCS (Field Citation Score) 10 40

world average for a specific field,

year and article type

C/FCS 1 0,5

www.gu.se

www.gu.se

Field normalized citation score, 1986-2006

Source: Swedish production of highly cited scientific publications (VR, 2010)

www.gu.se

SA RED10

www.gu.se

Research evaluation indicators

• Productivity (number of publications, number of collaborators, …)• Demand, Impact, Quality (number of citations, number of publications

in quality channels, …)• Excellence (compared to the field, ratio top5% cited publications)• Collaboration (network properties estimated by co-authorships)• Internationalization (number of publications in international

journals, number of international collaborators)• Interdisciplinarity (number of publications in channels in other

fields or with co-authors from other fields)

www.gu.se

• Publications in the database Web of Science (WoS) are aggregated for each university

• Number of publications and number of citations to the publications are normalized and multiplied together to form the publication indicator

Bibliometrics and allocation for research funding

www.gu.se

Quota per university, bibliometric indicator (> 1 %)

www.gu.se

Conclusion

• Compare ”like with like”

• Fractionalizing etc

• Knowledge about the organisation analysed

• Evaluating the past

• Conflict of interest

• Incentives? Research policy

www.gu.se

Literature

Carlsson, H. (2009). "Allocation of Research Funds Using Bibliometric Indicators – Asset and Challenge to Swedish Higher Education Sector." Infotrend 64(4): 82-88.

NordForsk (2010). ”Bibliometric Research Performance Indicators for the Nordic Countries” http://www.nordforsk.org/no/publikasjoner/bibliometric-research-performance-indicators-for-the-nordic-countries

”RED10 Research evaluation : reports from the evaluation of all research at theUniversity of Gothenburg 2010” (2011). http://gupea.ub.gu.se/bitstream/2077/24885/1/gupea_2077_24885_1.pdf

Vetenskapsrådet (2009). ”Den svenska produktionen av högt citerade vetenskapliga publikationer.” http://www.vr.se/download/18.1ada9fde1266f78be66800015/Rapport+1.2010.pdf

www.gu.se

http://www.ub.gu.se/info/bibliometri/presentationer/

www.gu.se

Thanks for your attention!

Karin Henning

bibliometri@ub.gu.se