performance indicators for science evaluation the challenge of providing the research information...

PERFORMANCE INDICATORS FOR SCIENCE EVALUATION

The challenge of providing the Research Information Sytems (RIS) needed in the ERA: Needs of the science community – a personal view

H. Rauch

Atominstitut der Österreichischen Universitäten

Stadionallee 2, 1020 Wien

SCIENTOMETRIC ANALYSIS

Pro´s: soft methodunibasedcapable of improvement

Contra´s: flops counting expert dependentISI dependent

ISI® Products & Services ISI Web of KnowledgeSM Citation Products Web of Science® Science Citation Index Expanded™ Social Sciences Citation Index® Arts and Humanities Citation Index® ISI Proceedings® Derwent Innovations IndexSM Current Awareness Products Current Contents Connect® ISI Discovery Agent SM Specialized Content ISI ChemistrySM BIOSIS Previews® INSPEC® CAB ABSTRACTS® Evaluation/Analytical Tools Derwent Patent IndicatorsSM Essential Science IndicatorsSM Journal Citation Reports® Information Management Tools EndNote® ProCite® Reference Manager® ISI Custom Marketing and Intelligence Services

ISI Custom Information Services

Fully customizable intelligence data formatting and delivery

Weekly market intelligence alerting Scientific Direct™Customized Mailing Lists ® ContentBuilder Research Community ISIHighlyCited.comSM Document Delivery ISI Document Solution® Federated Searching WebFeat Prism™ Links Management 1Cate™

Institute for Science Information

Headquater: Philadelphia/US

Offices: US, UK, Irland, Japan, Singapore

Employees: 850

Total journals covered: 8676

www.isinet.com

Thomson Coop.

RANKING OF ...

Nations

Fields

Int. Cooperations

Institutions

Journals

Individuals

etc.

absolute and relatives measures

static and time-dependent measures

correlation measures

Austrian Physics Evaluation

F.Aumayr, TU-Wien, Nov.1999

Neutron Scattering Science

total

Neutron Activation and Therapy

1985

1989

1992

1994

1996

1998

2000

2002

BEC

NAA / THER.

NMR

SCAT.TOT

0

500

1000

1500

2000

2500

3000

3500

stat. various research fields

General Comparison

Neutron activation

Neutron therapy

PHYSICS JOURNAL RANKING

Impact Factor T1/2

1. Rev. Mod. Physics 19.4 >10 a2. Solid State Physics 9.8 >103. Advances Physics 9.37 >104. Phys. Rev. Lett. 6.29

5.45. Phys. Reports 6.1 8.56. Ann. Rev. Nucl. Part. Sci. 5.9 7.67. Ann. Rev. Fluid Meth. 5.8

8.58. Mat. Sci. Eng. Res. 5.7 4.89. Adv. Atomic Mol. Opt. Phys. 5.66

>1010. Rep. Progr. Phys. 5.59 8.4...

Journal Ranking

Impact Factor

1. Clin.Res. 58.28

2. Am.Rev.Immun. 49.5

3. Am.Rev.Biochem. 44.4

4. Cell 40.4

10. Nature 27.07

25. Rev.Mod.Phys. 19.4

Publications versus Citations

W.Glänzel, A. Schubert, Scientometrics 56(2003)357

Ranking in GDP Ranking in articles Ranking in articles

per capita per capita per GDP

1.) USA Switzerland USA

2.) Norway Sweden India

3.) Iceland Israel China

4.) Switzerland Denmark UK

5.) Canada Finland Russia

6.) Denmark U.K. Japan

7.) Belgium Netherlands Germany

8.) Ireland Canada France

9.) Austria Australia Brazil

10.) Japan New Zealand Italy

11.) Australia Norway Canada

12.) Netherlands Singapore Ukraine

13.) Germany USA Turkey

. . . .

. . . .

. . . .Different kinds of country ranking

World Region Publications

M.Batty, The Scientist 17(2003)16, 10

Citations per country

M.Batty, The Scientist 17(2003)16, 10

M.Batty, The Scientist 17(2003)16, 10

M.Batty, The Scientist 17(2003)16, 10

WORLD CITATIONS

Country Share of World papers (%) Share of world citations (%)

US 34.6 49

UK 8.0 9.1

Japan 7.3 5.7

Germany 7.0 6.0

France 5.2 4.5

Canada 4.5 4.5

Italy 2.7 2.1

India 2.4 0.7

Australia 2.1 2.1

Netherlands 2.0 2.2

Sweden 1.7 2.1

Switzerland 1.4 1.9

P.R. China 0.9 0.3

Denmark 0.8 1.0

Finland 0.7 0.6

Norway 0.5 0.5

S. Africa 0.5 0.3

New Zealand 0.4 0.4

Self-Citations

D.W.Arkans, Scientometry 56(1962)235

The percentage of self-citations in different scientfic fields (NSI-categ.)

Field (NSI-category) Citation-rate % Self-cit n (num. art.)Clinical Medicine 14.2 17% 15,909Neuroscience 22.6 18% 1,934Ecology/Environment 14.3 19% 1,835Plant & Animal Science 12.0 20% 5,040Psychology/Psychiatry 9.8 21% 1,325Geosciences 12.4 21% 2,898Microbiology 18.3 21% 1,246Materials Science 6.2 22% 774Agricultural Sciences 8.8 22% 1,051Mathematics 7.9 22% 697Molec Biology & Genetics 24.8 22% 1,132Biology & Biochemistry 19.5 23% 4,153Engineering 6.5 23% 2,072Pharmacology 11.1 23% 1,390Multidisciplinary 10.6 24% 572Computer Science 4.9 24% 283Immunology 22.0 24% 1,579Physics 10.9 26% 2,857Chemistry 11.0 31% 4,530Astrophysics 15.6 31% 383

D.W.Arkans, Scientometry 56(1962)235

Proposal

Founding of a

European based

Initiative on Scientific Information

(in cooperation with ISI?)

1st Step: ESF-Program

2nd Step: EU-Network

CONCLUSION

Bibliometric methods contribute essentially to science evaluation

Bibliometric methods can help to decide on large facility issues

Bibliometric methods will become more important in future

Experts can do bibliometric analysis only

A European initiative could help