performance indicators for science evaluation the challenge of providing the research information...
TRANSCRIPT
PERFORMANCE INDICATORS FOR SCIENCE EVALUATION
The challenge of providing the Research Information Sytems (RIS) needed in the ERA: Needs of the science community – a personal view
H. Rauch
Atominstitut der Österreichischen Universitäten
Stadionallee 2, 1020 Wien
SCIENTOMETRIC ANALYSIS
Pro´s: soft methodunibasedcapable of improvement
Contra´s: flops counting expert dependentISI dependent
ISI® Products & Services ISI Web of KnowledgeSM Citation Products Web of Science® Science Citation Index Expanded™ Social Sciences Citation Index® Arts and Humanities Citation Index® ISI Proceedings® Derwent Innovations IndexSM Current Awareness Products Current Contents Connect® ISI Discovery Agent SM Specialized Content ISI ChemistrySM BIOSIS Previews® INSPEC® CAB ABSTRACTS® Evaluation/Analytical Tools Derwent Patent IndicatorsSM Essential Science IndicatorsSM Journal Citation Reports® Information Management Tools EndNote® ProCite® Reference Manager® ISI Custom Marketing and Intelligence Services
ISI Custom Information Services
Fully customizable intelligence data formatting and delivery
Weekly market intelligence alerting Scientific Direct™Customized Mailing Lists ® ContentBuilder Research Community ISIHighlyCited.comSM Document Delivery ISI Document Solution® Federated Searching WebFeat Prism™ Links Management 1Cate™
Institute for Science Information
Headquater: Philadelphia/US
Offices: US, UK, Irland, Japan, Singapore
Employees: 850
Total journals covered: 8676
www.isinet.com
Thomson Coop.
RANKING OF ...
Nations
Fields
Int. Cooperations
Institutions
Journals
Individuals
etc.
absolute and relatives measures
static and time-dependent measures
correlation measures
Austrian Physics Evaluation
F.Aumayr, TU-Wien, Nov.1999
Neutron Scattering Science
total
Neutron Activation and Therapy
1985
1989
1992
1994
1996
1998
2000
2002
BEC
NAA / THER.
NMR
SCAT.TOT
0
500
1000
1500
2000
2500
3000
3500
stat. various research fields
General Comparison
Neutron activation
Neutron therapy
PHYSICS JOURNAL RANKING
Impact Factor T1/2
1. Rev. Mod. Physics 19.4 >10 a2. Solid State Physics 9.8 >103. Advances Physics 9.37 >104. Phys. Rev. Lett. 6.29
5.45. Phys. Reports 6.1 8.56. Ann. Rev. Nucl. Part. Sci. 5.9 7.67. Ann. Rev. Fluid Meth. 5.8
8.58. Mat. Sci. Eng. Res. 5.7 4.89. Adv. Atomic Mol. Opt. Phys. 5.66
>1010. Rep. Progr. Phys. 5.59 8.4...
Journal Ranking
Impact Factor
1. Clin.Res. 58.28
2. Am.Rev.Immun. 49.5
3. Am.Rev.Biochem. 44.4
4. Cell 40.4
10. Nature 27.07
25. Rev.Mod.Phys. 19.4
Publications versus Citations
W.Glänzel, A. Schubert, Scientometrics 56(2003)357
Ranking in GDP Ranking in articles Ranking in articles
per capita per capita per GDP
1.) USA Switzerland USA
2.) Norway Sweden India
3.) Iceland Israel China
4.) Switzerland Denmark UK
5.) Canada Finland Russia
6.) Denmark U.K. Japan
7.) Belgium Netherlands Germany
8.) Ireland Canada France
9.) Austria Australia Brazil
10.) Japan New Zealand Italy
11.) Australia Norway Canada
12.) Netherlands Singapore Ukraine
13.) Germany USA Turkey
. . . .
. . . .
. . . .Different kinds of country ranking
World Region Publications
M.Batty, The Scientist 17(2003)16, 10
Citations per country
M.Batty, The Scientist 17(2003)16, 10
M.Batty, The Scientist 17(2003)16, 10
M.Batty, The Scientist 17(2003)16, 10
WORLD CITATIONS
Country Share of World papers (%) Share of world citations (%)
US 34.6 49
UK 8.0 9.1
Japan 7.3 5.7
Germany 7.0 6.0
France 5.2 4.5
Canada 4.5 4.5
Italy 2.7 2.1
India 2.4 0.7
Australia 2.1 2.1
Netherlands 2.0 2.2
Sweden 1.7 2.1
Switzerland 1.4 1.9
P.R. China 0.9 0.3
Denmark 0.8 1.0
Finland 0.7 0.6
Norway 0.5 0.5
S. Africa 0.5 0.3
New Zealand 0.4 0.4
Self-Citations
D.W.Arkans, Scientometry 56(1962)235
The percentage of self-citations in different scientfic fields (NSI-categ.)
Field (NSI-category) Citation-rate % Self-cit n (num. art.)Clinical Medicine 14.2 17% 15,909Neuroscience 22.6 18% 1,934Ecology/Environment 14.3 19% 1,835Plant & Animal Science 12.0 20% 5,040Psychology/Psychiatry 9.8 21% 1,325Geosciences 12.4 21% 2,898Microbiology 18.3 21% 1,246Materials Science 6.2 22% 774Agricultural Sciences 8.8 22% 1,051Mathematics 7.9 22% 697Molec Biology & Genetics 24.8 22% 1,132Biology & Biochemistry 19.5 23% 4,153Engineering 6.5 23% 2,072Pharmacology 11.1 23% 1,390Multidisciplinary 10.6 24% 572Computer Science 4.9 24% 283Immunology 22.0 24% 1,579Physics 10.9 26% 2,857Chemistry 11.0 31% 4,530Astrophysics 15.6 31% 383
D.W.Arkans, Scientometry 56(1962)235
Proposal
Founding of a
European based
Initiative on Scientific Information
(in cooperation with ISI?)
1st Step: ESF-Program
2nd Step: EU-Network
CONCLUSION
Bibliometric methods contribute essentially to science evaluation
Bibliometric methods can help to decide on large facility issues
Bibliometric methods will become more important in future
Experts can do bibliometric analysis only
A European initiative could help