Evaluating Research Performance of the University of the Philippines Los Banos

Office of the Vice Chancellor for Research and Extension

Outline of Presentation

• Current System of Research

Performance Evaluation

• UPLB Research, Development

and Extension Data 2006-2011

• Improving UPLB’s Research

Performance System of

Evaluation

UP as a National University (Republic Act 9500 or the New

UP Charter)

UP as a research university.

4

Basic Procedures of Research Project Evaluation at OVCRE-UPLB

Current System of Research Performance Evaluation

• Research funds generated• Human resources• Intellectual productivity

– Publications (ISI, refereed papers and citations in refereed journals)

– Patents – Commercialized products

• Awards and recognition• Activities directed to clientele

– Extension programs

Institutional performance evaluation• Annual data gathering by UP System

o For DBM reviews, whole university performance assessments, etc.)

• UPLB Form17 – Extension• UPLB Form18 – Extension Profile• UPLB Form19 – Intellectual Property• UPLB Form20 – International Publication Awards• UPLB Form22 – Research• UPLB Form23 – Research Profile• UPLB Form26 – Units Profile• UPLB Form38 – Refereed Publications

UPLB Intellectual Productivity

2005 2006 2010 2011

86 100 98 135 105 141 132

8 1 48 101

25 12 71 52

18 16 40 24

71 56 47 32

91 58 212 152

Articles/Book published/ Papers Presented

2007 2008 2009

ISI-Indexed Journals endorsed for IPAInternational Refereed Journals

56 20 29

Local Refereed Journal

85 61 125

Book, Book Chapter/ Section

28 25 36

Papers Presented in International Conferences

5870

49

Papers Presented in Local Conferences

150 242 244

Articles published in ISI-Indexed Journals

COLLEGES 2006 2007 2008 2009 2010 2011

CA 40 16 62 47 41 35CAS 28 41 56 26 44 36CDC - - - - 1CEAT - 1 3 5 2 4CEM 1 6 2 1 6CFNR 4 7 13 12 14 8CHE 3 1 - - 3 2CPAf 1 2 - - 3 2CVM 11 11 18 15 26 16SESAM - 1 2 1 - 8OVCRE 12 12 6 4 6 12OVCI - - - - 1 -OVCA - - - - 1OVCCA - - - - 1

TOTAL 100 98 162 110 141 132

Individual Research Performance Evaluation: Promotion criteria for faculty

Promotion criteria for REPS

Scholarly/Creative Work Applicable to All Units

There are also scholarly/creative work distinct to the unit, e.g. varieties, equipment, exhibits, novels, scripts, etc.

Publication Requirements for Appointment/Promotion to Appropriate Rank for UPLB Faculty

Minimum Qualification Standards for Appointment/Promotion to Appropriate Rank for REPS

*NOTE: One (1) ISI Publication = 1.5 Non-ISI refereed publication

Equivalencies to ISI Publications

Rewarding Exemplary Researchers

• International publications

award

• UP Scientific Productivity

System

• Expanded Academic

Support grant

UP Scientific Productivity System

Title Reward (Php/annum)

Points for appt

Points for renewal (after 3yrs)

UP Scientist I 120,000 1-min 35 and IITotal 55

1-min 25 and IITotal 35

UP Scientist II 144,000 1-40 min-50 maxTotal 75

1-25 min-30 maxTotal 45

UP Scientist III 180,000 1-45 min- 55 maxTotal 95

1-25 min- 35 maxTotal 55

Criteria1. Scientific

productivity2. Scientific

recognition

o System to award exemplary performanceo Includes several criteria such as:

• Originality and productivity• Research/Creative work and publications • Significance of research findings and creative

works• Recognition given to the research/creative work • Commitment/Dedicated service to clientele• Technical competence• Effectiveness• Impact of performance• Impact on profession/clients • Contribution to institutional development

UPLB Outstanding Awards for Researchers/Research Project, Extensionist/Extension Projects, and Creative Artists

Intellectual Property of UPLB

Benchmarking of UPLB Research Knowledge Products and

Technology Evaluation (www.uplb.edu.ph/ovcre)

Establishment of Center for Technology Transfer and

Enterpreneurship (CTTE) in 2007

List of UPLB patents /trademarks, licensing agreements

*Innovation and Technology Support Office (ITSO)– a patent library that provides access to global IP Search

Improving Research Performance Evaluation@UPLB

•Assessing impacts of research programs

•Benchmarking of R&D knowledge products (e.g. value chain

analysis)

•Use of citation index (ISI, Scopus) and H-index (Google

scholar) as indicators of research performance of a unit and

faculty/REPS/students

22

H-index (Hirsch index or Hirsch number)

• The index was suggested by Jorge E. Hirsch, a physicist at UCSD

• The h-index is intended to measure simultaneously the quality and quantity of scientific output, reflecting both the number of publications and the number of citations per publication.

• The index, however, works properly only for comparing scientists working in the same field; citation conventions differ widely among different fields.

Google Scholar gadget search

Citations Number of Publications

Hirsch Index

Florinia E. Merca

Florinia E. Merca

37 12 3

FE Merca 105 26 4

William G. Padolina

same 399 22 10

WG Padolina 513 32 10

Evelyn Mae T. Mendoza

same 419 28 13

EMT Mendoza 512 64 13

Christian Joseph Cumagun

same 102 8 5

Antonio C. Laurena

same 298 21 13

AC Laurena 318 30 9

Agnes C. Rola same 565 27 9

AC Rola 851 73 9

Hirsch Index of selected UPLB Faculty and Researchers (c/o Dr Mae Tecson-Mendoza)

Google Scholar gadget search

Citations Number of Publications

Hirsch Index

Juan M Pulhin 633 30 8

JM Pulhin 270 51 9

Merdelyn C. Lit Merdelyn Lit 154 5 3

Asuncion Raymundo

87 7 5

AK Raymundo 133 24 6

Nathaniel Bantayan

N Bantayan 133 16 6

MVO Espaldon same 68 9 3

V Espaldon 484 22 8

Rex Victor O. Cruz

17 10 2

RVO Cruz 123 47 5

Juan M Pulhin 633 30 8

JM Pulhin 270 51 9

Hirsch Index of selected UPLB Faculty and Researchers (Dr Mae Tecson-Mendoza, 2012)

R & D budget Income from generated technologies

No. of publi-cations

Reference

Stanford University

US$1.13 B(2009-10)

$65 M (2008-9)

www.stanford.edu

University of Cambridge

£240.5 M or $386 M

£149M Univ Cambridge (2010)

Iowa State University

$305 M $9.32 M

Kyoto University

$157 M $51,000 Kyoto Univ (2008)

KAIST $248 M 1716 (2008) KAIST (2010)

Universiti Putra Malaysia

US$36.6 M 15,345 (5 yr) www.upm.edu.my

University of the Philippines Los Baños

PhP234 M or $5.2 M

105 (2009) OVCI, UPLB (2010)

Source: Mendoza et al, 2010

Professorial lecture (Tecson-Mendoza et al., 2010) entitled “Establishing UPLB as a Research University” concluded that

“ While UPLB meets the minimum requirements of a research university, it has scored low in most of the criteria for research universities. In particular, it suffers from poor quality profile and number of faculty, low research budget, and low level research activities and outputs such as publications”.

Targets 2010Present

2015

1. Improve the quality of faculty (Reduce number of instructors, replace with assistant professors with PhD)

296 assistant professors

Additional 298 assistant professors

2.Maintain ratio of faculty to students at 1:13 by increasing number of faculty to 1000, balance of 156 will be teaching associates (TA)

0 teaching associates

Total of 156 TAs

3. Increase in budget for increase in number and quality of faculty4. percentage of faculty with PhD Presently 32%

(270/844)50% of total (additional 152)

5. Reduction in teaching load of faculty

12 units 6.0 or lower

6. faculty/researchers with research grants of at least P0.3 M

270 faculty members/Researchers (32%)

59070% of total number

7. increase in research budget PhP252 ($5.6 M) PhP500 ($11.1 M)8. increase in the number of graduate students (11% to 19%)

1,200 2,500

9. percent of international graduate students (1.3% to 7.7%)

150 1,000

10. number of publications (ISI) 0.35 2 per faculty/ researcher

Source: Mendoza et al. 2010