![Page 1: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/1.jpg)
University-industry interactions and innovative
universities: models and measurement
Robert Tijssen
Leiden University, Netherlands
Stellenbosch University, South Africa
Keynote at roundtable “Governance of System Innovation:
System Innovation Axes: Universities & Entrepreneurship”
6 July 2017 (FAPESP, São Paulo, Brazil)
![Page 2: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/2.jpg)
Outline
• Models: dealing with complexity and uncertainty
• Measurement models and indicators of university-industry
interactions
• Bibliometric analysis of Brazilian university-industry research
cooperation
• Brazilian ‘innovative universities’
• Pasteur’s Quadrant model and innovative universities
• Discussion: models, measurement and evidence-informed policies
![Page 3: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/3.jpg)
Models: dealing
with complexity
and uncertainty
![Page 4: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/4.jpg)
Are there any workable
analytical models !?
![Page 5: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/5.jpg)
![Page 6: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/6.jpg)
Is there any useful
empirical data
and information !?
How to deal with
chance events?
Is this a workable
analytical model !?
![Page 7: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/7.jpg)
What kind of added value should
metrics and indicators aim to achieve ?
Information value
Reduce complexity and extract meaningful information
Operational value
Acceptable concepts, definitions and criteria
Analytical value
Accurate data, measurements and performance indicators
Assessment value
Relevant information and knowledge for users
Credibility among stakeholders and public confidence
![Page 8: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/8.jpg)
Source: www.linkedin.com (killing-messenger-4-ways-assassinate-competitions-khalid-al-haribi)
![Page 9: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/9.jpg)
Source: www.forbes.com (10-ways-for-startups-to-survive-the-valley-of-death)
![Page 10: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/10.jpg)
Source: Fastercures.blogspot.com (are-we-there-yet-navigating-path)
![Page 11: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/11.jpg)
• Science and innovation policies, and policy initiatives, are
always embedded in complex adaptive systems
• To design, manage, monitor and evaluate policies we need
useful models and timely and relevant information
• Complex dynamic systems can never be fully captured by
models (no available information of individual parts; specific
outcomes or impacts are difficult to isolate from other
determinants or factors; causality and attribution problems)
Diabolical dilemma’s
of complex systems
![Page 12: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/12.jpg)
Performance measurement is usually based on:
• crude estimates of model parameters
• proxy measures of inputs, outputs, results and impacts
Diabolical dilemma’s
of complex systems
![Page 13: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/13.jpg)
![Page 14: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/14.jpg)
Measurement models
and indicators of
university-industry
interactions
![Page 15: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/15.jpg)
Indicators are a trade-off
between simplicity and
complexity
Indicators are usually either
model-driven or data-driven
![Page 16: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/16.jpg)
Source: Council of Canadian Academies (2013)
![Page 17: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/17.jpg)
![Page 18: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/18.jpg)
![Page 19: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/19.jpg)
![Page 20: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/20.jpg)
In order to be useful and
generally acceptable,
information derived from
indicators should be – at the
very least - meaningful and
convincing
![Page 21: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/21.jpg)
Defining ‘industry-science relationships’
and ‘university-industry interactions’
Extremely broad definition:
Any interaction, connection or communication between a university staff
member (or student) and a staff member of a business enterprise located
somewhere worldwide
Informal contacts
Teaching & training
Dual appointments of staff members
University-Industry Interactions
R&D contracts R&D projects
Intellectual property
Sharing facilities
Source: Based on Brennenraedts, Bekkers & Verspagen (2006)
![Page 22: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/22.jpg)
Source: Council of Canadian Academies (2013)
![Page 23: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/23.jpg)
Operationalizing
‘university-industry interactions’
Extremely narrow definition:
Tangible output as a result of successful research-based collaboration
between an academic researcher and R&D staff employed by a local
business enterprise
Available empirical data for large-scale studies:
National Innovation Surveys among business enterprises
Surveys among individual academic researchers and/or corporate R&D staff
University-Industry Co-authored Publications (UICPs)
![Page 24: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/24.jpg)
Source: Council of Canadian Academies (2013)
![Page 25: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/25.jpg)
Knowledge flows from
university science to industrial R&D
Performance indicators:
• Staff movement and mobility between academia and industry
• Dual appointments/employment of staff
• Patents
• Citations in patents to research publications
• University-Industry Co-authored Publications (UICPs)
![Page 26: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/26.jpg)
Bibliometric model of
university-industry interactions
Source: Tijssen R.J.W., Yegros-Yegros, A. and J.J. Winnink, Scientometrics, 109, pp. 677–696, 2016.
Research publications
Patents
Research publications
Research publications
Patents
Patents
Joint production
Joint production
Citations
Universities Industry
![Page 27: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/27.jpg)
Case study: Brazilian ‘innovative
universities’
![Page 28: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/28.jpg)
Collaborative research network structure:
Petrobras and Brazilian universities (2006-2014)
Source: Gielfi, G., Furtado, A,, De Campos, A., Tijssen, R,, (2017), University-industry research collaboration
in the Brazilian oil industry: the case of Petrobras. Revista Brasileira de Inovação.
![Page 29: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/29.jpg)
![Page 30: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/30.jpg)
‘Innovation performance’ metrics
Publication volume: total number of research articles indexed by
Thomson Reuters Web of Science database
Patent volume: total number of patents filed at the World International
Patent Organisation (WIPO)
Patent success: ratio of patent applications to WIPO granted patents
Patent citations: patent-to-patent citation impact (patent count)
Patent citation impact: patent-to-patent citation impact
Patent-to-article citation impact: relative citation impact citation from
patents to research publications
Industry article citation impact: citation impact from industry-produced
publications
Industry collaborative articles: percentage of
university-industry co-authored publications
![Page 31: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/31.jpg)
![Page 32: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/32.jpg)
![Page 33: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/33.jpg)
Discussion:
models, measurement
and evidence-informed
policies
![Page 34: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/34.jpg)
Current models are able to capture some relevant processes, outputs and impacts
Some performance indicators may provide useful comparative empirical information
Brazilian university-industry R&D is linked to global innovation systems; large differences
in performance levels among Brazilian universities and firms
Causality and attribution problems render it (almost) impossible to assess effectiveness,
efficiency, or determine rates of return
Capturing dynamic and open
science and innovation systems
![Page 35: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/35.jpg)
Contextualization is essential
Add information from local (Brazilian) sources:
• SciELO database of research publications;
• Lattes database on individual researchers
• Information from organisational databases (university
administration)
• Validation and verification studies with experts and stakeholders
(‘numbers with narratives’)
Utilize university rankings, and underpinning performance
indicators, as an transparency tool and a ‘way in’ to create common
elements in a comparative empirical evidence base
Produce persuasive ‘narratives with numbers’ (avoid false precision
of ‘statistical facts’) as input for policy debate
![Page 36: University-industry interactions and innovative ...fapesp.br/eventos/2017/insyspo/PDF/06-07/9h45_TIJSSEN.pdfKeynote at roundtable “Governance of System Innovation: ... Accurate data,](https://reader033.vdocument.in/reader033/viewer/2022060506/5f1f01c5233f6562157174a5/html5/thumbnails/36.jpg)
Some STI policy questions
• Which policy-relevant analytical frameworks (if any) can help better
understand university-industry interactions (and forecast their outcomes?)
• How could macro-level and meso-level policy oriented studies and micro-
level analysis of activities (projects, individuals) supplement each other ?
• Who are key R&D staff – within the public sector institutes, universities
and firms - engaged in those interactions; what are their major R&D
achievements and research-based innovation goals?
• What challenges confronted by public sector researchers when
engaging with the business sector, during university-industry collaboration
activities and research commercialization?
• What are the main contributions of private sector intermediates and
investors ?