www.efquel.org learning from peers an introduction to peer-review anthony f. camilleri 5 th ict...
TRANSCRIPT
![Page 1: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/1.jpg)
www.efquel.org
Learning from PeersAn introduction to peer-review
Anthony F. Camilleri 5th ICT Innovations Conference 201314th September 2013 – Ohrid, Macedonia
![Page 2: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/2.jpg)
www.efquel.org
What‘s in a Name?
Audit Expert-Review
Objective Subjective
Precise standards Broad guidelines
Verifies account of client Interprets account of client
Requires detailed knowledge of administrative procedures
Requires detailed knowledge of the subject area concerned
standards-basedreview
![Page 3: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/3.jpg)
www.efquel.org
Who is a peer?
• an expert in the field• an expert in what field?• e-learning!• what is e-learning?
![Page 4: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/4.jpg)
www.efquel.org
Features of an Expert-Peer
experience in course design and delivery
familiar with best-practice
comparative perspective
sense of missionnatural communicator
![Page 5: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/5.jpg)
www.efquel.org
A reviewer is a communicator
University
AgencyReview Team
![Page 6: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/6.jpg)
www.efquel.org
Inter-subjectivity
• different subjective perceptions, taken from different viewpoints, give an objective view of reality
• the quality basis of an external review• requires consensus
consensus is not a diplomatic nicetybut an essential pre-requisite of quality
![Page 7: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/7.jpg)
www.efquel.org
Learning from
self-assessment
![Page 8: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/8.jpg)
www.efquel.org
There is no such thingas objective quality
![Page 9: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/9.jpg)
www.efquel.org
How to learn from self-assessment1. Read the quality standard2. Understand the quality standard3. Ask Questions4. DO NOT fill it in5. Discuss it – with all stakeholders in the institution
a. How do we meet the standard?b. What can we do better?c. Does it apply in all areas?
6. Discuss it some more – do some implementation7. Have you internalised standard?8. Now fill in the questionnaire
![Page 10: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/10.jpg)
www.efquel.org
A look at the Quality Cycle
• Do• Check
• Plan• Act
アクション
計画
実行チェック
CHECK should be read as STUDYin English Check implies ‚to hold back‘(Deming, 1980)
![Page 11: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/11.jpg)
www.efquel.org
A Need to Prioritise
• Do• Check
• Plan• Act
アクション
計画
実行チェック
![Page 12: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/12.jpg)
www.efquel.org
Be Honest
„Most Quality Managers are Magicians“
Look Here
don‘t look here!
![Page 13: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/13.jpg)
www.efquel.org
What will self-assessment produce• A time to think, communicate and strategize• A better understanding of institutional
processes• An overview of where we are and hopefully
where we need to go
• A report
![Page 14: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/14.jpg)
www.efquel.org
Learning from
peer-review
![Page 15: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/15.jpg)
www.efquel.org
TheShow-Off
ThePolitician
TheGrumpy
TheBored
Don’t be one of these people….
![Page 16: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/16.jpg)
www.efquel.org
How to approach a peer-review
• Understand the purpose of the review
• Understand your role in the review– Your impressions– Of your part in the instituion
• Be candid and informative• Don’t try to hide things (you’ll be
caught)
![Page 17: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/17.jpg)
www.efquel.org
Main result of peer-review
an external evaluation of your institutional quality
(procedures)
a report
a certificate
![Page 18: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/18.jpg)
www.efquel.org
Run the cycle again
• Do• Check
• Plan• Act
アクション
計画
実行チェック
![Page 19: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/19.jpg)
www.efquel.org
Remember
NO process is without errors
There is ALWAYS room for improvement
![Page 20: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/20.jpg)
www.efquel.org
What to do with the report
1. Read the report2. Understand the report3. Ask Questions4. Discuss it – with all stakeholders in the institution
a. What did we miss in our Self-Assessment?b. Have our assumptions been confirmed or refuted?c. How can we do it better
5. Discuss it some more – do some implementation6. Have you internalised the recommendations?7. Now start the cycle again.
![Page 21: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/21.jpg)
www.efquel.org
EFQUEL’s e-Quality Services
E-Quality Review ServicesExpert Reviews
ECBCheck E-Quality Label Certification for Short Courses and Training Programmes
E-Quality Label for Programmes Certification for Academic Programmes
UNIQUe E-Quality Label Certification for Institutions and Institutes
![Page 22: Www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid,](https://reader030.vdocument.in/reader030/viewer/2022033108/56649ebc5503460f94bc5bb5/html5/thumbnails/22.jpg)
www.efquel.org
THANK-YOUfor your attention
Feedback is welcome!
Released under a Creative Commons Attribution ShareAlike 3.0 Belgium License
You are free:• to Share — to copy, distribute and
transmit the work• to Remix — to adapt the work
Under the following conditions:Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work).Share Alike — If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one.
13th June 2013 – VISIR Session – The Joy of Learning EDEN Conference - OSLOwww.efquel.org
„Learning from Peers: An introduction to peer review“
Anthony F. [email protected]://www.slideshare.net/anthonycamilleri/