better commissioning for better evaluations dr carmen huckel-schneider principal analyst knowledge...
TRANSCRIPT
![Page 1: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/1.jpg)
Better commissioning for better evaluations
Dr Carmen Huckel-Schneider
Principal Analyst
Knowledge Exchange Division
Sax Institute
Duncan Rintoul
Principal Evaluator
Centre for Education Statistics and Evaluation
Department of Education
![Page 2: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/2.jpg)
useimplementation/management
furtherplanning
initialplanning
procurement/engagement
Commissioning in the evaluation lifecycle
A simplified
![Page 3: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/3.jpg)
Commissioning in the evaluation lifecycle
useimplementation/management
furtherplanning
initialplanning
procurement/engagement
![Page 4: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/4.jpg)
Commissioning in the evaluation lifecycle
useimplementation/management
furtherplanning
initialplanning
procurement/engagement
![Page 5: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/5.jpg)
Commissioning in the evaluation lifecycle
useimplementation/management
furtherplanning
initialplanning
procurement/engagement
![Page 6: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/6.jpg)
useimplementation/management
furtherplanning
initialplanning
procurement/engagement
Commissioning in the evaluation lifecycle
![Page 7: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/7.jpg)
scenario1You need to be able to explain your program to an outsider
Better commissioning
for better evaluations
![Page 8: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/8.jpg)
scenario2You program needs to have clear and reasonable objectives
Better commissioningfor better evaluations
![Page 9: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/9.jpg)
scenario3
You need to be able to explain how your activities are supposed to lead to your intended outcomes
Better commissioning
for better evaluations
![Page 10: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/10.jpg)
1. Know your program well
Logic modelling is a great tool for this
Better commissioning
for better evaluations
![Page 11: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/11.jpg)
scenario4Be open-minded about what the evaluation may discover
Better commissioning
for better evaluations
![Page 12: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/12.jpg)
scenario5Be open to methods and approaches that you are unfamiliar with
Better commissioning
for better evaluations
![Page 13: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/13.jpg)
6Anticipate use: Who is going to find the evaluation helpful, and for what purpose?
Better commissioning
for better evaluationsscenario
![Page 14: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/14.jpg)
1. Know your program well2. Commission for use
Better commissioning
for better evaluations
![Page 15: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/15.jpg)
1. Know your program well2. Commission for use3. Build evaluation in early
Better commissioning
for better evaluations
• baseline data• comparison• built-in data collection
![Page 16: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/16.jpg)
1. Know your program well2. Commission for use3. Build evaluation in early4. Prioritise in light of the trade-off
between cost, time and quality
Better commissioning
for better evaluations
![Page 17: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal](https://reader035.vdocument.in/reader035/viewer/2022062805/5697bfce1a28abf838ca990b/html5/thumbnails/17.jpg)
Better commissioning for better evaluations
1. Know your program well2. Commission for use3. Build evaluation in early4. Prioritise