so you want to do an evaluation? - amazon web services · so you want to do an evaluation? john...
TRANSCRIPT
![Page 1: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/1.jpg)
So you want to do an Evaluation?
John StapletonWellesley-Maytree Public Policy Training Institute
April 7, 2006
![Page 2: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/2.jpg)
Doing an Evaluation:
Procurement policies
Ideas about how to go about it
What you should know depending on who you work for
![Page 3: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/3.jpg)
OUTLINE
1) Where you work matters!2) Government Evaluation
• Federal• Provincial• Municipal
3) Non-Profit Evaluations4) Funder (Foundation)5) Private Sector Evaluations
![Page 4: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/4.jpg)
Where your work matters!Where you work; government, non-profits, or in the profit sector will determine how you go about doing an evaluation.
![Page 5: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/5.jpg)
Your company or enterprise may already have a policy on evaluations. It is important to find it, read it, ask questions, and be knowledgeable.
![Page 6: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/6.jpg)
It is important to know how others go about evaluation.
“Post its? Nah, the boss gives me a gold star when I perform well.”
![Page 7: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/7.jpg)
Government Evaluations: The Federal Government
![Page 8: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/8.jpg)
Federal Government
Evaluation and Data Development (EDD) is the largest evaluation shop in the Federal Government, and provides relevant, reliable, objective and timely information on the efficiency and effectiveness of Human Resources Development Canada's (HRDC) programs
http://www11.hrdc-drhc.gc.ca/pls/edd/hrdc.main
![Page 9: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/9.jpg)
Federal Government
The Government evaluation website tells you much of what you need to know in terms of evaluations:• what the federal government does• its requirements • its priorities
![Page 10: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/10.jpg)
The second most important thing to know about the federal government is where it does
its business.
The Answer is ‘GETS’ , ‘MERX’, and ‘Canada Business’
![Page 11: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/11.jpg)
“It’s time for the senior bureaucrat performance evaluation, Fenwick. I’ll do you if you do me.”
![Page 12: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/12.jpg)
GETS – The Government Electronic Tendering Service
The Government Electronic Tendering Service (GETS) is an on-line system that advertises government contracting opportunities to potential bidders.
http://contractscanada.gc.ca/en/tender-e.htm
![Page 13: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/13.jpg)
GETS is being operated by Mediagrif Interactive Technologies Inc. as MERX™ which provides the service to the federal government under contract.
![Page 14: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/14.jpg)
More and more of the Government of Canada's requirements are advertised on
MERX, about $5 billion annually
Five billion dollars$5,000,000,000.00
This note is legal tender.
![Page 15: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/15.jpg)
MERX is Canada’s leading electronic-tendering service
MERX is the most complete source of public tenders, private tenders and private sector construction available in Canada.
http://www.merx.com/English/nonmember.asp?WCE=Show&TAB=1&State=1&hcode=DSmmOnl5zU6FVjU16CWLSQ%3d%3d
![Page 16: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/16.jpg)
MERX has leveled the playing field.
![Page 17: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/17.jpg)
Businesses of any size have easy and affordable access to billions of dollars in contracting opportunities with the federal government, participating provincial and municipal governments and the private sector.
Five billion dollars$5,000,000,000.00
This note is legal tender.
![Page 18: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/18.jpg)
MERX presently offers its suppliers three services:
1) Public Tenders Service:Billions of dollars in public sector business opportunities are tendered annually through the MERX Public Tenders Service, from goods and services representing hundreds of dollars to multi-million dollar contracts.
![Page 19: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/19.jpg)
2)Private Tenders Service:This newest service allows all types of businesses to expand into private-sector tendering. With MERX Private Tenders, suppliers can find more business opportunities from ready-to-buy buyers, expand their customer-base and grow their business
Buyer’s contract
![Page 20: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/20.jpg)
3) Private Construction Service:Tap into the billions of dollars in private construction projects currently reporting in Canada, from the construction of houses and hotels, to office buildings and shopping malls.
![Page 21: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/21.jpg)
Business Access Canada
Business Access Canada is an inter-departmental initiative to improve supplier and buyer awareness and simplify access to federal government purchasing information.
http://canadabusiness.gc.ca/gol/cbec/site.nsf/en/bg00338.html
![Page 22: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/22.jpg)
Provincial (Ontario) –
through Government
Services
![Page 23: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/23.jpg)
Provincial (Ontario) – through Government Services
http://www.mgs.gov.on.ca/english/index.html
The Ministry of Government Services(MGS) was created to modernize government operations and provide cost-effective services to consumers, businesses and the Ontario Public Service.
![Page 24: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/24.jpg)
Municipal – Not in
One Place - No
Evaluation ‘Central’
![Page 25: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/25.jpg)
It is not clear that Toronto (as a City Government) has a comprehensive approach to evaluation. It participates in and requires evaluation of proposals.The Tendering process and RFP process are very rigorous-- especially so following the ‘computer scandal.’
![Page 26: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/26.jpg)
Non-Profit Evaluations e.g. United Way
![Page 27: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/27.jpg)
The United Way is:• A comprehensive source for all forms of
evaluation.• Unlike Governments, the United Way (as an
example of the non-profit sector, has a ‘clearing house’ approach to evaluation.
![Page 28: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/28.jpg)
• The clearinghouse approach recognizes the many ways in which evaluation can be accomplished
• UWGT uses the PEOD approach
We don’t give it out, only collect it.
![Page 29: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/29.jpg)
Funder Approaches to Evaluation e.g. Maytree
![Page 30: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/30.jpg)
Funder Approaches to Evaluation e.g. Maytree
• Often devise their own approaches
• Following the approach is a condition of funding
![Page 31: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/31.jpg)
“It may seem we’re sinking deeper into debt, but really we’re just experiencing a quarter of negative growth.”
Guidelines: What we look for in a grantee:
• A willingness to work with other community organizations, institutions and funders
• The ability to evaluate the project, recognizing that successes and shortfalls lead to the development of other solutions
![Page 32: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/32.jpg)
• Evidence of an understanding of internal/external factors affecting the community.
• A commitment to share what was learned with the community The capacity to undertake the project, including evidence of leadership.
![Page 33: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/33.jpg)
How much money is available for a project?
• The amount of support and the duration of the grant will depend on the nature of the project
• Small projects range in size from $2,500-$25,000 where objectives can be reached in under a year
![Page 34: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/34.jpg)
• Multi-year support is available for projects that require an extended time-frame to accomplish their objectives
• Multi-year funding is determined by the submission, review and approval of annual project evaluation reports
I’m here to ask you for funding for my further development
![Page 35: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/35.jpg)
Who may apply:
• Registered charities or incorporated organizations that are submitting a proposal jointly with a registered charity
• Organizations that have an explicit mandate and a track record (of at least three years) in advancing the settlement and participation of refugees and immigrants
• Projects in large urban centres in Canada with significant populations of refugees and immigrants
![Page 36: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/36.jpg)
Private Sector Evaluations
• They may choose to do or not do evaluations.
• Responsibility is to Board of Directors and/or shareholders.
![Page 37: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/37.jpg)
Private sector evaluations:
• May be public or private e.g. may be ‘invitation only’
• May be by RFI.• May be by RFP.• If government
money is involved, it may adhere to government rules.
![Page 38: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/38.jpg)
In private sector evaluations there is“No one set of Rules”
![Page 39: So you want to do an Evaluation? - Amazon Web Services · So you want to do an Evaluation? John Stapleton Wellesley-Maytree Public Policy Training Institute. April 7, 2006. ... grant](https://reader035.vdocument.in/reader035/viewer/2022071003/5fc08f9597acce646f7412ff/html5/thumbnails/39.jpg)
Conclusions
• Procurement differs depending where you work
• Based on governance structures and public expectation
• Knowing procurement practice helps in knowing how you will do an evaluation – the ground rules
• Processes not necessarily widely known.