Towards an Evaluative Towards an Evaluative Framework for Framework for

Community Learning Community Learning NetworksNetworks

Leslie Regan ShadeLeslie Regan ShadeDept. of CommunicationDept. of Communication

University of OttawaUniversity of OttawaVideoconference toVideoconference to the World Bank Gender the World Bank Gender

and the Digital Divide Seminar Series, and the Digital Divide Seminar Series, November 5, 2002November 5, 2002

Talk OutlineTalk Outline Project Description, background, goalsProject Description, background, goals Theoretical perspectives, methodologyTheoretical perspectives, methodology Gender AnalysisGender Analysis Applicability to developing country projectsApplicability to developing country projects

Project DescriptionProject Description Project with Information Policy Research Project with Information Policy Research

Project University of TorontoProject University of Toronto Research development grant funded by Research development grant funded by

SSHRC Initiative on the New EconomySSHRC Initiative on the New Economy Part of wider project, Connecting Part of wider project, Connecting

Canadians Through Community Canadians Through Community Networking?Networking?

FocusFocus Begin conceptual & empirical groundwork Begin conceptual & empirical groundwork

towards evaluating Community Learning towards evaluating Community Learning Networks (CLNs) across CanadaNetworks (CLNs) across Canada

What are some of the key methods that What are some of the key methods that can constitute an effective evaluation can constitute an effective evaluation framework, meeting needs of all framework, meeting needs of all stakeholders?stakeholders?

BackgroundBackground 1998: Human Resources Development 1998: Human Resources Development

Canada (HRDC) launches Community Canada (HRDC) launches Community Learning Networks InitiativeLearning Networks Initiative

CLNS = physical, social, and electronic CLNS = physical, social, and electronic public spaces that foster community public spaces that foster community values & technological literacy in a values & technological literacy in a supportive learning environmentsupportive learning environment

Canadian Digital Divide Canadian Digital Divide ProgramsPrograms

Federal ‘Connecting Canadians’ agendaFederal ‘Connecting Canadians’ agenda Industry Canada led: SchoolNet, CAP, Industry Canada led: SchoolNet, CAP,

VolNet, LibraryNet, NetCorps….VolNet, LibraryNet, NetCorps…. Aim: promote economic development Aim: promote economic development

while nurturing social cohesionwhile nurturing social cohesion

Whither the Evaluation?Whither the Evaluation? Although several hundred million $$ have Although several hundred million $$ have

been spent in these programs in support been spent in these programs in support of some 10,000 community ICT of some 10,000 community ICT initiatives….initiatives….

There has been remarkably little There has been remarkably little evaluation: what has been achieved? evaluation: what has been achieved? difficulties? effects on community difficulties? effects on community networking practices?networking practices?

Research QuestionsResearch Questions Using St. Christopher’s House (Toronto) Using St. Christopher’s House (Toronto)

as a study…as a study… Do members of the CLN engage in, or Do members of the CLN engage in, or

plan to engage, in lifelong learning plan to engage, in lifelong learning programs?programs?

What impact has the ‘new economy’ had What impact has the ‘new economy’ had on communities using CLNs?on communities using CLNs?

Components of digital literacy?Components of digital literacy?

More QuestionsMore Questions Can communities engage meaningfully Can communities engage meaningfully

with the ‘new economy’: find work, utilize with the ‘new economy’: find work, utilize tech skills, access government services?tech skills, access government services?

Have CLNs ‘wired’ Canadians for the Have CLNs ‘wired’ Canadians for the ‘Information Age’?‘Information Age’?

How has voluntary/nonprofit sector aided How has voluntary/nonprofit sector aided communities?communities?

In summary…In summary… Has access to ICTs affected the lives of Has access to ICTs affected the lives of

members of the general public accessing members of the general public accessing technology through a CLN?technology through a CLN?

Theoretical ApproachesTheoretical Approaches Recognition of socio-technical nature of Recognition of socio-technical nature of

ICT development & useICT development & use Social construction of knowledgeSocial construction of knowledge Communities of practiceCommunities of practice

MethodologyMethodology Program Logic ModelProgram Logic Model Participatory approachesParticipatory approaches Lit reviewLit review Fieldwork: participatory design, action Fieldwork: participatory design, action

research, community interviews & surveysresearch, community interviews & surveys Community & govt. policy design seminarsCommunity & govt. policy design seminars

5 Broad Areas of Assessment5 Broad Areas of Assessment(Dara O’Neil)(Dara O’Neil)

Strong DemocracyStrong Democracy Social CapitalSocial Capital Individual EmpowermentIndividual Empowerment Sense of CommunitySense of Community Economic DevelopmentEconomic Development

Gender AnalysisGender Analysis Poses questions related to design, Poses questions related to design,

development, & management of CLCsdevelopment, & management of CLCs Creates gender indicatorsCreates gender indicators Qualitative & quantitative Qualitative & quantitative Can have an impact on policy (ideally) Can have an impact on policy (ideally)

Policy and ProgramsPolicy and Programs Were women & women’s groups consulted Were women & women’s groups consulted

- in the beginning - about the program - in the beginning - about the program development and policy goals?development and policy goals?

How were they consulted?How were they consulted? What projects were not funded?What projects were not funded?

Management of CLCManagement of CLC Are women(s)groups seeking out funds for Are women(s)groups seeking out funds for

CLCs?CLCs? Are community groups including Are community groups including

women(s)groups?women(s)groups? Are women involved in the daily Are women involved in the daily

management of the CLC? How? In what management of the CLC? How? In what function?function?

CLC Mission/GoalsCLC Mission/Goals• Are services meeting Are services meeting

women(s)groups concerns and women(s)groups concerns and needs?needs?

• Gendered uses of CLCs?Gendered uses of CLCs?

TrainingTraining Gender composition of CLC ‘clients’ Gender composition of CLC ‘clients’

trainedtrained Who provides training?Who provides training? ‘‘Gender-sensitive’ training?Gender-sensitive’ training? Targets social and economic needs?Targets social and economic needs?

Content IssuesContent Issues Who’s driving the content? Who’s driving the content? Local content facilitation?Local content facilitation? Are women information producers?Are women information producers? Local/indigenous knowledgeLocal/indigenous knowledge Literacy & language issuesLiteracy & language issues Universal usabilityUniversal usability

Women and ‘New Economy’Women and ‘New Economy’ Opportunity to train as technologists?Opportunity to train as technologists? Networking & advocacy?Networking & advocacy? Extend public sphere & contribute to civic Extend public sphere & contribute to civic

discourse?, e.g., >interaction with discourse?, e.g., >interaction with government/policy officialsgovernment/policy officials

Creation of virtual public spaces? Creation of virtual public spaces?

Relevance of Canadian Relevance of Canadian Study>Developing CountriesStudy>Developing Countries

Telecentre evaluationTelecentre evaluation ‘‘Best’ or ‘worst’ practices can illuminateBest’ or ‘worst’ practices can illuminate Extend global networkExtend global network

More Information & UpdatesMore Information & Updates http://www.fis.utoronto.ca/research/iprp/c3http://www.fis.utoronto.ca/research/iprp/c3

n/index.htmln/index.html