using accountability to support quality
DESCRIPTION
Using Accountability to Support Quality. Aligning Program, Campus, System, State, and Federal Models of Higher Education Effectiveness. Victor M. H. Borden, Ph.D. Associate Professor of Psychology Associate Vice Chancellor Information Management and Institutional Research - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/1.jpg)
Network Conference
Using Accountability to Support Quality
Aligning Program, Campus, System, State, and Federal Models of Higher Education Effectiveness
Victor M. H. Borden, Ph.D.Associate Professor of Psychology
Associate Vice ChancellorInformation Management and Institutional Research
Indiana University-Purdue University IndianapolisPresident, Association for Institutional Research
![Page 2: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/2.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
In ConclusionSuccessful accountability systems are sensitive to diverse perspectives on qualityThe best accountability measures derive from systematic assessment and evaluationAlignment across levels is optimized by:
Recognizing and rewarding multiple kinds of qualityActive listening to multiple constituent groups
Responsible accountability educates all constituents
![Page 3: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/3.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Part I
What is a quality higher education?
![Page 4: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/4.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
A Pause for Reflection
What qualities of a college experience are most valued by…
Students?Parents?Faculty?Trustees?Legislators?Accreditors?Business and Industry?
![Page 5: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/5.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Qualities of the College ExperienceStudents
Excellent teachers; access to rewarding careers/professions; academic support; personal enrichment; quality of student life; exposure to people
ParentsPersonal and professional development; safety; access to positive role models; stay out of trouble
FacultySmall classes; good students; space and resources (library, equipment, etc.) for research and scholarship; good colleagues; support for venture development; lack of bureaucracy
TrusteesEffective use of resources; faculty accomplishments (recognition and funding); student progress and achievement; contributions to economic development
LegislatorsAccess by constituents; employability of graduates; contributions to state welfare and development; effective use of resources; ties with business and industry; controlled costs
AccreditorsAdequate organizational structures and processes (administration and governance); appropriate credentials of faculty; effective use of resources; demonstrated student learning outcomes; quality assurance processes
Business and IndustryPreparation of graduates for workforce; support for research and development
![Page 6: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/6.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Quality
+
Cost AccessTo Student
+To State
Undifferentiated
+Differentiated
Program
Higher Education System Quality
![Page 7: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/7.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Quality Cost Access Students Teachers, programs, support, career
dev., student life, friends Low cost or
high aid To a point
Parents Career & personal dev., safety, role models, safety
Low cost or high aid
To a point
Faculty Small classes, good students, resources, colleagues, work environ.
Lots of funds Diverse and well prepared
Trustees Effective use of resources, faculty accomplishments; student progress, economic development
Managed costs; diverse
resources
Diverse, well prepared, fit to
mission Legislators Employability, contributions to state
welfare and development, effective use of resources, ties with business and industry
Low costs Broad access
Accreditors Org infrastructure and capacities, faculty credentials, effective use of resources, student learning, quality assurance
Fiscal viability, controlled
costs
Appropriate to mission
Business Employability, support R&D Managed Enough to fill workforce needs
![Page 8: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/8.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Models of Quality Reputation and Resources
Ratings and rankings
Institutional EffectivenessQuality assurance
Value-Added ApproachesStudent learning outcomes
Student EngagementQuality of academic experience
Higher Education Balanced Score CardMeasuring Up: The State Report Card
![Page 9: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/9.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Reputation and ResourcesPrevailing view?Revolves around institutional archetypes
Research university; Liberal arts college; Experience of residential 18-22 year olds
Peer judgments included academic reputation
Measures emphasize inputs and resourcesSelectivity, faculty/student ratio, library volumes, research and salary dollars
Graduation rates as outcomesAnother reflection of selectivity and residential nature
Epitomized by U.S. News & World Report
![Page 10: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/10.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Value-Added ApproachesMore talked about than implementedFocus on change from input to output
Student developmentRegional improvement
Favors longitudinal measurementControversy about amount of change vs. reaching standards of excellence (or even adequacy)Highlights key question: To what degree is institutional quality related to selectivity?Can be incorporated as contextual element of other models
![Page 11: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/11.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Institutional Effectiveness
Mechanistic approachRatio of resources to inputs, processes, and outcomes
Qualitative approachPeer review of structures, credentials, and processes“Audit” of quality assurance processes, including student outcomes assessment
Traditional accreditation approach
![Page 12: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/12.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Student EngagementFocuses on quality of college experienceDerived from “best practices” in undergraduate education
Wingspread; Chickering & Gamson
Basis of National Survey of Student Engagement (NSSE)
Fastest growing and most widely used survey in U.S. Higher Education HistoryEngagement Indices analyzed within context of student population characteristics
![Page 13: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/13.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Principles of Good PracticeEncourages contact between students and faculty Develops reciprocity and cooperation among students Encourages active learning Gives prompt feedback Emphasizes time on task Communicates high expectations Respects diverse talents and ways of learning
![Page 14: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/14.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
HE Balanced Score Card
Kaplan & Norton (1976) propose business model
Financial performanceCustomer service and satisfactionProcess effectiveness and efficiencyOrganizational learning
Ruben (1999) adapts to higher education
http://www.odl.rutgers.edu/pdf/score.pdf
![Page 15: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/15.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Ruben’s HE BSCTeaching/Learning
Programs/Courses, Student Outcomes
Service/OutreachUniversity, profession, alumns, state, prospective students, families employers
Scholarship/ResearchProductivity/Impact
Workplace satisfactionFaculty/staff
FinancialRevenues/expenditures
![Page 16: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/16.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Measuring UpState-Level FocusPreparation
H.S. grad rate; math/science course taking; math, science, reading, writing proficiency, college entrance exams; AP scores
ParticipationH.S.college rate; young adult enrollment; working adult enrollment
AffordabilityFamily abil. to pay at CC; family ability to pay at 4-Yr; need-based financial aid; low-priced colleges; low student debt
CompletionRetention and grad rates at 2- and 4-yr. colleges
BenefitsAdults w/bachelor’s + degree; Increased income from BA degree; increased income from some col/2-yr degree; population voting; charitable contributions; quant literacy; prose literacy; document literacy
![Page 17: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/17.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Measuring Up Student LearningAll states received an incomplete in the 2000 and 2002 roundsSeveral position papers regarding approaches to assessing college-level learning (Peg Miller and Peter Ewell)Several ongoing studies, e.g., RAND/CAEKentucky pilot, using licensing exams; GRE, MCAT, LSAT, etc; National Adult Literacy Survey; National Survey of Student EngagementMove toward a college-level NAEP?
![Page 18: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/18.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Part I SummaryDifferent people have different views of what defines the quality of higher educationAny attempt to create a comprehensive view will require
Multiple dimensions, multiple perspectives, and multiple measuresBalance between quantitative and qualitative components
But is a comprehensive view necessary, or can we take multiple, less complex views and then consider how well they align?
![Page 19: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/19.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Part II
How do we measure quality in higher
education?
![Page 20: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/20.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Common Methods
Peer Review of Self StudyBenchmarkingPerformance Indicators
![Page 21: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/21.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Peer Review of Self StudyHow would you assess the quality of the history major at Harvard University as compared to at Miami-Dade College?Self-study requires unit to take stock and reflect upon effectiveness in attaining goals, which requires
Having goals that relate to overall missionHaving capacity (infrastructure, resources, and processes) to effect goalsMonitoring effectiveness and adjusting
![Page 22: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/22.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Peer Review of Self Study
Peer review provides expert and credible judgment sensitive to contextManifestations
Faculty-led assessmentAcademic program reviewSpecialized (professional and disciplinary) accreditationRegional accreditationU.K. External Examiners
![Page 23: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/23.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Benchmarking Definition
Evaluation against an established standard
A process for evaluating business operations by detailed comparison with those of another business, in order to establish best practice and improve performance
![Page 24: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/24.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Best PracticeA process, technique, or innovative use of technology, equipment or resources that has a proven record of success in providing significant improvement in cost, schedule, quality, performance, safety, environment, or other measurable factors which impact an organizationContext specific example – substance abuse
"best practices" are those strategies and programs which are deemed research-based by scientists and researchers at:
National Institute for Drug Abuse (NIDA), Center for Substance Abuse Prevention (CSAP), National Center for the Advancement of Prevention (NCAP), Office of Juvenile Justice and Delinquency Prevention (OJJDP), and Centers for Disease Control and Prevention (CDC).
![Page 25: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/25.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Best PracticeStanley Fish in his Chronicle column…practices that had worked for some people
in some context where some problem had been identified and was addressed successfully by some solution"Best Practices" is itself a practice, an industry focused on itself and equipped with its own internal machinery including a version of the Academy Awards that allows practitioners to recognize and honor one another publicly
![Page 26: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/26.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Data and MeasuresComprise the metrics of benchmarking, but are not benchmarking itselfOften mistaken for outcome goals
U.S. News & World ReportCarnegie Classification
More correctly viewed as process indicatorsExamples
Graduate program admissions selectivity and yieldStudent credit hours per faculty FTE
![Page 27: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/27.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Realities of BenchmarkingOften used outside process context
Measures seen as having meaning in and of themselvesHow well do we do compared to others?This is why ratings and ranking systems are inherently invalid
But measures can be starting point for process inquiry
![Page 28: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/28.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Performance Indicators
History of external mandatesRecent efforts more closely related to internal evaluation and improvement efforts
BSCPerformance reports
![Page 29: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/29.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Criteria for Effective PIs*
Start with purposeAlign throughout organization (or system)Align across input, process, outputCoordinate a variety of methodsUse PIs in decision making
*Banta, T. W. and Borden V. M. H. (1994). Performance indicators for accountability and improvement. In V. M. H. Borden & T. W. Banta (eds.) Using performance indicators to guide strategic decision making. New Directions for Institutional Research, 82. San Francisco: Jossey-Bass.
![Page 30: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/30.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Principles for Effective PI Reporting*
FrameworkTransparentInclusiveAuditable
ContentCompleteRelevantSustainable
Quality & Reliability
AccurateNeutralComparable
AccessClearTimely
*Source: Global Reporting Initiative – Sustainability Reporting Guidelines
![Page 31: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/31.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
PIs as Measures
Inductive – Deductive Cycle
![Page 32: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/32.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Measurement - Theory
Validity and reliabilityUnless very careful attention is paid to one’s theoretical assumptions and conceptual apparatus, no array of statistical techniques will suffice – Blalock, 1982, p.9
i.e., garbage in, garbage oute.g., graduation rate, funding per FTE, etc.
![Page 33: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/33.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
APQC MIPO
An American Productivity and Quality Center (APQC) benchmarking study
Measuring Institutional Performance Outcomes (Higher Education)
![Page 34: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/34.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Effective Performance Measures…
…communicate the institution’s core values…are carefully chosen, reviewed frequently, and point to action to be taken on results…may be stimulated by external requirements…are best used as “problem detectors” to identify areas for management attention and further exploration…are linked to resource allocation indirectly (non-punitively)
![Page 35: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/35.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Effective Performance Measures…
…are publicly available, visible, and consistent across the organization…are best considered in the context of a wider transformation of organizational culture…take time to develop, require considerable “socialization” of the organization’s members, and are enhanced by stable leadership…change the role of managers and the ways in which they manage
![Page 37: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/37.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
![Page 38: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/38.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
![Page 39: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/39.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
![Page 40: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/40.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Assessable Outcomes
Instrumentation
Data Collection & Analysis
Application of Findings
Culture ofEvidence
Improvement
1. Reporting to internal constituents 2. Demonstrating accountability to
external stakeholders
3. Applying findings in campus improvement initiatives
4. Proposing improvement initiatives
5. Improving assessment methods
Web-based data Electronic portfolios
Evaluation
1. Academic and administrative program reviews
2. Evaluation of process effectiveness
3. Assessment of learning outcomes
• in major
• in general education
5. Student assessment
6. Constituent surveys
7. Management information and analysis
8. Program cost analysis
9. Web-based assessment tools
10. Annual campus performance report 11. NCA accreditation
4. Course evaluations
Planning & Budgeting 1. Mission, Vision, Goals developed 2. Unit goals aligned 3. Annual reports on web 4. Programs based on assessable goals,
with performance indicators
5. Biennial planning/budgeting hearings conducted
Implementation
(Everyone on campus implements goals)
![Page 41: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/41.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Part II Summary
Assessing quality requires conceptual and contextual framesMeasures of quality derive from and pertain to the assessment process
They do not have a life in and of themselves
Accountability for quality may have as much or more to do with demonstration of process than of particular outcomes
![Page 42: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/42.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Part III
How do we align approaches to quality
assessment across levels?
![Page 43: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/43.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Aligning Approaches to Quality Assessment Across Levels
How can programs, schools, colleges, universities, systems, states,…each define terms of quality that…
Are appropriate to local contexts and conditions?Fit within higher level organizations goals and objectives?
What mechanisms promote fit among and between levels?How does mission differentiation fit in?
![Page 44: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/44.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Mission Differentiation v. Uniformity
Do current measurement models and accountability systems promote 4-year institutions to strive to be either doctoral extensive or elite liberal arts?
or promote 2-year institutions to become 4-year institution?
Do systems and states provide appropriate incentives for defining excellence in a variety of ways?Is or can faculty culture be amenable to multiple dimensions of excellence?
![Page 45: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/45.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Promoting Diversity of Excellence
U.S. News has a range of ranking categoriesNational, liberal arts, comprehensive, best value, business, engineering, programs that enhance learning
Institutions like Alverno, Truman State, Portland State, and (I’d like to think) IUPUI have ‘made the map’ on the basis of attention to student learningThese institutions are influencing their states’ conceptions and funding of higher education
![Page 46: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/46.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Guidelines for Assessing HE Quality
Promote development of standards of excellence at each levelDirect accountability at each level for outcomes directly impacted by that level’s processesIndirect accountability for sub-level outcomes through demonstration of quality assurance processes
![Page 47: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/47.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Guidelines (2)Collaborative review of how it all fits togetherOnce standards for excellence are negotiated and accepted, they should be accommodated in higher level goals and objectivesMake it possible that while no institution contributes as well to every outcome, every institution has a place to contribute significantlySimplification, which is necessary for effective management, should be balanced by rich detail between the lines (or within the hyperlinks)
![Page 48: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/48.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Guidelines (3)Distinguish between outcome measures and measures that reflect contributions to outcomes
State-Level Measure: Access to Postsecondary EducationContributing measures (and who is most likely to contribute best)
Geographic diversity across state (selective, residential universities)Enrollment of low-income/place-bound students (regional colleges and universities)Enrollment by members of underserved populations (minority serving institutions, urban universities)Access by students with academic deficiencies (Community Colleges)
![Page 49: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/49.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004
Concluding QuestionsHow does what we measure relate to what we hope to achieve?How does how we measure contribute to goal attainment? How do our goals and related measures align with
The goals and measures of component organizations and units?The goals and desired outcomes of constituent users and stakeholders?
![Page 50: Using Accountability to Support Quality](https://reader036.vdocument.in/reader036/viewer/2022062809/568157a7550346895dc53659/html5/thumbnails/50.jpg)
Network Conference
Victor M. H. Borden – April 1, 2004