practicing what we preach: designing authentic ......practicing what we preach: designing authentic...
TRANSCRIPT
Practicing What We Preach: Designing Authentic Assessment for Faculty Development
Dr. Ian Beckford & Dr. Kathleen LandyTuesday, October 23, 2018
Levers for Improving Institutional Capacity & Enthusiasm for Programmatic Assessment
Dr. Ian Beckford & Dr. Kathleen LandyTuesday, October 24, 2017
Faculty Development
General Education Outcomes
ASLCAP/SWIG
CIE WIGDL UR
For High-Impact Practices (HIPs)
Faculty Development HIPs
Across-HIPs Training:Backward Design
Scaffolding ReflectionsHIP-specific Training+
Outcomes:1. Alignment to General Education Outcomes2. Clarity of Reflection Prompt
Faculty Development Assessing FD Outcomes
Faculty Development Results, FD Outcome 1
GENERAL EDUCATION ALIGNMENT
DIMENSIONHIP
ASL CIE/CR SWIG UR ALL
EXPLICIT ID OF GEN. ED. OUTCOMES 2.67 2.03 1.88 2.92 2.37
PROJECT DESCRIPTION 1.93 1.56 2.17 2.2 1.88
ALIGNMENT OF PROJECT COMPONENTS 2.05 1.54 1.88 2.38 1.9
NUMBER OF SUBMISSIONS 21 34 12 20 87
Faculty Development Results, FD Outcome 2
REFLECTION CLARITY
DIMENSIONHIP
ASL CIE/CR SWIG UR ALL
CLARITY OF DIRECTIONS 2.02 2.28 1.7 1.18 1.85
CLARITY OF PURPOSE 2.55 2.5 1.9 1.25 2.11
NUMBER OF SUBMISSIONS 20 29 15 20 84
Faculty Development Next Steps
• Disseminate data & discuss implications
• Repeat & Refine the protocol
• Scale
HIPs General Education Alignment Rubric
For Backward Design workshop deliverables
Instructor: Course/Section: HIP: ______________________________
*Gen Ed Outcomes 1-4, See Reverse Side of this page.
**For outcome-specific dimensions, see reverse side of this page.
Strong
Revisions
Suggested
Revisions
Required
3 2 1
Explicit Identification of Gen Ed Outcome
The project explicitly states and incorporates at least one QCC Gen. Ed. Outcome.*
The project indirectly incorporates at least one QCC Gen. Ed. Outcome.
The project does not incorporate any QCC Gen. Ed. Outcome.
Project Description
The project description thoroughly addresses outcome-specific dimensions**.
The project description partially addresses outcome-specific dimensions**.
The project description does not address outcome-specific dimensions**.
Alignment of Project Components with Gen Ed Outcome
The components of the project are aligned and call for the application of knowledge/skills directly related to the outcome(s).
The components of the project are aligned and call for the application of some knowledge/skills related to the outcome(s).
Components of the project are misaligned and call for the application of knowledge/skills not related to the outcome(s).
QCC General Education Outcomes
1. Communicate effectively through written and oral forms
2. Use analytical reasoning to identify issues or problems and evaluate evidence in order to make informed decisions
3. Reason quantitatively as required in various fields of interest and in everyday life
4. Apply information management and digital technology skills useful for academic research and lifelong learning
General Education Outcome-Specific Rubric Dimensions
Written Communication Analytical Reasoning Quantitative Reasoning Information Management & Technology Skills
Awareness of audience, purpose, and genre
Content Development & Organization
Control of Grammar & Mechanics
Evidence or sources
Identify and explain an issue, problem, or question
Present, organize, and evaluate sufficient and relevant evidence
Reach an informed conclusion or solution
Demonstrates ability to express information quantitatively in mathematical forms or to accurately convert information presented in mathematical forms to written language
Performs quantitative tasks: o a calculation or estimation to
yield a result o the extraction and
interpretation of information from a graph or other visual representation of data
o the construction of such a representation
Performs analysis, explanation or interpretation of aspects of quantitative thinking such as reasoning, method, rational, or verification of the obtained
Identify the scope of inquiry or investigation needed for the assignment
Use evidence or sources (cite as appropriate)
Evaluate information and sources critically
Use information effectively to accomplish a specific purpose
(Alternative Version)
Awareness of audience, purpose, and genre
Content Development & Organization
Control of Grammar & Mechanics
(Alternative Version) Identify the scope of inquiry or
investigation needed for the assignment
Use evidence or sources (cite as appropriate)
Evaluate information and sources critically
Apply digital technology tools effectively to accomplish the specific task/inquiry
HIPs Academic Reflection Rubric
For Scaffolded Reflection workshop deliverables
Instructor: Course/Section: HIP: ______________________________
.
Strong
Revisions
Suggested
Revisions
Required
3 2 1
Clarity of Purpose
The reflection prompt explicitly calls for students to write about one or more of the following in reference to the HIP-specific project:
Course content Metacognition/learning process Interdisciplinary/Real world
connections Personal awareness/growth
The reflection prompt calls for students to write about one or more of the following (yet not in reference to the HIP-specific project):
Course content Metacognition/learning process Interdisciplinary/Real world
connections Personal awareness/growth
The reflection prompt is overly broad, calling for neither a specific type of reflection, nor commentary on a specific learning activity.
Clarity of Directions
The reflection prompt includes clear directions for students with regard to:
Frequency of reflection Mode of reflection Grading expectations (if any)
The reflection prompt includes vague or partial directions for students with regard to:
Frequency of reflection Mode of reflection Grading expectations (if any)
The reflection prompt does not include clear directions for students with regard to:
Frequency of reflection Mode of reflection Grading expectations (if any)