beyond the classroom: a collaborative pilot to unify “a ... · pdf filesix...

42
Overcoming the Dreaded “ A” Overcoming the Dreaded “A” Word in Academic Support Jocelyn Manigo, Ed.D. Janet Long, M. Ed. Beyond the Classroom: A Collaborative Pilot to Unify Learning Assessment Across Six Academic Support Units

Upload: dangkiet

Post on 01-Feb-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Overcoming the Dreaded “

A” Overcoming the Dreaded “A” Word in Academic Support

Jocelyn Manigo, Ed.D.Janet Long, M. Ed.

Beyond the Classroom: A Collaborative Pilot to Unify Learning Assessment Across Six Academic Support Units

Page 2: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Goal for Today: Help You Gain Strategies to… Initiate, align, and implement an assessment

program for co-curricular units that support student learning

Apply common themes and consistent language to learning outcomes among administrative departments with diverse missions and functions

Page 3: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Partners in Assessment

“Today it is widely recognized that most out-of-classroom experiences, done right, help students learn, grow, and develop. The best out-of-classroom experiences are integrated with academic (classroom) experiences and help students achieve shared learning outcomes, such as skills in communication, leadership, and problem solving. They are sponsored not only by a student life or student development office but by academic programs and academic support units. Some collaborative ventures, such as first-year experiences, cross divisional lines and permeate the institution.” – Assessment Expert Linda Suskie (2015)

Page 4: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Partners in Assessment

“Those who administer services such as residentiallife, advising, career development, learning support,service learning, and financial aid are partners withfaculty members and students in developingoutcomes and assessing student learning. Forexample, student development personnel helpstudents to develop their own ethical values andto achieve the institution’s goal of graduatingstudents who are responsible citizens in amulticultural society.” – from Middle States Commission on Higher Education, Student Learning Assessment Options and Resources (2007)

Page 5: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Our Journey at Widener University

From infant to… …Triumphant toddler

Page 6: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Career Services | Counseling Center | Disabilities Services | Exploratory Studies | Student Success and Retention | Tutoring Services

Six Administrative Units on Board

Page 7: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Widener Learning Goals Reference Widener ILOs and GEGOs

Institutional Learning Objectives (ILOs)Students will:

1. demonstrate knowledge, skills, and scholarship appropriate to their major field of study.

2. think critically and communicate effectively.3. demonstrate attributes associated with professional and civic leadership.4. demonstrate characteristics of responsible citizenship.

General Education Goals (GEGOs)Liberally educated graduates: 1. communicate effectively.2. think critically.3. use quantitative methods effectively.4. have developed a wide range of intellectual perspectives and methodologies.

Page 8: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Focus: Critical Thinking

University Assessment Calendar

Page 9: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Assessment Pilot Timeline

Learning & Brainstorming

March-May‘16

Evaluation/Close LoopJune’17-Aug’17

PlanningJun-Aug ‘16

ImplementationAug’16-May’17

Page 10: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Our Starting Point

When I think of assessment, I think of…

Page 11: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Assessment Pilot Timeline

Learning & Brainstorming

March-May‘16

Evaluation/Close LoopJune’17-Aug’17

PlanningJun-Aug ‘16

ImplementationAug’16-May’17

Page 12: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Learning a New Language

Keep it simple Focus on learning Search for common ground Ask the right questions

What is your SLO? -vs- “What do you want students to learn?”

Page 13: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

The Language of Learning

Step 1: Declare the specific desired learning outcome.

“I know that a student has learned to think critically when…”

Page 14: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Example: Exploratory Studies

I know that a student has learned to think critically when he/she is able to demonstrate self-awareness of abilities, interests, values, and personality; and make informed independent decisions necessary for declaring an undergraduate major.

Page 15: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

The Language of Learning

Step 2: Determine the measurement tools. How will you know this learning is taking place? What tools will you use? (e.g. rubric, checklist) Should a tool be created?

Page 16: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Example: Exploratory Studies

Career Exploration Log FOCUS2 inventory Meeting with Career Counselor Utilization of campus resources

Academic advisor Faculty Undergraduate bulletin

Page 17: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate
Page 18: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Exploratory Studies New Career Exploration Log Rubric

Page 19: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

The Language of Learning

Step 3: Set a specific target for achieving the desired learning outcome.

What is your target for achieving this student learning outcome during the academic year?

What level of performance is “good enough”?

Page 20: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Example: Exploratory Studies

Original: 90% of Exploratory Studies students will submit their Career Logs to their academic advisor prior to spring registration of their freshman year.

Revised: 90% of ES students completing career logs will demonstrate critical thinking by attaining a score of "2" or higher on required paragraph response.

Page 21: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

The Language of Learning

Step 4: Close the Loop. What will you learn from measuring this learning

outcome? How can you use this information to guide your

daily practice?

Page 22: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Example: Exploratory Studies

Career log will… provide insight into which campus resources students

use to make decisions about major. demonstrate how students apply critical thinking skills

to exploration.

Page 23: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Putting It All Together: 6 Units, 1 Language

Common words/phrases/themes:

Articulate/articulating Apply critical thinking skills to… (interviewing,

self-advocacy, exploration, problem solving, etc.) Connect (academic performance with personal

accountability, strengths and skills to out-of-classroom experiences, etc.)

Thoughtful choices, informed decisions

Page 24: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Career Services

Page 25: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Exploratory Studies

Page 26: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Counseling Center

Page 27: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Disabilities Services

Page 28: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Student Success and Retention

Page 29: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Tutoring Services

Page 30: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

What worked at Widener

Designated point person(s) Understood timeline, including mid-year check-in Opportunities for revision Removing the “fear factor”

Page 31: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Show and Tell

New rubrics New survey tools New questions

Page 32: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Career Services Modified Mock Interview Rubric

Page 33: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Career Services Data Lab

Assessing Career-Related Writing

Page 34: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Counseling Center Satisfaction Survey

Q11 As a result of your experience at the Counseling Center, are you better able to identify your personal strengths? Yes (1) No (2)

Q12 As a result of your time at the Counseling Center, are you better able to identify your problem areas? Yes (1) No (2)

Q13 Are you better able to manage you life, cope with stress and self-regulate? Yes (1) No (2)

Q14 Were you having problems academically at the onset of treatment? Yes (1) No (2)

Page 35: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

New Disability Services Qualtrics Survey

Page 36: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Student Success and Retention New Academic Accountability Survey

Page 37: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Tutoring Services New Tutor Self-Evaluation Survey

Page 38: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Join your group:Residence LifeDining ServicesFinancial AidCareer Services

Your turn!

Page 39: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Activity

Complete SLO worksheet Watch your language! Share your findings with group

Page 40: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Activity: Communication SLO

“Oral communication is a prepared, purposeful presentation designed to increase knowledge, to foster understanding, or to promote change in the listeners' attitudes, values, beliefs, or behaviors.” –Association of American Colleges & Universities

Page 41: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

Jocelyn Manigo, Ed.D.Director, Tutoring [email protected]

Janet Long, M.Ed.Director, Career [email protected]

Questions?

Page 42: Beyond the Classroom: A Collaborative Pilot to Unify “A ... · PDF fileSix Administrative Units on Board. ... What tools will you use? (e.g. rubric, checklist) ... Undergraduate

References and Resources

Association of American Colleges and Universities (year).

Middle States Commission on Higher Education (2007).Student learning assessment: Options and resources. 2nd. edition. www.msche.org

Suskie, L. (2015). Introduction to measuring co-curricularlearning. New Directions for Institutional Research.