program evaluation report department of ......80% of students earn a final course grade of a b- or...

1

PROGRAM EVALUATION REPORT Department of Counseling

Clinical Mental Health Counseling Date of Review: February 2020 Review Period: 2018-2019 Academic Year

Data-Driven Program Modifications in 2018 - 2019

PYCL 0635: Group Theory and Practice Informing Data: 2017-2018 Program Evaluation: Learning Outcome #6 Group Work Based on a sample of n = 114 applicable Current Student Anonymous surveys, 89 students (78.07%) rated this as met moderately well, very well, or extremely well. Some students identified desire for additional group counseling experience. Program Response: Dr. Patrick Powell, Chair of the Department of Counseling Curriculum Committee, reviewed this data and consulted with the course faculty lead, Dr. Carly Paro. It was noted that 50% of the survey respondents represented online students. Resulting Modification: After being approved by core faculty, beginning in the 2018-2019 academic year, there are now requisite synchronous group participation experiences (both inside and outside of the class setting) for all sections of PYCL 0635. It is hypothesized this will positively impact student perceptions of, and feedback regarding, the PYCL 0635 Group Theory and Practice course.

PYCL 0608: Psychological Testing for Individual Evaluation

Informing Data: 2017-2018 Program Evaluation: Learning Outcome #7 Assessment Based on a sample of n = 114 applicable ratings on the Current Student Anonymous Survey, 81 students (71.05%) rated this as met moderately well, very well, or extremely well. For the PYCL 0608 course, students report the Key Performance Indicator (KPI) is confusing and does not align with the other course assignments. Program Response: Dr. Powell, course lead and Chair of the Department of Counseling Curriculum Committee, recommended a revision of the KPI assignment that targeted clinical skills as well as writing an academic paper about how assessments would be used. Resulting Modification: After being approved by core faculty, the revised PYCL 608 KPI assignment was implemented in the Winter 2019 semester.

2

Program Learning Outcomes for 2018 - 2019

Learning Outcome #1 ETHICAL PRACTICE-The ethical practice of counseling aligned with a professional counseling orientation in accordance with the standards and credentials of the counseling profession. Summary of Findings (supporting evidence/data): 80% of students earn a final course grade of a B- or better in PYCL 0570 Ethical, Legal, and Professional Issues for Counselors Total number of students assessed via summative assessment 1: 172 Mean Score for summative assessment 1: Based on a sample of 172 students, 171 students (99.4%) achieved a minimum grade of a B- or better Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 61 100% Miami 13 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 98 98.98% 80% of students passed the PYCL 0570 Ethical, Legal, and Professional Issues for Counselors KPI assignment with a score of 70 or higher. Total number of students assessed via summative assessment 2: 176 Mean Score for summative assessment 2: Based on a sample of 176 students, 175 students (99.4%) achieved a passing score of 70 or higher Campus Number of Students Percent who Earned 70% or higher Fort Lauderdale/Davie 62 100% Miami 13 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 100 99.01% Supervisors/Employer Survey 80% of Supervisors/Employers rated students’ competence as 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) on the Supervisors/Employers Survey ethics subscale Total number of students assessed via summative assessment 3: 40 Mean Score for summative assessment 3: Based on a sample of n = 40 applicable rating surveys, 40 students (100%) were rated at 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent)*

3

Current Student Anonymous Survey 80% of current students rated the ethical practices subscale as met moderately well, very well, or extremely well met in the CMHC program. Total number of students assessed via summative assessment 4: 156 Mean Score for summative assessment 4: Based on a sample of n = 148 applicable rating surveys, 143 students (96.62%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 60 93.33% Miami 11 100% Orlando 3 100% Palm Beach 3 100% Tampa 1 100% Online 70 98.57% Alumni Survey 80% of alumni rated the ethical practices subscale as met moderately well, very well, or extremely well met. Total number of students assessed via summative assessment 5: 17 Mean Score for summative assessment 5: Based on a sample of n = 17 applicable rating surveys, 16 Alumni (94.10%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 11 90.90% Miami 1 100% Orlando 1 100% Palm Beach 1 100% Tampa 2 100% Online 1 100%

Learning Outcome #2

SOCIAL AND CULTURAL DIVERSITY-Understand multicultural and pluralistic characteristics within and among diverse groups nationally and internationally while developing strategies for identifying and eliminating barriers, prejudices, and processes of intentional and unintentional oppression and discrimination. Summary of Findings (supporting evidence/data): 80% of students earn a final course grade of a B- or better in PYCL 0632 Social and Cultural Foundations of Counseling Total number of students assessed via summative assessment 1: 199 Mean Score for summative assessment 1: Based on a sample of 199 students, 194 students (97.5%) achieved a minimum grade of a B- or better

4

Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 79 100% Miami 15 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 105 95.24% 80% of students passed the 0632 Social and Cultural Foundations of Counseling KPI assignment with a score of 70 or higher Total number of students assessed via summative assessment 2: 201 Mean Score for summative assessment 2: Based on a sample of 201 student, 200 students (99.5%) achieved a passing score of 70 or above Campus Number of Students Percent who Earned 70% or higher Fort Lauderdale/Davie 80 100% Miami 15 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 106 99.06% Supervisors/Employer Survey 80% of Supervisors/Employers rated students’ competence as 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) on the Supervisors/Employers Survey diversity subscale Total number of students assessed via summative assessment 3: 40 Mean Score for summative assessment 3: Based on a sample of n = 40 applicable rating surveys, 39 students (97.5%) were rated at 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) Current Student Anonymous Survey 80% of current students rated the multicultural counseling subscale as met moderately well, very well, or extremely well met in the CMHC program. Total number of students assessed via summative assessment 4: 156 Mean Score for summative assessment 4: Based on a sample of n = 141 applicable rating surveys, 130 students (92.20%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 55 89.09% Miami 10 100% Orlando 3 100% Palm Beach 3 100% Tampa 2 100% Online 68 92.65%

5

Alumni Survey 80% of alumni ratee the multicultural counseling subscale as met moderately well, very well, or extremely well met. Total number of students assessed via summative assessment 5: 17 Mean Score for summative assessment 5: Based on a sample of n = 17 applicable rating surveys, 15 Alumni (88.20%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 11 90.90% Miami 1 100% Orlando 1 100% Palm Beach 1 0% Tampa 2 100% Online 1 100%

Learning Outcome #3 HUMAN GROWTH AND DEVELOPMENT-Understand factors associated with human growth and development across the lifespan. Summary of Findings (supporting evidence/data): 80% of students earn a final course grade of a B- or better in PYCL 0512 Human Growth and Development Total number of students assessed via summative assessment 1: 139 Mean Score for summative assessment 1: Based on a sample of 139 students, 137 students (98.6%) achieved a minimum grade of a B- or better Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 52 100% Miami 8 100% Orlando 8 100% Palm Beach 0 N/A Tampa 7 100% Online 64 96.88%

6

80% of students passed the PYCL 0512 Human Growth and Development KPI assignment with a score of 70 or higher Total number of students assessed via summative assessment 2: 138 Mean Score for summative assessment 2: Based on a sample of 138 students, 138 students (100%) achieved a passing score of 70 or above Campus Number of Students Percent who Earned 70% or higher Fort Lauderdale/Davie 52 100% Miami 8 100% Orlando 8 100% Palm Beach 0 N/A Tampa 7 100% Online 63 100% Supervisors/Employer Survey 80% of Supervisors/Employers rated students’ competence as 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) on the Supervisors/Employers Survey human growth subscale Total number of students assessed via summative assessment 3: 40 Mean Score for summative assessment 3: Based on a sample of n = 40 applicable rating surveys, 40 students (100%) were rated at 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) Current Student Anonymous Survey 80% of current students rated the human growth and development subscale as met moderately well, very well, or extremely well met in the CMHC program. Total number of students assessed via summative assessment 4: 156 Mean Score for summative assessment 4: Based on a sample of n = 133 applicable rating surveys, 124 students (93.23%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 57 91.23% Miami 7 100% Orlando 3 100% Palm Beach 3 100% Tampa 2 100% Online 61 93.44% Alumni Survey 80% of alumni rated the human growth and development subscale as met moderately well, very well, or extremely well met. Total number of students assessed via summative assessment 5: 17 Mean Score for summative assessment 5: Based on a sample of n = 17 applicable rating surveys, 17 Alumni (100%) rated this as met moderately well, very well, or extremely well

7

Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 11 100% Miami 1 100% Orlando 1 100% Palm Beach 1 100% Tampa 2 100% Online 1 100%

Learning Outcome #4 CAREER DEVELOPMENT – Understand career development theories and strategies for personal growth and employment opportunities in a global economy.

Summary of Findings (supporting evidence/data): 80% of students earn a final course grade of a B- or better in PYCL 0631 Career and Lifestyle Assessment Total number of students assessed via summative assessment 1: 230 Mean Score for summative assessment 1: Based on a sample of 230 students, 225 students (97.8%) achieved a minimum grade of a B- or better Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 72 98.61% Jacksonville** 8 100% Miami 13 100% Orlando 8 100% Palm Beach 9 100% Tampa 8 100% Online 112 96.43% 80% of students passed the PYCL 0631 Career and Lifestyle Assessment KPI assignment with a score of 70 or higher Total number of students assessed via summative assessment 2: 230 Mean Score for summative assessment 2: Based on a sample of 230 students, 230 students (100%) achieved a passing score of 70 or above Campus Number of Students Percent who Earned 70% or higher Fort Lauderdale/Davie 72 98.61% Jacksonville 8 100% Miami 13 100% Orlando 8 100% Palm Beach 9 100% Tampa 8 100% Online 112 96.43%

8

Supervisors/Employer Survey 80% of Supervisors/Employers rated students’ competence as 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) on the Supervisors/Employers Survey career counseling subscale Total number of students assessed via summative assessment 3: 40 Mean Score for summative assessment 3: Based on a sample of n = 40 applicable rating surveys, 39 students (97.5%) were rated at 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) Current Student Anonymous Survey 80% of current students rated the career development subscale as met moderately well, very well, or extremely well met in the CMHC program. Total number of students assessed via summative assessment 4: 156 Mean Score for summative assessment 4: Based on a sample of n = 119 applicable rating surveys, 109 students (91.60%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 53 86.79% Miami 6 83.33% Orlando 3 100% Palm Beach 2 100% Tampa 1 100% Online 54 96.30% Alumni Survey 80% of alumni rated the career development subscale as met moderately well, very well, or extremely well met. Total number of students assessed via summative assessment 5: 17 Mean Score for summative assessment 5: Based on a sample of n = 17 applicable rating surveys, 12 Alumni (70.60%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 11 81.80% Miami 1 100% Orlando 1 100% Palm Beach 1 0% Tampa 2 0% Online 1 100%

9

Learning Outcome #5 HELPING RELATIONSHIPS-Utilize essential interviewing, counseling, and case conceptualization skills to promote client understanding of and access to a variety of community-based resources. Summary of Findings (supporting evidence/data): 80% of students earn a final course grade of a B- or better in PYCL 511 Introduction to Counseling Techniques Total number of students assessed via summative assessment 1: 202 Mean Score for summative assessment 1: Based on a sample of 202 students, 198 students (98.0%) achieved a minimum grade of a B- or better Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 55 98.18% Miami 14 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 133 97.74% 80% of students passed the PYCL 511 Introduction to Counseling Techniques KPI with a score of 70 or higher Total number of students assessed via summative assessment 2: 204 Mean Score for summative assessment 2: Based on a sample of 204 attempts, 204 students (98.0%) achieved a passing score of 70 or above Campus Number of Students Percent who Earned 70% or Better Fort Lauderdale/Davie 55 98.18% Miami 14 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 135 97.78% Supervisors/Employer Survey 80% of Supervisors/Employers rated students’ competence as 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) on the Supervisors/Employers Survey helping relationships subscale Total number of students assessed via summative assessment 3: 40 Mean Score for summative assessment 3: Based on a sample of n = 40 applicable rating surveys, 40 students (100%) were rated at 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent)

10

Current Student Anonymous Survey 80% of current students rated the helping relationships subscale as met moderately well, very well, or extremely well met in the CMHC program. Total number of students assessed via summative assessment 4: 156 Mean Score for summative assessment 4: Based on a sample of n = 127 applicable rating surveys, 119 students (93.70%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 51 90.20% Miami 8 100% Orlando 3 100% Palm Beach 3 100% Tampa 1 100% Online 61 95.08% Alumni Survey 80% of alumni rated the helping relationships subscale as met moderately well, very well, or extremely well met. Total number of students assessed via summative assessment 5: 17 Mean Score for summative assessment 5: Based on a sample of n = 17 applicable rating surveys, 16 Alumni (94.10%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 11 100% Miami 1 100% Orlando 1 100% Palm Beach 1 0% Tampa 2 100% Online 1 100%

Learning Outcome #6

GROUP WORK – Utilize theoretical foundations of group counseling and group work to plan ethical and culturally relevant strategies for designing and facilitating groups. Summary of Findings (supporting evidence/data): 80% of students earn a final course grade of a B- or better in PYCL 0635 Group Theory & Practice Total number of students assessed via summative assessment 1: 231 Mean Score for summative assessment 1: Based on a sample of 231 students, 224 students (96.97%) achieved a minimum grade of a B- or better

11

Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 73 95.89% Miami 14 92.86% Orlando 8 100% Palm Beach 13 100% Tampa 5 100% Online 118 97.46% 80% of students passed the PYCL 0635 Group Theory & Practice KPI assignment with a score of 70 or higher Total number of students assessed via summative assessment 2: 229 Mean Score for summative assessment 2: Based on a sample of 229 students, 228 students (99.56%) achieved a passing score of 70 or above Campus Number of Students Percent who Earned 70% or Better Fort Lauderdale/Davie 72 98.61% Miami 14 92.86% Orlando 8 100% Palm Beach 14 100% Tampa 5 100% Online 116 100% Supervisors/Employer Survey 80% of Supervisors/Employers rated students’ competence as 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) on the Supervisors/Employers Survey group work subscale Total number of students assessed via summative assessment 3: 40 Mean Score for summative assessment 3: Based on a sample of n = 40 applicable rating surveys, 37 students (92.5%) were rated at 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) Current Student Anonymous Survey 80% of current students rated the group work subscale as met moderately well, very well, or extremely well met in the CMHC program. Total number of students assessed via summative assessment 4: 156 Mean Score for summative assessment 4: Based on a sample of n = 128 applicable rating surveys, 119 students (92.97%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 53 88.68% Miami 7 100% Orlando 3 100% Palm Beach 3 100% Tampa 1 100% Online 61 95.08%

12

Alumni Survey 80% of alumni rated the group work subscale as met moderately well, very well, or extremely well met. Total number of students assessed via summative assessment 5: 17 Mean Score for summative assessment 5: Based on a sample of n = 17 applicable rating surveys, 16 Alumni (94.10%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 11 100% Miami 1 100% Orlando 1 100% Palm Beach 1 0% Tampa 2 100% Online 1 100%

Learning Outcome #7 ASSESSMENT – Utilize methods of effective assessment relevant to academic/educational, career, personal, and social development. Summary of Findings (supporting evidence/data): 80% of students earn a final course grade of a B- or better in PYCL 0608 Psychological Testing for Individual Evaluation Total number of students assessed via summative assessment 1: 185 Mean Score for summative assessment 1: Based on a sample of 185 students, 180 students (97.3%) achieved a minimum grade of a B- or better Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 64 100% Jacksonville 8 100% Miami 9 100% Orlando 10 100% Palm Beach 10 100% Tampa 7 100% Online 77 93.51% 80% of students passed the 0608 Psychological Testing for Individual Evaluation KPI assignment with a score of 70 or higher Total number of students assessed via summative assessment 2: 183 Mean Score for summative assessment 2: Based on a sample of 183 students, 181 students (98.91%) achieved a passing score of 70 or above Campus Number of Students Percent who Earned 70% or Better Fort Lauderdale/Davie 64 100% Jacksonville 8 100% Miami 9 100%

13

Orlando 10 100% Palm Beach 10 100% Tampa 7 100% Online 75 97.33% Supervisors/Employer Survey 80% of Supervisors/Employers rated students’ competence as 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) on the Supervisors/Employers Survey assessment subscale Total number of students assessed via summative assessment 3: 40 Mean Score for summative assessment 3: Based on a sample of n = 40 applicable rating surveys, 38 students (95.0%) were rated at 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) Current Student Anonymous Survey 80% of current students rated the assessment subscale as met moderately well, very well, or extremely well met in the CMHC program. Total number of students assessed via summative assessment 4: 156 Mean Score for summative assessment 4: Based on a sample of n = 122 applicable rating surveys, 110 students (90.16%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 51 88.24% Miami 7 100% Orlando 3 100% Palm Beach 3 100% Tampa 1 100% Online 57 89.47% Alumni Survey 80% of alumni rated the assessment subscale as met moderately well, very well, or extremely well met. Total number of students assessed via summative assessment 5: 17 Mean Score for summative assessment 5: Based on a sample of n = 17 applicable rating surveys, 14 Alumni (82.40%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 11 81.80% Miami 1 100% Orlando 1 100% Palm Beach 1 0% Tampa 2 100% Online 1 100%

14

Learning Outcomes #8 RESEARCH AND PROGRAM EVALUATION – Understand the importance of research in advancing the counseling profession, including how to critique research to inform counseling practice. 80% of students earn a final course grade of a B- or better in PYCL 0507 Research and Evaluation for Counselors Total number of students assessed via summative assessment 1: 210 Mean Score for summative assessment 1: Based on a sample of 210 students, 202 students (96.2 %) achieved a minimum grade of a B- or better Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 67 100% Miami 16 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 127 93.70% 80% of students passed the PYCL 0507 Research and Evaluation for Counselors KPI assignment with a score of 70 or higher Total number of students assessed via summative assessment 2: 210 Mean Score for summative assessment 2: Based on a sample of 210 students, 210 students (100%) achieved a passing score of 70 or above Campus Number of Students Percent who Earned 70% or Better Fort Lauderdale/Davie 69 100% Miami 16 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 125 100% Supervisors/Employer Survey 80% of Supervisors/Employers rated students’ competence as 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent) on the Supervisors/Employers Survey research subscale Total number of students assessed via summative assessment 3: 40 Mean Score for summative assessment 3: Based on a sample of n = 40 applicable rating surveys, 37 students (92.5%) were rated at 3 (neither competent nor incompetent) or better (somewhat competent, extremely competent)

15

Current Student Anonymous Survey 80% of current students rated the research subscale as met moderately well, very well, or extremely well met in the CMHC program. Total number of students assessed via summative assessment 4: 156 Mean Score for summative assessment 4: Based on a sample of n = 145 applicable rating surveys, 135 students (93.10%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 62 91.94% Miami 7 85.71% Orlando 3 100% Palm Beach 3 100% Tampa 1 100% Online 69 94.20% Alumni Survey 80% of alumni rated this objective as met moderately well, very well, or extremely well met. Total number of students assessed via summative assessment 5: 17 Mean Score for summative assessment 5: Based on a sample of n = 17 applicable rating surveys, 16 Alumni (94.10%) rated this as met moderately well, very well, or extremely well Campus Sample Size Percent who Rated Moderately Well or Above Fort Lauderdale/Davie 11 100% Miami 1 100% Orlando 1 100% Palm Beach 1 0% Tampa 2 100% Online 1 100%

16

Clinical Mental Health Learning Outcomes

Learning Outcome #1 PROFESSIONAL IDENTITY-Understanding and demonstrating the professional identity of a clinical mental health counselor, including knowledge of the history, philosophy, professional organizations, ethical codes, preparation standards, and credentials as well as the roles, settings, and delivery modalities (e.g., inpatient, outpatient, partial hospitalization) of clinical mental health counselors Summary of Findings (supporting evidence/data): 80% of students earn a final course grade of a B- or better in PYCL 0660 Community Mental Health Total number of students assessed via summative assessment 1: 181 Mean Score for summative assessment 1: Based on a sample of 181 students, 175 students (96.7%) achieved a minimum grade of a B- or better Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 59 96.61% Miami 16 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 106 96.23% 80% of students earn a passing score of 80 or higher on the PYCL 0502 Counseling Theories and Practice Orientation Quiz Total number of students assessed via summative assessment 2: 137 Mean Score for summative assessment 2: Based on a sample of 137 students, 137 students (100%) achieved a passing score of 80 or higher. ***Note: Due to technical difficulties accessing this data in Canvas, some scores were not able to be reported. 80% of students passed the PYCL 511 Introduction to Counseling Techniques KPI assignment with a score of 70 or higher Total number of students assessed via summative assessment 2: 204 Mean Score for summative assessment 2: Based on a sample of 204 attempts, 204 students (98.0%) achieved a passing score of 70 or above. Campus Number of Students Percent who Earned 70% or Better Fort Lauderdale/Davie 55 98.18% Miami 14 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 135 97.78%

17

Learning Outcome #2 LEGISLATIVE AND POLICY ISSUES - Understanding the legislative and policy issues related to clinical mental health counseling and possessing strategies for advocacy and interfacing with other professionals. Summary of Findings (supporting evidence/data): 80% of students earn a final course grade of a B- or better in PYCL 0666 Case Conceptualization and Treatment Strategies Total number of students assessed via summative assessment 1: 195 Mean Score for summative assessment 1: Based on a sample of 195 students, 189 students (96.92 %) achieved a minimum grade of a B- or better Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 69 98.55% Miami 15 100% Orlando 9 100% Palm Beach 14 100% Tampa 5 100% Online 83 93.98% 80% of students passed the PYCL 0570 Ethical, Legal, and Professional Issues for Counselors KPI assignment with a score of 70 or higher. Total number of students assessed via summative assessment 2: 176 Mean Score for summative assessment 2: Based on a sample of 176 students, 175 students (99.4%) achieved a passing score of 70 or higher Campus Number of Students Percent who Earned 70% or higher Fort Lauderdale/Davie 62 100% Miami 13 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 100 99.01% 80% of students earn a passing score of 70 on the PYCL 0681 Counseling Internship Review of Assigned Articles and Quizzes Total number of students assessed via summative assessment 3: 199 Mean Score for summative assessment 3: Based on a sample of 199 students, 197 students (98.99%) achieved a passing score of 70 or higher

Campus Number of Students Percent who Earned 70% or higher Fort Lauderdale/Davie 58 100% Jacksonville 9 100% Miami 12 100% Orlando 8 100%

18

Palm Beach 6 100% Tampa 6 100% Online 100 98%

Learning Outcome #3 CULTURALLY COMPETENT CLINICAL MENTAL HEALTH COUNSELING PRACTICE - Attaining specialized knowledge and skills needed to provide culturally competent clinical mental health counseling services to diverse individuals, families, and groups, including assessment, diagnosis, treatment, referral, and prevention of mental and emotional disorders, including those related to crisis, trauma, substance use, and addiction Summary of Findings (supporting evidence/data): 80% of students earn a final course grade of a B- or better in PYCL 0666 Case Conceptualization and Treatment Strategies Total number of students assessed via summative assessment 1: 195 Mean Score for summative assessment 1: Based on a sample of 195 students, 189 students (96.92 %) achieved a minimum grade of a B- or better Campus Number of Students Percent who Earned B- or Better Fort Lauderdale/Davie 69 98.55% Miami 15 100% Orlando 9 100% Palm Beach 14 100% Tampa 5 100% Online 83 93.98% 80% of students passed the 0632 Social and Cultural Foundations of Counseling KPI assignment with a score of 70 or higher Total number of students assessed via summative assessment 2: 201 Mean Score for summative assessment 2: Based on a sample of 201 student, 200 students (99.5%) achieved a passing score of 70 or above Campus Number of Students Percent who Earned 70% or higher Fort Lauderdale/Davie 80 100% Miami 15 100% Orlando 0 N/A Palm Beach 0 N/A Tampa 0 N/A Online 106 99.06%

19

80% of students earn a passing score of 70 on the PYCL 0681 Counseling Internship Review of Assigned Articles and Quizzes Total number of students assessed via summative assessment 3: 199 Mean Score for summative assessment 3: Based on a sample of 199 students, 197 students (98.99%) achieved a passing score of 70 or higher

Campus Number of Students Percent who Earned 70% or higher Fort Lauderdale/Davie 58 100% Jacksonville 9 100% Miami 12 100% Orlando 8 100% Palm Beach 6 100% Tampa 6 100% Online 100 98% 80% of students earn a passing score of 70 or higher on the PYCL 0682 Continuing Counseling Internship Capstone Written Case Conceptualization Total number of students assessed via summative assessment 4: 189 Mean Score for summative assessment 4: Based on a sample of 189 students, 189 students (100%) achieved a passing score of 70 or higher Campus Number of Students Percent who Earned 70% or higher Fort Lauderdale/Davie 49 100% Jacksonville 7 100% Miami 12 100% Orlando 7 100% Palm Beach 6 100% Tampa 7 100% Online 101 100%

NOTES: *Supervisors and employers commonly supervise and/or employ students and graduates from various program formats. Therefore, supervisor/Employer data was not analyzed separately by format for this report. Aggregate data can be found in the 2018-2019 CMHC Program Evaluation report. ** Graduates from the Jacksonville Regional Campus were included in this report due to the last cohort graduating from this campus in August 2019. The Jacksonville campus is currently no longer offering the CMHC program. ***Adjustments were made in January 2020 to resolve barriers to collecting data from the PYCL 0502 Professional Orientation Quiz.

20

Assessment of Counselor Dispositions

Assessment of Counselor Dispositions

Total # Students Assessed

# Students who did not met at least

70% of elements

Met at least 70% of

elements

PYCL 0502 Communication Rubric 207 0 100%

Fort Lauderdale/Davie 56 0 100% Miami 16 0 100%

Orlando 0 0 100% Palm Beach 0 0 100%

Tampa 0 0 100% Online 135 0 100%

Ethical Behaviors Rubric 207 0 100% Fort Lauderdale/Davie 56 0 100%

Miami 16 0 100% Orlando 0 0 100%

Palm Beach 0 0 100% Tampa 0 0 100% Online 135 0 100%

Professional Behavior Rubric 207 0 100% Fort Lauderdale/Davie 56 0 100%

Miami 16 0 100% Orlando 0 0 100%


Professional Attitudes Rubric 207 0 100% Fort Lauderdale/Davie 56 0 100%

Miami 16 0 100% Orlando 0 0 100%


PYCL 0635 Communication Rubric 224 1 99.55%

Fort Lauderdale/Davie 73 1 98.63% Miami 14 0 100%

Orlando 8 0 100% Palm Beach 13 0 100%

Tampa 5 0 100% Online 111 0 100%

Ethical Behaviors Rubric 224 0 100% Fort Lauderdale/Davie 73 0 100%

21

Miami 14 0 100% Orlando 8 0 100%


Professional Behavior Rubric 224 0 100% Fort Lauderdale/Davie 73 0 100%

Miami 14 0 100% Orlando 8 0 100%


Professional Attitudes Rubric 224 0 100% Fort Lauderdale/Davie 73 0 100%

Miami 14 0 100% Orlando 8 0 100%


PYCL 0680 Communication Rubric 181 6 96.69%

Fort Lauderdale/Davie 70 4 94.29% Jacksonville 9 2 77.78%

Miami 12 0 100% Orlando 9 0 100%

Palm Beach 0 0 N/A Tampa 5 0 100% Online 76 0 100%

Ethical Behaviors Rubric 181 4 97.79% Fort Lauderdale/Davie 70 3 97.14%

Jacksonville 9 1 88.89% Miami 12 0 100%

Orlando 9 0 100% Palm Beach 0 0 N/A

Tampa 5 0 100% Online 76 0 100%

Professional Behavior Rubric 181 5 97.24% Fort Lauderdale/Davie 70 3 97.14%


Orlando 9 0 100% Palm Beach 0 0 N/A

Tampa 5 0 100% Online 76 0 100%

Professional Attitudes Rubric 171 4 98.28% Fort Lauderdale/Davie 70 3 97.14%


Orlando 9 0 100%

22

Palm Beach 0 0 N/A Tampa 5 0 100% Online 76 0 100%

23

DEMOGRAPHIC DATA Aggregate demographic data is reviewed an analyzed by the Assessment Committee to evaluate how well the program is meeting the overall program objective to “prepare diverse counselors,” as well as to identify trends and changes related to the demographic composition of students, graduates, and applicants. Current Students: Fall 2018 – Summer 2019 Total Number of Current Students in 2018 - 2019 = 742

Campus Frequency Percent

Fort Lauderdale 206 27.8

Jacksonville** 10 1.3

Miami 38 5.1

Orlando 20 2.7

Palm Beach 22 3.0

Tampa 12 1.6

Online 434 58.5

Total 742 100

24

2018 – 2019 Current Students: Gender and Race/Ethnicity

Campus Gender Race/Ethnicity

F M Asian Black or African

American

Hispanic or Latino

Inter-national

Multi-racial

Native American or Alaskan

Native

Native Hawaiian or Pacific

Island

White Unknown

Main/ Ft Lauderdal

e

86.9% (179) 13.1% (27) 2.9% (6) 18.5% (38) 39.3% (81) 5.3% (11) 1.5% (3) 0.5% (1) 0.5% (1) 27.7% (57) 3.9% (8)

Jacksonville**

80.0% (8) 20.0% (2) 0% (0) 50.0% (5) 0% (0) 0% (0) 0% (0) 0% (0) 0% (0) 50.0% (5) 0% (0)

Miami 86.8% (33) 13.2% (5) 0% (0) 7.9% (3) 76.3% (29) 0% (0) 2.6% (1) 0% (0) 0% (0) 13.2% (5) 0% (0)

Orlando 95% (19) 5.0% (1) 10.0% (2) 35.0% (7) 25.0% (5) 5.0% (1) 0% (0) 0% (0) 0% (0) 25.0% (5) 0% (0) Palm Beach 81.8% (18) 18.2% (4) 0% (0) 9.1% (2) 45.5% (10) 0% (0) 0% (0) 4.6% (1) 0% (0) 31.8% (7) 9.1% (2)

Tampa 100% (12) 0% (0) 0% (0) 16.7% (2) 25.0% (3) 0% (0) 0% (0) 0% (0) 0% (0) 58.3% (7) 0% (0)

Online 88.5% (384) 11.5% (50) 1.6% (7) 25.1% (109) 27.7% (120) 0.5% (2) 3.7% (16) 0% (0) 0.5% (2) 37.6% (163) 3.5% (15)

Total 88.0% (653) 12.0% (89) 2.0% (15) 22.4% (166) 33.4% (248) 1.9% (14) 2.7% (20) 0.3% (2) 0.4% (3) 32.6% (242) 3.4% (25)

25

2018 – 2019 Current Students: Age

Campus Age Range

20-24 25-29 30-34 35-39 40-44 45-49 50-54 55-59 60-64 65-69

Main/Ft Lauderdale

13.1% (27) 46.1% (95) 20.4% (42) 6.8% (14) 3.4% (7) 3.9% (8) 2.9% (6) 2.9% (6) 0% (0) 0.5% (1)

Jacksonville** 0% (0) 40.0% (4) 10.0% (1) 10.0% (1) 10.0% (1) 20.0% (2) 10.0% (1) 0% (0) 0% (0) 0% (0)

Miami 10.5% (4) 57.9% (22) 15.8% (6) 0% (0) 10.5% (4) 0% (0) 0% (0) 0% (0) 5.3% (2) 0% (0)

Orlando 10.0% (2) 45.0% (9) 15.5% (3) 10.0% (2) 5.5% (1) 0% (0) 0% (0) 10.0% (2) 5.5% (1) 0% (0)

Palm Beach 9.1% (2) 22.7% (5) 18.2% (4) 9.1% (2) 13.6% (3) 9.1% (2) 0% (0) 18.2% (4) 0% (0) 0% (0)

Tampa 16.7% (2) 50.0% (6) 16.7% (2) 8.3% (1) 8.3% (1) 0% (0) 0% (0) 0% (0) 0% (0) 0% (0)

Online 8.1% (35) 36.4% (158) 17.7% (77) 12.7% (55) 8.5% (37) 6.0% (26) 5.3% (23) 3.9% (17) 0.7% (3) 0.7% (3)

Total 9.7% (72) 40.3% (299) 18.2% (135) 10.1% (75) 8.5% (63) 5.1% (38) 4.0% (30) 3.9% (29) 0.1% (6) 0.1% (4)

26

Graduates: Fall 2018 – Summer 2019

Total Number of Graduates in 2018 - 2019 = 172




Miami 10 5.8

Orlando 7 4.1

Palm Beach 6 3.5

Tampa 6 3.5

Online 93 54.1

Total 172 100

27

2018 – 2019 Graduates: Gender and Race/Ethnicity



American

Hispanic or Latino

Inter-national

Multi-racial


Native


Island

White Unknown

Main/ Ft Lauderdal

e

95.3% (41) 4.7% (2) 2.3% (1) 18.6% (8) 44.2% (19) 2.3% (1) 0% (0) 0% (0) 0% (0) 27.9% (12) 4.7% (2)

Jacksonville**

85.7% (6) 14.3% (1) 0% (0) 42.9% (3) 0% (0) 0% (0) 0% (0) 0% (0) 0% (0) 57.1% (4) 0% (0)

Miami 80% (8) 20% (2) 0% (0) 10% (1) 70.0% (7) 0% (0) 10% (1) 0% (0) 0% (0) 10.0% (1) 0% (0)

Orlando 85.7% (6) 14.3% (1) 0% (0) 42.9% (3) 28.6% (2) 0% (0) 0% (0) 0% (0) 0% (0) 28.6% (2) 0% (0) Palm Beach 66.7% (4) 33.3% (2) 0% (0) 0% (0) 50% (3) 0% (0) 0% (0) 0% (0) 0% (0) 33.3% (2) 16.7% (1)

Tampa 100% (6) 0% (0) 0% (0) 0% (0) 33.3% (2) 0% (0) 0% (0) 0% (0) 0% (0) 66.7% (4) 0% (0)

Online 86.0% (80) 14.0% (13) 1.1% (1) 21.5% (20) 30.0% (26) 0% (0) 3.2% (3) 0% (0) 1.1% (1) 41.9% (39) 3.2% (3)

Total 87.8% (151) 12.2% (21) 1.2% (2) 20.3% (35) 34.3% (59) 1.0% (1) 2.3% (4) 0% (0) 1.0% (1) 37.2% (64) 3.5% (6)

28

2018 – 2019 Graduates: Age

Campus Age Range

20-24 25-29 30-34 35-39 40-44 45-49 50-54 55-59 60-64 65-69

Main/Ft Lauderdale

0% (0) 35.7% (25) 42.9% (30) 5.7% (4) 4.3% (3) 7.1% (5) 1.4% (1) 2.9% (2) 0% (0) 0% (0)

Jacksonville** 0% (0) 18.8% (3) 25.0% (4) 18.8% (3) 6.3% (1) 12.5% (2) 18.8% (3) 0% (0) 0% (0) 0% (0)

Miami 0% (0) 0% (0) 25.0% (2) 12.5% (1) 25.0% (2) 25.0% (2) 0% (0) 12.5% (1) 0% (0) 0% (0)

Orlando 0% (0) 25.0% (3) 50.0% (6) 8.3% (1) 8.3% (1) 0% (0) 8.3% (1) 0% (0) 0% (0) 0% (0)

Palm Beach 0% (0) 0% (0) 0% (0) 0% (0) 0% (0) 0% (0) 0% (0) 0% (0) 50.0% (1) 50.0% (1)

Tampa 0% (0) 0% (0) 50.0% (3) 16.7% (1) 0% (0) 16.7% (1) 0% (0) 16.7% (1) 0% (0) 0% (0)

Online 0% (0) 21.4% (9) 31.0% (13) 16.7% (7) 14.3% (6) 9.5% (4) 2.4% (1) 4.8% (2) 0% (0) 0% (0)

Total 0% (0) 25.6% (40) 37.2% (58) 10.9% (17) 8.3% (13) 9.0% (14) 3.8% (6) 3.8% (6) 0.6% (1) 0.6% (1)

29

Applicants: Applied to start in Fall 2018, Winter 2019, or Summer 2019

Total Number of Applicants = 446




Miami 34 7.6

Orlando 8 1.8

Palm Beach 6 1.3

Tampa 6 1.3

Online 247 55.4

Total 446 100.0

30

2018 – 2019 Applicants: Gender and Race/Ethnicity



American

Hispanic or Latino

Inter-national

Multi-racial


Native


Island

White Unknown

Main/ Ft Lauderdal

e 84.1% (116) 15.9% (22) 2.9% (4) 18.1% (25) 40.6% (56) 4.4% (6) 2.2% (3) 0.7% (1) 0% (0) 28.3% (39) 2.9% (4)

Jackson-ville** 57.1% (4) 42.9% (3) 0% (0) 42.9% (3) 0% (0) 0% (0) 14.3% (1) 0% (0) 0% (0) 42.9% (3) 0% (0)

Miami 91.2% (31) 8.8% (3) 0% (0) 5.9% (2) 70.6% (24) 5.9% (2) 0% (0) 0% (0) 0% (0) 14.7% (5) 2.9% (1)

Orlando 87.5% (7) 12.5% (1) 12.5% (1) 12.5% (1) 37.5% (3) 12.5% (1) 0% (0) 0% (0) 0% (0) 25.0% (2) 0% (0) Palm Beach 100% (6) 0% (0) 16.7% (1) 16.7% (1) 16.7% (1) 0% (0) 0% (0) 0% (0) 0% (0) 33.3% (2) 16.7% (1)

Tampa 66.7% (4) 33.3% (2) 16.7% (1) 16.7% (1) 50.0% (3) 0% (0) 0% (0) 0% (0) 0% (0) 16.7% (1) 0% (0)

Online 90.3% (223) 9.3% (23) 1.6% (4) 25.5% (63) 26.7% (66) 0.4% (1) 3.6% (9) 0% (0) 0% (0) 38.5% (95) 3.6% (9)

Total 87.7% (391) 12.1% (54) 2.5% (11) 21.5% (96) 34.3% (153) 2.2% (10) 2.9% (13) 0.2% () 0% (0) 33.0% (147) 3.4% (15)

31

2018 – 2019 Applicants: Age

Campus Age Range

20-24 25-29 30-34 35-39 40-44 45-49 50-54 55-59 60-64 65-69 Unknown

Main/Ft Lauderdale

34.8% (48) 34.8% (48) 17.4% (24) 2.9% (4) 3.6% (5) 2.9% (4) 2.9% (4) 0% (0) 0% (0) 0.7% (1) 0% (0)

Jacksonville** 0% (0) 28.6% (2) 28.6% (2) 14.3% (1) 0% (0) 14.3% (1) 14.3% (1) 0% (0) 0% (0) 0% (0) 0% (0)

Miami 23.5% (8) 58.8% (20) 5.9% (2) 5.9% (2) 5.9% (2) 0% (0) 0% (0) 0% (0) 0% (0) 0% (0) 0% (0)

Orlando 0% (0) 37.5% (3) 25.0% (2) 0% (0) 25.0% (2) 0% (0) 12.5% (1) 0% (0) 0% (0) 0% (0) 0% (0)

Palm Beach 66.7% (4) 0% (0) 0% (0) 0% (0) 0% (0) 33.3% (2) 0% (0) 0% (0) 0% (0) 0% (0) 0% (0)

Tampa 33.3% (2) 33.3% (2) 16.7% (1) 0% (0) 0% (0) 0% (0) 0% (0) 0% (0) 16.7% (1) 0% (0) 0% (0)

Online 13.4% (33) 32.4% (80) 18.2% (45) 11.7% (29) 10.5% (26) 5.3% (13) 3.6% (9) 2.8% (7) 0.8% (2) 0.8% (2) 0.4% (1)

Total 21.3% (95) 34.8% (155) 17.0% (76) 8.1% (36) 7.8% (35) 4.5% (20) 3.4% (15) 1.6% (7) 0.7% (3) 0.7% (3) 0.2% (1)

** Students, graduates, and applicants from the Jacksonville Regional Campus were included in this report due to the last cohort graduating from this campus in August 2019. The Jacksonville campus is currently no longer offering the CMHC program.

32

RECOMMENDATIONS The Assessment Committee recommends that the Curriculum Committee examine the following for curricular changes: 1. The Assessment Committee recommends an additional KPI assignment targeting student learning in the area of career development considering the benchmark was not met when measured by the alumni survey, particularly among regional campuses. To enhance student learning in this area, the Assessment Committee recommends the Curriculum Committee consider adopting the Signature Assignment for PYCL 0631: O*Net Assignment, as a KPI assignment. The O*Net assignment would be in addition to the existing KPI assignment: Career Counseling Theory Overview. The recommendation is based on this assignment targeting the student learning outcome related to career development, which alumni have scored lower. Further, as a KPI assignment, faculty advisors will be able to track student’s performance on both of these assignments as part of the annual student review. 2. In light of the increase in professional dispositions being “not met” in PYCL 0680: Counseling Practicum, the Assessment Committee recommends the Curriculum Committee consider a consistent manner to enhance the depth at which professional dispositions are explained at the start of PYCL 0680. This may include providing students with examples of what is considered “exemplary,” “acceptable,” “marginal,” and “unacceptable” in each of the categories of review and specific to behaviors expected of CMHC students starting practicum. The Assessment Committee is examining the following: 1. Exploring alternative measures of the learning outcomes related to the specialty areas. 2. Monitoring future alumni feedback related to assessment given marginal meeting of Learning Objective #7. 3. Increasing response feedback survey rates from current students at regional campuses. 4. Increasing feedback survey response rates from alumni.

program evaluation report department of ......80% of students earn a final course grade of a b- or...

Documents