annual academic assessment report cover sheet

18
10/2014 1 Annual Academic Assessment Report Cover Sheet Assessment reports are due the 1 st Wednesday after the Fall Term Program Information: Program Assessed Master of Business Administration (MBA) Department MBA Programs Office College Lee Business School (LBS) Department Chair Chin-Chun (Vincent) Hsu, Ph.D., CMA Assessment Coordinator Chin-Chun (Vincent) Hsu, Ph.D., CMA Date Submitted December 20, 2017 Contact Person for This Report Name Chin-Chun (Vincent) Hsu, Ph.D., CMA Phone 895-3842 Email [email protected] Please attach a narrative (not to exceed 4 pages, excluding appendices) addressing the following: What are the student learning outcomes? Please provide a numbered list. Which learning outcomes were assessed? How were they assessed? (Programs must use at least one direct assessment of student learning.) Undergraduate programs should assess at least one University Undergraduate Learning Outcome (UULO) each year, which may or may not overlap with a program learning outcome. Graduate programs should assess at least one outcome related to one of the following graduate level requirements each year: o student engagement in research, scholarship, creative expression and/or appropriate high-level professional practice. o activities requiring originality, critical analysis and expertise. o the development of extensive knowledge in the field under study. What was learned from the assessment results? How did the program respond to what was learned? Please limit the narrative portion of your report to no more than four pages. You may attach appendices with data, tables, charts, or other materials as needed. Please explain the relevant conclusions from any appendices in your narrative. Please contact the Office of Academic Assessment if you have questions or need assistance.

Upload: others

Post on 14-Jan-2022

1 views

Category:

Documents


0 download

TRANSCRIPT

10/2014 1

Annual Academic Assessment Report Cover Sheet Assessment reports are due the 1st Wednesday after the Fall Term

Program Information:

Program Assessed

Master of Business Administration (MBA)

Department

MBA Programs Office

College

Lee Business School (LBS)

Department Chair Chin-Chun (Vincent) Hsu, Ph.D., CMA

Assessment Coordinator

Chin-Chun (Vincent) Hsu, Ph.D., CMA

Date Submitted December 20, 2017

Contact Person for This Report

Name Chin-Chun (Vincent) Hsu, Ph.D., CMA

Phone 895-3842

Email

[email protected]

Please attach a narrative (not to exceed 4 pages, excluding appendices) addressing the following:

What are the student learning outcomes? Please provide a numbered list.

Which learning outcomes were assessed?

How were they assessed? (Programs must use at least one direct assessment of student learning.)

Undergraduate programs should assess at least one University Undergraduate Learning Outcome (UULO) each year, which may or may not overlap with a program learning outcome.

Graduate programs should assess at least one outcome related to one of the following graduate level requirements each year:

o student engagement in research, scholarship, creative expression and/or appropriate high-level professional practice.

o activities requiring originality, critical analysis and expertise. o the development of extensive knowledge in the field under study.

What was learned from the assessment results?

How did the program respond to what was learned?

Please limit the narrative portion of your report to no more than four pages. You may attach appendices with data, tables, charts, or other materials as needed. Please explain the relevant conclusions from any appendices in your narrative. Please contact the Office of Academic Assessment if you have questions or need assistance.

10/2014 2

What are the student learning outcomes? Please provide a numbered list.

Goals of the MBA Program are driven by the mission and strategic plan of the Lee Business School. Upon completion of the MBA program, students should be able to:

1. SLO 1: Recognize and evaluate ethical, legal and regulatory dimensions of business

decisions

2. SLO 2: Communicate effectively business ideas and analyses in writing

3. SLO 3: Communicate effectively business ideas and analyses in oral presentations

4. SLO 4: Work effectively in a team setting

5. SLO 5: Apply business concepts to managerial decision making

Which learning outcomes were assessed?

In Fall 2014, the MBA Programs were redesigned to support the mission and student learning outcomes and the new curriculum was implemented in Fall 2015. We perform the assessment by following the curriculum map in the newly developed 2015-2018 Three-year Assessment Plan. We intend to complete a cycle of assessment data collection in 2017-2018 academic year that will allow us to measure the attainment of these goals and outcomes. A curriculum map showing the assessment points for each learning outcome is attached in Appendix A.

In Fall 2017, we assessed all SLOs through several groups of students:

We assessed SLO 1 through MBA 787

We assessed SLO 2 through MBA 763 and MBA 769.

We assessed SLO 3 through MBA 769.

We assessed SLO 4 through MBA 767.

We assessed SLO 5 through MBA 787.

How were they assessed? (Programs must use at least one direct assessment of student learning.)

Utilizing the course-embedded system of assessment will allow for detailed outcome-level data on achievement of the outcomes connected to each program goal. The MBA teaching faculty and MBA Programs office developed rubrics and assessment data collection forms to assess student achievement of the learning outcomes. Please refer to Appendix 1-5 for sample rubrics and sample forms. The forms identify the performance levels in the following fashion – Level 5 (Excellent), Level 4 (Good), Level 3 (Adequate), Level 2 (Weak), and Level 1 (Poor).

10/2014 3

We assessed SLO 1 through core course MBA 787 [Direct Assessment: course-embedded assessment].

MBA students will recognize and evaluate ethical, legal and regulatory dimensions of

business decisions.

In Fall 2017, SLO 1 was also assessed in MBA 787 class. As the culminating experience

for all Lee Business School’s MBA students, MBA 787 Capstone Business Projects give

students the opportunity to demonstrate mastery of the skills and knowledge gained

throughout their program. SLO 1 is part of the assessment requirements. The project is

completed in four to five months (one academic semesters). [See Appendix 1].

We assessed SLO 2 through core course MBA 763 and MBA 769 [Direct Assessment: course-embedded assessment].

MBA students will demonstrate ability of communicating effectively business ideas and

analyses in writing.

In Fall 2017, written assignments for case analyses in MBA 763 Leadership, Teams and

Individuals served as course-embedded assessment. Throughout the semester the

students turn in team case analyses as well as individual assignments, all of which are

written assignments. In addition, the two exams are individual case analyses. The

professor rated students’ performance using the Assessment Rubric [See Appendix 2].

In Fall 2017, a case study decision essay assignments that center on economic analysis

decisions in MBA 769 Applied Economic Analysis served as course-embedded

assessment. The professor rated students’ performance using the Assessment Rubric

[See Appendix 2].

We assessed SLO 3 through core course MBA 769 [Direct Assessment: course-embedded assessment].

MBA students will demonstrate ability of communicating effectively business ideas and

analyses in oral presentation.

In Fall 2017, applied economic analysis reports in MBA 769 Applied Economic Analysis

serve as course-embedded assessment.. The Finance professor rated students’

performance using the Assessment Rubric [See Appendix 3].

10/2014 4

We assessed SLO 4 through core course MBA 767 [Indirect Assessment].

SLO 4 is to measure the student’s ability to work effectively in a team setting.

The students were informed that upon completion of the MBA 767, they would also be

asked to complete a Group Processes and Peer Evaluation Form (See Appendix 4). This

form was intended to measure the degree of effectiveness of the groups and the extent

to which all members did their share of the work.

We assessed SLO 5 through core course MBA 787 [Indirect Assessment].

SLO 5 is to measure the student’s ability to work effectively in a team setting.

The students were also informed that upon completion of the MBA 787’s Capstone

project, they would also be asked to complete a Group Processes and Peer Evaluation

Form (See Appendix 5). This form was intended to measure the degree of effectiveness

of the groups and the extent to which all members did their share of the work.

Undergraduate programs should assess at least one University Undergraduate Learning Outcome (UULO) each year, which may or may not overlap with a program learning outcome.

Not Applicable. The Master of Business Administration (MBA) degree is a business graduate program. UULO does not apply to graduate programs.

Graduate programs should assess at least one outcome related to one of the following graduate level requirements each year: o student engagement in research, scholarship, creative expression and/or appropriate high-level

professional practice. o activities requiring originality, critical analysis and expertise.

the development of extensive knowledge in the field under study.

The Master of Business Administration (MBA) degree is a non-thesis program designed to serve students, alumni, and businesses by providing educational programs that enhance leadership and competence among business people, especially business practitioners, and provides solutions for important business problems.

What was learned from the assessment results?

10/2014 5

We assessed SLO 1 through core course MBA 787. Results:

1. Table 1 and Table 2 report the results from MBA 787. The SLO 1 was assessed using

assessment rubric with five-point scale. Table 2 shows the percentage of students

meeting and exceeding expectation. In terms of Identification of Ethical Issues, most

students do very well with a median of 4.0; 46% of students have reached “Good” or

“Excellent” levels. In terms of Consideration of Stakeholders, most students do well with

a median score of 3 with 44% of students have reached “Good” or “Excellent” levels. In

terms of Analysis of Issue from Multiple Ethical Perspectives, the median score is 3.0 and

36% of students have reached “Good” or “Excellent” levels. In terms of Discussion of

Options, the median score is 3.0 and 44% of students have reached “Good” or

“Excellent” levels. In terms of Proposal of Decision, the median score is 3.0 and 36% of

students have reached “Good” or “Excellent” levels.

10/2014 6

We assessed SLO 2 through core course MBA 763 and MBA 769. Results:

1. Table 3 and Table 4 report the results from MBA 763 Leadership, Teams and Individuals.

The SLO 2 were assessed using assessment rubric with five-point scale. As shown in

Table 5, the median scores for all five dimensions are in 4. Table 6 shows the

percentage of students meeting and exceeding expectation. In terms of Clarity and

Conciseness, most students do very well with a median of 4.0; 65% of students have

reached “Good” or “Excellent” levels. In terms of Professional Tone, most students do

well with a median score of 4 with 60% of students have reached “Good” or “Excellent”

levels. In terms of Organization, the median score is 4.0 and 72.5% of students have

reached “Good” or “Excellent” levels. In terms of Grammar and Mechanics, the median

score is 4.0 and 67.5% of students have reached “Good” or “Excellent” levels.

10/2014 7

1.

2. Table 5 and Table 6 report the results from MBA 769 Applied Economic Analysis. The

SLO 2 were assessed using assessment rubric with five-point scale. As shown in Table 5,

the median scores for all five dimensions are in 4 or 5. Table 6 shows the percentage of

students meeting and exceeding expectation. In terms of Clarity and Conciseness, most

students do very well with a median of 4.0; 79.5% of students have reached “Good” or

“Excellent” levels. In terms of Professional Tone, most students do well with a median

score of 4 with 82% of students have reached “Good” or “Excellent” levels. In terms of

Organization, the median score is 5.0 and 94.8% of students have reached “Good” or

“Excellent” levels. In terms of Grammar and Mechanics, the median score is 5.0 and

76.9% of students have reached “Good” or “Excellent” levels.

10/2014 8

We assessed SLO 3 through core course MBA 769. Results:

1. Table 7 and Table 8 report the results from MBA 769. Table 7 shows the median scores

for all dimensions are in 4 or better. Table 8 shows the percentage of students meeting

and exceeding expectation. For Organization, most students do very well with a median

of 5.0; 97.5% of students have reached “Good” or “Excellent”. For Subject Knowledge,

most students do well with a median score of 4.0 with 92.4% of students have reached

“Good” or “Excellent” levels. For Mechanics, the median score is 5.0; 100% of students

have reached “Good” or “Excellent” levels. For Eye Contact, the median score is 5.0;

97.4% of students have reached “Good” or “Excellent” levels. For Elocution, the median

score is 5.0; 97.4% of students have reached “Good” or “Excellent” levels.

10/2014 9

We assessed SLO 4 through core course MBA 767. Results:

1. Table 9 and Table 10 report the results from MBA 767. The SLO 4 were assessed using

assessment rubric with five-point scale (5 = strongly agree and 1 = strongly disagree).

The students were asked to rate their team’s performance. The percentage of students

rating their team as “strongly agree” or “agree” for each question is shown in Table 10.

It should be noted that the results represent all students who completed ratings for

each question. As shown in Table 9, the median scores for all 8 out of 10 questions are

in 5.

10/2014 10

10/2014 11

We assessed SLO 5 through core course MBA 787. Results:

1. Table 11 and Table 12 report the results from MBA 787 Capstone Project assessment.

The SLO 5 were assessed using assessment rubric with five-point scale (5 = strongly

agree and 1 = strongly disagree). The students were asked to rate their team’s

performance. The percentage of students rating their team as “strongly agree” or

“agree” for each question is shown in Table 12. It should be noted that the results

represent all students who completed ratings for each question. As shown in Table 11,

the median scores for all 10 questions are in 5.

10/2014 12

How did the program respond to what was learned?

In 2015, MBA program developed new assessment forms and rubrics. Learning

outcomes are assessed in required courses identified in the Curriculum Map.

Overall speaking, from the assessment results in 2017, we are meeting goals.

The 2016-17 year provided more evidence of a successful MBA program

revision and improved learning outcomes. Faculty participation in

assessment activities increased, as did systematic review of assessment

results.

Major assessment results documented improved learning outcomes when

compared to the 2015 year. Collectively, our assessment results have

documented better outcomes.

However, greater emphasis on ethical, legal and regulatory issues (SLO #1)

is desired in the program. The faculty reviewed the results and concluded

that “it seems clear that students clearly understand ethical, legal and

regulatory issues, but do not understand well how to apply them in business

decision making.” In order to integrate these issues into all facets of the

curriculum, the faculty have suggested that

o (1) case studies designed to foster recognition and application of

ethical, legal and regulatory issues to business operation and

performance be introduced in key courses of the program, and

o (2) the culmination of strategic and operational application of

ethical, legal and regulatory knowledge be evaluated during the the

strategic management “capstone” course (MBA 787). Data will

continue to be collected in the spring of 2018 in MBA 787. Data from

this course will be compared to data collected from the previous two

academic years to gauge improvement in the areas discussed above.

The Lee Business School MBA program is set up as a non-cohort program.

Students can attend either part time or full time, and have flexibility in how

they take MBA courses. Students can graduate in as little as a year and a half

and have up to six years to complete the MBA program. On average our

students take three years to complete the program. It is important to look at

a student’s longevity in the program and how it relates to their scores.

10/2014 13

Appendix A

10/2014 14

Appendix 1

10/2014 15

Appendix 2

10/2014 16

Appendix 3

10/2014 17

Appendix 4

10/2014 18

Appendix 5