student assessment results ethics cpc - universidad … 4.7.pdf · · 2012-01-28student...

18 Standard 4: Measurement and Analysis of…

Student Assessment Results

Ethics CPC

Learning Outcome: Students will demonstrate knowledge of ethical principles and professionalism when making business decisions, recognizing the impact on stakeholders.

Method or Strategy Performance

Indicator Direct or Indirect

Results (%)

Analysis & Improvement Student Level

2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 40 multiple-choice questions administered to measure general knowledge and understanding of ethics.

Students will achieve an average score of 20% or more in the ethics questions of the Standardized Test.

Direct Internal

Freshman 69 65 38 N/A N/A N/A N/A Analysis:

Student performance exceeded established criteria in the freshman level for three periods in both standardized tests.

Seniors achieved the goal in the 40- question Standardized Test but did not achieve it in the 100-question test. The 40-question Standardized Test assesses general behavior. However, the 100- standardized test included concepts and theory. Senior students have not taken the Business Ethics course in the first semester because it’s offered in the last semester of the curriculum.

For the embedded final case study in Business Ethics, students exceeded expected performance.

Students are satisfied with their development of Business Ethics competences provided by the BAP according to respondents of the Senior Exit Survey.

Most Alumni Survey respondents considered that the BAP prepared them well in Business Ethics.

Students achieve the average assessment score in the MFT in one instance. In the last two instances, the performance was below the expected 2% which is not significant.

Improvement:

The faculty of the BAP courses that address ethics (Tables 6.3 and 6.4) will emphasize the ethics issues added in the revised rubric. Professors were




Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

advised to emphasize it more in class discussions.

The 100-question Standardized Test will be revised every two years. It will be administered at the end of the last semester to assure that students have taken most of the ethics course before the test.

As part of our continuous improvement process, the results and topics related to the ethics area were considered for reinforcing the courses.

Professors will reinforce business ethics concepts and theory in English in the classroom to improve language deficiencies.

The Ethics Rubric for the ethical and legal decisions in the professions and society (Case Study) was improved. The following changes were made in the rubric for oral and written reports: a) Greater emphasis on ethical issues. For

example, students should:

identify the constituents involved in the situation.

analyze the way these constituents were affected.

make recommendations to improve the ethical culture in the organization.

develop strategies to monitor the effectiveness of the recommendations.





Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012


Senior (90 credits or more)

N/A N/A N/A N/A 78 84 N/A




Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 100 multiple-choice questions administered to measure general knowledge and understanding of ethics.

Students will achieve an average score of 20% or more in the ethics questions of the Standardized Test. Direct

Internal

Freshman 31 29 26



35 53 44

Course Embedded Case Study with Rubric: Set of specific and fundamental criteria for evaluating the learning knowledge and competence achieved by the student in an ethics case study

At least 75% of the enrolled students will be able to analyze ethical aspects and principles presented in the case study. It is expected that 70% of the enrolled student will complete the final case study with accuracy of 75% or higher.

Direct Internal


85 95

100 (summer

2011)

Senior Exit Survey: 30 questions that allow students to evaluate the

At least 70% of the students will indicate that they are satisfied with their knowledge

Indirect Internal


97 85





Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

skills learned throughout the BAP

of business ethics.

Alumni Survey: 57 multiple-choice questions and 2 open questions about the alumni profile, the perception of their progress in obtaining skills, knowledge and abilities, and the degree of satisfaction with the BAP education and support services.

At least 70% of the survey respondents will consider that BAP prepared them well in business ethics.

Indirect External

BAP Graduate

97 100




Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Major Field Test: Multiple-choice tests prepared by Educational Testing Services that measure the common body of knowledge in business areas.

Average assessment indicator score in the MFT will be 30% or higher.

Direct External


N/A N/A N/A 30 28 28


Information Systems CPC Learning Outcome: Students will able to apply modern software systems (spread sheets, data base, presentation, etc.) to current business problems related to information technology towards the production of solutions.

Method or Strategy

Performance Indicator

Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 40 multiple-choice questions administered to measure general knowledge and understanding of information systems.

Students will achieve an average score of 20% or more in the information systems questions of the Standardized Test. Direct

Internal

Freshman 45 59 34

Analysis:

Student performance exceeded established assessment criteria at the freshman level for three years in both standardized tests.

Seniors’ performance achieved the goal in one of the instances of the 40-question Standardized Test but did not achieve the average score in the 100-question Standardized Test. Not all students had taken the SICI 4105 course when they took the exam.

Students achieve the average assessment score in the MFT in the last two years.

For the course embedded final project in SICI 4105, students exceed the established criteria in the three periods evaluated.

In the Senior Exit Survey, respondents indicated a lower level of satisfaction with their development of information system competences provided by the BAP in relation to the established performance indicator. However, most of the respondents in the Alumni Survey considered that the BAP prepared them well in information systems.

Improvement:

The 100-question Standardized Test will be revised every two years. It will be administered at the end of the last semester to assure that they have taken the Business Computer Tools course before the test.

Professors of the Information Systems course were advised to identify the major deficiencies, revise the content of the course and identify possible improvements.

BAP faculty who teach junior and senior courses were advised to incorporate more information systems applications in their courses according to the educational goals.

We will improve the Senior Exit Survey and include more specific questions that allow students to identify the deficiencies and the reasons for their dissatisfaction.

As part of our continuous improvement process, the analysis of the results and discussion of topics related to the system information area were considered for reinforcing the courses.

Also, professors will reinforce the information system concepts in English in classroom to improve language deficiencies.

Students will achieve an average score of 70% or more in the information systems questions of the Standardized Test.


66 72

Standardized Test: 100 multiple-choice questions administered to measure general knowledge and understanding of information systems.

Students will achieve an average score of 20% or more in the information systems questions of the Standardized Test. Direct

Internal

Freshman 64 43 36

Students will achieve an average score of 70% or more in the information systems questions of the Standardized Test.


69 52 47

Learning Outcome: Students will able to apply modern software systems (spread sheets, data base, presentation, etc.) to current business problems related to information technology towards the production of solutions.

Method or Strategy


Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Senior Exit Survey: 30 questions that allow students to evaluate the skills learned throughout the BAP.

At least 70% of the students will indicate that they are satisfied with their knowledge of information systems.

Indirect Internal


61 N/A 60


At least 70% of the survey respondents will consider that BAP prepared them well in information system.

Indirect External

BAP Graduate

93 94


Average assessment indicator score in the MFT will be 38% or higher

Direct External


N/A N/A N/A 36 40 41


Learning Outcome: Students will able to apply modern software systems (spread sheets, data base, presentation, etc.) to current business problems related to information technology towards the production of solutions.

Method or Strategy


Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Course Embedded assignments with Rubric: Set of specific and fundamental criteria for evaluating the learning knowledge and competence achieved by the Business Computer Course (SICI 4105).

It is expected that 70% of the enrolled student that turned in the final project will complete it with accuracy of 70% or higher.

Direct Internal

Sophomore 88.5 89 86.5

Management CPC Learning outcome: Understand basic management concepts to solve daily problems faced by managers.

Method or Strategy


Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 40 multiple-choice questions administered to measure general knowledge and understanding of management.

Students will achieve an average score of 20% or more in the management questions of the Standardized Test. Direct

Internal

Freshman 48 49 24

Analysis:

Student performance exceeded established assessment criteria at initial freshman level and senior level for three periods in both standardized tests.

Students achieve the average assessment score in the MFT in one instance. In the last two instances the performance was below the expected performance by 3% and 2% respectively, which is not significant.

In the Senior Exit Survey, students reported that they are satisfied with the development of managerial competences provided by BAP.

Most of the respondents in the Alumni Survey considered that BAP prepared them well in management.

Improvement:

The Pre- and Post-Test will be revised every two years.

As part of our continuous improvement process, the analysis of results and discussion of topics related to the management area were considered for reinforcing the courses.

Professors will reinforce the managerial core concepts in English in the classroom to improve language deficiencies.

Students will achieve an average score of 70% or more in the management questions of the Standardized Test.


71 69

Standardized Test: 100 multiple-choice questions administered to measure general knowledge and understanding of management.

Students will achieve an average score of 20% or more in the management questions of the Standardized Test. Direct

Internal

Freshman 73 50 56

Students will achieve an average score of 70% or more in the management questions of the Standardized Test.


76 79 76


At least 70% of the students will indicate that they are satisfied with their knowledge of management.

Indirect Internal


85 82

Alumni Survey: 57 multiple-choice questions

At least 70% of the survey respondents will

Indirect External

BAP Graduates

97 97


Learning outcome: Understand basic management concepts to solve daily problems faced by managers.

Method or Strategy


Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

and 2 open questions about the alumni profile, the perception of their progress in obtaining skills, knowledge and abilities, and the degree of satisfaction with the BAP education and support services.

consider that BAP prepared them well in management.



Direct External


N/A N/A N/A 40 33 34

Accounting CPC Learning outcome: Students will apply accounting principles to identify and record transactions and prepare financial statements.



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 40 Multiple-choice questions administered to measure general knowledge and understanding of accounting.

Students will achieve an average score of 20% or more in the accounting questions of the Standardized Test. Direct

Internal

Freshman 27 22 11

Analysis:

Freshmen performance exceeded established assessment criteria at the freshman level in both standardized tests, except in the 2009-2010 AY for the 40-question Standardized Test.

Seniors’ performance did not achieve the goal in the 40-question Standardized Test nor in the 100- question Standardized Test. Even though seniors did not achieve the performance indicator, we observed a knowledge added value of more than 30% since the freshman year.

Students achieve the average assessment score in the MFT in all instances.

Improvement:

The 100-question Standardized Test will be revised every two years. Consequently, we have included in the 2012 assessment plan a number of assessment strategies such as the following:

a) Accounting professors were advised to identify the major

deficiencies, revise and improve the content of specific topics in the courses.

b) Comprehensive accounting practice activities will be

required. These will give students the opportunity to work with the accounting cycle from the beginning of the business to the preparation o financial statements through a rubric.

c) The analysis of results and discussion of topics related to the accounting area were considered for reinforcing accounting in the courses.

d) Accounting faculty members will design and administer a

Pre-Test and Post–Test in the Fundamentals of Accounting course. It will be administered to the sophomores enrolled in the course.

e) Accounting faculty members will develop and administer a

standardized final test in Fundamentals of Accounting I and II (CONT3005 and CONT3006).

Students will achieve an average score of 70% or more in the accounting questions of the Standardized Test.


58 59

Standardized Test: 100 multiple-choice questions administered to measure general knowledge and understanding of accounting.

Students will achieve an average score of 20% or more in the accounting questions of the Standardized Test. Direct

Internal

Freshman 48 36 35

Students will achieve an average score of 70% or more in the accounting questions of the Standardized Test.


55 51 48


Learning outcome: Students will apply accounting principles to identify and record transactions and prepare financial statements.



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Major Field Test: multiple-choice tests prepared by Educational Testing Services that measure the common body of knowledge in business areas.


Direct External


N/A N/A N/A 37 36 41 f) The Accounting coordinator will reinforce the tutorial assistance for accounting students with the establishment of a formal system of tutoring services. The coordinator will also contact the Academic Support and Development Center (CADA) to establish an alliance to offer tutoring in accounting.

g) Professors will reinforce the accounting core concepts in

English in the classroom to improve language deficiencies.

Global Dimension CPC Learning outcome: Students will demonstrate knowledge of international business concepts and trends and appreciation of global business practices, diversity, and Multiculturalism.



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 40 multiple-choice questions administered to measure general knowledge and understanding of global dimension.

Students will achieve an average score of 20% or more in the global issues questions of the Standardized Test. Direct

Internal

Freshman 45 53 28

Analysis:

For the 40-question Standardized Test, students’ performance exceeded established assessment criteria at the freshman and senior levels for three years.

For the 100- question Standardized Test, students’ performance exceeded established assessment criteria at the freshman level but not at the senior level for three periods.

Most respondents of the Alumni Survey consider that the BAP prepared them well in global dimension.

Students achieved the average assessment score in the MFT in all instances.

Improvement:

The 100-question Standardized Test will be revised every two years.

As part of our continuous improvement process, the analysis of results and discussion of topics related to the global dimension area were considered for reinforcing the courses.

The faculty of the BAP courses that address global dimensions (See Tables 6.3 and 6.4) should emphasize international issues more.

Also, International Business professors will reinforce global dimension concepts in English in the classroom to improve language deficiencies.

Students will achieve an average score of 70% or more in the global issues questions of the Standardized Test.


78 75

Standardized Test: 100 multiple-choice questions administered to measure general knowledge and understanding of global dimension.

Students will achieve an average score of 20% or more in the global issues questions of the Standardized Test. Direct

Internal

Freshman 53 39 33

Students will achieve an average score of 70% or more in the global issues questions of the Standardized Test.


60 63 62


Learning outcome: Students will demonstrate knowledge of international business concepts and trends and appreciation of global business practices, diversity, and Multiculturalism.



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012


At least 70% of the survey respondents will consider that BAP prepared them well in global dimension.

Indirect External

BAP Graduate

91 100



Direct External


N/A N/A N/A 41 34 37

Statistic Quantitative Techniques CPC Learning outcomes: Students will be able to demonstrate proficiency analyzing and solving problems.

Method or Strategy


Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 40 multiple-choice questions administered to measure general knowledge and understanding of statistics / quantitative techniques.

Students will achieve an average score of 20% or more in the statistics/quantitative techniques questions of the Standardized Test. Direct

Internal

Freshman 41 40 22

Analysis:

For the 40-question Standardized Test, students’ performance exceeded established assessment criteria at the freshman and senior levels for three years.

For the 100-question Standardized Test, students’ performance exceeded established assessment criteria at the freshman level but not at the senior level for the three periods.

Students exceeded the average score of 20% in the statistics questions of the Pre-Test.

Students did not achieve the average score of 70% in the statistics questions of the Post- Test. The Post-Test was below the performance indicator. Faculty members believe that students’ performance in the post-test was below the established criteria because the test is not considered for their grades in the course.

Students achieve the average assessment score in the MFT in all instances.

In the Senior Exit Survey, students reported that they are satisfied with the development of statistic quantitative techniques competences provided by the BAP.

Most of the Alumni Survey respondents considered that the BAP prepared them well in statistic quantitative techniques.

Improvement:

The 100-question Standardized Test will be revised and improved. It will be revised every two years.

The analysis of results and discussion of topics related to the statistics dimension area were considered for reinforcing the courses.

Professors will discuss specific ways to motivate students to do their best in the Post-Test in order to achieve better performance.

Professors will revise and improved the content of the standardized Pre-and Post–Test in the Statistics I course. It will be administered to the sophomores enrolled in the course.

To improve performance, the statistics professors will coordinate tutorial assistance to students enrolled in their courses.

Students will achieve an average score of 70% or more in the statistics/quantitative techniques questions of the Standardized Test.


60 61

Standardized Test: 100 multiple-choice questions administered to measure general knowledge and understanding of statistics / quantitative techniques.

Students will achieve an average score of 20% or more in the statistics/quantitative techniques questions of the Standardized Test. Direct

Internal

Freshman 52 38 38

Students will achieve an average score of 70% or more in the statistics/quantitative techniques questions of the Standardized Test.


54 55 46


Learning outcomes: Students will be able to demonstrate proficiency analyzing and solving problems.

Method or Strategy


Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Pre- Test and Post-Test: Same test is administered to students at the beginning of the Statistics I course (ESTA 3041) and upon completion of the course.

Students will achieve an average score of 20% or more in the Statistics questions of the Pre Test. Students will achieve an average score of 70% or more in the statistics questions of the Post Test.

Direct Internal

Sophomore

The students obtained

an average

of 32% in the Pre test and 53% in

the Post test.


At least 70% of the students will indicate that they are satisfied with their knowledge of statistics/ quantitative techniques.

Indirect Internal


76 71


At least 70% of the survey respondents will consider that BAP prepared them well in statistic quantitative techniques.

Indirect External

BAP Graduate

93 97

Learning outcomes: Students will be able to demonstrate proficiency analyzing and solving problems.

Method or Strategy


Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem

2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012



Direct External


N/A N/A N/A 38 34 35


Marketing CPC Learning outcome: Students will be able to identify and evaluate business opportunities and develop a marketing plan for a product and service.



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 40 multiple-choice questions administered to measure general knowledge and understanding of marketing.

Students will achieve an average score of 20% or more in the marketing questions of the Standardized Test. Direct

Internal

Freshman 43 43 22

Analysis:

For the 40-question Standardized Test, students’ performance exceeded established criteria at freshman and senior levels for three years.

For the 100-question Standardized Test, students’ performance exceeded established criteria at freshman level but not at the senior level for the three periods.

For the embedded final marketing plan in Marketing, students exceeded established criteria.

Students achieve the average score in the MFT in the last two instances.

Improvement:

The 100-question Standardized Test will be revised and improved every two years.

As part of our continuous improvement process, the analysis of results and discussion of topics related to the marketing area were considered for the courses.

Professors will reinforce the marketing concepts in English in classroom to improve language deficiencies.

Students will achieve an average score of 70% or more in the marketing questions of the Standardized Test.

Senior (90 credits or

more)

75 77

Standardized Test: 100 multiple-choice questions administered to measure general knowledge and understanding of marketing.

Students will achieve an average score of 20% or more in the marketing questions of the Standardized Test. Direct

Internal

Freshman 36 36 34

Students will achieve an average score of 70% or more in the marketing questions of the Standardized Test.


more)

56 57 52

Rubrics: Set of specific and

It is expected that 70% of

Direct Internal

Junior 70 90 79 85

Learning outcome: Students will be able to identify and evaluate business opportunities and develop a marketing plan for a product and service.



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

fundamental criteria for evaluating the learning knowledge and/or competence achieved by the student in a marketing plan project in a Marketing course (MERC 3115)

the enrolled student will complete the marketing plan with accuracy of 70% or higher.



Direct External

N/A N/A N/A 28 31 31


Business Legal Environment CPC Learning outcome: Students will be aware of the legal and regulatory environment of business.



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 100 multiple-choice questions administered to measure general knowledge and understanding of business legal environment.

Students will achieve an average score of 20% or more in the business legal environment questions of the Standardized Test.

Direct Internal

Freshman 41 30 26

Analysis:

For the 100-question Standardized Test, students’ performance exceeded established criteria at the freshman level but not at the senior level for three periods.

Students did not achieve the average score in last two instances of the MFT.

The last survey reflects that students are satisfied with their development of business legal environment competencies provided by the BAP.

The Business Legal course focuses on the Puerto Rico Civil Code and does not include most of the common law concepts that are covered in the MFT.

Improvement:

The 100-question Standardized Test will be revised and improved every two years.

The analysis of results and discussion of topics related to the business legal environment area were considered for reinforcing in the courses.

Professors will reinforce the business legal concepts in English in the classroom to improve language deficiencies.

Professors of Business Law were advised to identify the major deficiencies, revise the content of the courses and identify possible improvements.

Students will achieve an average score of 70% or more in the business legal environment questions of the Standardized Test.


more)

46 46 50


At least 70% of the students will indicate that they are satisfied with their knowledge of business legal environment.

Indirect Internal


more)

61 73



Direct External


more)

N/A N/A N/A 30 28 28

Business Finance CPC Learning outcome: Students will analyze financial statements and other financial data.



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 40 multiple-choice questions administered to measure general knowledge and understanding of business finance.

Students will achieve an average score of 20% or more in the business finance questions of the Standardized Test. Direct

Internal

Freshman 26 55 32

Analysis:

For the 40-question Standardized Test, students’ performance exceeded established criteria at the freshman and senior levels for three years.

For the 100-question Standardized Test, students’ performance exceeded established criteria at the freshman level but not at the senior level for the three periods. Many seniors had not taken the Money and Banking Finance and/or Business Finance courses.

Students achieve the average assessment score in the MFT in the first and third instance. In the second instance, the performance was below expectations by 4%.

Improvement:

The100- question Standardized Test will be revised every two years.

As part of our continuous improvement process, the analysis of results and discussion of topics related to the finance area were considered for reinforcing the courses.

Finance professors will reinforce the business finance concepts in English in the classroom to improve language deficiencies.

To improve performance, faculty will consider offering tutorial assistance for students enrolled in the finance course.

Finance faculty members will prepare a Pre- and Post-Test for the Business Finance course (FINA 3006). It will be administered to juniors enrolled in the course.

Students will achieve an average score of 70% or more in the business finance questions of the Standardized Test.


more) 74 73

Standardized Test: 100 multiple-choice questions administered to measure general knowledge and understanding of business finance.

Students will achieve an average score of 20% or more in the business finance questions of the Standardized Test. Direct

Internal

Freshman 40 45 44

Students will achieve an average score of 70% or more in the business finance questions of the Standardized Test.


more) 57 64 59


Average assessment indicator score in the MFT will be 36% or higher

Direct External


more) N/A N/A N/A 40 32 40


Economics CPC Learning outcome: Students will understand the impact of economic environment on the business organization and apply microeconomic analysis tools.



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 40 multiple-choice questions administered to measure general knowledge and understanding of economics.

Students will achieve an average score of 20% or more in the economics questions of the Standardized Test. Direct

Internal

Freshman 15 17 6

Analysis:

For the 40-question Standardized Test, students did not achieve the established criteria at the freshman and senior levels for three years. The test had only two economics questions in this CPC.

For the 100-question Standardized Test, students’ performance exceeded established criteria at the freshman level but not at the senior level for the three periods.

Students exceeded the average score of 20% in the economics questions of the Pre Test.

Students did not achieve the average score of 70% in the economics questions of the Post Test. Some faculty members think that the Post-Test was below the performance indicator because it is not considered for their grades.

Students did not achieve the average assessment score in the MFT.

Improvement:

The100-question Standardized Test will be revised and improved every two years.

As part of our continuous improvement process, the analysis of results and discussion of topics related to the economics area were considered for reinforcing the courses.

Professors will discuss creative ways to motivate students to do their best in the Post-Test to achieve better performance.

Professors will reinforce the economics concepts in English in the classroom to improve language deficiencies.

Economics professors will design a standardized Pre- and Post-Test for the Principles of Economics course (ECON 3007).

Students will achieve an average score of 70% or more in the economics questions of the Standardized Test.

Senior (90 credits)

14 16

Standardized Test: 100 multiple-choice questions administered to measure general knowledge and understanding of economics.

Students will achieve an average score of 20% or more in the economics questions of the Standardized Test. Direct

Internal

Freshman 43 38 39

Students will achieve an average score of 70% or more in the economics questions of the Standardized Test.

Senior (90 credits)

53 62 63

Pre & Post Test: The same test was administered to students at the

Students will achieve an average score of 20%

Direct Internal

Junior

33% in the Pre

Test and 65% in

Learning outcome: Students will understand the impact of economic environment on the business organization and apply microeconomic analysis tools.



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

beginning of the course and upon completion of the Micro-Economic (ECON 3155) and Economic and Social Development of Puerto Rico (ECON 4036) courses.

or more in the economics questions of the Pre Test. Students will achieve an average score of 70% or more in the economics questions of the Post Test.

the Post Test.

Major Field Test: Multiple-choice tests prepared by Educational Testing Services that measure the common body of knowledge in business areas


Direct External

Senior (90 credits)

N/A N/A 32 30 31


Other Institutional Competencies

Communications Skills

Method or Strategy


Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012


At least 70% of the survey respondents will consider that the BAP prepared them well in communications skills.

Indirect External

BAP Graduate

96 97

Analysis:

Alumni perception is that the BAP was effective in the development of communications skills.

In the Spanish open question of the Standardized Test, 0% of participants scored exemplary, 57% scored Basic, 39% scored Needs Improvement and 4% scored within the unacceptable range. In the English open question, all participants (89) scored within the Needs Improvement range. The highest average was in writing Language Usage and Mechanics. The lowest average was in writing a conclusion in both languages. Most students achieved performance indicator in Spanish. However, in English all need improvement.

Seniors are satisfied with their development of the Spanish communication skills provided by BAP.

Seniors are dissatisfied with their development of English communication skills competences provided by the BAP.

For the course embedded final presentation in INCO 3005, students exceed the established criteria in the third period evaluated.

In the Employer Survey, the goal was not met by 0.8%. Improvement:

The BAP faculty will share survey results with Business Communication professors in the English Department for evaluation of these assessment results to take remedial action.

Add an assessment instrument that focuses on business writing, such as memo or letter writing, based on a business scenario.

Standardized Test: 40 multiple-choice questions (business topics) and 2 open questions (English and Spanish communications skills).

Students will achieve an

average score of 3 or more (from a

scale of 1-4) in Spanish and 2.5

in English.

Direct Internarl

Senior

2.99 Spa

2.24 Eng

3.10 Spa

2.40 Eng


At least 70% of the survey respondents will consider that the BAP prepared them well in Spanish and English.

Indirect Internal

Senior

91% of the

respondents

consider that the

BAP prepared them well in

Spanish oral

communication

and 39% in English

85% of the respondents consider that

the BAP prepared

them well in Spanish oral communication and 53% in English

oral communicati

on.

85% of the respondents consider that

the BAP

Method or Strategy


Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

oral communication

.

85% of the

respondents

consider that the

BAP prepared them well in

Spanish writing communication

and 49% in English writing communication

.

prepared them well in

Spanish writing

communication and 49% in English

writing communicati

on.


Method or Strategy


Direct or Indirect

Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Course-embedded assessment: Set of specific and fundamental criteria (rubric) for evaluating the competence achieved by the student in an oral presentation project in Business Communication in English (INCO 3005) and Spanish (ESCO 3001) courses.

It is expected that 70% of the

enrolled students that turned in the final project will complete it with accuracy of 70%

or higher.

Direct Internal

65 45

73 74 (ESCO

3001)

Employer Survey: This instrument gathers information related to how the competencies acquired in the BAP contribute to the success of our graduates in the labor market to identify and improve areas for improvement and maintain our strengths.

At least 70% of employers will

indicate that the BAP graduate

meet the expected minimum

competencies.

Direct External

69.2

Research Skills



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012

Standardized Test: 40 multiple-choice questions administered to measure knowledge of the business area including research skills.

Students will achieve an average score of 20% or more in the research skills questions of the standardized test. Direct

Internal

Freshman 5 12 9

Analysis:

For the 40-question Standardized Test, students did not achieve the established performance criteria at the freshman and senior levels for three years. The test had only one question in this competency.

The Senior Exit Survey reflects that students are dissatisfied with their development of research skills provided by the BAP.

For the course embedded final project in International Business (COIN 4305) and Economics (ECON 4036), the students exceeded the established criteria in all years.

Improvement:

Given the low satisfaction indicated by students in the Senior Exit Survey, more professors will assign research projects in their courses. This will give students more opportunities to develop research skills.

Students will achieve an average score 70% or more in the research skills questions of the standardized test.

Senior 32 37


At least 70% of the survey respondent will consider that BAP prepared them well in research skills.

Indirect Internal

Senior 45 42

Course-embedded assessment: Set of specific and fundamental criteria (rubric) for evaluating the competence achieved by the student in an oral presentation and written projects in international business (COIN 4305) and economics and (ECON 4036).

Students will achieve an average score of 70% or more in their research projects.

Direct Internal

Senior 93.5 92 89


Team Work Skills



Results (%)


2007-2008

2008-2009

2009-2010

1st

Sem 2010-2011

2nd

Sem

2010-2011

1st

Sem

2011-2012

2nd

Sem

2011-2012


At least 70% of the survey respondents will consider that the BAP prepared them well in team work.

Indirect External

Senior 90 97

Analysis:

Alumni perception is that the BAP helped them acquire totally or partially interpersonal and collaborative skills to work well in teams.

In the course-embedded assessment in Principles of Marketing course (MERC 3115), the performance indicator was achieved in four instances. The teams turned in the marketing plan on time. They also turned in a written plan and gave an oral presentation to the group.

Students had problems answering the 2007-08 instruments and it was decided that faculty members would prepare a rubric to assess teamwork.

The Senior Exit Survey reflects that students are satisfied with their development of team work skills provided by the BAP.

Improvement:

BAP faculty members developed a rubric to assess team work.

Course-embedded assessment: Set of specific and fundamental criteria (rubric) for evaluating the competence achieved by the student in an oral presentation and written projects in the Principles of Marketing (MERC 3115) course.

At least 70% or more of the groups worked effectively in teams.

Direct Internal

Junior 97 100 100 95


At least 70% of the survey respondents will consider that BAP prepared them well in team work.

Indirect Internal

Senior 87.9 86.6

student assessment results ethics cpc - universidad … 4.7.pdf · · 2012-01-28student...

Documents