weber state university annual assessment of evidence of ......certificate in network technologies...

1

Weber State University Annual Assessment of Evidence of Learning

Department/Program: Networking Management and Business Multimedia Network Management Technology Major

Academic Year of Report: 2012-2013 Date Submitted: November 15, 2013 Report author: Diana Green and Ken Cuddeback NTM Faculty Contact Information: Allyson Saunders, Elizabeth Hall 383 Phone: 801-626-6823 Email: [email protected]

2

A. Brief Introductory Statement:

Our department has three separate introductory statements related to the three different majors. Listed below is the introductory statement for Network Management Technology: The Network Management Technology major is in the Network Technology and Business Multimedia Department (NTM) in the College of Applied Science and Technology (COAST) at Weber State University (WSU). Students have the following degree options:

Bachelor of Science in Network Management Technology Associate of Applied Science in Network Management Technology Minor in Network Management Technology Certificate in Network Security Technology Certificate in Network Technologies

Students learn to maintain voice and data telecommunications systems. For voice systems, students design, install and manage phone systems, as well as practice programming switches for telephone applications in a lab situation. For data systems, students learn Linux, Microsoft, and Cisco; master computer programs for Web design graphics, the Internet, and network security; install software and configure data systems to operate efficiently; explore cyber ethics and policies; and participate in an internship in a corporate network department. Graduates in this major may work in the network industry and includes working with a voice network, a data network, or a converged network. Jobs may focus on local area networks, fiber optics, switches, firewalls, router configuration protocols, microwave and satellite communications, online databases, telephone systems, voice technology, and network security.

3

B. Mission Statement

The Network Technology and Business Multimedia Department is committed to providing the highest quality undergraduate programs while preparing students to assume roles in decision making, leadership, research, and service to community and business. The department assists students in developing, communicating, and applying knowledge for the technical and professional world as well as gaining a desire for lifelong learning.

4

C. Student Learning Outcomes

Measureable Learning Outcomes

At the end of their study at WSU, students in this program will 1. possess effective business communication skills. 2. possess effective computational skills. 3. possess knowledge and skills of technology. 4. implement effective decision-making and problem-solving skills. 5. implement effective ethics and professionalism.

5

D. Curriculum

Curriculum Map

Core Courses in Department/Program

Department/Program Learning Outcomes

Le

arn

ing

Ou

tco

me

1:

Eff

ect

ive

Bu

sin

ess

C

om

mu

nic

ati

on

S

kil

ls

Le

arn

ing

Ou

tco

me

2:

Eff

ect

ive

C

om

pu

tati

on

al

Skil

ls

Le

arn

ing

Ou

tco

me

3:

Kn

ow

led

ge

an

d

Sk

ills

Le

arn

ing

Ou

tco

me

4:

Imp

lem

en

tati

on

of

De

cisi

on

-Ma

kin

g

an

d P

rob

lem

So

lvin

g

Sk

ills

Le

arn

ing

Ou

tco

me

5:

Lic

en

sure

Le

arn

ing

Ou

tco

me

6:

Kn

ow

led

ge

of

Eth

ics

an

d P

rofe

ssio

na

lism

NTM 1040 Speedbuilding/Keyboarding (discontinued course) CEET 1105 (discontinued course) CEET 1110 Basic Electronics E U U NA CS 1400 Fundamentals of Programming CS 2550 Database Design and Application Development CS 2650 Computer Architecture/Organization NTM 2010 Business English (discontinued course) NTM 2080 Database Applications (discontinued course) NTM 2200 Microcomputer Operating Systems E E NA NTM 2300 Introduction to LAN Management U U NA NTM 2500 (discontinued course) NTM 2532 Web Page Design and Development U NA NTM 2710 Digital Switching Systems E E NA NTM 2720 Transport Media & Emerging Technologies E E NA NTM 2730 Digital Switching & Transport Applications U U NA NTM 3070 Advanced Spreadsheet Applications (discontinued course)

NTM 3090 Advanced Electronic Presentations (discontinued course)

6



Le

arn

ing

Ou

tco

me

1:

Eff

ect

ive

Bu

sin

ess

C

om

mu

nic

ati

on

S

kil

ls

Le

arn

ing

Ou

tco

me

2:

Eff

ect

ive

C

om

pu

tati

on

al

Skil

ls

Le

arn

ing

Ou

tco

me

3:

Kn

ow

led

ge

an

d

Sk

ills

Le

arn

ing

Ou

tco

me

4:

Imp

lem

en

tati

on

of

De

cisi

on

-Ma

kin

g

an

d P

rob

lem

So

lvin

g

Sk

ills

Le

arn

ing

Ou

tco

me

5:

Lic

en

sure

Le

arn

ing

Ou

tco

me

6:

Kn

ow

led

ge

of

Eth

ics

an

d P

rofe

ssio

na

lism

NTM 3250 Business Communication A NA Acctng 2010 Survey of Accounting I (discontinued course) NTM 2415 Cisco TCP/IP Protocol Suite, Routing Protocols, and Router Configuration

Artifact U NA

NTM 2435 Cisco Adv Routing Protocols, LAN Switching & WAN Theory and Design

Artifact* U NA

NTM 3200 Linux Systems Administration U NA NTM 3210 (discontinued course) NTM 3300 Advanced Network Security Management Artifact* U NA NTM 3310 Network Server Administration NTM 3532 Internet/Database Integration U NA NTM 3550 Supervising Information Technology U U NA NTM 3710 (discontinued course) NTM 3720 Advanced Transport Media (3710 & 3720 combined) U U NA E NTM 3730 Cyber Policy and Ethics U U E NA E NTM 4700 Data Network Design U U NA E NTM 4710 Traffic Technology & Voice Network Design U U U NA E NTM 4760 Network/Telecommunications Internship E A A A NA A NTM 4790 Network/Telecommunications Senior Project E Artifact U NA CS 3030 Scripting Languages CS 3705 Protocol Analysis ECON 1010 COMM 2110 MGMT 3010 Organizational Behavior and Management

7



Le

arn

ing

Ou

tco

me

1:

Eff

ect

ive

Bu

sin

ess

C

om

mu

nic

ati

on

S

kil

ls

Le

arn

ing

Ou

tco

me

2:

Eff

ect

ive

C

om

pu

tati

on

al

Skil

ls

Le

arn

ing

Ou

tco

me

3:

Kn

ow

led

ge

an

d

Sk

ills

Le

arn

ing

Ou

tco

me

4:

Imp

lem

en

tati

on

of

De

cisi

on

-Ma

kin

g

an

d P

rob

lem

So

lvin

g

Sk

ills

Le

arn

ing

Ou

tco

me

5:

Lic

en

sure

Le

arn

ing

Ou

tco

me

6:

Kn

ow

led

ge

of

Eth

ics

an

d P

rofe

ssio

na

lism

(discontinued course) MKTG 3010 Marketing Concepts & Practices (discontinued course)

Notea: Define words, letters or symbols used and their interpretation; i.e. 1= introduced, 2 = emphasized, 3 = mastered or I = Introduced, E = Emphasized, U = Utilized, A = Assessed comprehensively; these are examples, departmental choice of letters/numbers may differ Noteb: Rows and columns should be transposed as required to meet the needs of each individual department E. Assessment Plan Update Problem Identified Action to Be Taken Issue 1 After the Telecommunications curriculum changes have been approved, then the program needs to seek ABET accreditation.

Current 5 Year Program Review: 2012 Year 1 Action to Be Taken: 2012 Change major name from Telecommunications Administration to Network Management Technologies. Done Get curriculum changes completed. Done Year 2 Action to Be Taken: 2013 Apply for ABET accreditation. ABET committee has been formed and type of ABET accreditation has been determined. Documents are being prepared for the ABET accreditation. The application for ABET accreditation needs to be moved to 2014. Year 3 Action to Be Taken: 2014

8

Apply for ABET accreditation and complete ABET accreditation self-study. Year 4 Action to Be Taken: 2015 Receive ABET accreditation.

Issue 2 Gather artifacts for assessment.

Current 5 Year Program Review: 2012 Year 1 Action to Be Taken: 2012 Collect artifacts from NTM 2415 Done Collect artifacts from NTM 4790 Done Year 2 Action to Be Taken: 2013 Collect artifacts from NTM 2435 and NTM 3300 and NTM 4790. The artifacts are being gathered from the three courses. Done

F. Report of assessment results for the most previous academic year:

a. Evidence of Learning: Courses within the Major 1. NTM 2415 and NTM 2435: The students practice building networks as part of their assignments and then for thefinal exam, they build virtual networks.

2. NTM 3300: The students use packet tracer files to determine the types of packets sent on a network and determine which files are harmful to the network. They also identify levels of security on the network through the packet tracer files.

3. NTM 4790: Employer evaluation forms are provided at the conclusion of the internship/senior project experience that identify the learning outcomes 1, 2, 3, 4, and 6. The summary of the results are found in the charts shown in this section of the assessment report.

Evidence of Learning: Courses within the Network Management Technology Major

9

Program Learning Goal

Measurable Learning Outcome

Method of Measurement

Direct and Indirect

Measures*

Findings Linked to Learning Outcomes Interpretation of

Findings

Action Plan/Use of Results

Goal 1: Students will possess effective business communication skills

Learning Outcome 1: Students will maintain a score of 3.5 or above on the writing assessment.

Measure 1: Writing Assessment Rubric

Measure 1:

Measure 1: Since Fall 2009, students have maintained an average score of 3.84 on the written communication assessment.

Measure 1: To continue to evaluate the individual element scores on the writing rubric to improve the sub scores

Learning Outcome 2: Students will maintain a score of 3.5 or above on the oral communication assessment.

Measure 2: Oral Communication Assessment Rubric

Measure 2:

Measure 2: Since Fall 2009, students have maintained an average score of 4.24 on the oral communication assessment.

Measure 2: To evaluate the individual element scores on the oral com rubric to determine the reason for the decline in scores.

4.06 4.02

3.64 3.65

3.00

3.50

4.00

4.50

5.00

2009 2010 2011 2012

Academic Year

Writing Assessment

4.41 4.27

4.14 4.12

3.00

3.50

4.00

4.50

5.00

2009 2010 2011 2012

Academic Year

Oral Assessment

10





Direct and Indirect

Measures*


Findings


Goal 2: Students will possess effective computational skills

Learning Outcome 2: Students will accurately use formulas and functions to perform business applications.

Measure 1: Internship Employer and Student Forms

Measure 1: Of the employers who rated students’ computational skills, 50 out of 64 (78 percent) rated students in the highest level. Of the students who rated their own computational skills, 44 out of 61 (72 percent) rated themselves in the highest level.

Measure 1: To continue to have employers rate student’s computa-tional skills. To continue to have students rate their computa-tional skills.

0

5

10

15

20

Acc

ura

tely

use

s fo

rmu

las

and

fu

nct

ion

s…

Mak

es o

nly

afe

w e

rro

rs w

ith

form

ula

s an

d…

Mak

esn

um

ero

us

erro

rs w

ith

…

NA

Em

plo

ye

rs

Computational Skills by Employers

2009

2010

2011

2012

02468

1012141618

Acc

ura

tely

use

sfo

rmu

las

and

fun

ctio

ns

to…

Mak

es o

nly

a f

ewer

rors

wit

hfo

rmu

las

and

…

Mak

es n

um

ero

us

erro

rs w

ith

form

ula

s an

d… NA

Stu

de

nts

Computational Skills by Students

2009

2010

2011

2012

11





Direct and Indirect

Measures*


Findings


Goal 3: Students will possess effective knowledge and skills

Learning Outcome 3: Students will work beyond the level of educational background.


Measure 1:

Measure 1: Of the employers who rated students’ knowledge and skills, 69 out of 69 (100 percent) rated students at the works beyond or on level comparable to educational background levels. Of the students who rated their own knowledge and skills, 67 out of 67 (100 percent) rated themselves at the works beyond or on level comparable to educational background levels.

Measure 1: To continue to have employers rate student’s knowledge and skills. To continue to have students rate their knowledge and skills.

0

5

10

15

20

Wo

rks

bey

on

dle

vel

of

edu

cati

on

alb

ack

gro

un

d

Wo

rks

on

lev

elco

mp

arab

le t

oed

uca

tio

nal

bac

kgr

ou

nd

Wo

rks

on

lev

elb

elo

wed

uca

tio

nal

bac

kgr

ou

nd

Em

plo

ye

rs

Knowledge and Skills by Employers

2009

2010

2011

2012

02468

101214

Wo

rks

bey

on

dle

vel

of

edu

cati

on

alb

ack

gro

un

d

Wo

rks

on

lev

elco

mp

arab

le t

oed

uca

tio

nal

bac

kgr

ou

nd

Wo

rks

on

lev

elb

elo

wed

uca

tio

nal

bac

kgr

ou

nd

Stu

de

nts

Knowledge and Skills by Students

2009

2010

2011

2012

12





Direct and Indirect

Measures*


Findings


Goal 4: Students will possess effective decision-making and problem-solving skills

Learning Outcome 4: Students will identify most problems and implement solutions.


Measure 1:

Measure 1: Of the employers who rated students’ problem-solving skills, 57 out of 69 (83 percent) rated students in the highest level. Of the students who rated their own problem-solving skills, 54 out of 67 (81 percent) rated themselves in the highest level.

Measure 1: To continue to have employers rate student’s problem-solving skills. To continue to have students rate their problem-solving skills.

0

5

10

15

20

Iden

tifi

esm

ost

pro

ble

ms

and

imp

lem

ents

…

Iden

tifi

esso

me

pro

ble

ms

and

imp

lem

ents

…

Un

able

to

iden

tify

pro

ble

ms

and

imp

lem

ent…

Em

plo

ye

rs

Problem Solving by Employers

2009

2010

2011

2012

0

5

10

15

20

Iden

tifi

es m

ost

pro

ble

ms

and

imp

lem

ents

solu

tio

ns

Iden

tifi

es s

om

ep

rob

lem

s an

dim

ple

men

tsso

me

solu

tio

ns

Un

able

to

iden

tify

pro

ble

ms

and

imp

lem

ent…

Stu

de

nts

Problem Solving by Students

2009

2010

2011

2012

13





Direct and Indirect

Measures*


Findings



Measure 1:

Measure 2: Of the employers who rated students’ decision-making skills, 57 out of 69 (83 percent) rated students in the highest level. Of the students who rated their own decision-making skills, 60 out of 67 (90 percent) rated themselves in the highest level.

Measure 2: To continue to have employers rate student’s decision-making skills. To continue to have students rate their decision-making skills.

0

5

10

15

20

25

Mak

esap

pro

pri

ate

dec

isio

ns…

Mak

esap

pro

pri

ate

dec

isio

ns…

Un

able

to

mak

eap

pro

pri

ate…

NA

Em

plo

ye

rs

Decision Making by Employers

2009

2010

2011

2012

05

10152025

Mak

esap

pro

pri

ate

dec

isio

ns…

Mak

esap

pro

pri

ate

dec

isio

ns…

Un

able

to

mak

eap

pro

pri

ate

dec

isio

ns N

A

Stu

de

nts

Decision Making by Students

2009

2010

2011

2012

14





Direct and Indirect

Measures*


Findings


Goal 5: Students will possess knowledge of ethics and professionalism

Learning Outcome 5: Students will demonstrate excellent work ethics.


Measure 1: Measure 1: Of the employers who rated students’ ethics, 60 out of 69 (87percent) rated students in the highest level. Of the students who rated their own ethics, 61 out of 67 (91 percent) rated

Measure 1: To continue to have employers rate student’s work ethics. To continue to have

15





Direct and Indirect

Measures*


Findings


themselves in the highest level.

students rate their work ethics.

*At least one measure per objective must be a direct measure; indirect measures may be used to supplement direct measure(s)

05

10152025

Dem

on

stra

tes

exce

llen

t w

ork

eth

ics

Dem

on

stra

tes

goo

d w

ork

eth

ics

Dem

on

stra

tes

po

or

wo

rket

hic

s

Em

plo

ye

rs

Ethics by Employers

2009

2010

2011

2012

05

10152025

Dem

on

stra

tes

exce

llen

tw

ork

eth

ics

Dem

on

stra

tes

goo

d w

ork

eth

ics

Dem

on

stra

tes

po

or

wo

rket

hic

s

Stu

de

nts

Ethics by Students

2009

2010

2011

2012

16

c. Evidence of Learning: General Education Courses: (See CIL General Education Report)

G. Summary of Artifact Collection Procedure

Artifact Learning Outcome Measured When/How Collected? Where Stored? NTM 2415 No. 3—Possess Knowledge and

Skills of Technology Once a year Canvas—stored in

individual class Canvas page

NTM 2435 No. 3—Possess Knowledge and Skills of Technology

Once a year Canvas—stored in individual class Canvas page


Once a year Canvas—stored in individual class Canvas page


Once a year Canvas—stored in individual class Canvas Page and with Department Assessment Records

We changed where these artifacts are stored from our department drive to the NTM 2415 Canvas class where students have access to them.

17

Report of progress on ‘non-learning-outcome recommendations’ from previous 5 year program review (optional): Date of Program Review: March 2, 2012 Recommendation Progress Description Recommendation 1 Faculty

Hire a faculty member immediately. 2013: Formed a Search Committee and are in the process of writing the job description. Hire faculty member. Done

Recommendation 2 Advisor

Hire department advisor. 2014: Pursue discussion with Dean to determine possibility and timeframe.

Recommendation 3 Equipment Donations

Obtain equipment donations from Advisory Committee rather than faculty purchasing equipment with personal funds.

2013: Determine strategies for obtaining funds from Advisory Committee, industry, grants, and graduates for needed equipment. Received Grant 2014: Purchase needed equipment from funds obtained. Grant provided in 2013.

Recommendation 4 Department Vision

Create a department vision that includes a Master’s Degree in NTM.

2013: Include as agenda item for department faculty meetings. Done

Recommendation 5 ABET Accreditation

Continue to research and pursue ABET accreditation.

2014: Start process by preparing paperwork for ABET accreditation.

Recommendation 6 Lab Aides

Hire student lab aides for NMT labs. 2015: Determine what funds are available and how many lab aides could be hired. Search for students qualified to work in NMT labs. Fiscal study needs to be conducted to determine feasibility. Grant provided in 2013. 2016: Implement funds and hire lab aides. Hired in 2014.

Recommendation 7 Visibility

Increase visibility of our program with industry, university leaders, students, and potential students.

2013: Discuss action plan at department meetings and advisory committee meetings to meet goal. Determined to create Wall of Fame, EH

18

318 Recommendation 8 Advisory Committee

Increase membership of Advisory Committee.

2013: Discuss with advisory committee how best to represent the new NMT course content. Continual Discussion with input.

Please respond to the following questions.

1) Reflecting on this year’s assessment(s), how does the evidence of student learning impact your faculty’s confidence in the program being reviewed; how does that analysis change when compared with previous assessment evidence? To answer this question, compare evidence from prior years to the evidence from the current year. Discuss trends of evidence that increases your confidence in the strengths of the program. Also discuss trends of concern (e.g. students struggling to achieve particular student outcomes). The NTM Department faculty members are confident in students’ computational skills, knowledge and skills, problem-solving skills, decision making skills, and ethics as evidenced by their percentage scores ranging between 72 percent and 100 percent at the highest or next highest level on all these measures.

2) With whom did you share the results of the year’s assessment efforts? On the web, telecom advisory committee

The results of the year’s assessment efforts are shared on the web through this assessment report, with the NTM faculty during department meetings, and with the Network Management Technology Advisory Committee.

3) Based on your program’s assessment findings, what subsequent action will your program take?

The most important item this year is to obtain an additional faculty member to teach in the Network Management Technology major. Done