administration & scoring instructions 3ci

22
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved Cross-Cultural Competence Inventory Administration & Scoring Instructions Date of Submission: 4 August 2010 Purchase Order #: SEA877 Line Item: 010 Prepared for: RED-INC 48015-1 Pine Hill Run Road Lexington Park, MD 20653 Prepared by: Carol A. Thornson Karol G. Ross Cognitive Performance Group 3662 Avalon Park E. Blvd., Suite 205 Orlando, FL 32828 Office (407) 282 - 4433 Fax (407) 384 – 8822 [email protected]

Upload: never-what

Post on 22-Mar-2016

225 views

Category:

Documents


0 download

DESCRIPTION

Cross-Cultural Competence (3C) has been researched in civilian domains for many years and several validated scales were developed to assess how well civilians (e.g., expatriate workers, students abroad, etc.) might perform in other cultures, or how quickly they will adapt to a new culture and feel at home. Because such research may not be directly applicable to military populations, the 3CI was developed specifically to measure the dimensions of 3C that are important and relevant in achieving military missions in other cultures.

TRANSCRIPT

Page 1: Administration & Scoring Instructions 3CI

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

Cross-Cultural Competence Inventory Administration & Scoring Instructions

Date of Submission: 4 August 2010

Purchase Order #: SEA877 Line Item: 010 Prepared for: RED-INC 48015-1 Pine Hill Run Road Lexington Park, MD 20653 Prepared by: Carol A. Thornson Karol G. Ross Cognitive Performance Group 3662 Avalon Park E. Blvd., Suite 205 Orlando, FL 32828

Office (407) 282 - 4433 Fax (407) 384 – 8822 [email protected]

08 Fall

Page 2: Administration & Scoring Instructions 3CI

ii

Table of Contents

Description of the Cross-Cultural Competence Inventory (3CI)...................................... 1

Background ..................................................................................................................... 1

3CI Subscale Dimensions .............................................................................................. 1

Administration Instructions ............................................................................................... 4

Online Administration..................................................................................................... 4

In-Person Administration ............................................................................................... 4

Scoring Instructions ........................................................................................................... 5

Suggested Feedback on Cultural Adaptability ................................................................. 6

Suggested Feedback on Engagement .............................................................................. 7

Suggested Feedback on Mission Focus ........................................................................... 8

Suggested Feedback on the 3CI Composite Score ........................................................ 10

Appendix A ........................................................................................................................ 11

3CI for In-person Administration ................................................................................. 11

Appendix B ........................................................................................................................ 19

Explanation of Research .............................................................................................. 19

Page 3: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

1

Description of the Cross-Cultural Competence Inventory (3CI)

The Cross-Cultural Competence Inventory (3CI) is a self-report measure that was designed for the military in order to predict how an individual or a unit is likely to perform in cross-cultural encounters. This will enable the Services to:

Better assess the readiness of our forces

Target training to those skills that help achieve missions in the field

Assess the effectiveness of cultural training

Design more authentic cultural training exercises

Guide the future development of cultural training efforts

Background

Cross-Cultural Competence (3C) has been researched in civilian domains for many years and

several validated scales were developed to assess how well civilians (e.g., expatriate workers,

students abroad, etc.) might perform in other cultures, or how quickly they will adapt to a new

culture and feel at home. Because such research may not be directly applicable to military

populations, the 3CI was developed specifically to measure the dimensions of 3C that are

important and relevant in achieving military missions in other cultures.

3CI Subscale Dimensions

Following validation of this instruent, the dimensions that the 3CI measures include: (1) Cultural

Adaptability; (2) Engagement; (3) Mission-Focus; and (6) Determination.

Cultural Adaptability Subscale

This subscale assesses the tendency to enjoy, relate to, and feel comfortable in other cultures and

with people from those cultures. An example item from this subscale is: “When dealing with people

of a different ethnicity or culture, understanding their viewpoint is a top priority for me.”

Those scoring high on this subscale are likely to be more adaptable in cross-cultural interactions,

especially those requiring diplomacy, an open mind, and the ability to relate to those from other

cultures. They enjoy exploring other cultures and will quickly learn as much as they can about

those cultures. Those scoring low on this subscale likely do not enjoy exploring other cultures or

Page 4: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

2

interacting with those from other cultures. They may also be more close-minded and ethnocentric

in their orientation to other cultures and to people with dissimilar backgrounds from their own.

Engagement Subscale

This subscale assesses the tendency to seek out and enjoy interpersonal relationships and to

engage others in a positive and non-egotistical manner. An example item from this subscale is:

“Even after I've made up my mind about something, I am always eager to consider a different

opinion.”

Those scoring high on this dimension are likely to be socially skilled, as well as optimistic, cheerful,

and able to control their emotions during interactions. They would tend to make friends quickly

within new groups and cultures. Those scoring low on this subscale would likely not enjoy social

interactions with others and tend to remain isolated rather than venturing out to mingle with the

locals.

Mission-Focused Subscale

This subscale assesses the tendency to play by the rules, plan, and use logic to solve problems.

This subscale isn’t culturally based, but may be important in a military context, where it is critical to

maintain structure and discipline. An example item from this subscale is: “I think that having clear

rules and order at work is essential for success.”

Those scoring high on this subscale would likely be high in conscientiousness, enjoy regularity and

routine, and tend to be good “team players” who are respected by leaders and peers. Those

scoring low on this subscale would likely lack discipline and maturity.

Determination Subscale

This scale assesses the tendency to remain task-focused and able to tune out distracting thoughts.

This subscale is also not culturally based but may be important for a military officer or leader. An

example item from this subscale is: “After an interruption, I don't have any problem resuming my

concentrated style of working.” It should be noted that two of the items are “reversed,” so that lower

scores indicate a higher level of the attribute. An example of a reversed item is: “It's often difficult

for me to suppress thoughts that interfere with what I need to do.”

Those scoring high on this subscale are most likely determined problem-solvers, able to arrive at solutions

quickly, while remaining confident in their ability to do so. Although this is especially important in a military

context, it must be kept in mind that being high on this subscale alone may not indicate someone who is

able to solve cross-cultural problems, per se. The entire picture must be taken into account and the total

3CI score considered. Someone scoring low on this subscale, but high on the first two scales, on the other

Page 5: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

3

hand, might do well in exploring other cultures and interacting with those from other cultures in a civilian

setting, or on holiday, but lacking Determination and Mission Focus, may not do so well in a military setting.

Page 6: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

4

Administration Instructions

As outlined above, the 3CI is a 43-item instrument to measure the four dimensions of 3C. A six-point Likert scale is used throughout the inventory, with respondents indicating the extent to which they (1) “Strongly Disagree” to (6): “Strongly Agree” with each statement. Five items to screen for those participants who are engaging in impression management or social desirability bias are added to this scale, bringing the total number of items to 48. The 3CI can be administered in person as a paper-and-pencil survey (see Appendix A) or at a secure site online with an optional demographics form inquiring as to age, rank, gender, and deployment history.

Online Administration

If administration is online, a brief Explanation of Research & Informed Consent is provided for you

and data will be sent to you upon request as an Excel spreadsheet. The URL that will direct

respondents to the Explanation & Informed Consent, followed by the demographics and 3CI is:

https://www.surveymonkey.com/s/3CI_Survey_Link

In-Person Administration

If administration is in person, copies of the 3CI can be printed out from Appendix A. An Explanation

of Research is provided in Appendix B. This can be added to your Informed Consent or amended

and/or expressed verbally to respondents at the in-person data collection, should you choose to do

so.

Page 7: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

5

Scoring Instructions

STEP 1: Sum the Social Desirability items (6, 12, 21, 29, 37)

STEP 2: Remove the participant’s data if this score is greater than 15.

STEP 3: Reverse code items 15 and 42 (such that 1 = 6, 2 = 5, and so on)

STEP 4: Create Subscale Scores for each of the four dimensions of 3C by computing the Mean of the items for each subscale:

Cultural Adaptability Subscale, 18 items:

4, 8, 10, 14, 16, 18, 20, 22, 25, 28, 30, 32, 34, 36, 38, 44, 45, 48.

Engagement Subscale, 11 items:

1, 5, 11, 19, 23, 26, 31, 40, 42, 43, 46.

Mission Focus Subscale, 7 items:

2, 7, 13, 17, 24, 35, 47.

Determination Subscale, 7 items:

3, 9, 15, 27, 33, 39, 42.

STEP 5: Compute the 3CI Composite Score by computing the Mean of the four subscale scores.

Page 8: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

6

Suggested Feedback on Cultural Adaptability

IF the Respondent’s score is less than 4.0

THEN Feedback =

You scored lower than average on Cultural Adaptability.

This means that you probably do not enjoy travelling to new places and exploring

other cultures as much as someone who scores high on this dimension. It may be

that you do not have as many positive experiences meeting new people from

various ethnic and cultural backgrounds.

Therefore, you may need to work harder on trying to see the positive aspects of

other cultures and of customs that are different from your own. This is a good skill to

develop as it will enable you to better understand other people’s perspectives and

goals, thereby helping you to reach your own goals.

IF the Respondent’s score is between 4.0 through 5.0

THEN Feedback =

You scored in the average range on Cultural Adaptability.

This means that you somewhat enjoy travelling to new places and different cultures.

You are mostly open to interacting with people from ethnic and cultural

backgrounds that are different from your own, though you may not go out of your

way to meet them.

Therefore, you may need to work harder on trying to see the positive aspects of

other cultures and of customs that are different from your own. This is a good skill to

develop as it will enable you to better understand other people’s perspectives and

goals, thereby helping you to reach your own goals.

IF the Respondent’s score is greater than 5.0

THEN Feedback =

You scored higher than average on Cultural Adaptability.

This means that you are open-minded and greatly enjoy exploring and learning

about other cultures. You also enjoy interacting with people from many different

backgrounds and ethnicities and learning about their unique perspectives.

This is an important skill for you to continue to cultivate as it can assist you in

establishing important networks of associations with a variety of individuals.

Page 9: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

7

Suggested Feedback on Engagement

IF the Respondent’s score is less than 3.75

THEN Feedback =

You scored lower than average on Engagement.

This means that you probably do not enjoy a great deal of social interaction with

others but you do enjoy spending time alone. You are probably more of a quiet, low-

key, and deliberate person who does not seek counsel from others when making

decisions or forming your own opinion about something.

Although you may not naturally be a sociable person, you should try to engage with

others more than you do. Learning how to cultivate valuable relationships is an

important interpersonal skill to develop which can assist you in reaching your goals.

IF the Respondent’s score is between 3.75 through 4.5

THEN Feedback =

You scored in the average range on Engagement.

This means that you enjoy being with others at times, but also enjoy being alone.

You don’t have a great deal of trouble making new friends, but it might take you

some time to warm up to other people.

You should continue to make efforts getting to know others because learning how to

cultivate valuable relationships is an important interpersonal skill to develop, and

can assist you in reaching your goals.

IF the Respondent’s score is greater than 4.5

THEN Feedback =

You scored higher than average on Engagement.

You are most likely a socially skilled and friendly person who enjoys being with

other people. You also tend to be optimistic and cheerful in your encounters with

others, able make friends easily regardless of the particular social group or culture.

Cultivating valuable relationships is an important interpersonal skill that you

possess which will continue to assist you in reaching your goals

Page 10: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

8

Suggested Feedback on Mission Focus

IF the Respondent’s score is less than 4.0

THEN Feedback =

You scored lower than average on Mission Focus.

This means that you most likely prefer being spontaneous rather than planning. You

may be somewhat of a non-conformist who does not enjoy following the rules. You

may become frustrated and lose your temper when confronted by stressful

situations.

Therefore, you may need to work harder on maintaining self-discipline, remaining

calm during stressful situations, and following the rules. These are important skills

to develop because they will assist you in working well with others, solving

problems, and advancing in your career.

IF the Respondent’s score is between 4.0 through 5.0

THEN Feedback =

You scored in the average range on Mission Focus.

This means that you’re able to follow the necessary guidelines in accomplishing

your goals, although you may lack self-discipline from time to time. You usually

maintain your composure, although you might lose your temper or get frustrated

when stress is very high.

You should continue to address those areas where you lack self-discipline or lose

your temper. Doing so will enable you to work better with others, solve problems

effectively, and reach your full career potential.

IF the Respondent’s score is greater than 5.0

THEN Feedback =

You scored higher than average on Mission Focus.

This means that you tend to act dutifully and responsibly. You’re someone who

employs logic in making decisions and doesn’t mind following the rules. You

probably prefer planned over spontaneous behavior and enjoy regularity and

routine. You are also high in self-discipline and do not let stress interfere with

accomplishing your job.

This is an important skill to possess and should continue to assist you in reaching

your goals and furthering your career.

Page 11: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

9

Suggested Feedback on Determination

IF the Respondent’s score is less than 3.75

THEN Feedback =

You scored lower than average on Determination.

This means that you may have some difficulty staying on task and tuning out

distractions. You also may need more time than others when making decisions,

especially when under stress. At times, you may lack self-confidence and feel

unsure of yourself and your decisions.

Working on your determination by trying to be more decisive and confident in your

decisions is an important skill for you to develop. Learning how to concentrate

better will also aid you in solving problems more quickly and effectively.

IF the Respondent’s score is between 3.75 through 4.5

THEN Feedback =

You scored in the average range on Determination.

This means that you are mostly able to stay on task and tune out distracting

thoughts, although this may be a problem for you at times. You sometimes need to

take your time when making decisions, especially when under stress. You are

generally confident in your decisions, but there are times you may be unsure of

yourself.

Working on your determination by trying to be more decisive and confident in your

decisions is an important skill for you to develop. Learning how to concentrate

better will also aid you in solving problems more quickly and in leading others more

effectively.

IF the Respondent’s score is greater than 4.5

THEN Feedback =

You scored higher than average on Determination.

This means that you are able to focus and stay on task and also are adept at tuning

out distracting thoughts. You are confident in most of your decisions and are able to

arrive at them more quickly than others.

This is an important skill to possess, especially as related to problem-solving and

leadership skills.

Page 12: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

10

Suggested Feedback on the 3CI Composite Score

IF the Respondent’s score is less than 4.25

THEN Feedback =

Your total score on Cross-Cultural Competence was lower than average.

This means that your ability to interact effectively with those of other cultures, in

order to achieve mission success, may be somewhat hampered.

In order to rectify this situation, and to increase the probability of our military

members achieving their cross-cultural missions successfully and safely, better

training is being developed by military and civilian researchers. By taking the time to

respond to this survey and others like it, you have provided critical information to aid

our efforts in this important goal.

IF the Respondent’s score is between 4.25 through 4.75

THEN Feedback =

Your total score on Cross-Cultural Competence is in the average range.

This means that your ability to interact effectively with those of other cultures, in

order to achieve mission success, is on par with most of the military members we

have assessed so far.

In order to increase the probability of our military members achieving their cross-

cultural missions successfully and safely, better training is being developed by

military and civilian researchers. By taking the time to respond to this survey and

others like it, you have provided critical information to aid our efforts in this

important goal.

IF the Respondent’s score is greater than 4.75

THEN Feedback =

Your total score on Cross-Cultural Competence was higher than average.

This means that your ability to interact effectively with those of other cultures, in

order to achieve mission success, is greater than most of your peers.

In order to increase the probability of our military members achieving their cross-

cultural missions successfully and safely, better training is being developed by

military and civilian researchers. By taking the time to respond to this survey and

others like it, you have provided critical information to aid our efforts in this

important goal.

Page 13: Administration & Scoring Instructions 3CI

Contract # Task 5 Report

FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved

11

Appendix A

3CI for In-person Administration

Page 14: Administration & Scoring Instructions 3CI

CROSS-CULTURAL COMPETENCE INVENTORY

BACKGROUND: The Department of Defense has identified cross-cultural competence (the

ability to interact effectively with foreign nationals) as one of the most critical determinants of

success in military missions today. By completing this survey, you are contributing to important

research toward understanding the factors associated with such skills.

INSTRUCTIONS: Please read the 48 statements below and for each statement, please indicate

your level of agreement with that statement, from strongly disagree to strongly agree.

Please remember that there are no right or wrong answers; therefore, your FIRST response is

usually your BEST response.

Thank you for taking the time to participate in this important research.

1. I enjoy presenting information to a group of friends.

Strongly Strongly

Disagree Agree

2. I think having clear rules and order at work is essential for success.

Strongly Strongly

Disagree Agree

3. After an interruption, I don't have any problem resuming my concentrated style of

working.

Strongly Strongly

Disagree Agree

4. When dealing with people of a different ethnicity or culture, understanding their

viewpoint is a top priority for me.

Strongly Strongly

Disagree Agree

5. If I see someone I know, I usually stop and talk to them.

Strongly Strongly

Disagree Agree

Page 15: Administration & Scoring Instructions 3CI

6. I've never known someone I didn't like.

Strongly Strongly

Disagree Agree

7. I try to look for a logical explanation or solution to almost every problem.

Strongly Strongly

Disagree Agree

8. A job is often successful because you understand the people you're working with well.

Strongly Strongly

Disagree Agree

9. When I go shopping, I have no trouble deciding what I want to buy.

Strongly Strongly

Disagree Agree

10. I enjoy interacting with people from different cultures.

Strongly Strongly

Disagree Agree

11. When I want to feel more positive emotions (happiness or amusement), I change what I'm

thinking about.

Strongly Strongly

Disagree Agree

12. I've never been late for an appointment.

Strongly Strongly

Disagree Agree

13. I can be more successful at my job if I understand what's important to other people.

Strongly Strongly

Disagree Agree

Page 16: Administration & Scoring Instructions 3CI

14. I'm confident I'd be able to socialize with people from different cultures.

Strongly Strongly

Disagree Agree

15. It's often difficult for me to suppress thoughts that interfere with what I need to do.

Strongly Strongly

Disagree Agree

16. I could change my verbal behavior (e.g., accent, tone) if a cross-cultural interaction

requires it.

Strongly Strongly

Disagree Agree

17. My behavior is usually an expression of my true inner feelings, attitudes, and beliefs.

Strongly Strongly

Disagree Agree

18. If I have a job to do with other people, I like to get to know them well.

Strongly Strongly

Disagree Agree

19. I often control my emotions by changing the way I think about the situation I'm in.

Strongly Strongly

Disagree Agree

20. When trying to solve a problem I foresee several long-term consequences of my actions.

Strongly Strongly

Disagree Agree

21. I believe that we shouldn't engage in leisure activities.

Strongly Strongly

Disagree Agree

Page 17: Administration & Scoring Instructions 3CI

22. When I interact with people from other cultures or ethnic backgrounds, I try to show my

appreciation of their culture.

Strongly Strongly

Disagree Agree

23. I enjoy talking in a large meeting of friends and acquaintances.

Strongly Strongly

Disagree Agree

24. When I'm faced with a stressful situation, I make myself think about it in a way that helps

me stay calm.

Strongly Strongly

Disagree Agree

25. Traveling to other cultures is something I enjoy.

Strongly Strongly

Disagree Agree

26. If my approach to a problem isn’t working with someone, I can easily change my tactics.

Strongly Strongly

Disagree Agree

27. I can make impromptu speeches on topics about which I have almost no information.

Strongly Strongly

Disagree Agree

28. It's easy for me to understand what it would feel like to be a person from a different

culture.

Strongly Strongly

Disagree Agree

Page 18: Administration & Scoring Instructions 3CI

29. I feel that there's really no such thing as an honest mistake.

Strongly Strongly

Disagree Agree

30. I am confident of my ability to communicate well with all kinds of people from all kinds

of ethnic and cultural backgrounds.

Strongly Strongly

Disagree Agree

31. Making sure everyone gets along in my team is one of my priorities.

Strongly Strongly

Disagree Agree

32. When considering most conflict situations, I can usually see how both sides could be

right.

Strongly Strongly

Disagree Agree

33. I can control my thoughts from distracting me from the task at hand.

Strongly Strongly

Disagree Agree

34. I'm sure I'd be able to handle all the stresses of adjusting to a new culture.

Strongly Strongly

Disagree Agree

35. When confronted with a problem, I can usually find several different solutions.

Strongly Strongly

Disagree Agree

36. I would enjoy visiting other countries that are unfamiliar to me.

Strongly Strongly

Disagree Agree

Page 19: Administration & Scoring Instructions 3CI

37. I've never hurt another person's feelings.

Strongly Strongly

Disagree Agree

38. I am confident I can get used to the unusual conditions of living in another culture.

Strongly Strongly

Disagree Agree

39. I would never describe myself as indecisive.

Strongly Strongly

Disagree Agree

40. When feeling stressed, I’m able to calm myself by thinking of other things.

Strongly Strongly

Disagree Agree

41. I tend to get to know my neighbors well.

Strongly Strongly

Disagree Agree

42. If I am in trouble, I find it difficult to think of something to do.

Strongly Strongly

Disagree Agree

43. Even after I've made up my mind about something, I'm usually eager to consider a

different opinion.

Strongly Strongly

Disagree Agree

44. When thinking about a problem, I consider as many different opinions on the issue as

possible.

Strongly Strongly

Disagree Agree

Page 20: Administration & Scoring Instructions 3CI

45. Our culture's ideas of right and wrong may not be right for all cultures in the world.

Strongly Strongly

Disagree Agree

46. When I want to feel less negative emotions (sadness, frustration, or anger), I change what

I'm thinking about.

Strongly Strongly

Disagree Agree

47. I'm able to work well with others to help them find better ways to do their job.

Strongly Strongly

Disagree Agree

48. People have different methods that are equally successful in solving a problem.

Strongly Strongly

Disagree Agree

Page 21: Administration & Scoring Instructions 3CI

Appendix B

Explanation of Research

Page 22: Administration & Scoring Instructions 3CI

EXPLANATION OF RESEARCH

PURPOSE OF STUDY: The current assessment tool was developed by Cognitive Performance Group in conjunction with researchers from the University of Central Florida and the Defense Equal Opportunity Management Office (DEOMI). This tool was designed to assess Warfighter readiness to work closely with people from other cultures in order to achieve military missions, as well as to support DoD policy decisions about training, education, and operations. YOUR PARTICIPATION will consist of providing demographic information as to age, rank, gender, and deployments, followed by a cultural survey. Participation in this study is voluntary. If you choose not to participate, this action will not affect your relationship with the DoD and there will be no loss of benefit to which you would otherwise be entitled.