administration & scoring instructions 3ci
DESCRIPTION
Cross-Cultural Competence (3C) has been researched in civilian domains for many years and several validated scales were developed to assess how well civilians (e.g., expatriate workers, students abroad, etc.) might perform in other cultures, or how quickly they will adapt to a new culture and feel at home. Because such research may not be directly applicable to military populations, the 3CI was developed specifically to measure the dimensions of 3C that are important and relevant in achieving military missions in other cultures.TRANSCRIPT
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
Cross-Cultural Competence Inventory Administration & Scoring Instructions
Date of Submission: 4 August 2010
Purchase Order #: SEA877 Line Item: 010 Prepared for: RED-INC 48015-1 Pine Hill Run Road Lexington Park, MD 20653 Prepared by: Carol A. Thornson Karol G. Ross Cognitive Performance Group 3662 Avalon Park E. Blvd., Suite 205 Orlando, FL 32828
Office (407) 282 - 4433 Fax (407) 384 – 8822 [email protected]
08 Fall
ii
Table of Contents
Description of the Cross-Cultural Competence Inventory (3CI)...................................... 1
Background ..................................................................................................................... 1
3CI Subscale Dimensions .............................................................................................. 1
Administration Instructions ............................................................................................... 4
Online Administration..................................................................................................... 4
In-Person Administration ............................................................................................... 4
Scoring Instructions ........................................................................................................... 5
Suggested Feedback on Cultural Adaptability ................................................................. 6
Suggested Feedback on Engagement .............................................................................. 7
Suggested Feedback on Mission Focus ........................................................................... 8
Suggested Feedback on the 3CI Composite Score ........................................................ 10
Appendix A ........................................................................................................................ 11
3CI for In-person Administration ................................................................................. 11
Appendix B ........................................................................................................................ 19
Explanation of Research .............................................................................................. 19
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
1
Description of the Cross-Cultural Competence Inventory (3CI)
The Cross-Cultural Competence Inventory (3CI) is a self-report measure that was designed for the military in order to predict how an individual or a unit is likely to perform in cross-cultural encounters. This will enable the Services to:
Better assess the readiness of our forces
Target training to those skills that help achieve missions in the field
Assess the effectiveness of cultural training
Design more authentic cultural training exercises
Guide the future development of cultural training efforts
Background
Cross-Cultural Competence (3C) has been researched in civilian domains for many years and
several validated scales were developed to assess how well civilians (e.g., expatriate workers,
students abroad, etc.) might perform in other cultures, or how quickly they will adapt to a new
culture and feel at home. Because such research may not be directly applicable to military
populations, the 3CI was developed specifically to measure the dimensions of 3C that are
important and relevant in achieving military missions in other cultures.
3CI Subscale Dimensions
Following validation of this instruent, the dimensions that the 3CI measures include: (1) Cultural
Adaptability; (2) Engagement; (3) Mission-Focus; and (6) Determination.
Cultural Adaptability Subscale
This subscale assesses the tendency to enjoy, relate to, and feel comfortable in other cultures and
with people from those cultures. An example item from this subscale is: “When dealing with people
of a different ethnicity or culture, understanding their viewpoint is a top priority for me.”
Those scoring high on this subscale are likely to be more adaptable in cross-cultural interactions,
especially those requiring diplomacy, an open mind, and the ability to relate to those from other
cultures. They enjoy exploring other cultures and will quickly learn as much as they can about
those cultures. Those scoring low on this subscale likely do not enjoy exploring other cultures or
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
2
interacting with those from other cultures. They may also be more close-minded and ethnocentric
in their orientation to other cultures and to people with dissimilar backgrounds from their own.
Engagement Subscale
This subscale assesses the tendency to seek out and enjoy interpersonal relationships and to
engage others in a positive and non-egotistical manner. An example item from this subscale is:
“Even after I've made up my mind about something, I am always eager to consider a different
opinion.”
Those scoring high on this dimension are likely to be socially skilled, as well as optimistic, cheerful,
and able to control their emotions during interactions. They would tend to make friends quickly
within new groups and cultures. Those scoring low on this subscale would likely not enjoy social
interactions with others and tend to remain isolated rather than venturing out to mingle with the
locals.
Mission-Focused Subscale
This subscale assesses the tendency to play by the rules, plan, and use logic to solve problems.
This subscale isn’t culturally based, but may be important in a military context, where it is critical to
maintain structure and discipline. An example item from this subscale is: “I think that having clear
rules and order at work is essential for success.”
Those scoring high on this subscale would likely be high in conscientiousness, enjoy regularity and
routine, and tend to be good “team players” who are respected by leaders and peers. Those
scoring low on this subscale would likely lack discipline and maturity.
Determination Subscale
This scale assesses the tendency to remain task-focused and able to tune out distracting thoughts.
This subscale is also not culturally based but may be important for a military officer or leader. An
example item from this subscale is: “After an interruption, I don't have any problem resuming my
concentrated style of working.” It should be noted that two of the items are “reversed,” so that lower
scores indicate a higher level of the attribute. An example of a reversed item is: “It's often difficult
for me to suppress thoughts that interfere with what I need to do.”
Those scoring high on this subscale are most likely determined problem-solvers, able to arrive at solutions
quickly, while remaining confident in their ability to do so. Although this is especially important in a military
context, it must be kept in mind that being high on this subscale alone may not indicate someone who is
able to solve cross-cultural problems, per se. The entire picture must be taken into account and the total
3CI score considered. Someone scoring low on this subscale, but high on the first two scales, on the other
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
3
hand, might do well in exploring other cultures and interacting with those from other cultures in a civilian
setting, or on holiday, but lacking Determination and Mission Focus, may not do so well in a military setting.
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
4
Administration Instructions
As outlined above, the 3CI is a 43-item instrument to measure the four dimensions of 3C. A six-point Likert scale is used throughout the inventory, with respondents indicating the extent to which they (1) “Strongly Disagree” to (6): “Strongly Agree” with each statement. Five items to screen for those participants who are engaging in impression management or social desirability bias are added to this scale, bringing the total number of items to 48. The 3CI can be administered in person as a paper-and-pencil survey (see Appendix A) or at a secure site online with an optional demographics form inquiring as to age, rank, gender, and deployment history.
Online Administration
If administration is online, a brief Explanation of Research & Informed Consent is provided for you
and data will be sent to you upon request as an Excel spreadsheet. The URL that will direct
respondents to the Explanation & Informed Consent, followed by the demographics and 3CI is:
https://www.surveymonkey.com/s/3CI_Survey_Link
In-Person Administration
If administration is in person, copies of the 3CI can be printed out from Appendix A. An Explanation
of Research is provided in Appendix B. This can be added to your Informed Consent or amended
and/or expressed verbally to respondents at the in-person data collection, should you choose to do
so.
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
5
Scoring Instructions
STEP 1: Sum the Social Desirability items (6, 12, 21, 29, 37)
STEP 2: Remove the participant’s data if this score is greater than 15.
STEP 3: Reverse code items 15 and 42 (such that 1 = 6, 2 = 5, and so on)
STEP 4: Create Subscale Scores for each of the four dimensions of 3C by computing the Mean of the items for each subscale:
Cultural Adaptability Subscale, 18 items:
4, 8, 10, 14, 16, 18, 20, 22, 25, 28, 30, 32, 34, 36, 38, 44, 45, 48.
Engagement Subscale, 11 items:
1, 5, 11, 19, 23, 26, 31, 40, 42, 43, 46.
Mission Focus Subscale, 7 items:
2, 7, 13, 17, 24, 35, 47.
Determination Subscale, 7 items:
3, 9, 15, 27, 33, 39, 42.
STEP 5: Compute the 3CI Composite Score by computing the Mean of the four subscale scores.
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
6
Suggested Feedback on Cultural Adaptability
IF the Respondent’s score is less than 4.0
THEN Feedback =
You scored lower than average on Cultural Adaptability.
This means that you probably do not enjoy travelling to new places and exploring
other cultures as much as someone who scores high on this dimension. It may be
that you do not have as many positive experiences meeting new people from
various ethnic and cultural backgrounds.
Therefore, you may need to work harder on trying to see the positive aspects of
other cultures and of customs that are different from your own. This is a good skill to
develop as it will enable you to better understand other people’s perspectives and
goals, thereby helping you to reach your own goals.
IF the Respondent’s score is between 4.0 through 5.0
THEN Feedback =
You scored in the average range on Cultural Adaptability.
This means that you somewhat enjoy travelling to new places and different cultures.
You are mostly open to interacting with people from ethnic and cultural
backgrounds that are different from your own, though you may not go out of your
way to meet them.
Therefore, you may need to work harder on trying to see the positive aspects of
other cultures and of customs that are different from your own. This is a good skill to
develop as it will enable you to better understand other people’s perspectives and
goals, thereby helping you to reach your own goals.
IF the Respondent’s score is greater than 5.0
THEN Feedback =
You scored higher than average on Cultural Adaptability.
This means that you are open-minded and greatly enjoy exploring and learning
about other cultures. You also enjoy interacting with people from many different
backgrounds and ethnicities and learning about their unique perspectives.
This is an important skill for you to continue to cultivate as it can assist you in
establishing important networks of associations with a variety of individuals.
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
7
Suggested Feedback on Engagement
IF the Respondent’s score is less than 3.75
THEN Feedback =
You scored lower than average on Engagement.
This means that you probably do not enjoy a great deal of social interaction with
others but you do enjoy spending time alone. You are probably more of a quiet, low-
key, and deliberate person who does not seek counsel from others when making
decisions or forming your own opinion about something.
Although you may not naturally be a sociable person, you should try to engage with
others more than you do. Learning how to cultivate valuable relationships is an
important interpersonal skill to develop which can assist you in reaching your goals.
IF the Respondent’s score is between 3.75 through 4.5
THEN Feedback =
You scored in the average range on Engagement.
This means that you enjoy being with others at times, but also enjoy being alone.
You don’t have a great deal of trouble making new friends, but it might take you
some time to warm up to other people.
You should continue to make efforts getting to know others because learning how to
cultivate valuable relationships is an important interpersonal skill to develop, and
can assist you in reaching your goals.
IF the Respondent’s score is greater than 4.5
THEN Feedback =
You scored higher than average on Engagement.
You are most likely a socially skilled and friendly person who enjoys being with
other people. You also tend to be optimistic and cheerful in your encounters with
others, able make friends easily regardless of the particular social group or culture.
Cultivating valuable relationships is an important interpersonal skill that you
possess which will continue to assist you in reaching your goals
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
8
Suggested Feedback on Mission Focus
IF the Respondent’s score is less than 4.0
THEN Feedback =
You scored lower than average on Mission Focus.
This means that you most likely prefer being spontaneous rather than planning. You
may be somewhat of a non-conformist who does not enjoy following the rules. You
may become frustrated and lose your temper when confronted by stressful
situations.
Therefore, you may need to work harder on maintaining self-discipline, remaining
calm during stressful situations, and following the rules. These are important skills
to develop because they will assist you in working well with others, solving
problems, and advancing in your career.
IF the Respondent’s score is between 4.0 through 5.0
THEN Feedback =
You scored in the average range on Mission Focus.
This means that you’re able to follow the necessary guidelines in accomplishing
your goals, although you may lack self-discipline from time to time. You usually
maintain your composure, although you might lose your temper or get frustrated
when stress is very high.
You should continue to address those areas where you lack self-discipline or lose
your temper. Doing so will enable you to work better with others, solve problems
effectively, and reach your full career potential.
IF the Respondent’s score is greater than 5.0
THEN Feedback =
You scored higher than average on Mission Focus.
This means that you tend to act dutifully and responsibly. You’re someone who
employs logic in making decisions and doesn’t mind following the rules. You
probably prefer planned over spontaneous behavior and enjoy regularity and
routine. You are also high in self-discipline and do not let stress interfere with
accomplishing your job.
This is an important skill to possess and should continue to assist you in reaching
your goals and furthering your career.
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
9
Suggested Feedback on Determination
IF the Respondent’s score is less than 3.75
THEN Feedback =
You scored lower than average on Determination.
This means that you may have some difficulty staying on task and tuning out
distractions. You also may need more time than others when making decisions,
especially when under stress. At times, you may lack self-confidence and feel
unsure of yourself and your decisions.
Working on your determination by trying to be more decisive and confident in your
decisions is an important skill for you to develop. Learning how to concentrate
better will also aid you in solving problems more quickly and effectively.
IF the Respondent’s score is between 3.75 through 4.5
THEN Feedback =
You scored in the average range on Determination.
This means that you are mostly able to stay on task and tune out distracting
thoughts, although this may be a problem for you at times. You sometimes need to
take your time when making decisions, especially when under stress. You are
generally confident in your decisions, but there are times you may be unsure of
yourself.
Working on your determination by trying to be more decisive and confident in your
decisions is an important skill for you to develop. Learning how to concentrate
better will also aid you in solving problems more quickly and in leading others more
effectively.
IF the Respondent’s score is greater than 4.5
THEN Feedback =
You scored higher than average on Determination.
This means that you are able to focus and stay on task and also are adept at tuning
out distracting thoughts. You are confident in most of your decisions and are able to
arrive at them more quickly than others.
This is an important skill to possess, especially as related to problem-solving and
leadership skills.
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
10
Suggested Feedback on the 3CI Composite Score
IF the Respondent’s score is less than 4.25
THEN Feedback =
Your total score on Cross-Cultural Competence was lower than average.
This means that your ability to interact effectively with those of other cultures, in
order to achieve mission success, may be somewhat hampered.
In order to rectify this situation, and to increase the probability of our military
members achieving their cross-cultural missions successfully and safely, better
training is being developed by military and civilian researchers. By taking the time to
respond to this survey and others like it, you have provided critical information to aid
our efforts in this important goal.
IF the Respondent’s score is between 4.25 through 4.75
THEN Feedback =
Your total score on Cross-Cultural Competence is in the average range.
This means that your ability to interact effectively with those of other cultures, in
order to achieve mission success, is on par with most of the military members we
have assessed so far.
In order to increase the probability of our military members achieving their cross-
cultural missions successfully and safely, better training is being developed by
military and civilian researchers. By taking the time to respond to this survey and
others like it, you have provided critical information to aid our efforts in this
important goal.
IF the Respondent’s score is greater than 4.75
THEN Feedback =
Your total score on Cross-Cultural Competence was higher than average.
This means that your ability to interact effectively with those of other cultures, in
order to achieve mission success, is greater than most of your peers.
In order to increase the probability of our military members achieving their cross-
cultural missions successfully and safely, better training is being developed by
military and civilian researchers. By taking the time to respond to this survey and
others like it, you have provided critical information to aid our efforts in this
important goal.
Contract # Task 5 Report
FOR OFFICIAL USE ONLY © 2010 by Cognitive Performance Group All Rights Reserved
11
Appendix A
3CI for In-person Administration
CROSS-CULTURAL COMPETENCE INVENTORY
BACKGROUND: The Department of Defense has identified cross-cultural competence (the
ability to interact effectively with foreign nationals) as one of the most critical determinants of
success in military missions today. By completing this survey, you are contributing to important
research toward understanding the factors associated with such skills.
INSTRUCTIONS: Please read the 48 statements below and for each statement, please indicate
your level of agreement with that statement, from strongly disagree to strongly agree.
Please remember that there are no right or wrong answers; therefore, your FIRST response is
usually your BEST response.
Thank you for taking the time to participate in this important research.
1. I enjoy presenting information to a group of friends.
Strongly Strongly
Disagree Agree
2. I think having clear rules and order at work is essential for success.
Strongly Strongly
Disagree Agree
3. After an interruption, I don't have any problem resuming my concentrated style of
working.
Strongly Strongly
Disagree Agree
4. When dealing with people of a different ethnicity or culture, understanding their
viewpoint is a top priority for me.
Strongly Strongly
Disagree Agree
5. If I see someone I know, I usually stop and talk to them.
Strongly Strongly
Disagree Agree
6. I've never known someone I didn't like.
Strongly Strongly
Disagree Agree
7. I try to look for a logical explanation or solution to almost every problem.
Strongly Strongly
Disagree Agree
8. A job is often successful because you understand the people you're working with well.
Strongly Strongly
Disagree Agree
9. When I go shopping, I have no trouble deciding what I want to buy.
Strongly Strongly
Disagree Agree
10. I enjoy interacting with people from different cultures.
Strongly Strongly
Disagree Agree
11. When I want to feel more positive emotions (happiness or amusement), I change what I'm
thinking about.
Strongly Strongly
Disagree Agree
12. I've never been late for an appointment.
Strongly Strongly
Disagree Agree
13. I can be more successful at my job if I understand what's important to other people.
Strongly Strongly
Disagree Agree
14. I'm confident I'd be able to socialize with people from different cultures.
Strongly Strongly
Disagree Agree
15. It's often difficult for me to suppress thoughts that interfere with what I need to do.
Strongly Strongly
Disagree Agree
16. I could change my verbal behavior (e.g., accent, tone) if a cross-cultural interaction
requires it.
Strongly Strongly
Disagree Agree
17. My behavior is usually an expression of my true inner feelings, attitudes, and beliefs.
Strongly Strongly
Disagree Agree
18. If I have a job to do with other people, I like to get to know them well.
Strongly Strongly
Disagree Agree
19. I often control my emotions by changing the way I think about the situation I'm in.
Strongly Strongly
Disagree Agree
20. When trying to solve a problem I foresee several long-term consequences of my actions.
Strongly Strongly
Disagree Agree
21. I believe that we shouldn't engage in leisure activities.
Strongly Strongly
Disagree Agree
22. When I interact with people from other cultures or ethnic backgrounds, I try to show my
appreciation of their culture.
Strongly Strongly
Disagree Agree
23. I enjoy talking in a large meeting of friends and acquaintances.
Strongly Strongly
Disagree Agree
24. When I'm faced with a stressful situation, I make myself think about it in a way that helps
me stay calm.
Strongly Strongly
Disagree Agree
25. Traveling to other cultures is something I enjoy.
Strongly Strongly
Disagree Agree
26. If my approach to a problem isn’t working with someone, I can easily change my tactics.
Strongly Strongly
Disagree Agree
27. I can make impromptu speeches on topics about which I have almost no information.
Strongly Strongly
Disagree Agree
28. It's easy for me to understand what it would feel like to be a person from a different
culture.
Strongly Strongly
Disagree Agree
29. I feel that there's really no such thing as an honest mistake.
Strongly Strongly
Disagree Agree
30. I am confident of my ability to communicate well with all kinds of people from all kinds
of ethnic and cultural backgrounds.
Strongly Strongly
Disagree Agree
31. Making sure everyone gets along in my team is one of my priorities.
Strongly Strongly
Disagree Agree
32. When considering most conflict situations, I can usually see how both sides could be
right.
Strongly Strongly
Disagree Agree
33. I can control my thoughts from distracting me from the task at hand.
Strongly Strongly
Disagree Agree
34. I'm sure I'd be able to handle all the stresses of adjusting to a new culture.
Strongly Strongly
Disagree Agree
35. When confronted with a problem, I can usually find several different solutions.
Strongly Strongly
Disagree Agree
36. I would enjoy visiting other countries that are unfamiliar to me.
Strongly Strongly
Disagree Agree
37. I've never hurt another person's feelings.
Strongly Strongly
Disagree Agree
38. I am confident I can get used to the unusual conditions of living in another culture.
Strongly Strongly
Disagree Agree
39. I would never describe myself as indecisive.
Strongly Strongly
Disagree Agree
40. When feeling stressed, I’m able to calm myself by thinking of other things.
Strongly Strongly
Disagree Agree
41. I tend to get to know my neighbors well.
Strongly Strongly
Disagree Agree
42. If I am in trouble, I find it difficult to think of something to do.
Strongly Strongly
Disagree Agree
43. Even after I've made up my mind about something, I'm usually eager to consider a
different opinion.
Strongly Strongly
Disagree Agree
44. When thinking about a problem, I consider as many different opinions on the issue as
possible.
Strongly Strongly
Disagree Agree
45. Our culture's ideas of right and wrong may not be right for all cultures in the world.
Strongly Strongly
Disagree Agree
46. When I want to feel less negative emotions (sadness, frustration, or anger), I change what
I'm thinking about.
Strongly Strongly
Disagree Agree
47. I'm able to work well with others to help them find better ways to do their job.
Strongly Strongly
Disagree Agree
48. People have different methods that are equally successful in solving a problem.
Strongly Strongly
Disagree Agree
Appendix B
Explanation of Research
EXPLANATION OF RESEARCH
PURPOSE OF STUDY: The current assessment tool was developed by Cognitive Performance Group in conjunction with researchers from the University of Central Florida and the Defense Equal Opportunity Management Office (DEOMI). This tool was designed to assess Warfighter readiness to work closely with people from other cultures in order to achieve military missions, as well as to support DoD policy decisions about training, education, and operations. YOUR PARTICIPATION will consist of providing demographic information as to age, rank, gender, and deployments, followed by a cultural survey. Participation in this study is voluntary. If you choose not to participate, this action will not affect your relationship with the DoD and there will be no loss of benefit to which you would otherwise be entitled.