Download - EdTech 505 Evaluation Report
Evaluation Report Boise State University Multicultural Student Services
Tunnel of Oppression 2012
Report submitted by
Evangeline Dennler-Beaver
Faculty Member, University Foundation Program
Assistant to the Multicultural Student Services Coordinator
Assistant to the Student Diversity and Inclusion Director
Graduate Student, Master of Educational Technology Program
Boise State University
Report submitted to
VP Student Affairs, Boise State University
1
Table of Contents
Summary-------------------------------------------------------------------------------------------------
2
Description of the Program Evaluated---------------------------------------------------------------
Program Objectives--------------------------------------------------------------------------------
Program Components------------------------------------------------------------------------------
3
3
3
Evaluation Method--------------------------------------------------------------------------------------
Participants------------------------------------------------------------------------------------------
Procedures-------------------------------------------------------------------------------------------
Data Sources----------------------------------------------------------------------------------------
4
4
4
4
Results---------------------------------------------------------------------------------------------------
Objectives and Activities------------------------------------------------------------------------
Participants' Feedback---------------------------------------------------------------------------
Goal Attainment----------------------------------------------------------------------------------
5
6
7
8
Discussion----------------------------------------------------------------------------------------------
8
Recommendations-------------------------------------------------------------------------------------
9
Project Cost---------------------------------------------------------------------------------------------
10
Appendices----------------------------------------------------------------------------------------------
Appendix A: Campus Update invites participants to register for the
Tunnel of Oppression----------------------------------------------------------------------------
Appendix B: Facebook; MSS invited friends to register for Tunnel---------------------
Appendix C: Participant Information and Informed Consent------------------------------
Appendix C: Pre-Survey to be completed before walking through the Tunnel--------
Appendix D: Post-Survey to be completed after debriefing-------------------------------
11
12
13
14
15
16
2
Summary
Boise State University’s Multicultural Student Services, along with co-sponsorship by the
student clubs Boise Filipino American Relations Club and Diversity Association (BARCADA)
and Gamma Beta Phi, presented the eighth Tunnel of Oppression (TOP) on campus this fall.
TOP is an interactive program to highlight oppression and its negative effects.
The university community and the public had the opportunity to learn about issues of oppression
that effect different groups both locally and globally.
The program also highlighted how easily oppression can be perpetuated. For example, when a
racist statement is made and bystanders do nothing and remain silent, oppression continues. In
remaining silent, bystanders contribute to the continuation of aggression, that although small, can
build up and cause damage to people affected by historically-oppressed groups, such as women,
People of Color and the LGBTQ (Lesbian, Gay, Bisexual, Transgender, Queer and Questioning)
community.
Student committees chose the topics: racism, size-ism, transgender issues, global education
issues, and war on women. Each committee developed their own script, props, and scene under
the guidance of the Tunnel Director.
This evaluation is to determine whether the objectives were met, to determine the number of
people registered to go through the Tunnel, and if it was necessary to present the program in two
parts, such as fall and spring. A pre-survey was given to people before they enter the Tunnel and
a post-survey (same as the pre-survey) was given following the debriefing. To determine if
learning outcomes were achieved, participants filled out the questionnaires.
The purpose of this evaluation is to determine different variables and different views of the
campus community and the public, people who may experience oppression or allies who may
recognize situations but cannot articulate. In addition, gathering data is to assess and interpret
outcomes on the impact of the program.
Another purpose of this evaluation is to determine the participants’ challenges, connecting what
they have seen in the Tunnel with personal experiences. Evaluating this program is to examine
the impact of the program on the participants. Therefore, evaluation is essential in any program
or project to justify a request for funding and the importance of the planning process.
This final evaluation aims to describe and understand how oppression moves participants into
action. It contains a description of the program, evaluation procedures, a presentation of
evaluation results, and discussion of the program and its results for future use by others who
want to raise awareness of oppression. This report provides formative and summative data to
help determine the future of TOP and how it presents different types of oppression in our society
and around the world.
The evaluation of the Tunnel of Oppression program was successful in analyzing the data
collected and providing insight into the participants’ knowledge—the evaluation is an important
tool to build and expand this interactive program. The survey and evaluation of the Tunnel of
Oppression revealed results of making a positive impact in people’s lives.
3
Description of the Program Evaluated
The Tunnel of Oppression aims to define and understand what oppression is and recognize what
forms it takes to urging participants into action by humanizing the issues of traditionally and
historically-oppressed groups, providing participants an opportunity to distinguish between the
voices of the underrepresented and the voices of the dominant culture. At the end of the
program, participants will be able to:
Program Objectives
1. Determine the number of people that registered to go through the Tunnel.
2. Determine different variables of the campus community and the outside community and
to seek a stream-of-consciousness raising on campus.
3. Determine different views of how participants may experience oppression and how allies
may understand but cannot articulate their views
Program Components
The program included registration to walk through five different theaters: racism, size-ism,
transgender issues, global education, and the war on women. Participants arrived at least 15
minutes early to check in and sign a consent form. The purpose of the pre-survey was to
determine how much knowledge and understanding participants had about oppression, and if
they had the ability to formulate constructive, ethical responses. After the Tunnel experience,
participants attended a debriefing, then a post-survey (same as the pre-survey) was given to
measure if their understanding of oppression had increased.
The program was presented in 9 different sessions in 30-minute blocks, including debriefing.
The debriefing was conducted by faculty and five graduate students in the counseling program,
and two of the debriefers were professional counselors.
4
Evaluation Method
Participants
The participants in the program were students, staff/faculty, and community members who
answered pre-survey and post-survey questions, collected data, and who provided feedback for
the improvement of the evaluation process. The school news Update was sent out to invite
students, staff/faculty, and community members to register for a walk-through of the Tunnel.
TOP invitations were also posted on Facebook, inviting participants to register for a walk-
through.
Procedures
The program evaluation was conducted on Nov. 8-10, 2012, looking for goals attained and the
impact of the theater topics on the success of the program. The participants filled out a
questionnaire with answers for strongly agree, moderately agree, neutral, disagree, and strongly
disagree in a check box scale to find out if the learning outcomes were achieved. The post-survey
was completed after debriefing.
Data Sources
Copies of the questionnaires can be found in the Appendices and the monitoring process
identified to meet the stated goal. Surveys given to the participants are to determine different
variables of the campus community and the outside community and to seek a stream-of-
consciousness raising on campus.
The survey also provided information on how participants may experience oppression, and how
allies may understand oppression but cannot articulate their thoughts. The questionnaire was also
used to assess continued personal growth and identity development as well as to promote
staff/faculty awareness which would then be advantageous to both students and the campus
community. Lastly, a critique of Dr. Harris, Vice President of Student Affairs, employed a
critical review of the program, providing useful feedback used to assess the costs for
recommended additional funding.
5
Results
Objectives and Activities
Below are the results of the online registration in relation to the program objectives. The
participants completed the online registration to reserve a spot in blocks of 30 minutes.
Objective 1: Determine the number of people registers go through the Tunnel.
All the participants registered and signed the consent form (see Appendix C). There were 954
participants registered to go through the Tunnel. Results appear above, revealing that the
objective was met.
Objective 2: Determine different variables of the campus community and the outside
community to seek a stream-of-consciousness of oppression on campus.
Responses to the pre-survey/post-survey questions dealing with oppression due to racism are
shown below in Figure 1. Eighty-one percent of the participants have experienced oppression at
some time. One percent of the participants strongly agree, eight percent moderately agree, ten
percent Neutral, forty-eight percent disagree, and thirty-three percent strongly disagree that
racism is no longer a problem in today’s society. These numbers indicate that there is a vital role
for a program like Tunnel of Oppression to assist people in understanding the concepts of
struggling with racism.
According to the responses to pre-survey/post survey question six, the Boise State community is
inclusive of all people as shown below in Figure 2. One hundred percent of the participants
recognize that Boise State community is inclusive of all people. These numbers indicate growth
for Boise State being all inclusive.
6
Figure 1.
As a result, the assessment is determined that this objective was met.
Figure 2.
As a result, the assessment is determined that this objective was met.
Objective 3: Determine different views of how participants may experience oppression and
of how allies who may understand but cannot articulate.
Questionnaire responses appear below in Figure 3. Ninety-four percent of the participants
concluded that they thought they would be less frustrated if they could recognize unintentional
7
bias instead of disregarding the issues in today’s society. In this survey, several participants
recognized micro-aggression and it helped them understand the essence of cultural differences.
Figure 3.
As a result, the assessment determined that this objective was met.
Participants' Feedback
1. I learned to explore my gender socialization and how my circumstances have shaped the
way I identify as a male.
2. Power and oppression affect various dimensions of social life and are situated in history
and culture.
3. Eye opening, interesting, happy to end my ignorance, I wish I was more exposed.
4. What an impact experience, all of the staff and actors for Tunnel are changing our world.
5. As a white male, a sense of control via guilt is implemented on me because of these acts.
6. Tough experience, very worthwhile, wonderful students who participated in acting, great
messages.
7. Amazingly, it was disturbing to see everything and hear other peoples' tales afterwards.
8. Great production, very eye-opening and powerful.
9. The Tunnel really makes you aware of things that you can say “lightheartedly” that really
hurt others.
8
Goal Attainment
Overall results: after reviewing all records and examining the activities, the evaluation concludes
that the Tunnel of Oppression program successfully attained all thereof the program objectives.
Discussion
The purpose of the evaluation was to determine how well the TOP fulfills the program
objectives. It was determined that the Tunnel has the potential of offering more options for Boise
State students than is currently available. This evaluation shows that there was a significantly
positive impact in people understanding from experiencing this interactive theater. The findings
of this evaluation have also lead to the continuation of the program.
Objective 1: Determine the number of people register to go through the Tunnel. The data provided by the participants’ registration and there were 954 participants registered go
through the Tunnel. The report reflects a general awareness that shows a high number of people
registered. As a result of these assessments, it is determined that the objective was met.
Objective 2: Determine different variables of the campus community and the outside
community to seek a stream of consciousness raising to campus.
A pre-survey/post-survey participants' responses indicated that power and oppression affects
various dimensions of social life and situated in history and culture. The definition of oppression
and what is formed it takes a little time to process everything. After the debriefing, the
participants were required further discuss Tunnel of Oppression. As a result of these
assessments, it is determined that the objective was met.
Objective 3: Determine different views that participants may experience oppression or
allies that may understand and cannot articulate.
Feedback carried out by the participants and Dr. Harris, Vice President of Student Affairs,
showed that this program was viable to continue for spring 2013. Participants felt that the Tunnel
provided training that raises awareness. The Tunnel also highlights how to dismantle systematic
oppression and help participants identify unconscious bias that creates a more inclusive
environment.
According to the data, the opinions expressed in this interactive program are considered artistic
and political expressions in the best tradition of the participants' first amendment rights.
Participants gain knowledge that allows them to take ownership of their learning. The program
helps participants recognize unintentional biases and participants exposed to the Tunnel play a
significant role in the future for addressing local, national and global issues of oppression.
In conclusion, the analysis result determined that the program objective was met. The evaluation
of the Tunnel of Oppression was successful in analyzing the data collected and providing insight
into participants’ thoughts and feelings. Results are what the program staff expected. However,
there are recommendations that will help the Multicultural Student Services expand their
resources for all students at Boise State University.
9
Recommendations
It is essential that the Tunnel of Oppression at Boise State University receive funding to continue
in spring 2013. The operation of the program needs additional resources for future production
because it requires many weeks of planning, training and implementing.
The Tunnel of Oppression is an excellent opportunity for all people to learn about oppression
and how to deal with it appropriately, including prevention. The program brings to light the
campus climate and modern forms of oppression. After reviewing the post-survey data, proposals
for the spring Tunnel 2013 will define expectations and guidelines for scenes, utilize the
University Foundation program faculty, continue the post-discussion group, and the timeline to
promote the registration two months in advance.
Conclusion
The evaluation of the Tunnel of Oppression program was successful in analyzing the data
collected and providing insight into the participants’ knowledge—the evaluation is an important
tool to build and expand this interactive program. The survey and evaluation of the Tunnel of
Oppression revealed results of making a positive impact in people’s lives.
10
Project Cost
Beaver Consulting Evaluation Solutions
Services
5803 W. Poplar Dr.
Boise, ID 83704
Phone 208-283-5146 Fax 208-258-3073
INVOICE
INVOICE #[100]
DATE: JANUARY 6, 2013
TO:
Ro Parker, MSS Coordinator
Multicultural Student Services
1910 University Dr.
Boise, ID 83725
208-426-5950
FOR:
Evaluating the Tunnel of Oppression
Make all checks payable to Beaver Consulting Evaluation Solution Services
Total due in 15 days. Overdue accounts subject to a service charge of 1% per month.
DESCRIPTION HOURS/DAYS RATE AMOUNT
Evaluator’s services: 15 days $500.00/day $7,500.00
Creating survey; Data Analysis;
Writing Report
Supplies/Materials:
Printing Services
Office Supplies
$1,000.00
$1,500.00
TOTAL $10,000.00
Thank you for your business!
The evaluator cost of the evaluation is for services rendered. The cost includes reviewing the Tunnel of
Oppression program, creating data collection (pre-survey/post survey questions), data analysis, and
preparation of the final evaluation report. The total time spent is calculated at 15 days at the rate of
$500 per day. Supplies/materials cover printing services and office supplies. To contain expenses,
BCESS will disseminate copies of the final report electronically and mail a hard copy.
11
Appendix A: Campus Update invites participants to register for a walk-through of the
Tunnel of Oppression.
STUDENT NEWS
Boise State University Multicultural Student Services Presents Annual “Tunnel of Oppression”
The Tunnel of Oppression will return to Boise State University for its eighth year at 1pm Nov. 8
and 10am on Nov 9 and 10 in the Student Union Simplot Ballroom.
The Tunnel is a visual, theatrical and interactive production that helps raise consciousness about
various forms of oppression. Visitors pass through a series of dramatic vignettes and learn about
the many forms of discrimination. This year's theme is "Are you free when others are
oppressed?"
After each presentation, participants will be able to discuss the program’s content in groups
staffed by student leaders, administrators and counselors. Multicultural Student Services presents
the Tunnel to promote a campuswide commitment to challenging oppression and to help
recognize people and organizations actively committed to social justice. Social justice
organizations will be on hand to discuss ways to get involved with the community.
Registration is available for individuals and groups at mss.boisestate.edu. For more information
or to volunteer, call (208) 426-5950.
12
Appendix B: Facebook; MSS invited friends to register for Tunnel
13
Appendix C: Participant Information and Informed Consent: To be signed before walk-
through Tunnel.
The Tunnel of Oppression is designed to give participants a very direct and emotional learning experience
around issues of diversity, cultural differences, oppression, and discrimination. This experience may be
upsetting and might leave you with strong feelings of sadness, anger, fear, or other intense emotions.
Most who participate in this program find it beneficial in the long run and are able to manage their
emotions. However, some participants may experience strong negative reactions that may feel
unmanageable.
If at any time you need to exit the Tunnel, please let your guide know and we will make the
necessary arrangements.
If you have a history of direct experience with oppression, violence, or discrimination, this program may
cause you to feel as though you are reliving those experiences, which can be uncomfortable.
Participation in this program is not required. If a faculty member has sent you to the Tunnel, she or
he should have told you this experience is optional. If you are receiving course credit for participation,
you should have been given options of other activities or projects that will earn you the same credit. If
this is the case, please notify the program staff of the course name/number and the name of your
professor, and we will make the necessary arrangements for you to be allowed to participate in an
alternative activity.
You may be asked to go through part of the Tunnel impaired with a disability. If you do not want this,
please let your guide know. You may also be exposed to explicit or graphic language. This is to
authentically recreate the oppression that many marginalized groups face and is solely for the purpose of
raising awareness. You should at no time feel you have to respond to any actors engaging you.
There will be a debriefing room available with staff to help you talk about your reactions and feelings
after you have experienced the Tunnel. However, if you are concerned that you will be strongly,
negatively impacted by participation, please leave before the program gets underway. There will be
no negative judgments of you by faculty or staff leading the program. If you decide to stay, please know
that you will be given a chance to debrief with staff. Please turn off your cell phone!
If at any time after the event you need to discuss your reactions with someone, Boise State students may
contact the staff at Counseling Services at 426-1601, or visit the office located in Taylor Hall, Room
B103. Non-students may call 211 and ask for a counselor referral or maybe referred by on-site counselors.
I have read the information above and agree to participate in this activity.
_____________________________ ___________________________
Printed Name Signature
________________________________________
Signature of Parent (If participant is under 18.)
To improve the Tunnel of Oppression experience in the future, and to better understand how it
may have impacted participants, please provide your email address in the space below. We will
contact you by email within the next two weeks with a link for you to fill out a confidential survey.
Please print clearly.
EMAIL:______________________________________________________________________________
14
Appendix C: Pre-Survey to be completed before walking through the Tunnel.
1. What is your gender identification?_______________
2. What is your age?_______________
3. What is your racial identification? ________________
4. What is your relationship with Boise State?
Student Staff/Faculty Community
Please indicate whether you agree with the following questions, if you strongly agree you should circle 5. If you
agree moderately, you should circle number 4, if you neither agree nor disagree, you should circle number 3.
5. Racism is no longer a problem in today’s society.
Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree
5 4 3 2 1
6. Boise State community is inclusive of all people.
Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree
5 4 3 2 1
7. Women’s bodies are more likely to be controlled by society than men’s.
Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree
5 4 3 2 1
8. I am aware of how my actions impact others who are not like me.
Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree
5 4 3 2 1
9. Generally, I consider myself more a citizen of the world than a citizen of a country.
Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree
5 4 3 2 1
15
Appendix D: Post-Survey to be completed after the debriefing.
1. Racism is no longer a problem in today’s society.
Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree
5 4 3 2 1
2. Boise State community is inclusive of all people.
Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree
5 4 3 2 1
3. Women’s bodies are more likely to be controlled by society than men’s.
Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree
5 4 3 2 1
4. I am aware of how my actions impact others who are not like me.
Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree
5 4 3 2 1
5. Generally, I consider myself more a citizen of the world than a citizen of a country.
Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree
5 4 3 2 1
6. Comments: