college of computing & informatics educational initiatives for undergraduate programs aaat...
TRANSCRIPT
![Page 1: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/1.jpg)
College of Computing & Informatics Educational
Initiatives for Undergraduate Programs
AAAT MeetingSeptember 11, 2014
Audrey Rorrer
![Page 2: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/2.jpg)
Overview
• Context: Challenges and Solutions
• Assessment Process
• Examples and Preliminary Results
• Lessons Learned
• Future Directions
![Page 3: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/3.jpg)
3
Pipeline
• Concerns:• Limited discipline
exposure in High School• Image of computing• Low diversity• <20% nationally
• Focus:• Social relevance and
interdisciplinary campaign
• Center for Education Innovation
Retention
• Concerns:• Entry level course DFWs• Climate: peer and
faculty approachability
• UNIFIED DEGREE
• Focus:• Computing Professionals
courses (Prospect for Success)
• Teaching Initiatives: engagement, pathways, course splits
Graduation
• Concerns:• Time to graduation• Transfer student credits
• Focus:• Degree maps• Prospect for Success for
transfer students• The T Shaped
Professional
CCI Challenges & SolutionsC
halle
ng
eSolu
tion
![Page 4: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/4.jpg)
Key Educational Initiatives
1212 Split/4 credits
Flipped Classrooms
Pathways Engagement: CS Professionals
![Page 5: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/5.jpg)
CCI Assessment Feedback Loop
• Check & Recommend
• Review & Act
• Assess & Analyze
• Implement
Program Modificatio
ns
Data Collection:
SLOs, Benchmarks, Surveys,
Focus Groups
Department Review
Committees
Department & Faculty Meetings;
Dean
![Page 6: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/6.jpg)
Overall Assessment Measures & Cycle
Semester
• Fall & Spring Descriptive Data• Counts of enrollment, graduation, exits by program; levels,
transfer status, credit hours; incoming FTFTF* student traits (gpa, pgi, etc.)
Annual
• Benchmark Data• Retention and graduation rates (4,5,6 yr) of FTFTF* by program• Student Learning Outcomes by program
Ongoing
• Education Initiatives: 1212 Split + 4 credits; Flipped Courses, Pathways, Engagement• Overall changes in Descriptive and Benchmark Data• DFWs/As/BCs in initiative courses, student surveys (CCI + Student
Affairs)
*FTFTF = first time full time freshmen
![Page 7: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/7.jpg)
Educational Initiatives
![Page 8: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/8.jpg)
Educational Initiatives Targeted Data
Education Initiatives
Measures Method
•1212 Split/4 credit
•Flipped Classroom (ITIS 1212 & 2300)
- Count and % of DFWs, As, B/Cs- Performance in ITCS 1213- Student Learning Outcomes- Comparative study
- Changes in course outcomes (pre-baseline vs post- implementation)
- Retention & Graduation
•Pathways - Course load averages by level, transfer status- Graduation rates at 4,5,6 years
- Changes over time (repeated measures)
- Retention & Graduation
•Engagement
(ITCS 1600, 2600)
- Count of internships & REUs; change over time
- Survey (Academic/career intentions, attitudes)
- Retention for FTFTF- Graduation rates at 4,5,6 years- Prospect for Success Student
Learning Outcomes
- In course surveys (pre/post)- Pre-Advising Survey
(academic year 2012-13 baseline)
- Senior survey (EASE- longitudinal)
- Retention & Graduation
![Page 9: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/9.jpg)
Preliminary Indicators
• Currently in 2nd fall term of implementation
• Working with IR to investigate course outcomes in consecutive courses
Fall 2011
Engagement: Prospect for Success
Fall 2013
1212 Split• By Dept.• By Calculus• 4 credits
Flipped Courses
Underway
Pathways• Graduation rate
trends• Credit hours • Advising
![Page 10: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/10.jpg)
Educational Initiatives
Computing Professionals
![Page 11: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/11.jpg)
Engagement Courses
• ITCS 1600 Computing Professionals• ITCS 2600 Computing Professionals II• Weekly large group seminar series• Weekly small group peer-led activities• Required out-of-class participation
• The T-Shaped Professional
![Page 12: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/12.jpg)
Engagement Study of 1600• Hypothesis: Engagement will increase
student sense of belonging, self-efficacy, coping skills, professional identity
• Study Design: Mixed- Methods• Pre/post survey [likert type scales,
constructs]• Focus groups and interviews to
corroborate survey findingsFall 2011
Spring 2012
Fall 2012
Spring 2013
Fall 2013
Fall 2014
Prospect for
Success
Formative
![Page 13: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/13.jpg)
Focus Groups & Interviews
• Course helped students make friends
• Helps students understand value of obtaining discipline related experiences
• Course activities help student learn about campus support
• Fall Terms 2011, 2012; Spring 2012, 2013 [total N=35]
![Page 14: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/14.jpg)
Engagement Survey Results• Each Term• Spring 2013: Climate was significantly higher at post
(U=89.5, p=.037)
• Overall Positive Descriptive Outcomes [Spring 2012-Spring 2013]
Additional Items Pre PostAre you interested in an undergraduate research opportunity? 52% 58%
Are you interested in an internship or co-op? 82% 87%
Construct Pre Mean Rank
Post Mean Rank
Climate 19.3 28.55
![Page 15: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/15.jpg)
Educational Initiatives
Flipped Courses
![Page 16: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/16.jpg)
Flipped Courses in SIS
![Page 17: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/17.jpg)
Flipped Classrooms Study
Post-Survey; 7 point Likert scale and 3 Open-Ended items
![Page 18: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/18.jpg)
Flipped Classroom Responses
Themes from Open Ended Comments:
Students Liked Interactivity/Hands-on Learning:“I liked the fact that it was more hands-on than other classes.”
“Being able to work with people is the highlight of this course.”
“I liked how the lab actually helped me learn in the class and all of the videos were helpful.”
A few negative sentiments:“Time spent outside of the classroom watching videos made me feel like the class was online.”
![Page 19: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/19.jpg)
Lessons Learned and Future Directions
Lessons Learned
• Mixed-methods complete the picture
• Survey restraint• Leverage existing
resources
• Widespread marketing
Future Directions
• Strategic Planning
• Unified Degree
• Learning Analytics
![Page 20: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/20.jpg)
Appendices
![Page 21: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/21.jpg)
Engagement Survey Constructs and Sample Items
Computing Self-Efficacy
• I can complete the programming requirements for a computing/IT major
Help-Seeking/Coping Skills
• When I do poorly on an exam, I try to come up with a strategy about what to do
Climate
• Degree of interaction with faculty and students
• I can relate to the people around me in my classes
Professional Identity
• I feel that I "fit" in the field of computing/IT
• I know the type of skills I need to be a successful computing/IT student in college and in my future career
![Page 22: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/22.jpg)
Engagement Statistical Analysis
• Mann-Whitney Test for Each Semester• Small sample sizes in post responses, non-parametric approach was used.
• Limitation• Small number of post survey responses
• Self-report, sample bias
• Unknown confounds
![Page 23: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/23.jpg)
Fall 2008 Fall 2009 Fall 2010 Fall 2011 Fall 2012 Fall 20130
200
400
600
800
1000
1200
1400
1600
1800
959
11091181
1317
1393
1579
CCI Fall Enrollment by Degree Program
IT-PhDCIS-PhDBiG-PhDIT-MSHI-PSMCS-MSBiG-MSSIS-UGCS-UGTotal EnrollmentCertificates
2,039Fall 2014
![Page 24: College of Computing & Informatics Educational Initiatives for Undergraduate Programs AAAT Meeting September 11, 2014 Audrey Rorrer](https://reader034.vdocument.in/reader034/viewer/2022051401/56649f005503460f94c1599d/html5/thumbnails/24.jpg)
'2007-08 2008-09 2009-10 2010-11 2011-12 2012-13
6237 43
61 7392
31
3944
6262
736370
66
57
10163
3135
37
32
32 39
115
19
12
70
5
85
6
2
2 4921
198186
214
234
291298
Degrees Awarded by Program
UG CS UG SIS MS BiG MS CS MS ITPhD BiG PhD CIS PhD IT Total Degrees