darren cambridge eli webinar july 11, 2011
DESCRIPTION
Seeking Evidence for Impact: Lessons from the Inter/National Coalition for Electronic Portfolio Research. Darren Cambridge ELI Webinar July 11, 2011. Overview. Conceptual foundations of approach Structure of the Inter/National Coalition for Electronic Portfolio Research - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/1.jpg)
Seeking Evidence for Impact: Lessons from the Inter/National Coalition for
Electronic Portfolio Research
Darren Cambridge ELI WebinarJuly 11, 2011
![Page 2: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/2.jpg)
Overview
• Conceptual foundations of approach • Structure of the Inter/National Coalition for
Electronic Portfolio Research • Findings about three types of learning• Contributing factors
![Page 3: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/3.jpg)
The Importance of Having ProblemsIn scholarship and research, having a "problem" is at the heart of the investigative process; it is the compound of the generative questions around which all creative and productive activity revolves. But in one’s teaching, a "problem" is something you don’t want to have, and if you have one, you probably want to fix it. … How might we make the problematization of teaching a matter of regular communal discourse? How might we think of teaching practice, and the evidence of student learning, as problems to be investigated, analyzed, represented, and debated? —Randy Bass
![Page 4: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/4.jpg)
Three curricula
Kathleen Yancey, Reflection in the Writing Classroom
![Page 5: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/5.jpg)
Research into the Swamp
“There is a high, hard ground where practitioners can make effective use of [traditional] research-based theory and techniques, and there is a swampy lowland where situations are confusing ‘messes’ incapable of technical solution. The difficulty is that the problems of the high ground, however great their technical interest, are often relatively unimportant to clients or to the larger society, while in the swamp are the problems of greatest human concern.” Donald Schön
![Page 6: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/6.jpg)
Transactional Research• Practitioners generate research questions• Goal is to influence practice• Methodologies chosen based on knowledge
about learning, not exclusively current disciplinarily-accepted methodologies
• Agency for answering the questions resides in multiple constituents– practitioner researchers– learners– peer practitioner researchers
• Diversity provides robustness
![Page 7: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/7.jpg)
DISCUSSION
![Page 8: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/8.jpg)
COALITION STRUCTURE
![Page 9: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/9.jpg)
Inter/National Coalition for Electronic Portfolio Research
Coalition Exigency
• Rapid growth in use of electronic portfolios in the United States (and beyond)
• Wide diversity of models • Considerable potential to impact learning and
engagement• Evidence uneven and unintegrated
![Page 10: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/10.jpg)
Inter/National Coalition for Electronic Portfolio Research
Coalition Structure
• Inter/National Coalition for Electronic Portfolio Research established in 2003
• Led by Barbara Cambridge (AAHE/NCTE), Kathleen Yancey (Clemson/FSU), Darren Cambridge (EDUCAUSE/GMU/AIR)
• Six cohorts of about ten campuses that work together for three years
![Page 11: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/11.jpg)
Cohort 1 Alverno CollegeBowling Green State UniversityIndiana University-Purdue University Indianapolis (IUPUI)LaGuardia Community CollegeNorthern Illinois UniversityPortland State UniversityStanford UniversityUniversity of WashingtonVirginia Tech University
Cohort 2 Clemson UniversityKapi’olani Community CollegeGeorge Mason UniversityThomas CollegeThe Ohio State UniversityUniversity of GeorgiaUniversity of IllinoisUniversity of Nebraska OmahaWashington State University Arizona State University
Cohort 3California State UniversitiesFlorida State UniversityFramingham State UniversityGeorge Mason UniversityMinnesota State Colleges and UniversitiesPenn State UniversityUniversity of San DiegoSeton Hall UniversitySheffield Hallam UniversityUniversity of WaterlooUniversity ofWolverhampton
![Page 12: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/12.jpg)
Cohort 4University of BradfordUniversity of CumbriaUniversity of GroningenLondon Metropolitan UniversityUniversity of Manchester Medical SchoolUniversity of MichiganUniversity of NorthumbriaUniversity of NottinghamUniversity of WolverhamptonQueen Margaret University College
Cohort 5 Kapi’olani Community CollegeLouisiana State UniversityUniversity of AkronUniversity of CincinnatiUniversity of DenverUniversity of North Carolina WilmingtonUniversity of OregonVirginia State UniversityVirginia Tech
Cohort 6Bowling Green State UniversityCurtin University of Technology (Australia)Goshen CollegeIndiana University Purdue University IndianapolisLamar UniversityNortheastern UniversityPortland State UniversityUniversity of GeorgiaUniversity of MichiganUniversity of MississippiVirginia Military InstituteWestminster College
![Page 13: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/13.jpg)
Inter/National Coalition for Electronic Portfolio Research
Coalition Activities
• Individual questions and collaborative themes• Two meetings a year• Blog, newsletter, and Ning• Interaction between cohorts • Consultations with Coalition leadership• Coordinated dissemination
![Page 14: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/14.jpg)
Inter/National Coalition for Electronic Portfolio Research
Intra-campus Practices
• Diverse team • Space for forming• Narrow but open question• Balance between intellectual and pragmatic
purposes
![Page 15: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/15.jpg)
Inter/National Coalition for Electronic Portfolio Research
Diverse Team
• Both people who have research in their job title and those who don’t
• Reflective of the range of people involved in portfolio practice on the campus– Include administrators– Include students
• Portland State: Administrators, students, faculty from multiple disciplines
![Page 16: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/16.jpg)
Inter/National Coalition for Electronic Portfolio Research
Space for Forming
• Need sufficient time and space to develop– Shared expectations– Shared conceptual framework– Personal relationships within team
![Page 17: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/17.jpg)
Inter/National Coalition for Electronic Portfolio Research
Narrow but Open Question
• Well-focused research question• Openness to the data taking you elsewhere
![Page 18: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/18.jpg)
Inter/National Coalition for Electronic Portfolio Research
Intellectual and Pragmatic Purposes
• Clear sense of audiences and purposes of research • Practitioner research doesn’t have to be just
evaluation • Balance between what you need to justify your work
and what’s intellectually meaningful• Practice as inquiry
![Page 19: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/19.jpg)
Inter/National Coalition for Electronic Portfolio Research
Diversity and Balance
• Who might you ask to join your team you’ve not previously considered?
• What aspects of your project can you expand or emphasize to balance intellectual and pragmatic value?
![Page 20: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/20.jpg)
Inter/National Coalition for Electronic Portfolio Research
Inter-campus Practices
• Senior administrative support • Triangulation rather than replication • Collaborative exploration of
methodologies• Regular conversations with neutral
experts • Multiple genres of reporting out
![Page 21: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/21.jpg)
Inter/National Coalition for Electronic Portfolio Research
Senior Administrative Support
• Three-year commitment of travel funding from institutional budget– Confirmation of commitment to portfolio practice
• Regular updates and notes of thanks• Ideally, member of the team
![Page 22: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/22.jpg)
Inter/National Coalition for Electronic Portfolio Research
Triangulation
• Triangulation rather than replication • Enough structure to focus and connect, but not
restrict– No one strict definition of “research” – Shared themes but not a mandated research question
• Cohorts One and Two: Catalog and taxonomy of reflective artifacts
• Critical friends
![Page 23: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/23.jpg)
Inter/National Coalition for Electronic Portfolio Research
Collaborative Exploration of Methodology
• Guided exploration of research methodologies and methods
• Both a way to plan the project and a way to develop shared understanding of research
• Breaking out of received notions of research through conversations– Across disciplines– Across campuses
![Page 24: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/24.jpg)
October 10, 2006 Inter/National Coalition for Electronic Portfolio Research
Conversations with Experts
• Quarterly conference calls with a Coalition leader
• Periodic occasions for reviewing and asking questions
• The questioning is probably more important than the advice
![Page 25: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/25.jpg)
October 10, 2006 Inter/National Coalition for Electronic Portfolio Research
Multiple Reporting Genres
• Variety of forms of reporting– One-pagers– Blue Skies questions– Thick descriptions of artifacts– Presentations of evidence – Chats
• Helps to stimulate creativity and accommodate multiple styles
![Page 26: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/26.jpg)
DISCUSSION
![Page 27: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/27.jpg)
EMERGENT RESULTS
![Page 28: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/28.jpg)
Dimensions of Learning
• Reflective Learning• Integrative Learning • Learning to Establish Identity
![Page 29: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/29.jpg)
Reflective learning
• Eportfolios can document reflective ability• Eportfolios reveal a positive correlation
between the quality of reflection and evidence
• The relationship between reflection and evidence is more complex than previously considered
![Page 30: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/30.jpg)
![Page 31: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/31.jpg)
Semester Reflection Evidence
Fall 2004 2.76 3.31
Spring 2005 3.11 3.12
Fall 2005 3.55 3.70
Spring 2006 3.17 3.23
Northern Illinois University
![Page 32: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/32.jpg)
![Page 33: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/33.jpg)
Transactional Benefits
• Alverno– Beginning with faculty conceptual frameworks
leads to better integration into practice• Northern Illinois
– Teaching assistants as researchers leads to stronger investment in reflective practice
• George Mason– Student affairs educators as researchers leads to
expansion of knowledge in both domains
![Page 34: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/34.jpg)
Integrative Learning
Eportfolio use correlates with increased student engagement.
![Page 35: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/35.jpg)
LaGuardia CCSSE Results
How much has your coursework emphasized synthesizing & organizing ideas, information, or experiences in new ways? 1 = Very Little, 2 = Some, 3= Quite a Bit, 4 = Very Much
![Page 36: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/36.jpg)
LaGuardia ePortfolio & Retention
![Page 37: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/37.jpg)
Kapi’olani Community College
![Page 38: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/38.jpg)
Transactional Benefits
• LaGuardia– Multiple methodologies for different
constituencies– Students as co-inquirers essential to interpretation
• Kapi’olani– Impact and interpretation situated in cultural
context
![Page 39: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/39.jpg)
Learning to Establish Identity
Eportfolios can help engender strong and complex professional identities.
![Page 40: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/40.jpg)
University of Waterloo“Again, this is also describing the relationship between employees in audit engagements as well as school assignments. The only difference I noticed is that in school assignments, everyone has around the same educational and technical background, whereas during an audit engagement, there are different levels of employees (senior managers, managers, senior staff and junior staff) grouped together to provide a larger variety of mindset during the engagement. I believe that creating a group with different levels of employees is the most efficient method because junior staff will be learning from more experienced staff during the engagement, senior staff will be able to concentrate on the more difficult aspects of the audit while junior staff could complete the small, simple and tedious tasks, and finally the audit team can get a larger variety of ideas due to the diverse members.”
![Page 41: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/41.jpg)
Clemson University
![Page 42: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/42.jpg)
Virginia Tech
![Page 43: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/43.jpg)
Transactional Benefits
• Cross-disciplinary collaboration yields expanded methods for understanding profession
• Students serve as co-inquirers through reflective representation of their experience
![Page 44: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/44.jpg)
Contributing factors
• Matrix thinking • Ownership and expressive range • Structure and support
![Page 45: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/45.jpg)
Matrix Thinking
![Page 46: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/46.jpg)
![Page 47: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/47.jpg)
Freedom and Structure
• Expressive range– Visual design – Linking– Use of multiple media
• Structure and support– Levels of structure appropriate to student ability – Language tailored to discipline and profession– Peer mentoring and mentors as peers
![Page 48: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/48.jpg)
Electronic Portfolios 2.0: Emergent Research on Implementation and Impact
• Collection of 24 chapters detailing research from the first three years of the Coalition
• Published by Stylus in 2009
• More about the Coalition at ncepr.org
![Page 49: Darren Cambridge ELI Webinar July 11, 2011](https://reader036.vdocument.in/reader036/viewer/2022062519/56815009550346895dbde119/html5/thumbnails/49.jpg)
Eportfolios for Lifelong Learning and Assessment
• Connects the work of the Coalition to a broader theoretical framework and wider range of research
• Published by Jossey-Bass in 2010
• More about my work at ncepr.org/darren