Transcript
Page 1: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

NYU Academic Assessment Council February 29, 2016

Page 2: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle• 4/11 Council meeting

– Full report & results from AY2015 cycle– Guest presentation: New Accreditation Standards for Middle States

• Mini-grant applications due Friday 3/4 • Upcoming assessment capacity building opportunities

– 4.18-4.20 Assessment Network of New York Annual Conference: University at Buffalo Amherhest, NY

– 5.20 Middle States Workshop “Creating and Selecting Assessment Tools” Philadelphia, PA

Page 3: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Learning PortfoliosExecutive Sponsor: Matthew SantiroccoPresenter: Yulee Jun, Dan Rabinowitz

Feb 2016

3

Page 4: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

A collection of artifacts that provides direct evidence of individual’s learning, mastery, or accomplishments over time.

What is a Learning Portfolio?

Collecting

PresentingExplaining

2

Page 5: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

NYU Environmental Scan (2013)

Number of Faculty and Administrators Consulted: 64

3

Page 6: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Findings: Interests and Needs

Credentialing and AccreditationHighly specialized discipline-specific accreditation requirements

Advisement and MonitoringTool to assist advisors and students in understanding progress toward degree completion

Assessment, Collection, and PresentationBroadest of all categories

4

Page 7: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Learning Portfolio Timeline

5

2013 2014 2015 2016

Environmental Scan

TaskstreamPilot Launch

Platform Selection

Project TeamWorking Group

Project Sponsorship

Google Pilot Launch

Page 8: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Taskstream Offering

6

Student Created Portfolio Directed Response Folio (DRF)

Open structure Structured template

Flexible and customizable templates Learning assessment

Student-selected work Pre-determined assignments

Open-ended Prescribed

Page 10: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: EdD Theatre

8

School / Program Steinhardt – Doctor of Education in Educational Theatre

Program Description

Practice-based doctorate with an emphasis on arts-based research methods

Learning Portfolio Needs

Collect and store various work products in a structured format

Page 11: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: EdD Theatre

9

Defined structure for assignment submission

Page 12: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: EdD Theatre

10

Page 13: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: American Language Institute

11

School / Program

NYU Shanghai –American Language Institute (ALI)

Program Description English proficiency program

Learning Portfolio

Needs

Collect and store various work products in a structured format

Assess student learning

Page 14: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: American Language Institute

12

Competency-based artifact collection

Page 15: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: Computer Science

13

School / Program

Tandon School of Engineering –Undergraduate Computer Science

Program Description

Senior year group project for Computer Science majors

Learning Portfolio

Needs

Collect and store various work products in a structured format

Assess student learning

Page 16: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: Computer Science

14

Defined structure for assignment submission

Page 17: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: Computer Science

15

Evaluation Criteria

Page 18: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: Computer Science

16

4 3 2 1

Oral Presentation

Speaks clearly, using proper grammar. Appears motivated. Shows evidence of good preparation for the presentation. Uses appropriate visual aids effectively. Answers questions thoroughly.

Effectively communicates the major points. Acceptable use of visual aids. Is prepared and answers questions satisfactorily.

Student conveys the information, but not very effectively. Preparation is below average. Answers to questions leave something to be desired.

Student is not well prepared and the research results are not clearly communicated. Student has trouble answering questions.

Page 19: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: Computer Science

17

Performance-based report Sample: Single Semester Program Report

Page 20: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Pilot Use Case: Computer Science

18

Performance-based report Sample: Multiple Semester Program Report CS 401 – Fall 2015

CS 401 – Fall 2016

CS 401 – Spr 2017

Page 21: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Student Experience Survey

19

Fall Semester student experience survey

RatingStrongly Agree = 7

Agree = 6

Somewhat Agree = 5

Neutral = 4

Somewhat Disagree = 3

Disagree = 2

Strongly Disagree = 1

Page 22: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

How to Participate in Learning Portfolios?

20

Reach out to the Learning Portfolios Service [email protected]

Iterative Learning Portfolio build

Requirements gathering

Training and support

Learning Portfolios survey

Page 23: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Learning Portfolios Survey

21

• What would you like to accomplish by using Taskstream?

• To help students market their skills for future employers, graduate programs?

• To assess the mastery of learning objectives at the course or program level? Will it

replace existing practices that your department already has in place?

• To complement your accreditation efforts?

• Does your program have articulated student learning outcomes?

• Are the learning outcomes mapped to particular courses and / or assignments?

• Are you currently using rubrics to assess student work?

Page 24: NYU Academic Assessment Council · 2020-06-03 · Updates & Announcements • Compliance & Reporting Updates – AY2015 cycle • 4/11 Council meeting – Full report & results from

Learning Portfolio Deployment Timeline

22

Ed.D Theatre Tandon ALI

Start to Deploy Duration 11 weeks 11 weeks 6 weeks

Key Considerations:• Availability of faculty and / or program administrators • Availability of Instructional Designers and / or departmental staff


Top Related