CLOE Setup & Walk-thru

Course Learning Outcome Evaluation (CLOE)

• Purpose

• How it works

• What triggers the data to be included?

• How to configure an activity to be included?

• How to request the CLOE Data Export (via Data Hub)

• Example

Terminology

• Organizational Structure – “Org Units”• Parents/Children

• Competency Tool• Competencies• Learning Objectives• Activities

• Alignment of Learning Activities to Objectives

• Rubrics

• Achievement Threshold

Purpose

• Activity performance data

• At the learning objective alignment level of granularity

• Ex: rubric rows or quiz sections/questions

• Provide detailed data for flexible reporting needs

• For one course, multiple courses under a parent or all courses

How It Works

• Triggered by:

• Alignment of an activity to a learning objective

• With a defined achievement threshold

1. Align activities to learning objectives on the Objectives tab

2. Add an Assessment

3. Define an Achievement Threshold

Considerations

• Rubrics should be created within the course offering for rubric evaluation data to be included.

• A grade item must be attached to the assessment activity for the grade data columns to be populated.

• Competency status must be Approved for achievement data to be tracked and reported.

Considerations

• Points and custom points rubrics can be reversed in order – text only rubrics cannot

• Rubrics should be associated on the Objectives tab of the learning activity (quiz, dropbox, grade item, etc.)

• Not on the Properties tab

Considerations

• All activities associated to the learning objective need to completed before it will show on the data export.

• Learning objectives and activities should have a one to one relationship

• All students will be included in the data export whether they have been evaluated or not

Considerations - Administrators

• The config variable d2l.Tools.AdvancedDataSets.ProgramOrgUnitTypeIdmust be configured in your learning environment.

• Brightspace Analytics – Administrator Guide

• Available in the Brightspace Community

• Setup and permissions for Data Hub

• Setup and permissions for CLOE

Data Hub - Personas

Data Hub is built for 3 key personas

Organization Brightspace Administrator

Data Analyst

Assignment Configuration

1

2

Quiz Configuration

1

2

3

Grade Configuration

1

2

Demo

Assignment Configuration

1

2

Quiz Configuration

1

2

3

Grade Configuration

1

2

How to Request – Data Hub

How to Request – Data Hub

How to Request – Data Hub

How to Request – Data Hub

What it Looks Like

Best Practice Recommendations

• Create the Competency and the Learning Objective above the course offering level. (Course Template or higher)

• Recommended one to one association between the Learning Objective and the assessment Activity.

• The Rubric cannot be shared and must be created in the course to see full details on the CLOE report.

CLOE Output Notes

When CLOE is run,

• Org Unit ID (Column B) will always represent where the parent Competency object lives (ie. If at the main Org level it will be 6606).

• Filter on Column K (Course Offering ID) or L (Course Offering Name) to drill down on a course level.

• The Activity Name is associated with the Grade Item

• No Grade Item, no Activity Name in the CLOE export.

Thank You

Additional Resources available in the Brightspace Community

http://community.brightspace.com