wcet leadership summit - smartermeasure & noncognitive readiness data

DR. MAC ADKINSPRESIDENT, SMARTERSERVICES

Noncognitive Readiness Data

Feel Your Pain

I understand your need not just to collect data, but to make meaning in actionable ways from the data. Ph.D. in Higher Education Leadership, Auburn

University, 1995 Served as a Dean at two regionally accredited

universities Served as a data analyst in and institutional

effectiveness office for three years

Touching the Elephant

http://www.google.com/url?sa=i&rct=j&q=&source=images&cd=&cad=rja&docid=We4Kcy2l2palrM&tbnid=IVFApbzSXB6AOM:&ved=0CAUQjRw&url=http%3A%2F%2Ftheblindelephant.com%2Fthe_blind_elephant_fable.html&ei=t7CwUZ-SCsG90gGvl4HICg&bvm=bv.47534661,d.dmQ&psig=AFQjCNFTSsNZq65VolwoTQDrkk6l6DqCbw&ust=1370620459516822

http://images.google.com/TeacherPage'%26StaffID%3D'22661

Types of Data Used To Predict Learner Success

WHATAcademic Success – GPA,

Standardized Tests

Demographic – Income level, First generation

college student

Learning Pathways – Blackboard

Engagement - Starfish

WHY

SmarterMeasure Learning Readiness Indicator

Data about “WHY”

a student does something is actionable.

SmarterMeasure Learning Readiness Indicator

A 124-item online skills test and attributes inventory that measures a student’s level of readiness for studying online

Used by over 500 Colleges and UniversitiesSince 2002 taken by over 2,225,000

students

http://images.google.com/url?sa=i&rct=j&q=&source=images&cd=&cad=rja&docid=-7RwMYOnv0m2aM&tbnid=uV0KIQ2db3HQkM:&ved=0CAUQjRw&url=http%3A%2F%2Fblog.al.com%2Fspotnews%2F2010%2F06%2Funiversity_of_alabama_plans_to.html&ei=vsawUZCfPIqLywH18oGACg&bvm=bv.47534661,d.aWc&psig=AFQjCNFnD1Rq2lG8akaw7aUhsj3-O1vyNg&ust=1370626080940515

http://images.google.com/url?sa=i&rct=j&q=&source=images&cd=&cad=rja&docid=NqaM9ZZncv1fyM&tbnid=dm0vWe7qnmcouM:&ved=0CAUQjRw&url=http%3A%2F%2Fwww.lonestar.edu%2Flibrary%2Fkin_EducationCert.htm&ei=7sewUejlFoq3yQGo0IHYDA&bvm=bv.47534661,d.aWc&psig=AFQjCNGymnvtntjvVLr_nvF1xnv6xzOH1Q&ust=1370626410215144

http://images.google.com/url?sa=i&rct=j&q=&source=images&cd=&cad=rja&docid=jdpVaLNXSTgj3M&tbnid=kSqBsmISgyvwoM:&ved=0CAUQjRw&url=http%3A%2F%2Fwww.waei.org%2Ffw111%2F&ei=q8iwUYOLNYnIyAHprIDwBg&bvm=bv.47534661,d.aWc&psig=AFQjCNFS5DOHY0yNs5Fxsiq8ONpYmw3Qng&ust=1370626599913928

http://images.google.com/url?sa=i&rct=j&q=&source=images&cd=&cad=rja&docid=l0R7qS-MPwn9aM&tbnid=1pYaTG4_JC2HyM:&ved=0CAUQjRw&url=http%3A%2F%2Fwww.tonymorelli.com%2Ftonymorelli%2Fwork.html&ei=6MiwUazGM4beyAHku4G4DA&bvm=bv.47534661,d.aWc&psig=AFQjCNG80h9bOccfF5e2IKyFp0cB3xvvxA&ust=1370626659895317

What Does The Assessment Measure?

INTERNAL

INDIVIDUAL ATTRIBUTES

MotivationProcrastination

Time ManagementHelp Seeking

Locus of Control

LEARNING STYLES

Visual / VerbalSocial / SolitaryPhysical / Aural

Logical

EXTERNAL

LIFE FACTORS

Availability of TimeDedicated Place

ReasonSupport from Family

SKILLS

TECHNICAL

Technology UsageLife ApplicationTech Vocabulary

Computing Access

TYPING

RateAccuracy

ON-SCREEN READING

RateRecall

WCET Survey, May 2013

Noncognitive Data is a Valid Indicator of Student Success & Retention

Middlesex Community CollegeBefore SmarterMeasure™ was

implemented, 6% to 13% more students failed online courses than students taking on-ground courses. After the implementation, the gaps were narrowed: 1.3% to 5.8% more online students failed than on-ground students.

Academic Success Rates

Skills Resources Time0

10

20

30

40

50

60

70

High ScoreLow Score

Less than 10% of students with low scores experienced academic success.

Statistically Significant Relationships Academic

AchievementEngagement Retention

Individual Attributes

X X X

Technical Knowledge

X X X

Learning Styles

X X

Life Factors X X

Technical Competency

X

Using Discriminant Analysis a composite using the scales of Life Factors, Individual Attributes, Technical Competency, Technical Knowledge, and Learning Styles was created to predict levels of engagement and satisfaction with 93% classification accuracy.

http://images.google.com/url?sa=i&rct=j&q=accuracy&source=images&cd=&cad=rja&docid=YJCqrHntU1nhiM&tbnid=TeVHNoJDg-4KfM:&ved=0CAUQjRw&url=http%3A%2F%2Fwww.opsrules.com%2Fsupply-chain-optimization-blog%2Fbid%2F282916%2FWhy-You-Shouldn-t-Waste-Effort-Improving-Forecast-Accuracy&ei=ttOwUfWXJOnXygG84YDADQ&bvm=bv.47534661,d.aWc&psig=AFQjCNGqHwZO-_TyjaAyPpz9Ww4XM-7KSQ&ust=1370629401980316

Statistically significant correlations were found between SmarterMeasure scores and student satisfaction, retention and academic success.

Satisfaction

RetentionSuccess

Technical

Motivation

Time

http://en.wikipedia.org/wiki/File:Argosy_logo.png

Readiness and Satisfaction

Comparison to Compass Scores

X indicates statistically significant correlation between scores

http://images.google.com/url?sa=i&rct=j&q=north+central+michigan+college+logo&source=images&cd=&cad=rja&docid=WCvklGIxOv3lcM&tbnid=FffHd0MAcx_jnM:&ved=0CAUQjRw&url=http%3A%2F%2Farticles.petoskeynews.com%2F2012-03-21%2Froom-and-board_31222383&ei=5tGwUfzSEafJyQHFoYCABA&bvm=bv.47534661,d.aWc&psig=AFQjCNGoXJJDPMu4WCytF5uqW1eVSijZFw&ust=1370628961028239

For More Info

SmarterServices.com or SmarterMeasure.com(877) 499-SMARTER

[email protected]

mailto:[email protected]

wcet leadership summit - smartermeasure & noncognitive readiness data

Education

online students

r t e r s e r v

data analyst

noncognitive data

types of data

n sp r e s i d e n t

student satisfaction

retention andacademic