DL Versus On-Ground – What the Research Says – and What It Doesn’t Say

Andy BorchersIMEBSlides are at: www.kettering.edu/~aborcher

Preview

With the advent of the Internet and growth of Distance Learning (DL), some have wondered: “Before we commit ourselves to ‘the virtual

classroom’ or even the ‘virtual university’, I would like to see solid empirical research that shows that undergraduates will learn how to think critically, interact rationally and develop the cognitive and ethical perspectives that they acquire in a good residential program.” October, 1992 Research in Distance Education

Preview

My presentation today will focus on three main points that address this question: “No significant distance phenomenon”

compiled by Thomas Russell. “What’s the difference?” IHEP “What is different between DL and

traditional education?” Andy Borchers

An admonition

The subject of DL can evoke emotions for a number of reasons: Faculty tend to prefer the learning style they

learned under. They may feel threatened by change.

With DL has come a host of ‘new age’ institutions that have evoked a competitive market for higher education. The economic lives of many institutions hang in the balance.

Our point today is to ask “what does the research say”, not to argue preferences in learning styles.

“No Significant Difference”

The title of a 1999 book by Thomas Russell. Russell reports on the history of research on distance learning versus face to face instruction,

summarizing 355 studies. Available on the web. Most studies:

Focused on individual courses. Looked at outcomes such as

course grades and attitudes(such as satisfaction)

“No Significant Difference”

Major conclusion “The fact is that the findings of

comparative studies are absolutely conclusive, one can bank on them. No matter how it is produced, how it is delivered whether or not it is interactive, low tech, high tech, students learn equally well with each technology and learn as well as their on-campus face-to-face counterparts.”

A History of Studies

Early work (1920-1950) Focus on film, phonograph and correspondence

courses Major interest in American military (esp. film)

and the Midwest – Nebraska, Oklahoma, etc. Television era (1950- )

Continued work in a variety of areas – English, calculus, accounting, etc. and various locations – U.S., Canada, Latin America, Australia and Japan.

Various media – TV, radio, movies, AV Wide range of institutions – Harvard, Penn

State, Ford Foundation, public school districts, and corporate settings.

A History of Studies

Computer Age (late 1970’s to today) Numerous studies including

asynchronous and synchronous approaches via TV and computer mediated.

Comparison between “high tech” interactive approaches and “low tech” low interactive approaches.

355 Studies Later....

The same phrases appear over and over: “No significant difference” “No statistical difference” “Comparable”, “Similar” “At least as well...” “No method ... any more effective...”

Results hold for single course studies and meta analysis of multiple studies.

Parallel Site – Significant Difference

Some 37 studies have found differences: Sometimes on-line “wins” Sometimes on-ground “wins”

Two Critical Observations – “Ceteris Paribus”

Good researchers control extraneous factors. This research focuses on the effect of media in isolation.

Hence, the results could better be stated: Students learn equally well with each

technology and learn as well as their on-campus face-to-face counterparts, ceterus paribus (all other things the same).” (italics added by Andy Borchers).

But, are “all other things the same” between traditional and DL education?

Two Critical Observations

Research focus throughout these 355 studies are individual courses. Only a few focus on entire degree programs. Hence, does media have an impact on

DL versus traditional “degree programs”?

A student’s education is certainly more than one course – it is the sum of years of education.

What’s the Difference

The title of an April, 2000 study, conducted by IHEP (Institute for Higher Education Policy) Funded by American Federation of Teachers

and National Educational Association Theme – Critical evaluation of “No Significant

Difference”

What’s the Difference

Distance Education isn’t new – roots in 19th Century

There is a large collection of research on effectiveness: Seems to indicate “no significant

difference” This research base needs careful

analysis, however.

What Did They Do?

Examined 40 research studies conducted in the 1990’s on the effectiveness of DL. Mix of one-way, two-way and computer

mediated approaches Can be categorized as:

Descriptive studies Case Studies Correlational research True experimental research – preferred to

establish causal links since factors are controlled. Only a few of these studies exist.

What Did IHEP Find?

Found that studies focused on three factors: Student outcomes Student attitudes about learning Student satisfaction

Major finding – “there is a paucity of true, original research” Generally critical of existing research Hence, we can’t conclude much about DL

versus traditional education

What Did IHEP Find?

Key shortcomings Most studies don’t control extraneous variables Most studies don’t use randomly assigned

subjects – hence, selection bias Questionable reliability and validity of

instruments Lack of control for student/faculty attitudes (the

reactive effect) Sheer volume of studies don’t respond to

inherent bias of self interested researchers – but IHEP seems to ignore their own bias.

What Did IHEP Find?

What are the gaps? Research focuses on outcomes in single courses. Research looks at average performance; it

ignores differences among students. Research doesn’t explain high drop out rates for

DL students. Research doesn’t account for differences in

learning styles Research focuses on single technologies, not

technology “cocktails” (blended approaches) Research provides no theoretical framework Research fails to consider digital libraries

Implications

DL’s ability to extend “access” to remote students is unclear – especially if students need computer skills to use it.

What is the “quality of access” that DL offers?

Factors other than media may be far more significant in impacting outcomes – student motivation, instructor, learning tasks and learner characteristics.

What the Difference? An Assessment

Key observations IHEP offers no original research of their

own. They only offer criticism of others.

IHEP is biased based on their funding sources (AFT and NEA).

IHEP seemingly ignores the best done studies on DL.

If we wait for perfectly reliable and valid instruments, we may never know.

What Is Different?

My personal experience in teaching: On-Ground On-Line

Dramatic changes in Higher Education: Growing consumerism among students Emergence of for profit universities and

aggressive, tuition driven non-profits Changing face of graduate education:

Increase in part-time programs A “Credential” war among employees?

Is education becoming a commodity?

Growing Consumerism Among Students

Are students “customers”? Customers can take their money elsewhere. Students are “pupils”, however.

Will students accept their apprentice role under the leadership of faculty?

Ever increasing tuition charges lead families to shop for “best buys” and “Let’s Make a Deal”

DL is one of the latest moves by schools to meet consumer demand – “Why do I have to go to class, bring it to me!”

The Rise of For Profit Education

Early leaders – schools like University of Phoenix, DeVry: Focus- adult learners in part-time, career programs:

Bachelor Degree completion Graduate management and education – inc. PhD

Business Model Frequently DL or on-ground with DL support Frequently multi-campus Employ large numbers of adjuncts as

“facilitators” UoP has 90 full time faculty for > 45,000 students

Minimal research and service missions Have achieved NCA accreditation

Chronicle of Higher Education

Index of For Profits Apollo Group and University of Phoenix Career Education Corporation Corinthian Colleges DeVry Inc. Education Management ITT Educational Services Strayer Education Sylvan Learning Whitman Education

Growth of Aggressive, Tuition Driven Non-Profits

In competitive response, tuition driven non-profits (schools financed largely by tuition dollars): Examples include Baker College, Nova

Southeastern University Major DL players

Typically, employ business models with: Large adjunct corps Big users of DL technology Trendy curriculums Similar to for-profits in many ways

Financial Differences

Example institutions: University of Phoenix – aggressive for-

profit Nova Southeastern University –

aggressive non-profit Kettering University – traditional non-

profit

Financial Comparison

Comparison of Financials

             

  UoP   NSU   Kettering

             

Revenue (tuition) 100%   87%   69%  

Income (gift, grant, investment)     13%   31%  

Cost of Revenue 47%   82%   73%  

Selling, G&A and other 24%   12%   13%  

Income Tax 12%          

Net Income or Gain 18%   6%   14%  

Changing Face of Graduate Education

Growth of part-time programs For many mid-career professionals a

masters degree in “something” is a key item to add to their resume.

But to many – the subject or quality of institution doesn’t matter

DL is quite attractive An ensuing credential war

Pieces of paper matter more than learning.

Master Degrees Awarded

020,00040,00060,00080,000

100,000120,000

Year

Engineering

Business Management And Administrative Services

200+ Regionallyaccredited DL MBAprograms

Is Education Becoming a Commodity?

An open question: Some recent research questions the

economic value of education from top schools.

Is a BS from New Mexico Tech ($2k/year) worth that much less than a BS from Stanford ($30k/year +)?

Will digital technology replace traditional classroom interaction between faculty and students?

Conclusion

So what’s the answer to the question: “Is there solid empirical research that

shows that undergraduates will learn how to think critically, interact rationally and develop the cognitive and ethical perspectives that they acquire in a good residential program?”

Conclusion

The answer isn’t clear. It does appears: Everyone has an opinion. That mode of delivery (DL or

traditional) isn’t nearly as important as a host of other factors.

That the educational world is changing rapidly due to technology and competition.

Conclusion

What does this mean for Kettering? A general blurring of market distinctions. Students and families have higher

expectations of institutions. Engineering programs may be “safe” from

some competitors, but not the general market for credentials.

We’re in a competitive market – in the long run no school is “safe”.

Technology is here to stay.