sp110811
DESCRIPTION
An institutional study of the influence of ‘onlineness’ on student evaluation of teaching in a dual mode Australian universityTRANSCRIPT
![Page 1: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/1.jpg)
An institutional study of the influence of ‘onlineness’ on student evaluation of teaching in a dual mode Australian university
Stuart Palmer@s_palm .
Institute of Teaching and LearningDeakin University
#spalmer
![Page 2: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/2.jpg)
![Page 3: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/3.jpg)
![Page 4: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/4.jpg)
![Page 5: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/5.jpg)
![Page 6: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/6.jpg)
Systematic influences on SET data
The literature says…Class size – negatively correlated;Year level – positively correlated; andDiscipline area - various
In more recent times, rapid expansion of online learning
![Page 7: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/7.jpg)
Student evaluation of teaching & units (SETU)
1. This unit was well taught2. The course materials in this unit were of high quality3. The workload in this unit was manageable4. Requirements for completing the assessment tasks in this unit were clear5. The teaching staff gave me helpful feedback6. The library resources met my needs for this unit7. I would recommend this unit to other students8. The technologies used to deliver the online content in this unit performed
satisfactorily9. The on-line teaching and resources in this unit enhanced my learning experience10. This unit challenged me to learn
n/a; 1=strongly disagree; 2=disagree; 3=neutral; 4=agree; 5=strongly agree
![Page 8: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/8.jpg)
Data set used in study
Mean SETU rating sets for 1432 units of study
Representing 74498 individual sets of SETU ratings
58.5 % of all units listed in the Deakin University handbook for the period under consideration
![Page 9: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/9.jpg)
1
2
3
4
5
1 2 3 4 5
Mea
n SE
TU r
ating
-it
em 9
Mean SETU rating - item 8
SETU items relating to 'onlineness'
r2 = 0.73
p = 0.0000
![Page 10: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/10.jpg)
3.85
3.90
3.95
4.00
n < 51 50 < n < 101 n > 100
Mea
n SE
TU ra
ting
-it
em 8
3.70
3.75
3.80
3.85
n < 51 50 < n < 101 n > 100
Mea
n SE
TU ra
ting
-it
em 9
Class size
F = 0.885
p > 0.41
No Sig. Diff.
F = 3.199
p > 0.041
No Sig. Diff.
![Page 11: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/11.jpg)
3.80
3.85
3.90
3.95
4.00
4.05
4.10
Early Later Postgrad
Mea
n SE
TU ra
ting
-it
em 8
3.60
3.65
3.70
3.75
3.80
3.85
3.90
Early Later Postgrad
Mea
n SE
TU ra
ting
-it
em 9
Year level
F = 8.972
p < 0.0002
Sig. Diff.
F = 16.515
p < 1x10-7
Sig. Diff.
![Page 12: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/12.jpg)
3.80
3.85
3.90
3.95
4.00
4.05
4.10
Arts/Ed Bus/Law Sci/Tech Health
Mea
n SE
TU ra
ting
-it
em 8
3.60
3.65
3.70
3.75
3.80
3.85
3.90
3.95
4.00
Arts/Ed Sci/Tech Bus/Law Health
Mea
n SE
TU ra
ting
-it
em 9
Discipline area
F = 11.998
p < 2x10-7
Sig. Diff.
F = 21.177
p < 4x10-13
Sig. Diff.
![Page 13: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/13.jpg)
3.60
3.70
3.80
3.90
4.00
Conventional Wholly online
Mea
n SE
TU ra
ting
-it
em 1
3.40
3.50
3.60
3.70
3.80
3.90
4.00
Conventional Wholly online
Mea
n SE
TU ra
ting
-it
em 7
Online mode of offer
F = 18.266
p < 0.0003
Sig. Diff.
F = 22.350
p < 3x10-6
Sig. Diff.
![Page 14: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/14.jpg)
SETU and wholly online units
1. *This unit was well taught2. The course materials in this unit were of high quality3. The workload in this unit was manageable4. Requirements for completing the assessment tasks in this unit were clear5. The teaching staff gave me helpful feedback6. The library resources met my needs for this unit7. *I would recommend this unit to other students8. The technologies used to deliver the online content in this unit performed satisfactorily9. *The on-line teaching and resources in this unit enhanced my learning experience10. This unit challenged me to learn
* Reported to university Council
![Page 15: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/15.jpg)
2.75
3.25
3.75
4.25
1 7 9
Mea
n SE
TU ra
ting
SETU item
2003(n=51, 17%)
2004(n=73, 42%)
2005(n=47, 32%)
2006(n=32, 37%)
Case study – SEB221
![Page 16: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/16.jpg)
2.75
3.25
3.75
4.25
1 7 9
Mea
n SE
TU ra
ting
SETU item
2003(n=51, 17%)
2004(n=73, 42%)
2005(n=47, 32%)
2006(n=32, 37%)
Case study – SEB221
![Page 17: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/17.jpg)
2.75
3.25
3.75
4.25
1 7 9
Mea
n SE
TU ra
ting
SETU item
2003(n=51, 17%)
2004(n=73, 42%)
2005(n=47, 32%)
2006(n=32, 37%)
Case study – SEB221
![Page 18: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/18.jpg)
Conclusions
Mean ratings for the two ‘online’ SETU items (item 8 – ‘The technologies used to deliver the online content in this unit performed satisfactorily’ and item 9 – ‘The on-line teaching and resources in this unit enhanced my learning experience’) are strongly, significantly and positively correlated
Comparing units offered in wholly online mode to units offered in all other modes, mean ratings for SETU items 1 ‘this unit was well taught’ and 7 ‘I would recommend this unit to other students’ were both significantly lower for wholly online units
![Page 19: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/19.jpg)
Conclusions
Class size had no significant influence on either SETU item 8 or item 9
Mean ratings for SETU items 8 and 9 are significantly and positively related to the enrolled year level of the respondent, based on the groupings of ‘early years’ (first & second years), ‘later years’ (third & later years) and ‘postgraduate’ (programs beyond undergrad level)
Mean ratings for SETU items 8 and 9 are significantly different between Faculties – with the Faculty of Health having the highest mean rating for both items
![Page 20: Sp110811](https://reader036.vdocument.in/reader036/viewer/2022062419/557d2946d8b42a90748b49b0/html5/thumbnails/20.jpg)
Thank you for your time
http://myqr.co/zJrD Presentation