2:15 – 2:30. software for text analysis the ceq collects written comments under the headings...

CEQuery

2:15 – 2:30

What is CEQuery? Software for text analysis

The CEQ collects written comments under the headings “Best aspects” and “Needs improvement”◦ What were the best aspects of your course?◦ What aspects of your course were most in need of

improvement?

CEQuery classifies into 5 Domains and 26 Subdomains

CEQuery enables the student’s qualitative comments to be linked with quantitative:◦ demographic and field of education variables◦ satisfaction scales and graduate outcomes

“Listen to the ‘voice’ of students & not just rely on quantitative measures”◦ Professor Geoff Scott

What is CEQuery?

What is CEQuery? Domains:

◦ Assessment◦ Course Design◦ Outcomes◦ Staff◦ Support

Subdomain:◦ Assessment

Expectations Feedback Marking Relevance Standards

Any good? CEQuery comments hit rate: 80%

◦ Of the remaining 20% not hit in CEQuery, half are not meaningful (cannot be coded)

Coding of comments to sub-domains by CEQuery checked by multiple raters◦ Accuracy approx 90%

Still being used by over 20 universities in Aust and a couple in NZ – even though it is very out of date

Best Aspects - domains

Best Aspects – sub-domains

The comments

BA / NI ratio

Does not work on Windows Vista or Windows 7◦ Some functionality / interface very tired◦ Using outdated phrasing

Dictionary last updated in 2005◦ Search terms outdated?

text speak / chat messaging eg LOL, IMHO, FTW Emoticons eg:

The issues

Contact GCA

Google:◦ Accessing the Student Voice

Professor Geoff Scott

Want to know more?

To get around Vista/Win7 - set up an old PC using Windows XP with CEQuery and remote desktop (RDP) into it

You can use Access 2007 or 2010◦ Save as MDB (Access 2003 format)

Import your data SPSS etc◦ score your comments in CEQuery and import the

resulting Access file into SPSS

Tips for users