OMtetra: System guide

November 2011

OpenMentor how-to: Contents

• Welcome page and navigation• Before uploading an assignment• Uploading an assignment• Viewing reports• How to construct feedback for analysis in

OpenMentor based on Bale’s rules

Welcome page and navigationSign into OpenMentor

•Choose the course associated with the assignments•Read about OpenMentor•Sign into the system

Working area

Before uploading an assignment

• Sign into OpenMentor• Select a course

Before uploading an assignment

• Click on the link• On the screen that follows, click on the button• Click on and type a title for the

assignment to be uploaded. Alternatively, you may choose a title from the drop down list.

• Save the title of your assignment

• You should see the saved title on the list displayed

Before uploading an assignment

• Review and mark the assignment. Add the marks in capital letters at the beginning of the file, save the file and use this version to upload into OpenMentor. The file must be saved as .doc

Uploading an assignment

• Click on the Upload assignment link on the navigation menu

• Fill in the list of fields displayed

Use the drop down list to select one of the assignment titles saved

Upload the fileChoose the overall grade of the assignmentSelect the name of the student who submitted the assignment and the reviewer

Viewing reports

• Click on the View reports link to access the graphs generated by OpenMentor where the feedback included in the assignment is analysed.

Reports: tutors

Follow this link to read a summary of all the comments given by one lecturer on all the assignments uploaded, and

classified into one of the four categories

Reports: students

Follow this link to read a summary of the comments given by one lecturer on

the assignments uploaded for the student, and classified into one of the

four categories

Reports: per tutor per group

Follow this link to expand the comments views and access those

referred to in brackets

Writing the feedback

• Open Mentor works by stripping out tutors’ comments on an electronic assignment and based on Bale’s Interaction Process framework, applying a set of rules to these comments in order to put them into four major categories, namely Positive reactions, Teaching points, Questions and Negative reactions. It then provides feedback to the tutor about how their comments provide support to the students.

Bales' Interaction Process used for the analysis in OpenMentor

How to construct feedback for analysis in OpenMentor based on Bale’s rules

• After an analysis of hundreds of marked assignments, the following rules were created to analyse tutors’ feedbacks. The words that OpenMentor expects to find in order to classify the feedback comments under one of the four categories described earlier are indicated in the table.

Keywords per categories

• Positive comments• Teaching points• Questions• Negative comments

Positive: "A1">Shows tension release/"A2">Shows solidarity/"A3">Shows agreement

excellent (good|comprehensive) well\s+(done|concluded)\*tick\* try\s+to very\s+nicewell\s+presented effective\s+use a\s+helpful(thanks|thank\s+you) shows\s+an\s+understanding \A\s*Of\s+courseconcise well\s+(structured|stated) (this|that)\s+is better(well|clear)(ly)?\s+(structured|structure|summary|summarised|presented|presentation)

ok yes

fine agreed indeedclear\s+intro reasonable useful\s+points?seems\s+valid fair\s+comment nicelyexcellent\s+analysis

Teaching point: B1">Gives suggestion B2">Gives opinion B3">Gives information

(discuss|explain)\ further

notice+that (would|might|could)expand

Enlarge upon

better\ job I would but (would|might|could)+be (helpful|useful)

Important +to You +could (some|more)+commentsYou +should I recommend Before you No need +to I+would+have means+here I+(am|think) better+toPlease+(see|refer+to|look+at)

(probably|possibly)+better+to

consider need+to

careful useful+not+to take+care alsobest+to note+that however be+sure+tothink+about needs+(to+be|some) you+(have+to|must) useful+torequires compare perhaps UseDo+a might+think+of check you+(might|

ought)I+(thought|agree|suggest)

(analysis|analyse|assessment|evaluation)

I+(do|don't) think appears+to

inconsistent+with (demonstrates|shows)+ this

And Also

Teaching point: B1">Gives suggestion B2">Gives opinion B3">Gives information

too+many already+said losing. focus i. liketoo+descriptive sounds. like lacks. structure

needs+further This+is explain+moreas+well+as order if+you yes. butexplain make+sure+to link+to (could|would|

might)+also(evidence|reference)

correction interesting give. examples

(was|is)+needed same as. before please word+countQuestion+\d+ Page:?+\d+ \d++words

Overall ref (might|could|would|may|should)+have+been

could+be+viewed+as

could+probably+have

not+enough wondering reaction+is

i+think i+assume+that in+my+opinion would. goodwould+be good. but good+example. (but|

better+to)well+observed+except

it+is+a+good+idea+to

ok. but i+(don't|do+not)+understand

I+have+to bear(ing)?+in+mind you+seem+to+be (I'm|I+am)+notyou+needed+to could+be make+it. clear(So|therefore) very+brief this. is. better you+can+useworth+(mentioning|commenting)

remember

C1">Asks for information C2">Asks for opinion C3">Asks for suggestion

\bno\b \A\s*Whywhat\s+does what\s+are\A\s*what\s+conclusions \A\s*(What|where|how|can)\A\s*In\s+what \A\s*And\s+where\A\s*if

D1">Shows disagreement D2">Shows tension D3">Shows antagonism

not\s+sure this.*?does\s+not not\s+necessarilydon't\s+understand not\s+the\s+(point|question) this\s+(should|does)\s+notsays\s+nothing not\s+clear missed\s+the\s+pointyou\s+(do|must)\s+not very\s+shallow \A\s*I\s+disagreedisappointed \A\s*It\s+is\s+not \A\s*Don't|never\A\s*(Don't|Dont|Do\s+not) \A\s*Not \A\s*no

Questions?Please send us your comments or questions by email to:

Alejandra Recioars@ecs.soton.ac.uk