onscreen marking 2016 user guide - board of studies · onscreen marking user guide – marker page...

Onscreen Marking 2016 User Guide

Marker

Table of Contents

Getting Started ........................................................................................................... 3

Briefing ....................................................................................................................... 3

Markers Assigned to Multiple Marksheets .................................................................. 4

Benchmarks ................................................................................................................ 6

Practice Marking ......................................................................................................... 9

Marking ..................................................................................................................... 11

Non-Attempts ........................................................................................................ 15

Adding Pages to a Response ................................................................................... 16

Booklets Requiring Attention .................................................................................... 18

Search ...................................................................................................................... 21

Other Features ......................................................................................................... 23

Documents and Files ............................................................................................ 23

Preferences ........................................................................................................... 24

Information ............................................................................................................ 26

Senior Marker Online ............................................................................................ 26

Messages .............................................................................................................. 26

Frequently Asked Questions ..................................................................................... 30

Help .......................................................................................................................... 31

Onscreen Marking User Guide – Marker

Getting Started To start marking, log in to Markers Online using your Marker Number (User ID) and password. https://bosho.boardofstudies.nsw.edu.au/links/markersonline.html

Once you have logged in you will be taken to the Site Map. To access scripts for marking, click Responses, under Onscreen Marking.

Briefing Before marking commences, all markers are briefed about the processes and procedures of the marking operation. During briefing you will be trained to apply the marking kit, including the marking guidelines and scheme, and the benchmarks. This ensures that all markers have a shared understanding of the awarding of marks for their question. For more information about briefing, please see the Marking Operations Manual.

Functions relating to marking will appear under this heading.

https://bosho.boardofstudies.nsw.edu.au/links/markersonline.html


Markers Assigned to Multiple Marksheets You may be assigned to one or to multiple marksheets, depending on how the exam paper is divided. If you have been assigned to more than one marksheet you will need to move between them during briefing and marking. Your senior marker will direct you when to change marksheets. You can switch between marksheets in one of the following ways. When you first click Responses, a pop-up box will appear on the screen.

The marksheets you have been assigned to will be listed. Click the name to view scripts for that marksheet.

Click Responses and a pop-up box will appear on the screen.

Click the marksheet name.


If you are already in Responses and you want to change marksheets, click the marksheet name at the top of the page.

A pop-up box will list the marksheets you have been assigned to. Click the marksheet name.

The page will reload. Notice that the marksheet name listed at the top of your screen will change to that of the marksheet selected.

You will also notice that, should the marksheets be set at different marking phases, the functions available to you will be different for each marksheet – for example, if one is set to Practice Marking and the other to Marking, you will only be able to do practice marking in the first. Notes:

Click the marksheet name.


Benchmarks Senior markers read a range of responses from a variety of exam centres, and select those that best illustrate the marking guidelines as benchmarks. Each benchmark response is clearly aligned to a mark. Annotations made by the senior markers detail how characteristics of the response relate to the marking guidelines. The benchmarks ensure that markers have a clear understanding of the intent of the question and marking guidelines, and assist in consistent application of the guidelines. Note that not all questions will have benchmarks. For more information about how benchmarks are selected, please see the Marking Operations Manual. Markers are able to access the benchmarks during all phases of marking. To do so, click benchmark at the top of the page.

A pop up box will appear on screen.

Benchmarks are generally listed from highest to lowest mark. The page identifier, total marks awarded and any senior marker annotations are also listed for each benchmark. The Private Note column is where your notes will appear. To view a benchmark, click the page identifier.

Click benchmark.


When you view the benchmark response, you can also see the marks awarded and any annotations made by a senior marker.

Make your own notes in the Note tab and then click save note at the top of the screen.

Click the page identifier.

Annotations appear here.

Marks are listed here.

Click save note.

Make your notes here.


You can scroll through all the benchmarks by clicking either down or up at the top of the screen. Otherwise, click return to list and select benchmarks from the complete list.

Your notes will be shown in the Private Note column.

To look at the other benchmarks, repeat the steps above. Remember: During any phase of briefing and marking, you can access the benchmarks by clicking benchmark at the top of the screen.

Notes:

Your notes will appear in the Private Note column.

Click return to list.

Click down or up.

Click benchmark.


Practice Marking Before marking commences, all markers are required to carry out practice marking. In practice marking, you will apply the marking kit to a range of responses. This ensures that you understand and are able to consistently apply the marking kit. To commence practice marking, go to the Site Map and click Responses.

Click start practice marking.

A response will appear on the screen.

Any annotations made by the senior marker(s) may also be visible.

Click Responses.

Click start practice marking.


Read the response and allocate marks.

Once you have allocated marks, hit the Save button.

After clicking Save, the next response will appear on the screen. Repeat steps as above. You can change how you allocate marks by clicking the Preferences icon. For more information on Preferences, please see pages 24 and 25. To stop practice marking and return to the list of responses, click stop marking. DO NOT use the browser back button.

Allocate marks here.

Click save.

Click stop marking.


Marking Markers move into the marking phase when the SOM and senior marker(s) are satisfied that the marking guidelines are working appropriately, and that markers are consistently applying the marking kit. Please note: not all markers necessarily move into this phase at the same time. Once you have been directed to commence marking, please go to the Site Map and click Responses.

You will be taken to the main onscreen marking page. This page automatically defaults to “Today”. To view a previous session, select a date from the drop down list; the page will reload automatically.

To start marking new responses, click start marking at the top of the page.

Select a date from the drop down list.

Click Responses.

Click start marking.


A response will appear on the page.

Read the response and allocate marks.

Please note: Once a response has been allocated to you, this response cannot be returned to the pool of scripts to go to another marker. You must mark every script that is presented to you. If there are any issues with the response, and it requires further action before you mark it, you should flag it. To do this, select the issue from the drop down list. If there are no issues with the response, select Okay – the drop down list will default to this. Options from the drop down list:

Okay – there are no issues with the response. This is the default option.

Hold – to be used if you don’t want to mark the particular response at the time, e.g. you may want to discuss a response with your SM, so you put it on hold until after your discussion.

Incomplete – part of the response is missing. Remember: Try adding pages first – see pages 16 and 17 for more details. If the response is still missing a part flag it as incomplete.

Attention of Senior Marker – you want to bring the response to the attention of your SM, e.g. you are concerned about an aspect of the response. If you select this option, include a note so that your SM knows why you are bringing the response to their attention.

Wrong Question – a response to another question has been presented to you.

Allocate marks here.

Make notes here.


If you select any option other than Okay, please make a note explaining why you have flagged the booklet, as a reminder to you and your senior marker when it is being reviewed. When you have finished allocating marks, and selected an option from the drop down list, click the Save button.

If you have assigned the booklet a status other than Okay, a pop up box will appear after you Save, confirming that you want to save the booklet with that status. Click OK to confirm. The next response will then appear on your screen. To continue marking, repeat steps as above. To stop marking, click stop marking at the top of the page. DO NOT use the browser back button.

You will return to the main marking screen. Any responses you have marked during the session, as well as their status and the total marks awarded to that response, will be listed.

Responses marked during the session will be listed here.

Select an option from the drop down list.

Click Save.

Click stop marking.


To review a particular response, click the page identifier.

A table containing statistics for the session, including how many responses you have marked and read, as well as the total mark allocated, will also appear on the screen.

Please note: any booklets that you have viewed but not marked, eg where you have selected stop marking before saving marks or put a booklet on hold, will be flagged with a ?.

Booklets requiring marks will be flagged with a ?.

Click the page identifier.

Statistics available here.


Non-Attempts If the response is a non-attempt, either enter a non-attempt in the marks field or, if available, click the non-attempt link at the top of the page.

A pop-up box will ask you to confirm that the response is a non-attempt before the mark is saved. Please note: the non-attempt link will only be available when all questions on the marksheet are compulsory. If your question is an optional question, for example, a student chooses to respond to part (a) OR part (b), and the student has not attempted a response, you will need to manually enter the non-attempt for either part (a) or part (b). DO NOT enter the non-attempt for both questions. Depending on how your mark box preferences are set up, you will do this by entering ‘00’ as the mark, or picking ‘non-attempt’ from the drop down. Notes:

Click non-attempt.


Adding Pages to a Response Where the response has been answered as part of a question/answer booklet or a multipage writing booklet and it appears that the student may have continued their answer on another page of the booklet, but that page is not automatically presented to you, it is not necessary to rebuild this response. Instead pages can be added to the response using the ‘Tools’ function under Responses. To do this, click the Tool icon at the top of the page.

A pop up box will appear on the screen. Tick the booklet pages you want to include and record the reason for their addition, then click Adjust Pages.

Now you will be able to view all of the pages. The following message will also appear above the marks table.

Tick the pages you want to include.

Record the reason.

Click Adjust Pages.


Booklets that have had pages added will also be flagged on your list of Responses. An annotation will appear next to the status indicating the number of pages.

If after adding pages, you think a response is still incomplete, you should flag it by selecting Incomplete for further investigation, before you save any marks. Notes:

Number of pages added.


Booklets Requiring Attention If you save any booklets with a status of anything other than Okay’, for example, those saved with the status of ‘Attention of Senior Marker’, ‘Incomplete’ or ‘Hold’, an alert icon will appear at the top of your screen.

This acts as a reminder to you to return to responses that need a mark. Once a response has been allocated to you, it cannot be reassigned to another marker. It is your responsibility to enter a mark. You should review this list every marking session. If a response is ready to mark, enter a mark and change the status to Okay. Click the icon to open a pop up box listing how many booklets you have flagged as requiring your attention. To look at the booklet(s), click on the Page ID.

The pop up box will close and the page will reload with the response.


Review the response. If all issues with the response have been resolved, allocate marks and change the status to Okay.

Then click Save.

You will be returned to the main responses page. The response will no longer appear on the Requires Attention list, and instead will appear with the books marked this session. When you are reviewing responses, you will be able to identify whether pages have been added or rebuilding has occurred in two ways. If you are looking at booklets listed on the Responses page, an annotation will appear next to the booklet’s status.

Allocate marks.

Change status to Okay.

Click Save.

Response has been rebuilt.

Pages have been added to the response.


When you open a response that has been rebuilt, a message will appear above the marks table.

Your senior marker will regularly review your list of booklets requiring attention, in particular those that require action from them. Discuss with them how they will communicate what action has been taken and advise you that a booklet is now ready to mark. Notes:


Search To find a specific response or group of responses, use the search function. You can search by mark or status. Click search at the top of the screen.

A pop up box will appear. Select a session the dropdown list, or to include marked responses from all sessions, select Any Session.

Next, choose your search criteria:

Search by page identifier – this allows you to search for a specific response. Enter the page identifier, then click search.

Select a session.

Click search.

1. Enter a page identifier.

2. Click search.


Search by question – use this to search for responses to a particular question, or responses within a specific mark range.

To search for a particular question, tick the box next to the question number.

To search for responses in a specific mark range, enter the marks in the boxes provided. Then click search.

Please note: to search for responses that have been allocated a particular mark, put that mark in both fields.

Search by status – this allows you to search responses based on status e.g. search for responses on hold, or responses with notes, or that require attention. Click the button next to the status you want to search by, then click search.

Notes:

3. Click search.

2. Click search.

1. Select a specific question or all questions.

2. Select a mark range.

1. Select a status.


Other Features There are a number of other features within the Onscreen Marking system. Most are accessed through icons at the top of the Responses page. When you click one of these icons, a pop up box will appear on screen.

Documents and Files

To view documents relating to your marking operation, click on this icon. A pop up box will show documents relating to both the whole operation and individual marksheets.

To view a document, click on the name. Please note: documents may also be flagged as either ‘New’, ‘Updated’ or ‘Important!’. This will be indicated after the document name.

Documents for the whole marking operation.

Documents for a particular marksheet.

Click the name to view.


Preferences

Change the settings for your current page by clicking the Preferences icon.

On the main Responses page, choose how responses are listed.

Icons Position – change the position of the icons/statistics/ marks table.

Return to selected booklet – choose ‘yes’ to show the last response viewed when you save marks or stop marking. The most recent response will always be highlighted in yellow.

Show list of booklets with – choose ‘Seq. No.’ to view by sequence number, or ‘First Marked Date’ to view time of marking.

Show Last Modified Date – choose ‘yes’ to see when the response was last modified.

When viewing responses, set PDF parameters and choose how you record marks.

Icons/Mark Position – change the position of the icons/marks table.

Icons/Marks Section Width – choose a section width.

Mark Type – choose how your mark grid will appear (see next page).

PDF Parameters – choose whether or not you want to show various PDF functions. Set PDF zoom levels for all responses, rather than adjusting them for each response. Please note: Use Inbuilt PDF Reader should be set to ‘No’ unless otherwise instructed.

Additional Box Settings –automatic advance will move you to the next question as soon as you enter a mark. Automatic save will save your mark(s) as soon as they are entered and load the next response.

Additional Button Settings – choose how other ‘buttons’ appear on the page (only available when ‘Button’ is the mark type).


Mark Type Your marking grid can be configured in three different ways.

Box – type the mark in the appropriate box.

Button – click the button to enter a mark.

Dropdown – select appropriate marks from the dropdown list.

Type the mark and save.

Click the button and save.

Select a mark from the list and save.


Information

The Information links to information about the course and marksheet. It also contains information about the marking period, and your browser details.

Senior Marker Online

If you hover your curser over this icon, you will see the message ‘Your senior marker (name) was marking in the last five minutes’. This may be useful when you are marking externally, as your senior marker will not always be online at the same time as you.

Messages

This function allows you to directly message and receive messages from your Senior Marker. This function is particularly useful when doing external marking. Click the Messages icon to open your message inbox. All messages sent and received will appear on this screen. To send a message, click new message.

Click this icon to open your inbox.


Your senior marker’s name will appear in the ‘To’ field. Enter a subject, and then compose your message. When you are ready to send your message, click post message.

The message will now be listed on the main Messages page. To edit or delete the message click the Subject line.

When the message is open, choose one of the following options from the top of the screen:

return to list – takes you back to main message screen

change message – this allows you to edit the message

delete – click here to delete the message.

Click new message.

2. Compose your message.

Your SM’s name.

1. Enter a subject.

3. Click post message to send your message.

Click here to edit or delete a message.

Choose the appropriate action.


You will be notified that you have a new message in one of two ways. 1. When you first open the Responses page, the messages pop-up box will

automatically appear on screen. All of your messages will be listed, and any unread messages will be marked with the new message icon – a closed blue envelope.

Please note: while you have unread messages, the Messages window will keep popping up. 2. If you are on the Responses page when you receive a new message, the

messages icon at the top of the page will change from an open envelope to a closed envelope.

To view the new message(s), click the envelope. The messages window will pop up. To view a message, click the subject.

The message will open.

Unread messages are flagged with a closed envelope.

Click here to open the message.


To reply, click the link under the message box.

Type your reply in the top box. The message you are replying to will appear below. When you are ready to send, click post message. To cancel, click return to list.

Click here to reply.

1. Type your reply here.

The original message will appear here.

2. Click post message or return to list.


Frequently Asked Questions Why can’t I mark?

At certain times during the operation, you may be stopped from marking. Reasons for this can include:

There are no more responses to mark – all the responses for your marksheet have been marked.

You have already marked the maximum number of responses for that session – at the start of the marking period, the SOM determines how many responses markers will be able to mark in each session. Once you have reached this number in a particular session, you will be stopped from marking. If you are marking externally, you will be able to resume marking on the following day. If you are marking corporately, advise your senior marker.

You have failed a start-up or common responses – all markers have to mark common and start-up responses (start-up responses are common responses that are marked at the start of each session). If you fail any of these responses – ie: if you do not give the response the correct mark – you may be stopped from marking.

I need to talk to my senior marker about a response, but they are not available at the moment. Am I able to move on to the next response and then come back to this one?

Yes. Once a response has been allocated to you it is yours to mark. In order to move on to the next response you will need to put the particular response on hold. To do this, select hold from the dropdown list under the marks grid, see page 12. When you are ready to look at the response again, using the search by status option of the search function, choose hold as the criteria to search by. For more information on how to do this, see page 21.

My senior marker wants me to go back and review all the responses that I’ve given a mark of 4. How do I do this?

Using the search function, choose Search by question. From the drop down list, select which session(s) you want to search through (select ‘any’ if you want to search through all the responses you have marked), then enter the mark range you want to search by (in this case both fields should have a 4 entered) and click on ‘search’. All the responses you have marked within this mark range will then be listed on the screen. Click on the page identifier to review each response. For more information on how to use the search function, see page 21.


This response should have gone to a different marksheet. What do I do?

If you see a response that has gone to the wrong marksheet, alert your senior marker by changing the status to Wrong question (see page 12).

What do I do if a response is incomplete?

Check if the response has been continued in another part of the booklet by adding pages (see pages 16 and 17). If you can’t find the rest of the response, alert your senior marker by changing the status to Incomplete (see page 12)

Help If you require further assistance during marking, please contact your senior marker.