guide to pira, puma, puma 6 extension and gaps online...
TRANSCRIPT
1 March 2019
MY ASSESSMENT AND REPORTING KIT
Guide to PiRA, PUMA, PUMA
6 Extension and GaPS online
analysis and reports
Before you can use the analysis and reports, your school’s Access Co-ordinator will need to
set up your school on the platform and grant you access. For a simple set-up guide, visit
http://rsassessment.com/mark-online-support.
2 March 2019
Contents Using the marksheets .............................................................................................................................. 3
Export test mark input file / CSV export and import ........................................................................... 4
Navigating between marksheets ......................................................................................................... 6
Gap Analysis ............................................................................................................................................ 7
Gap analysis for a single paper and class ............................................................................................. 7
Performance indicators ........................................................................................................................ 8
Gap analysis export for the whole school ............................................................................................ 8
Generating reports ................................................................................................................................ 10
Pupil Reporting ...................................................................................................................................... 11
Individual Pupil Report .......................................................................................................................11
Pupil Progress Report (PIRA, PUMA and GaPS) .................................................................................12
Academic Year, Class or Group Reporting ............................................................................................ 13
Academic Year, Class or Group Comparison Report ..........................................................................13
Academic Year, Class or Group Analysis Report (PIRA, PUMA and GaPS) .........................................14
Academic Year, Class or Group Listing ...............................................................................................15
Academic Year, Class or Group Progress Report (PIRA, PUMA and GaPS) ........................................16
3 March 2019
Using the marksheets To generate your reports, you first need to record the marks that your pupils have
scored in the PUMA/PUMA 6 extension/PiRA/GAPS paper-based standardised tests.
This can be done either by importing a CSV file containing their results, or by manually
entering their scores via the marking forms.
To start, click on Marksheets and Gap Analysis in the left-hand menu.
To input the marks manually, click on the PUMA, PUMA 6 Extension, PiRA or GaPS logo
and then select the paper and class or group who have taken the test – then click
Mark/Gap Analysis.
4 March 2019
Your screen will be populated with a list of the pupils that are included in the selected
class or group and a marking form that can be completed with their results in the
selected test.
Input the date that the class or group took the test and then each pupil’s results,
question-by question. If the pupil did not attempt a question, record this with an ‘n’. To
edit any entry, just click the number and re-enter it.
If you are using our interactive tests the marksheet is populated automatically.
However, if you have the Access Co-ordinator or Teacher Admin roles there is now the
ability to amend an interactive mark where required and in line with the paper mark
scheme.
Export test mark input file / CSV export and import Alternatively, you can download a file to your computer that will allow you to enter the
marks for your class or group via a spreadsheet. To do this, click the CSV export button.
5 March 2019
Click on 1. Export template CSV to download the file. The file is a comma separated
value (or CSV) file that can be opened in any spreadsheet program such as Microsoft
Excel. When you've downloaded and opened it you may want to resize the columns so
that you can see all the data. When you save the file, you can save it as a CSV or as an
Excel spreadsheet (.xls, .xlsx).
• The first row contains text that will be used by the importer and should not be
changed.
• The second row contains the column headings and the questions to be marked.
The subsequent rows are where you enter the pupils' marks. You should enter
the date that the pupil took the test and the mark (1 or 0) that was achieved for
each question or question part, or 'n' if the question was not attempted.
The completed CSV should look like this:
6 March 2019
To import the file for processing once you've completed it return to the Marksheets
you wish to import data for and open the CSV export dialogue. From here you have the
option to Upload CSV directly by clicking 2. Choose file, selecting your completed CSV,
then 3. Upload CSV.
Alternatively, return to the Marksheets homepage and click CSV import.
Navigating between marksheets
This is an easy process with multiple options from within the marksheet area.
To change the marksheet for the paper you are viewing and maintain the same group of pupils just
click on the paper name and a drop down menu will open to make your selection from.
If you want to change the class or group your are viewing, but retain the same paper just click on the
class/ group name and a drop down menu will open to make a different selection.
7 March 2019
Gap Analysis
Gap analysis for a single paper and class By clicking Show Gap Analysis/Export, you can view extra detail such as question facility and your
pupils’ average scores on each question or strand. You can switch between the Questions and
Strands view using the tabs at the top right of the marksheet.
You can also download a spreadsheet view of the marksheet by clicking Gap Analysis export. This
includes the marksheet as well as the following information:
- Question facility - Percentage of the class that successfully answered each question - Average total raw score and percentage the class achieved on the test - Strand breakdown:
o Score per pupil per strand o National average score per strand o Class average per strand o Total available marks per strand
- Per pupil scores:
8 March 2019
o Standardised score o Age-standardised score o Hodder Scale Score o Performance Indicator
We have added a UPN column to the Gap analysis class and whole school export for as an additional
method of identifying pupils when comparing their MARK data with other platforms. UPN can be
added to MARK using the pupil import CSV template, manually, or from your MIS.
Performance indicators The thresholds used for performance indicators for PIRA, PUMA and GAPS are as
follows. These are not applicable for PUMA 6 Extension.
Performance indicator Standardised score
Working towards <94
Working at 94-114
Working at greater depth >114
Gap analysis export for the whole school For PUMA, PiRA and GAPS, you can export all of a term’s results for your whole school
in one spreadsheet (GAPS coming soon). Not available for PUMA 6 Extension.
To do this, select Gap Analysis – School Export from the Marksheets screen:
Then select the product, term and academic year from the dropdowns and click
Generate.
9 March 2019
The spreadsheet will then be created and downloaded to your computer. Please note -
each year group’s data will be displayed on a different tab.
Please note that the Whole School Gap analysis export considers all attempts of a given
pupil for the selected paper. This means that multiple attempts will have an effect on
the class average displayed.
Furthermore, students attempting a paper outside of the test cycle, e.g. taking an
Autumn paper in the Summer term, will not be represented in the Whole school Gap
analysis export. This is because the test taken dates for each paper is a set value that
must fall within a specific date range, attempts of a paper outside of this data range
may skew the class average and are therefore not included.
Unlike our other MARK reports, the whole school export looks for both the data range
and the test paper (Autumn, Spring or Summer), so when you select ‘Autumn’ it
ensures it only shows Autumn test papers taken in the autumn date range. Students
who have taken papers outside of the date range will still show in the correct
marksheet in MARK.
The term dates for each paper are:
Paper Start Date End Date
Autumn 15-08-2018 31-12-2018
Spring 01-01-2019 31-03-2019
Summer* 01-04-2019 31-07-2019
*Tests taken between 31/07 and 15/08 will not be included in the Whole School Gap
analysis.
10 March 2019
Generating reports Click on Reports in the left-hand menu to access the full suite of reports available. To
run your report, use the Report Picker to select either PiRA, PUMA, PUMA 6 Extension
or GaPS in the Product name dropdown menu, and then the Report type that you
require. Select the combinations of classes, groups or individual pupils and papers you
want to report on and run your report.
New contextual groups are available in MARK as part of the group reports drop down and can be
used to compare attainment.
11 March 2019
Pupil Reporting
Individual Pupil Report This report shows the performance of an individual
pupil on their most recently taken test.
Use for
✓ Analysis of specific areas of strengths and
weakness, by national curriculum strand
✓ Fine monitoring of predicted progress over the
coming year
✓ Parents’ evening reporting
The first page features an overall performance graph showing the Standardised Score on the test,
allowing a quick visual representation of how the pupil is performing against the national average
for his or her year group.
The summary data shows:
• The date the test was taken
• The pupil’s age at the time of the test
• Raw score
• The average score of the standardisation cohort for
the gender of the child
• Standardised score
• Age-standardised score (not for PUMA 6 extension)
• Age-standardised Percentile (not for PUMA 6
extension)
• Hodder Scale score
• Reading/Mathematics/GPS age
• Yes/No flag - identifying if the pupil’s Maths/Reading
Age is more than a year below their chronological age
(not on GAPS or PUMA 6 Extension reports)
The second section shows the pupil’s performance by strand.
The summary data shows:
• The date the test was taken
• The pupil’s raw score by strand out of maximum number of marks
The final information shown is the pupil’s predicted Hodder Scale score for the next three terms.
12 March 2019
Pupil Progress Report (PIRA, PUMA and GaPS)
Please note this report is not currently
available for PUMA 6 Extension.
This report compares the performance of an
individual pupil across several tests (up to a
maximum of 6).
Use for
✓ Tracking progress, term-by-term
✓ Looking for patterns of strengths and
weakness
✓ Demonstrating the impact of
interventions
✓ Parents’ evening reporting
The first section features a graph showing the
pupil’s performance across a series of tests.
These are shown as standardised scores against the National Average standardised
scores.
The summary data shows:
• The date each test was taken
• The pupil’s age at the time of each test
• Their total raw score
• National average standardised score
• Standardised score
• Age-standardised score
• Hodder Scale score
• Age-standardised Percentile
• Reading/Mathematics/ GPS age
The second section shows the pupil’s performance by strand across up to 6 tests.
The summary data shows:
• The date the test was taken
• The pupil’s raw score by strand out of maximum number of marks
13 March 2019
Academic Year, Class or Group Reporting
Academic Year, Class or Group Comparison Report This report shows the performance of different groups on a specific test.
Use for:
✓ Analysis of the performance of specific
groups against the class/year as a
whole, e.g. Pupil Premium, ethnicity
etc.
✓ SLT, governor and Ofsted reporting
The graph compares the standardised scores for
each group, split into boys and girls.
The summary data for each group shows:
• The number of pupils in that group
• Minimum standardised scores of the group
• Maximum standardised scores of the group
• Mean standardised scores of the group
• Mean Hodder Scale score of the group
The national average standardised scores are also shown for all children.
14 March 2019
Academic Year, Class or Group Analysis Report (PIRA, PUMA
and GaPS)
Please note this report is not currently available for PUMA 6 Extension.
This report shows the performance one group on a specific test, their
average score and the national average standardised score.
Use for:
✓ Analysis of individual pupil performance
against class and national averages
✓ A quick visual representation of the
standardised scores across the class or group
– flagging pupils who may need more support
The graph shows the performance of members of a
group, their average score and the national average
standardised score.
The summary data for each group for boys, girls and all
students show the:
• Number of pupils in each group
• Average age of the group
• Minimum scores of the group
• Maximum scores of the group
• Median standardised of the group
• Standard deviation of the group
• Average score of the group
• The national average
15 March 2019
Academic Year, Class or Group Listing
This report shows the performance of one group on a specific test, the proportion matching expectations and their average performance by strand. Use for:
✓ Planning ✓ Pinpointing areas of the curriculum that might need more in-depth teaching or
practice, across the class or group
Summary data includes
• The date the test was taken
• The pupil’s age at the time of
the test
• Reading/Mathematics/GPS
age
• Raw score
• Standardised score
• Age-standardised score (not
for PUMA 6 Extension)
• Age-SS Percentile (not for
PUMA 6 Extension)
• Yes/No flag - identifying if the
pupil’s Maths/Reading/GPS
Age is more than a year below
their chronological age (not for
PUMA 6 Extension)
• The pupil’s raw score by strand out of maximum number of marks
• Group averages across all the above
The charts on the second page show the percentage of pupils in each performance
indicator band across the class or group (not for PUMA 6 Extension) and the average
strand performance against the average score received by the standardisation cohort
(the national average).
16 March 2019
Academic Year, Class or Group Progress Report (PIRA, PUMA
and GaPS)
Please note this report is not currently available for PUMA 6 Extension.
This report shows the performance of one group across several tests (up
to a maximum of 6).
Use for:
✓ Analysis of the progress of
specific groups, e.g. Pupil
Premium, intervention groups,
More Able etc.
✓ SLT, governor and Ofsted
reporting
The graph compares the standardised
scores for the group across each test, split
into boys and girls.
The summary data for each group shows:
• The number of pupils in that group
• Minimum standardised scores of
the group
• Maximum standardised scores of
the group
• Mean standardised scores of the group
• Mean Hodder Scale score of the group
• The national average standardised score
If you have any difficulties getting your school set up on MARK, or
using the online analysis and reports – please send an email to
[email protected] containing your questions, contact
details and a good time to contact you, and we will call you to help you
through the process.