Having an Effective Ranking Discussion
Ofqual has stated that, once you have decided on the recommended grades for students, centres will need to recommend “the rank order of students within each grade – for example, for all those students with a grade 5 in GCSE maths, or a grade B in A level biology, a rank order, where 1 is the most secure/highest attaining student, and so on”.
Assigning A Starting Rank
Ofqual has given an example in the case of large departments by starting off with a suggested rank by each individual teacher, then integrating the lists to use this as a start point for discussion (Ofqual, 3rd April, p8). If you have followed our methodology to calculate an Overall Total Mark to inform a recommended grade, this step of the ranking process will be simple as students can be ranked in order of the Overall Total Mark achieved (See “Step 2: Taking the pressure out of recommending student grades”). This is an extremely robust way of starting the process; your rankings will be more objective as the teachers will have used evidence-based information to inform the marks, grades and now the start rank position.
On Pupil Progress you will be able to produce a download at the click of a button that will contain all the marks, grades and information that you will need for your ranking discussions. It will even provide you with a starting rank for your discussions, based on the Overall Total Mark that has already been validated in Step 3. A collaborative approach to recommending and validating grades.
Using this more objective and performance-based approach to your starting ranks will also help reduce unfairly assigning students a rank that is affected by unconscious bias or based on the advocacy skills of individual teachers in the department.
Handling Large Numbers of Students with the Same Grade
It is worth recognising before you start this process how many students you are likely to have on the same grade. You can easily do this by looking at the number of students that achieved each grade last year as a rough guide of what you should expect this year.
As an example, we can take a fairly standard situation where there is a cohort of 80 GCSE geography students, with a distribution of grades that follows the national average. According to the Ofqual grade distributions from Summer 2019, 35,090 students achieved a grade 5 out of 250,985 candidates, or 13.9% of the national cohort. Translate it to a school setting and this would be 11 of our 80 students that are likely to achieve a grade 5.
To achieve a grade 5 in Geography AQA in June 2019, a student needed 116 marks overall, and 134 to get a grade 6 – a gap of 18 marks. Therefore it is likely these 11 students on grade 5 will have different Overall Total Marks and so can be ranked easily and reliably. The ranking conversation would be more about validating and ensuring that there has been consistency in Step 3. A collaborative approach to recommending and validating grades.
In many schools, students are unlikely to follow the national distribution and will more commonly cluster around a smaller range of grades. For example, high achieving schools will have a higher proportion of their students clustered around grades 9-7 than the national distribution. These ranking conversations will be more focused on the situations where there is more than one student on the same Overall Total Mark. This means the conversations will be about fewer students and will require input from fewer teachers at a time. This should also reduce friction and reduce the risk of decisions becoming more subjective and introducing more unconscious bias. You can read more on keeping the conversations focused and objective in our article Facing the Challenge of Ranking your Students.
Working Across Tiers
Confidence in the tiering decisions will really be tested by this process. Ofqual have made it clear that the grade submitted by a centre must match the tier, i.e.:
- foundation students can have a grade 5-1 submitted
- higher tier can have grade 9-3 or U submitted.
For 9-1 Maths, Science and MfL, students on a grade of 5, 4 or 3 (the grade overlap on tier) may be on different tiers which may prove slightly more problematic for ranking discussion.
If you have chosen a student to sit higher tier, this should be because they are capable of achieving a grade 6 or above. The exam boards make it very clear that students who are at a risk of achieving a grade 4 should not be entered for Higher tier, therefore they are likely to be students with good evidence of working at grade 5 and above. If they have been entered for the foundation tier, it is because they are unlikely to achieve a high 5. Bearing this in mind it should follow that students on a higher tier should be ranked above foundation tier students.
Based on the logic above, it would be best for the starting ranks to be ordered first by tier (higher above foundation), then Overall Total Marks. In the discussions, you can then work through each student individually. If you are finding that a lot of your foundation students are being ranked higher than the higher tier students then you may need to question the evidence that is being used to support the ranking and why it is so different to the evidence used in the tiering decisions.
Preparing For Ranking Discussions
If there are issues with the grades and Overall Total Marks recommended, then this should be addressed in one-to-one conversations before the ranking meeting. Ensure you and the teachers involved are satisfied that the Grade Judgements and Overall Total Marks are as reliable as possible. You can check if the Overall Total Marks for the students they teach are in the order they would expect using our sorting tool on the tracker during Step 3. A collaborative approach to recommending and validating grades. If any changes need to be made, do this before the meeting.
Pupil Progress will automatically provide a starting rank for your students using their Overall Total Marks, which you can download onto an excel spreadsheet along with the core data. Students that have the same Overall Total Marks will be highlighted by the sheet. Share the list with your team before the meeting so they can look through it and consider any students they feel should be moved up or down the ranking list.
Barnaby Grimble
Co-founder
Chief Product Officer
Comments