Potential for Success – response to Sutton Trust article by Dr Rebecca Montacute

Roger Titcombe's picture

Dr Montacute’s  article is linked to a Sutton Trust media release of 31 July 2018, purporting to show that high attaining disadvantaged pupils are under-performing at school. Considerable mainstream media coverage resulted, none of which was in any way critical. On 1 August 2018, I sent a detailed refutation of the claims in the article to Dr Montacute, care of the Sutton Trust. I also copied in all of the mainstream media that had published stories based on the Sutton Trust Press Release. Not a single acknowledgement or response resulted, let alone any challenge to my arguments and evidence.

I am not surprised, because the narrative that disadvantaged pupils are being failed by the school system plays into both Conservative and Labour ideologies. In the former case our comprehensive education system is blamed, despite the evidence that grammar schools and zero tolerance Academies are no more effective at ‘closing the gap’. Too many on the left are obsessed with a ‘discrimination’ based explanation for low attainment (in the face of the evidence), combined with an ideological revulsion to the concept of ‘intelligence’, which is addressed in Parts 1.2 and 1.3 of my book. This is like trying to understand physics while rejecting the concept of energy.

Dr Montacute’s article (which is the basis of most Sutton Trust policy pronouncements) and its conclusions are flawed by the failure to distinguish attainment from ability and the further failure in the study to define and measure ability. The following claims in the article are in italics. My comments  are set out paragraph by paragraph.

Authored by Dr Rebecca Montacute, Potential for Success analyses how high attaining students fare in secondary schools in England. The report also explores issues surrounding how to maximise the potential of high attaining young people through analysis of existing literature and case studies of good practice in schools that do particularly well for these students.

The report does nothing of the sort. The majority of it reflects on the fact that disadavantaged pupils (presumably mainly identified by eligibility for Free School Meals) are under-represented as high attainers at GCSE. The high attainers to which the study then goes on to repeatedly refer are not identified as high ability by IQ or Cognitive Ability Tests (CATs). The factual link between Free School Meals eligibility (FSM) and lower IQ/cognitive ability is either not recognised or ignored. But CATs data linked to FSM eligibility that prove the link have been published by GL Assessment. See p10 of the document.

The national mean CATs scores, Verbal Reasoning (VR), Quantitative Reasoning (QR) and Non-Verbal Reasoning (NVR) for non-FSM pupils are as follows. The corresponding percentiles are in brackets.

VR – 102 (55th), QR – 101 (53rd), NVR – 102 (55th)

But for FSM pupils the national mean scores are:

VR – 92 (30th), QR – 93 (32nd) , NVR – 94 (34th)

These are huge, highly significant differences that readily account for the disadvantaged pupils attainment gap claimed in the article.

Had the study targeted pupils in Academy schools that use CATs screening in Y6 or Y7, of which there are many, then the fact that FSM pupils in general perform at GCSE according to their lower CATs scores, rather than their inflated SATs scores would have been evident. All schools that use CATs screening are well aware of this, as is GL Assessment, the company that markets the CATs. My own extensive research, with my colleague John Mountford, has involved comparing CATS and SATs data for intake cohorts as a whole and for the intake pupils with FSM. We too find the same strong pattern in which while intake SATs scores are consistently somewhat lower for FSM pupils, intake CATs scores are much lower. We conclude that FSM pupil’s SATs scores are significantly inflated by the ‘high stakes’ nature  of the tests (OfSTED judgements and local league tables in relation to primary schools), whereas CATs, which are in any case much stronger predictors of GSCE results, are not.

It is easy to see why the link with social disadvantage/relative poverty and lower cognitive ability is so uncomfortable, but no reputable educational research organisation, let alone the government and the media, should be ignoring or covering up uncomfortable truths. Once these are accepted all of the consequential flaws in Dr Montacute’s  paper become readily apparent and make immediate sense, thus establishing the urgent need for national changes to teaching methodology prioritising developing the cognitive ability of all pupils, over the chasing of exam results by ‘exam factory’ methods that fail to result in permanent deep learning.

Students from disadvantaged backgrounds are less likely to be in the top 10% for attainment in English and maths at the end of primary school – referred to in this report as high attainers. Disadvantaged students are three times less likely to be in this high attainment group than their more advantaged peers: only 4% of disadvantaged students have high attainment at KS2, compared to 13% of non-disadvantaged pupils.

Of course students with cognitive abilities in the 30th – 34th percentile range are less likely to be in the top 10% of attainment in SATs at the end of primary school. It’s cognitive ability that counts. FSM pupils are also even less likely to have benefited from a cognitively developmental curriculum in Y7 as a result of pressure to cram/revise for SATs, so they in fact suffer a double disadvantage.

Furthermore, even for those disadvantaged pupils who do perform strongly in primary school, they are much more likely to fall behind at secondary school, compared to other high attaining students, across a range of measures. While high attainers overall make about an average level of progress between key stage 2 and key stage 4 (a Progress 8 score of .02, where the national average is zero), those from disadvantaged backgrounds fall substantially behind, with a negative Progress 8 score of -0.32.

Because FSM ‘high attainment’ in SATs is frequently brought about by extreme coaching/cramming/revising it does not generally last even to the end of the Y6 summer holidays, let alone to Y11 of secondary. Every secondary school that takes a substantial proportion of FSM pupils knows this, which is why so many of them screen their Y7 intakes with CATs.

They are also less likely to achieve the top grades that open doors to universities and employers: while 72% of non-disadvantaged high attainers achieve 5 A*-A grades or more at GCSE, only 52% of disadvantaged high attainers do. If high attaining disadvantaged students performed as well as high attaining students overall, an additional 1,000 disadvantaged students  would achieve at least 5A*-A at GCSE each year.

Dr Montacute is simply recognising that FSM students with lower cognitive abilities, along with all other students in the cognitive ability percentile range 30th – 34th, perform less well at GCSE than students of average cognitive ability (50th percentile) and above. The way to improve these outcomes is to replace the behaviourist teaching and learning approaches brought about by the government’s ideological promotion of the marketisation of our education system since the 1988 Education Reform Act, with the cognitively developmental approaches that have been proven to enhance deep understanding and raise cognitive ability/IQ.

High attainers from disadvantaged backgrounds who are white have the lowest level of attainment at GCSE compared to their peers in any other ethnic group. Only 45% of disadvantaged white students with high prior attainment gain 5A*-A at GCSE, compared to 63% of black students and 67% of Asian students from similar backgrounds.

This is accounted for by low mean CATs scores especially in the white working class communities of former industrial northern towns. For example, the mean intake CATs score in my former headship school near the docks in Barrow-in-Furness was 85 (16th percentile). I only know this because Cumbria was the only LEA in northern England where there was universal CATs screening in Y7, and I was a member of the LEA working party responsible for the CATs screening policy. A far greater proportion of schools in the affluent south use CATs and they will all be well aware of the pattern, but disinclined to publicise it.

Students with high attainment do better at GCSE in schools with lower proportions of students on free school meals, schools in London, in converter academies, and in schools with higher numbers of other previously high attaining students.

Much of that is readily explained by CATs data. Repeated research now shows that Academies in general are no more effective in raising attainment than Local Authority schools. What we do know from EEF research into the ‘attainment gap’ is that it exists in schools judged by OfSTED to be ‘outstanding’ to the same extent as those judged to be ‘requires improvement’ and ‘inadequate’. You can find an informed discussion of these issues here.

Disadvantaged students make up a much smaller proportion in grammar schools, compared to those in comprehensives, with disadvantaged high attainers only half as likely as high attainers overall to enter a grammar. In grammar schools, only 1 in 17 of all high attainers are from disadvantaged backgrounds, compared to 1 in 8 high attainers in comprehensive schools.

More confusion on attainment and disadvantage here. We do know that FSM students have typical cognitive abilities in the 30th – 34th percentile range and are therefore unlikely to pass the 11plus cognitive ability test. No surprise there.

Maximising the potential of highly able young people poses three main challenges in schools: identifying the right students, offering them the right programmes and interventions, and managing the process organisationally in a sustainable way. While highly able students from certain backgrounds, in certain parts of the country, and attending certain types of schools face substantial barriers, what schools actually do for such students can be crucial for success.

But EEF research shows that the alleged attainment gap is the same in all types of schools, grammars, comprehensives, ‘inadequate’ and ‘outstanding’ alike. If high ability is not rigorously identified and distinguished from the illusion of high attainment produced by the high stakes SATs regime, then it is unlikely that useful suggestions for improving educational effectiveness will emerge.

The further recommendations that follow in the report range from truisms to incoherent generalisations.

There are effective evidence based approaches for raising cognitive ability and hence attainment for all students of all abilities including those on FSM. You can find these explained and discussed in my book and on my website. This article would be a good place to start.

Share on Twitter Share on Facebook

Be notified by email of each new post.


John Mountford's picture
Sat, 18/08/2018 - 16:35

Roger, I commend you for sticking with Local Schools Network to post this very important challenge to the status quo.  Personally, I would not have done so, and for good reason. The absence of any comment from the originators of this platform speaks oceans for their actual commitment to the cause of changing the face of education reform. Janet Downes has worked almost singlehandedly to keep LSN alive. Without her, you and a few others it would wither on the vine because it has lost its way.

What you have written highlights The Sutton Trust's failure to accept that their negative contribution to the ongoiung debate about equality and social mobility creates a problem. Their approach is basically flawed. Their lack of interest, as a powerful voice in the ongoing debate about equality, is mirrored by the apathy shown here. Your opening remarks are germane to why I feel this strongly. You have it right with you comment,  " Too many on the left are obsessed with a ‘discrimination’ based explanation for low attainment (in the face of the evidence), combined with an ideological revulsion to the concept of ‘intelligence’, "

In this regard, I would ask your readers to consult those parents bringing up more than one child in a family why they have to understand the different temperaments, dispositions , etc. of their charges in order to support their personal development.  If asked how they account for the differences you'd find them turning to genetics for an explanation. The simple fact is we are born different. Even before nurture plays its hopeful hand, the differences can be mind boggling and are down to genetic endowment. Let me state emphatically, this does not determine their futures. It does not predict their ultimate development but it makes them different because of what natutre has furnished them with. 

So, Roger to all those left-leaning sceptics who shy away from engaing with you, even to declare you've got it wrong and explaining why they hold that view, I say - GROW UP. What is at stake is too important to let political correctness stifle debate.

John Mountford's picture
Wed, 05/09/2018 - 13:47

Roger, it saddens me to add another negative comment to your very important article. However, my challenge to the originators of LSN has either gone unread (not a good sign) or they feel no ongoing sense of commitment to promote lively, current and open debate about education and its future (in which case, shame on them).
To those fair minded individuals on the left and right, I would encourage them to engage in what I accept is a challenging debate about this, too-long neglected area.
Clearly, we cannot rely on academics to back up their own work in the face of challenge from professionals with uncomfortable questions about the conclusions they come to.

Add new comment

Already a member? Click here to log in before you comment. Or register with us.