Top Scoops

Book Reviews | Gordon Campbell | Scoop News | Wellington Scoop | Community Scoop | Search


Will Fairfax respond to unfairness of school comparisons?

Publishing National Standards: Will Fairfax Media respond to the unfairness of school comparisons?

by Martin Thrupp
June 13, 2013

The next stage of releasing this year’s National Standards judgements will be the release of data on individual schools later this month. When it happens Fairfax’s response should be of considerable public interest.

It has become increasing clear that it is impossible to use National Standards data for comparing the achievement of schools. It was obvious from the outset that the data was raw data that doesn’t take account of differences in the nature of school intakes. It has subsequently also become apparent from research that numerous sources of variation underlie the way the data is collected making it even more unsuitable for comparative purposes.

Despite this, Fairfax may be gearing up for publishing another round of National Standards data by way of its newspapers and especially the ‘School Report’ section of its various websites. A new heading has appeared on the Stuff education page: ‘School report: data now available for 2009 New Zealand Schools’. When compared to other media sources such as APN’s The New Zealand Herald and Radio New Zealand, Fairfax also appears to have little coverage of recent criticisms of the release of the data.

It is concerning that Fairfax might want to continue promoting the comparison of schools’ National Standards judgements despite the increasing evidence that this is misleading. I reproduce below a statement sent to Fairfax last month where I urged this media company to stop publishing the data.

Statement about Fairfax publication of National Standards data (newspapers and digital) in 2013.

Last year Fairfax made a point of trying to be responsible about its initial publication of ‘ropey’ National Standards data. Fairfax’s September 2012 release of the data was qualified by the editorial comments of then senior political reporter, John Hartevelt and by a range of other commentaries and case studies.

Since that time it has become apparent that because Fairfax put the data online in particular ways, the release of data now continues in a way that is largely unqualified. A reader can currently go onto Fairfax’s Stuff education page or just the home pages of papers like the Waikato Times or Nelson Mail, be invited by the ‘School Report’ button to pick up to ten schools and can start comparing their results without having to be exposed to very much in the way of context.

For this reason, whether Fairfax reporters bother with the same level of qualifying commentary this year as they did when the data was first published in September 2012 is not the test of commitment to a contextualised account of the data that it might have otherwise been. Fairfax is already failing in requiring on any continuing basis the contextualised view of National Standards it promised readers last September when Hartevelt claimed that Fairfax had “...not simply dumped all of the new National Standards data online”.

My latest RAINS research report released last week illustrates the further serious problem of much variability in what the data actually represents across schools. It may have some meaning within the assessment processes of individual schools but shouldn't be used for making comparisons between them - see especially section 3 of the report.

Just yesterday Nikki Kaye, Associate Minister of Education, said in the House that ‘we [the Government] will be publishing the data because we are confident of overall teacher judgments, not just one assessment tool’. Yet the RAINS research indicates the data does not deserve the confidence being expressed in it by Government.

In the circumstances I urge Fairfax not to publish this year’s National Standards data and to remove the 2012 data from its websites. The publication of such a poor data set has become increasingly indefensible.


Martin Thrupp is a Professor of Education at the University of Waikato.

© Scoop Media

Top Scoops Headlines


Gordon Campbell: on the inquiry into the abuse of children in care

Apparently, PM Jacinda Ardern has chosen to exclude faith-based institutions from the government’s promised inquiry into the abuse of children in state care. Any role for religious institutions – eg the Catholic Church – would be only to observe and to learn from any revelations that arise from the inquiry’s self-limiting focus on state-run institutions… More >>

Summer Reading:

Charlotte Graham: I OIA'd Every Council In NZ...

A “no surprises” mindset and training and advice that has taught public servants to see any media interaction as a “gotcha” exercise perpetrated by unscrupulous and scurrilous reporters has led to a polarised and often unproductive OIA process. More>>


Veronika Meduna: The Kaikoura Rebuild

A Scoop Foundation Investigation The South Island’s main transport corridor will be open to traffic again, more than a year after a magnitude 7.8 earthquake mangled bridges and tunnels, twisted rail tracks and buried sections of the road under massive landslides. More>>

Charlotte Graham: Empowering Communities To Act In A Disaster
The year of record-breaking natural disasters means that in the US, as in New Zealand, there’s a conversation happening about how best to run the emergency management sector... More>>


Campbell On: The attacks on Lorde, over Israel
The escalation of attacks on Lorde for her considered decision not to perform in Israel is unfortunate, but is not entirely unexpected…More

Jan Rivers: The New Zealanders Involved In Brexit

There are a number who have strong connections to New Zealand making significant running on either side of the contested and divisive decision to leave the European Union. More>>