AUS Tertiary Update
Academics warned of research-assessment
Association of University Staff academic vice-president, Dr Grant Duncan, will today urge tertiary-education staff not to support any future research-assessment schemes, especially those based on bibliometrics. Dr Duncan, in a paper to the Tertiary Education Commission (TEC) forum, “Measuring Research Performance: What are the Options?”, will highlight serious problems with the Performance-Based Research Fund’s use of the individual as the unit of research assessment, the way in which scores are allocated to individuals, and the release and misuse of individual scores.
Speaking personally rather than as a representative of AUS, Dr Duncan will argue that the individual unit of assessment creates a mismatch between what is being assessed (individual researchers and their achievements) and what is being rewarded (universities and their budgets).
“Naturally, research is actually performed by, and depends upon, individuals and teams of individuals. But it is the aggregate institutional ranking that determines the funding allocation; whereas the creation and release of quality scores for individuals has resulted in much invidious behaviour and many misuses of those scores, or cheap internally produced imitations of PBRF quality scores, and the pressure on staff to comply with the audit criteria means that a public policy and management issue is force-fed to individuals,” Dr Duncan will tell the forum.
In his paper, Some principles for redesigning the PBRF, Dr Duncan will also tackle the additional problems that would be associated with a bibliometric, rather than peer-review, approach to research assessment, especially if it too is based on the individual. He will highlight the lack of accuracy in citations indexes and controversy over journal rankings; the gap between being cited and being read, let alone understood; and the migration of research outputs into “high-impact” off-shore publications and its deleterious effect on New Zealand-based studies.
In addition, Dr Duncan will deal with such problems as the possible rewarding of research that causes controversy and is consequently widely cited despite any poor analysis or because of offensive implications; differences in citation conventions and rates across different disciplines and languages; co-authorship exploitation of graduate students; and assessment of contribution percentages among multiple co-authors.
Acknowledging the validity of the view that the PBRF has had some benefits for academics, Dr Duncan will add, “But also, with the present PBRF, we have seen some academics being pressured, harassed, and bullied into research and publishing. The absurdity and injustice of this should be evident to anyone. I can only see this getting worse with the narrow range of criteria specifiable by bibliometric evaluation methods.”
Dr Duncan is a member of the TEC’s PBRF Sector Reference Group for the 2012 PBRF quality evaluation consultation exercise.
Also in Tertiary
Update this week
1. OECD confirms lack of support, says NZUSA
2. Participation urged in PBRF consultation
3. $40 million for genomics research
4. One-stop tertiary shop in Wanganui
5. Upsets expected in research assessment exercise
6. Melbourne academics face sack
7. Research and tobacco
8. Review recommends full research funding
9. Bastardisation or honour?
OECD confirms lack
of support, says NZUSA
Figures released in the recent Organisation for Economic Cooperation and Development report, Education at a Glance 2008, confirm New Zealand’s lack of investment in student support and the high cost borne by students and their families, according to the New Zealand Union of Students’ Associations. “This report proves we have a high-cost and limited-student-support tertiary system that leaves graduates burdened by debt simply for getting an education,” said NZUSA co-president Paul Falloon.
NZUSA said that the 1.5 percent of GDP spent on tertiary education in New Zealand is equal to the OECD average; however a greater share comes from students and their families than in many other countries. Private expenditure in the form of tuition fees accounted for a “massive” 40 percent of expenditure on tertiary institutions, while the OECD average is only 27 percent.
“It’s clear that the lion’s share of funding to the tertiary sector is coming from those who can least afford it, young students and their families,” said Mr Falloon. “This is an inequitable and unsustainable situation given large tuition fees and the high cost of living New Zealanders face. There’s nothing spare to give,” he added.
The report reveals that the average fee for a New Zealand degree-level qualification was $US2,671 in 2005, while eight of the OECD countries surveyed charged no fees. Diploma-level average fees were $US2,489 and six countries charged no fees at all at this level. “New Zealand is often compared to Ireland, and along with Norway, Denmark, and Sweden, that country charges no fees for tertiary education with excellent results academically and for its economy. We would do well to follow this example”, said Mr Falloon.
“Contrary to misleading and inflammatory claims by the New Zealand Vice-Chancellors’ Committee,” he concluded, “only around 23 percent of government expenditure on tertiary education goes directly to student support, only slightly above the OECD average of 18 percent.”
urged in PBRF consultation
Two more consultation papers have been released by the Tertiary Education Commission in the 2012 PBRF Quality Evaluation process. The papers, which follow the initial 2012 Quality Evaluation paper, cover the unit of assessment and special circumstances, and have a deadline for response of 17 October 2008. Further consultation papers are to follow.
The unit of assessment consultation paper discusses issues with regard to the PBRF unit of assessment for the 2012 quality assessment; considers some options for addressing these concerns and makes a recommendation; and invites feedback on the options and recommendations of the Sector Reference Group (SRG) presented in the paper and on any other matters regarding the unit of assessment that should be considered as part of the redesign process.
The special circumstances paper discusses issues and concerns about the special circumstance provisions and their application in the PBRF quality evaluation; considers some options for addressing those concerns; and invites feedback on the options and recommendations of the SRG presented in the paper and on any other matters regarding special circumstances that should be considered as part of the redesign process.
AUS academic vice-president and SRG member, Dr Grant Duncan, is urging maximum participation by AUS members in the PBRF consultation process. “These papers raise important issues that directly affect our members. AUS will be making submissions on the papers but I also encourage individuals to read them and make their own submissions directly to TEC or through their branch to complement the AUS one,” he said. “The unit of assessment paper is of special significance for our members.”
$40 million for genomics
Researchers behind a new genomics research infrastructure involving several of the country’s universities and crown research institutes (CRIs) say it will accelerate the progress of genetic research and technology in New Zealand. The initiative will bring together scientists from three universities, the University of Otago, Massey University, and the University of Auckland, and one crown research institute, AgResearch. It also has support from another four universities and seven CRIs.
The infrastructure will receive $40 million in government funding through the Ministry of Research, Science and Technology over the next nine years alongside parallel investment from collaborating institutions. Modern genomic technologies, which allow scientists to examine the structure and function of thousands of genes at a time, are considered vital to advancing research in health, agriculture, horticulture, biosecurity, and biodiversity.
Director of the University of Otago’s cancer genetics laboratory, Professor Anthony Reeve, a leader in the infrastructure’s development, says such a collaborative national infrastructure will help New Zealand stay at the forefront in genomic research. “New technologies and methodologies are emerging all the time. We need to keep pace with that change for the benefit of New Zealanders,” he said.
Each of the key institutions will bring different areas of expertise to the infrastructure. As the lead institution, the University of Otago has expertise in all areas, including genome sequencing, bioinformatics, and gene arrays, the technology used to examine genetic variations. This is complemented by the strong expertise Massey University has in sequencing, genomics, and bioinformatics, and the University of Auckland’s and AgResearch’s expertise in genomics and bioinformatics. They also have complementary technologies which do different tasks.
One-stop tertiary shop in Wanganui
Students in the Wanganui region will soon have a new and possibly unique way to map out the best study route to their chosen careers. A new one-stop-shop resource will be based at Wanganui’s new tertiary-education campus, Matapihi ki te Ao, and is the first step in what has been described as a new concept for tertiary education in New Zealand. The resource provides information on all tertiary-study options in the region, and links to other support and industry information.
The Whanganui Tertiary Education Venture (WTECV) project launched the new initiative yesterday as a pilot that will also give up to 200 students at private tertiary-education providers in the region access to UCOL facilities in Wanganui.
The WTECV project is a partnership involving the Tertiary Education Commission, Whanganui UCOL, and other tertiary-education providers in the region, as well as support agencies such as Career Services, Study Link, and Work and Income New Zealand.
The initiative offers new opportunities for present and future tertiary-education students in the Wanganui region. Two state-of-the-art, touch-screen portals will allow access to a new website with information on more than 130 courses available within the region. As well as links to tertiary-education providers, the portals also provide links to education-related agencies and industry training organisations as well as a bi-lingual glossary of terms.
Whanganui UCOL principal Suzanne Frecklington says the launch is an important milestone towards creating a shared learning community that represents the region’s tertiary-education providers. “We’re pleased to open up new opportunities for students by giving them tools to plan their study paths and their careers. We’re also looking forward to sharing our wonderful new facilities at Matapihi ki te Ao with a wider student group,” said Ms Frecklington.
Upsets expected in research assessment exercise
Major upsets to the existing hierarchy of research excellence can be expected when the results of the research assessment exercise (RAE) are released in December, according to an academic helping to judge the submissions. Ray Paul, an emeritus professor at Brunel University, has warned that, when trying to select the best research papers to submit to the 2008 RAE, some university departments have relied too heavily on the perceived prestige of the journals the research was published in.
“Such rankings do not equate to research quality,” he said. “The results that come out in December may not be what [departments] expect. They may have got themselves a whole pile of publications in the top-ranked journals but find themselves not top-ranked.”
The RAE rules prevent assessment panels from using journal rankings to judge quality, requiring them instead to use peer review. But Professor Paul said it was “common knowledge” that universities had used ranked lists of journals to decide which papers to submit to the RAE. He cites the example of an information-systems journal that appears “near the top of the table” but has a “striking” lack of correspondence with quality.
“The reason for this is that the journal, with a very large circulation, has concentrated on making the research results clear to its wider and varied readership, and therefore wants little in the paper about the research content. So when assessing such a paper for research quality, there is hardly any,” he added. “It would appear to me that journal league tables are to do with promotion procedures and rites of passage in academia, not quality research.”
From Zoë Corbyn in Times Higher Education
Melbourne academics face sack
As many as 20 senior academics could be sacked from Melbourne University’s embattled arts faculty by the end of the year in a cut designed to save about $NZ2.45 million. The announcement this week by dean of arts, Professor Mark Considine, is in addition to the 30 voluntary redundancies announced earlier this year and coincides with the release of a staff workload survey indicating widespread stress.
A draft proposal, released to staff for consultation, outlines the forced redundancy programme, stating that the sacked staff would have to be out by the end of the year “to assist with reducing staffing costs”. The draft says targeted staff would be those whose research activity over the past five years failed to meet academic board requirements.
The National Tertiary Education Union (NTEU) said this would include senior lecturers, associate professors, and professors. NTEU Melbourne University branch president, Ted Clark, said the cut represented a significant proportion of academic staff, almost 10 percent of the full-time teaching workforce in the arts faculty, and would endanger subject offerings next year as well as increase the workload for remaining staff at a time when many felt overworked. He added that the student-staff ratio would swell beyond the current 20 to one following the cuts.
The troubled arts faculty has already weathered the loss of 24 professional and six academic staff by way of voluntary redundancies this year. That exit followed last year’s departure of 24 academic staff from the faculty, a move that cut wage costs by $NZ5.26 million to $NZ50.5 million this year. Results of the union survey, conducted in May with more than 800 staff across faculties, show general and academic staff feel they are experiencing excessive workloads and work-life imbalance.
From Bridie Smith in the Age
Research and tobacco
Earlier this year, the New York Times published an account of a contract between Philip Morris USA, America’s largest tobacco company, and Virginia Commonwealth University in Richmond. The contract was highly unusual in giving the tobacco company not only the right to bar publication or discussion of the research but also assigned to the company all patent and intellectual property rights flowing from the research.
Responding to the report, Dr Rick Solana, Philip Morris’s senior vice-president for research and technology, said that, once the company concluded that its competitive interests were protected regarding any research results, it could permit publication. “Once the intellectual property is protected, then it’s usually OK to publish. Something being proprietary does not mean something cannot be published,” he told the newspaper.
Some anti-smoking organisations maintain that research which the industry pays for is near to worthless, or at best suspect. Monika Kosińska, secretary-general of the European Public Health Alliance, for instance, says, “Where there’s a conflict of interest between the organisation producing the products and the health outcome, that research is always compromised.”
By contrast, the industry argues that the more money engaged in research, the better the health benefits. “Maximising the funding available for researchers can offer the greatest potential benefits in addressing the health risks associated with smoking,” says Marija Sepic, manager of external communications at Philip Morris International.
In sharp conflict with that view, the leading US public-health agency, Centers for Disease Control and Prevention (CDC), argues that opponents of public health (in which they include the tobacco industry) frequently attempt to “manufacture uncertainty” by questioning the validity of scientific evidence on which health regulations are based. Producers of tobacco and other hazardous products frequently ridiculed any research that threatened their interests as “junk science”, said CDC. The agency always has in mind the funding source and other potential biases when considering research.
From Alan Osborn in University World News
Review recommends full research
According to the National Tertiary Education Union, the release of a comprehensive review of Australian innovation, Venturous Australia, will make a valuable contribution to the debate about the future direction of education and research and development (R&D) policy for Australia. “The report highlights the importance of innovation for Australia’s future economic, social, and cultural prosperity,” said NTEU national president, Dr Carolyn Allport.
“It also shows that the stalling of productivity growth over the last five years has occurred at the same time as levels of public investment in education and R&D have been declining. The need for increases in the level of public investment in the education and skills of our people, human capital, is emphasised as an essential and central component of any policy response that aims to strengthen Australia’s innovation performance,” she said.
“NTEU strongly supports the recommendations for an immediate increase in funding for research undertaken by our universities to ensure that grants cover the full costs of undertaking specific research projects, without reducing the number of projects being supported. The union also applauds the report’s recommendations for greater collaboration in research and increases in the level of financial support for research students,” Dr Allport continued.
“If our universities are expected to provide a quality education that produces graduates with the capacity to adopt and adapt new innovations, it is critical that both universities and the proposed funding model encourage greater engagement of academic staff in research. The report correctly highlights that maximising the benefits from innovation research requires greater numbers of people to participate in research,” concluded Dr Allport.
Bastardisation or honour?
“I was party to it, willingly, I had a hell of a lot of fun, [but] I totally refute the implication ... that it was an exercise in bastardisation,” said Dr Ray Roberts, who participated in what has been described as the pitchfork ritual of the elite applied mathematics department at the Australian National University. His explanation follows reports that postgraduates unfortunate enough to fall behind in their work in the department were paraded, bent over as a mock poem was read, and had a pitchfork pointed at their bottoms.
However, not everybody agrees it was fun. Andrew Stewart, an ANU physicist who feels he was pressured into early retirement in 2005 for denouncing these rituals as bastardisation, has reprised the affair for the Senate inquiry into academic freedom.
The academic organisers of the pitchfork rituals insisted they were voluntary affairs and vice-chancellor Ian Chubb has assured Dr Stewart by letter that “no student of the university will be required to participate in ritual-type activities”. Dr Stewart says that, when one student refused to take part, an email summoning staff in the department to a pitchforking spoke of “important secret business”. The rituals took place in the early 2000s.
Dr Roberts said his 2004 doctorate was “one of the proudest achievements” of his life. “I was the second recipient of the pitchfork award and I can assure you I consider it a great honour,” he said. “It was done off-site from the university, [at] a private person’s residence. I just find it amazing that anybody could consider it bastardisation. Quite the reverse: all the academic staff were terribly supportive.”
Nigel Palmer, president of the Council of Australian Postgraduate Associations, was bemused by the rituals. “I’d assumed that these sorts of practices had gone out of fashion with flares,” he said.
From Bernard Lane in the Australian
More international news
More international news can be found on University World News:
Update is published weekly on Thursdays and distributed
freely to members of the Association of University Staff and
others. Back issues are available on the AUS website:
www.aus.ac.nz. Direct inquiries should be made to the