REF changes could have a bad impact on mental health

Posted in Research on October 1st, 2017 by steve

“In late 2013, I led a project evaluating how universities went about preparing the impact element of their submission to the 2014 research excellence framework. As was widely reported, we estimated that the monetised costs of preparing submissions across the sector was about £55 million …” (more)

[Jonathan Grant, Times Higher Education, 28 September]

Tags: , ,

TEF results – How do REF and TEF results compare?

Posted in Governance and administration on June 22nd, 2017 by steve

“My first ever blog for Wonkhe was back in 2014, just after the REF results were released. I compared those results with NSS, to see if they could give us an idea of different institutions’ strategic focuses on research and teaching …” (more)

[David Morris, Wonkhe, 22 June]

Tags: , , ,

Why is so much research dodgy? Blame the Research Excellence Framework

Posted in Research on October 17th, 2016 by steve

UK“The study of psychology is facing a crisis. A lot of research doesn’t show the same results when the experiment is repeated, and it is critical we address this problem. But the Research Excellence Framework has led to a research culture which is suffocating attempts to stabilise psychology in particular, and science in general …” (more)

[Alex Jones and Andrew Kemp, Guardian, 17 October]

Tags: , ,

The Stern Review on REF 2014 – a review of recommendations

Posted in Research on August 23rd, 2016 by steve

UK“Following the recent publishing of the Stern Review of REF 2014, Dr Sergey Popov looks at some of the recommendations contained in the report …” (more)

[QPOL, 22 August]

Tags: , ,

Cheap at any price?

Posted in Governance and administration on May 31st, 2016 by steve

UK“In the United Kingdom at least there now appears to be a belief that assuring quality means measuring things. This, as we have noted previously in this blog, lies at the heart of the Research Excellence Framework …” (more)

[Ferdinand von Prondzynski, University Blog, 31 May]

Tags: , ,

REF: static ranking raises questions about management policies

Posted in Research on December 24th, 2015 by steve

UK“Universities hoping to enter the top half of the Russell Group based on research prowess are likely to be disappointed because their position in academia’s unofficial pecking order seldom changes substantially, a study suggests …” (more)

[Jack Grove, Times Higher Education, 24 December]

Tags: , ,

Why I had to quit the research excellence framework panel

Posted in Research on November 19th, 2015 by steve

UK“Despite some whispers that the research excellence framework (REF) might be scrapped, the government’s higher education Green Paper, published earlier this month, indicates that it will remain – possibly subject to a metrics-based interim ‘refreshment’. There is even a proposal to introduce a version for teaching. That is a pity …” (more)

[Times Higher Education, 19 November]

Tags: , ,

Metrics-based mini REF ‘won’t be credible’

Posted in Research on November 10th, 2015 by steve

UK“A proposed additional assessment of research quality between research excellence frameworks based on metrics such as citations rather than peer review would not be seen as credible, according to one of the authors of a major government-commissioned report on the subject …” (more)

[David Matthews, Times Higher Education, 10 November]

Tags: , ,

Was the REF a waste of time? Strong relationship between grant income and quality-related funding allocation

Posted in Research on August 25th, 2015 by steve

UK“If the funding allocated to universities on the basis of the REF is correlated to the grant funding universities already receive, what is the point of the output assessment process? …” (more)

[Jon Clayden, Impact of Social Sciences, 25 August]

Tags: , ,

Why did REF2014 cost three times as much as the RAE? Hint: It’s not just because of the added impact element

Posted in Research on August 4th, 2015 by steve

UK“The benefits of any research assessment framework should ideally outweigh the costs and burden incurred by universities and staff. Derek Sayer argues there should be cause for concern now that recent analysis shows the 2014 REF bill was three times as much as the last UK assessment exercise …” (more)

[Impact of Social Sciences, 3 August]

Tags: , , ,

REF 2014 cost almost £250 million

Posted in Research on July 14th, 2015 by steve

UK“Universities spent about £4,000 for each researcher who they submitted to the research excellence framework, a report has revealed. The estimate of institutions’ own total spend on the REF exceeds £230 million, of which £55 million went on preparing impact statements and £19 million for panellists’ time …” (more)

[Holly Else, Times Higher Education, 14 July]

Tags: ,

Science, values and the limits of measurement

Posted in Research on July 14th, 2015 by steve

UK“Metrics play a growing role in managing research. But to understand their limitations, we need to draw on the humanities. Last week, the independent review of metrics in research assessment published its final report The Metric Tide …” (more)

[Cameron Neylon, Guardian, 14 July]

Tags: , ,

Metrics cannot replace peer review in the next REF

Posted in Research on July 9th, 2015 by steve

UK“The findings of the Independent Review of the Role of Metrics in Research Assessment and Management conclude that ‘no metric can currently provide a like-for-like replacement for REF peer review’ …” (more)

[Emily Lupton, Wonkhe, 9 July]

Tags: ,

Can the research excellence framework run on metrics?

Posted in Research on June 18th, 2015 by steve

UK“The current research excellence framework is ‘a bloated boondoggle’ that ‘steals years, and possibly centuries, of staff time that could be put to better use, and includes so many outcome measures that every university can cherry-pick its way to appearing ‘top-ranking’ …” (more)

[Paul Jump, Times Higher Education, 18 June]

Tags: , , ,

REF 2014: impact element cost £55 million

Posted in Research on April 2nd, 2015 by steve

UK“The impact element of the research excellence framework was almost as costly to institutions as the entire 2008 research assessment exercise. That is one of the findings of Rand Europe’s assessment of institutions’ and panellists’ experience of the inaugural inclusion of impact in the 2014 REF …” (more)

[Paul Jump, Times Higher Education, 2 April]

Tags: , , ,

Book Review: Rank Hypocrisies: the Insult of the REF by Derek Sayer

Posted in Research on March 9th, 2015 by steve

UK“Publication of the results of the 2014 Research Excellence Framework evaluation of the quality of work undertaken in all UK universities last December attracted much attention, as league tables of university and department standings were constructed and estimates of the financial consequences of the achieved grades were assessed …” (more)

[Ron Johnston, Impact of Social Sciences, 8 March]

Tags: ,

Research: the wrong priority for the arts and humanities?

Posted in Research, Teaching on February 12th, 2015 by steve

UK“The fact that the publication of the research excellence framework was such big news indicates the extent to which every university department has become obsessed with its performance since research assessment exercises were established in 1986 …” (more)

[David Oldfield, Times Higher Education, 12 February]

Tags: , , , ,

Academic estimates ‘real’ cost of REF exceeds £1bn

Posted in Research on February 12th, 2015 by steve

UK“Official estimates of the cost of research assessment to universities are ‘disingenuous’ and the real bill could exceed £1 billion, a senior academic has estimated …” (more)

[Paul Jump, Times Higher Education, 12 February]

Tags: ,

Death in academia and the mis-measurement of science

Posted in Life, Research on February 11th, 2015 by steve

UK“Universities are increasingly run like businesses hungry for performance benchmarks, disconnected from the way scientists themselves would like their research evaluated …” (more)

[Arran Frood, EuroScientist, 9 February]

Tags: , , ,

Stop treating universities as if they were a football game

Posted in Governance and administration on February 3rd, 2015 by steve

UK“Universities are now virtually run by the various measures of their performance. They have sacrificed the freedom to make their own choices. Instead, they have to conform to the direction and choices embodied in all these external measures set by others …” (more)

[Peter Scott, Guardian, 3 February]

Tags: , , ,