Consultation 2009
The four UK higher education funding bodies have consulted on proposals for the Research Excellence Framework (REF) and are currently analysing the responses. The consultation set out proposals for all key aspects of the framework and invited responses from across the UK.
Proposals
HEFCE 2009/38 sets out proposals for all key features of the REF. These include:
- defining research excellence and the key features of the assessment framework
- assessing the quality of research outputs – including the use of citation information
- assessing the impact of research on the economy and society
- assessing the research environment
- the overall outcomes of the assessment
- the configuration of panels and Units of Assessment (UOAs), and how to achieve appropriate levels of consistency between these
- measures to promote equalities and diversity
- the timetable for implementation of the REF
- the accountability burden implications of the REF.
A summary of our proposals can be found in 'The Research Excellence Framework: A brief guide to the proposals' (Adobe PDF 124K).
Development of proposals
We developed the proposals through a substantive bibliometrics pilot exercise and extensive advice and discussions with a range of stakeholders. A range of reports and documents are available below.
Bibliometrics pilot exercise
We conducted a substantive pilot of bibliometrics indicators of research quality, as a significant new element in the framework.
- More on bibliometrics and citation data
- Report on the pilot exercise to develop bibliometric indicators (HEFCE 2009/39)
- Report on data collection for the bibliometrics pilot exercise
- First report on 'lessons learned' from the bibliometrics pilot exercise
- Second report on 'lessons learned' from the bibliometrics pilot exercise
Assessing impact
Proposals for the assessment of impact have been developed through:
- workshops with a range of research users
- a consultancy study on international approaches to assessing the impact of research (Not yet available)
We have initiated a pilot exercise to test and develop our approach. More about assessing impact and the pilot exercise.
Expert Advisory Groups
We established Expert Advisory Groups and held a series of meetings with these groups to discuss, and take advice on all key aspects of the REF proposals as they developed. We have produced a summary of their discussions over the series of meetings.
- Summary of Expert Advisory Group discussions (Adobe PDF 240K)
Equality and diversity
We worked with the Equality Challenge Unit (ECU) to review the equalities measures taken in the 2008 RAE and identify potential improvements for the REF. We have undertaken quantitative analysis of staff selected for the 2008 RAE, analysed the bibliometrics pilot data to identify equalites issues, and taken advice from the REF Expert Advisory Groups.
Burden
We commissioned a review of the accountability burden of the 2008 RAE, and discussed the options for reducing burden in the REF with a range of key stakeholders.
Other work
We worked with the Research Information Network (RIN) to investigate the influence of research assessment upon researchers' publication behaviours. We also worked with the Joint Information Systems Committee (JISC), the Higher Education Statistics Agency, the research councils and a number of institutions to develop and support improvements to research information management.
Last updated 23 December 2009