Single Output REF Impact Case Studies: A Rare but Valid Option | Stephen Kemp posted on the topic | LinkedIn Here’s one for the REF impact case study nerds! I am sometimes asked about impact case studies underpinned by a single research output. My answer is generally that they exist and this is completely w...

Such an exploration of REF2021 impact case studies.

The data challenge a common assumption about single-output ICS, and that’s exactly why evidence matters.

What’s been your experience with single-output case studies? www.stephenckemp.co.uk/ref-impact-c...

#REF2021 #researchimpact #casestudies

World is short of nearly a million midwives, report warns Shortage raises rates of maternity intervention, while improving access to care could potentially save 4.3m lives a year, say experts

Links:

* www.theguardian.com/global-devel...

** www.thelancet.com/series-do/mi...

*** Taken from results2021.ref.ac.uk/impact/dac99...
#REF2021

Screenshot of article title, authors, and Abstract Psychology and research assessment in the United Kingdom Matthew Inglis,Colin Foster,Hugues Lortie-Forgues,Victoria Simms & Elizabeth Stokoe Abstract What can we learn about psychology research in the UK, and its perceived quality, from examining manuscripts submitted to the psychology, psychiatry and neuroscience subpanel of the 2021 Research Excellence Framework (REF2021)? Using a latent Dirichlet allocation topic modelling approach, we identified 33 topics which collectively summarised the content of the journal articles returned to the subpanel. We found that the composition of submissions to the subpanel, in terms of these topics, explained a large proportion of the variance in the quality assessments they received from the expert peer review subpanel. Our model identified topics which were typically associated with receiving higher and lower unit-level quality assessments. In our discussion we pay particular attention to the fate of qualitative research, and discuss possible accounts for why units who returned a large amount of qualitative work tended to receive lower quality assessments than those who did not.

For anyone interested in #psychology, #research assessment and evaluation, how the expert panel rated research submitted to #REF2021 - and especially the fate of #qualitative research - our article in Cogent Psychology is #OpenAccess (link in next post).

1/2

Equality and employment aspects of the UK Research Excellence Framework Abstract. This article analyses issues of equality and selection arising from the preparation for, and submissions to, the Research Excellence Framework 20

Published open access this week in OUP’s Research Evaluation (by me)

Equality and employment aspects of the UK Research Excellence Framework url: academic.oup.com/rev/article/...

#REF2021 #REF2029

Meet our next #RISummit Duo: David Phipps & Dori Simeonov

They will explore Strengthening Institutional Impact Support, with fresh perspectives on changes after #REF2021 in the UK and the evolving role of #AI in knowledge mobilization.

Register now at researchimpactsummit.com

Investing in research in the #InnovationCorridor between #Camden and #Peterborough benefits...everyone. Here's #REF2021 impact of the Corridor's #universities mapped across the UK. Darker the colour the greater the.impact concentration.

Happy to have a chat if you go in this direction and find it useful. I was involved in the submission side of #REF2021 so I might be able to answer some questions about structures, organisation, etc - not a research area of mine, though (DM/ my institutional details are easy to find).

Impact database : Results and submissions : REF 2021

Taking it on from the other side: In the UK's Research Excellence Framework research units need to report so-called "Impact Case Studies", i.e. how their research has been used outside academia. Maybe worth a shot?

#REF2021
results2021.ref.ac.uk/impact

#REF2014
impact.ref.ac.uk/casestudies/

In May 2022, @livunipol.bsky.social got its #REF2021 results, which showed significant progress from the previous REF! We were proud of these results - for a day, then we start planning on how to improve them further! IMO, 100% of academics (PhD to Prof) should go in so all research is celebrated!

a man wearing glasses and ear buds says a bit of a controversial one ALT: a man wearing glasses and ear buds says a bit of a controversial one

Spent the day talking #REF2029, so...

#REF2021 cost HE £430m, or ~£3m per institution.

70% of UK HEIs are forecast to be in the red soon.

So...why's the sector doing this when >90% of the variance in QR is explained just by citations?

REF's great but...keeping HE is more important for the UK.

“If you liked #REF2021, you’ll LOVE #REF2029…”

Doing a research on books in the #REF2021 project. One weird finding is that political science has very high share of authored books among all books (vs. edited books and book chapters). #bibliographicdata #scisci #scientometrics

How to write a “good” REF Environment Statement As Research England considers increasing the weighting of environment statements to 25% in REF2029, there is a heightened focus on what exactly constitutes a high-quality statement. Based on a text…

Discussing their recent study of #REF2021 environment statements, @lizziegadd.bsky.social, @lizstokoe.bsky.social & @mjinglis.bsky.social highlight eight features of 'good' statements & suggest how they can be incorporated into work for #REF2029

#ResearchEvaluation #HigherEducation wp.me/p4m9em-cSm

What is a high-quality research environment? Evidence from the UK’s research excellence framework Matthew Inglis, Elizabeth Gadd, Elizabeth Stokoe Abstract As part of the UK university sector’s performance-related research funding model, the ‘REF’ (Research Excellence Framework), each discipline-derived ‘Unit of Assessment’ must submit a statement to provide information about their environment, culture, and strategy for enabling research and impact. Our aim in this paper is to identify the topics on which these statements focus, and how topic variation predicts funding-relevant research environment quality profiles. Using latent Dirichlet allocation topic modelling, we analysed all 1888 disciplinary ‘unit-level’ environment statements from REF2021. Our model identified eight topics which collectively predicted a surprisingly large proportion—58.9%—of the variance in units’ environment scores, indicating that the way in which statements were written contributed substantially to ....

What is a high-quality #research #environment?

New paper by @mjinglis.bsky.social @lizziegadd.bsky.social & me topic modelling all unit-level #REF2021 environment statements shows that how statements were written contributed substantially to the perceived quality of a unit’s research environment.

Coming to the end of the week
Part 4 of #REF2014 #REF2021 #psychometrics.

This time a look at how much the institutions matters from which a submission is made for the respective GPA score.

Back to #REF2014 #REF2021 application of #psychometrics in clustered data:

Do subject-specific standards matter?

The Research Excellence Framework is the UK’s system for assessing the quality of research in UK higher education institutions.

More detail:

In #psychometrics & #REF2021 the analyses from

are now applied to #REF2021 data.

The #REF2014 high inter-correlations between the 3 quality indicators were interpreted as evidence that dropping any one of the indicators has little effect on ordering.

#REF2021 #REF2028 research evaluation activity picked up gain & I came back to analyses I did earlier this year replicating parts of this paper by @Mehmet_Pinar_M @timjhorne:


The paper applies #PCA to #REF2014 profile data:
💾

So... how many #REF2021 Impact Case studies were about forcing a socially or environmentally problematic company out of business??

Congratulations to @UoSGeogEnv for rising to joint 3rd place in the Geography and Environmental Studies #REF2021

Subscribe to the Financial Times A subscription to the Financial Times provides you with t...

The culture of anti intellectualism in the U.K. does us no favours. 41% of research found to be world beating. Today should be a national holiday #REF2021 https://on.ft.com/3L8S6Pw

88% of Oxford’s archaeology research submission was rated 4* & 3* - or 'world leading' & 'internationally excellent'. Endorsing the research power of our community & networks across the globe & testament to the positive impact #archaeology has in the present! #REF2021

Sparing a thought for academic colleagues up nice and early to ponder the meaning of #REF2021 (or is it #REF2022) 😀

I can see my office! - great #ref2021 result for ⁦@NorthumbriaUni⁩ today and ⁦@NBSNU⁩ campus featured here. Places us top 30 for research power. Congrats to all my colleagues - it’s been hard work but paid off :) #lovehe #highered

Good morning, UK academia. Rankings don't define us and sure as hell should not divide us. #CollaboratorsNotCompetitors #REF2021

Cannot believe I am sitting in Finland wondering/curious about #REF2022 #REF2021 results
I left the UK in Oct 2020 - But I guess, if a success, my strategy as PVC-Research in my last institution will not be remembered, but if it has gone wrong my input will be an easy target 😂

Heidi Brattland provides a fascinating insight into planning and building feedback systems in Norway and how feedback is a good cultural fit.

Have a look at this interview:


And one of the studies she refers to:


#REF2021

Can we agree that if one is comparing 2/+ treatments w/o random assignment, extraordinary methods & arguments are required to even suggest that they correlate w anything at all?

[After living under the #REF2021 rock, just coming back to #peerreview-ing]

When you use #rstats to calculate word count scenarios.

#REF2021

On 20 Nov @ResEngland @UKRI_News confirmed Mar21 #REF2021 submission date. Given emergence ofmuch more infectious Cov-19 variant & now closure of schools for 6+ wks, there is strong case for reconsidering this decision & postponing further. Staff are stretched to breaking point.