Research Evaluation Group Outputs and Outreach
Articles, blog posts and podcasts
- Gadd, Elizabeth. (2022). ‘More Than Our Rank’ reaches the places that league tables can’t. Research Fortnight. (17 October 2022) https://www.researchprofessionalnews.com/rr-news-uk-views-of-the-uk-2022-10-more-than-our-rank-reaches-the-places-that-league-tables-can-t/
- Emerald Podcast Series. Are you in? How close are we to reaching more responsible research assessment across the globe? (parts 1 & 2) [Elizabeth Gadd talking about the INORMS work on responsible research evaluation.] https://www.emeraldgrouppublishing.com/podcast-are-you-how-close-are-we-reaching-more-responsible-research-assessment-across-globe-parts-1
- Barnett, Adrian & Elizabeth Gadd. 2022. University league tables have no legs to stand on. Significance, 19 (4), 4-7. https://rss.onlinelibrary.wiley.com/doi/epdf/10.1111/1740-9713.01663 (Repository version also available)
- SRAI Shop Talk Podcast | Hot Topics in Research Administration – Episode 2 | Baron Wolf talking about SCOPE
- Gadd, Elizabeth, Richard Holmes & Justin Shearer. (2021) Developing a method for evaluating global university rankings, Scholarly Assessment Reports, 3(1), p.2. https://www.scholarlyassessmentreports.org/articles/10.29024/sar.31/
- Gadd, Elizabeth. (2021) Mis-measuring our universities: why global university rankings don’t add up. Frontiers in Research Metrics & Analytics, 09 September 2021 https://www.frontiersin.org/articles/10.3389/frma.2021.680023/fullin.org)
- Strøm, Tanja & Nils Pharo (2020). Rangeringene må bedømmes kritisk. Khrono 29.10.2020. https://khrono.no/rangeringene-ma-bedommes-kritisk/527018
- Gadd, Elizabeth. University Ranking need a rethink. (2020) Nature. 24 November 2020. https://www.nature.com/articles/d41586-020-03312-2
- Gadd, Elizabeth & Richard Holmes. (2020). Rethinking the rankings. ARMA Blog. https://arma.ac.uk/rethinking-the-rankings/
- Himanen, Laura & Elizabeth Gadd. (2019). Introducing SCOPE – a process for evaluating responsibly. https://thebibliomagician.wordpress.com/2019/12/11/introducing-scope-aprocess-for-evaluating-responsibly/
Reports
In the press
- Ber universitetene utdanne folk i bruk og misbruk av rangeringer.[Encourage the universities to educate people in the use and abuse of rankings.] https://khrono.no/ber-universitetene-utdanne-folk-i-bruk-og-misbruk-av-rangeringer/821622 (Khrono is an independent newspaper for higher education and research in Norway.)
- Recommendation of the use of SCOPE to address research assessment reform in China. https://www.nature.com/articles/d41586-022-00408-9
- Research assessment exercises are necessary — but we need to learn to do them better. Nature 617, 437 (2023). https://www.nature.com/articles/d41586-023-01611-y [Mention of SCOPE framework].
- Rapple, Charlie. (2023) Smorgasbord: Trends from the Spring 2023 Meetings and Conferences. Scholarly Kitchen [Mention of SCOPE framework as a key takeaway from the EARMA conference].
- Baron Wolf, More Than Our Rank: A New Initiative from the INORMS Research Evaluation Working Group, SRAI News 08 March 2023 https://www.srainternational.org/blogs/srai-news/2023/03/08/more-than-our-rank-a-new-initiative-from-the-inorm
- Morrish, Liz. (2022) No More Big Lie. Academic Irregularities Blog. https://academicirregularities.wordpress.com/2022/12/31/no-more-big-lie/ [Describes the INORMS More Than Our Rank scheme as “a fantastic initiative from actual practitioners”].
- Bredahl, Laura. (2022) “The Current and Evolving Landscape of Bibliometric Tools and Technologies”, Library Technology Reports vol. 58, no. 8 (November/December 2022). https://doi.org/10.5860/ltr.58n8. Describes the INORMS SCOPE Framework and states: “The work coming out of INORMS is crucial for a bibliometric practitioner to understand”.
- Rushforth, Alex, Marta Sienkiewicz, Sarah de Rijcke, Building knowledge infrastructure to support research assessment reforms: Dispatches from the Dutch Recognition and Rewards Festival 2022: https://leidenmadtrics.nl/articles/building-knowledge-infrastructure-to-support-research-assessment-reforms-dispatches-from-the-dutch-recognition-and-rewards-festival-2022[Reference to SCOPE framework]
- Research evaluation needs to change with the times. Nature 601, 166 (2022) doi: https://doi.org/10.1038/d41586-022-00056-z [Reference to SCOPE framework]
- INORMS Research Evaluation Group Releases Guide to SCOPE Framework for Responsible Research Evaluation. (10 December 2021). Baron G Wolf https://www.srainternational.org/blogs/srai-news/2021/12/08/inorms-research-evaluation-group-releases-guide-to
- INORMS Guide aims for more responsible research evaluation. (22 November 2021) Mico Tatalovic https://www.researchprofessionalnews.com/rr-news-world-2021-11-inorms-guide-aims-for-more-responsible-research-evaluation/
- Editorial – ‘Research managers are essential to a healthy research culture. (7 July 2021) https://www.nature.com/articles/d41586-021-01823-0
- University leaders urged to take a stand against rankings (16 March 2021) Fiona MacIntyre. https://www.researchprofessionalnews.com/rr-news-uk-universities-2021-3-university-leaders-urged-to-take-a-stand-against-rankings/
- Measure what matters: ranking universities in the age of a pandemic. (4 March 2021) Goda Naujokaitytė https://sciencebusiness.net/covid-19/news/measure-what-matters-ranking-universities-age-pandemic
- Baron Wolf, New Approach to Research Evaluation and University World Rankings, SRAI News 13 November 2020 https://www.srainternational.org/blogs/srai-news/2020/11/13/new-approach-to-research-evaluation-and-university
Allied Organisations
- Declaration on Research Assessment (DORA) https://sfdora.org/
- Humane Metrics Initiative (HumetricsHSS) https://humetricshss.org/
- Latin American Forum for Research Assessment (FOLEC)
- Metricas Project Brazil https://metricas.usp.br/
- UK Reproducibility Network: Open and Responsible Researcher Reward and Recognition (OR4). INORMS REG represented on the Advisory Board.
Key Findings and Outputs
Presentations
| Date | Conference / Event Name | Presenters | Title |
|---|---|---|---|
| April 2023 | Gdansk University, Poland (20 April 2023) | Elizabeth Gadd | Can rankings support universities' quest for excellence? |
| April 2023 | UKSG Conference. Glasgow, Scotland | Elizabeth Gadd | Investigating the appropriate role for publications in research evaluation using the INORMS ‘SCOPE’ framework. |
| April 2023 | Queens University Belfast (5 April 2023) | Elizabeth Gadd | Exploring responsible research evaluation approaches. |
| March 2023 | Philea-EU Research Forum. Warsaw, Poland (9 March 2023) | Elizabeth Gadd | In pursuit of fairer & more meaningful research assessment. |
| January 2023 | Event. University of Strathclyde, Scotland (30 January 2023) | Elizabeth Gadd | Seven priorities for improving research culture through research assessment. What next for Research Integrity? |
| November 2022 | ARMA Conference | Elizabeth Gadd | Evaluating global universities responsibly: the INORMS More Than Our Rank initiative. |
| September 2022 | Nordic Workshop on Bibliometrics and Research Policy, September 21-23, 2022 in Turku, Finland | Kasper Bruun and Marianne Gauffriau | Selected responsible research assessment guidelines – an overview |
| May 2022 | EARMA Conference 2022, Oslo | Marianne Gauffriau, Lone Bredahl, Tanja Strøm, Laura Himanen | Research evaluation matters - Barriers and incentives towards responsible research evaluations at Danish Universities |
| November 2021 | The Nordic Workshop on Bibliometrics and Research Policy 2021 | Marianne Gauffriau, Lone Bredahl, Tanja Strøm, Laura Himanen | Using SCOPE to investigate research evaluation practices at Danish universities - Work in progress |
| October 2021 | ARMA Conference | Elizabeth Gadd | |
| September 2021 | LATMetricas (https://latmetricas.wordpress.com/) | Elizabeth Gadd & Aline Pacifico | Title to be confirmed |
| July 2021 | Focus on Open Science Chapter XIII | Elizabeth Gadd | Value-led research evaluation: a practical guide for Open Research |
| May 2021 | INORMS 2021 | Laura Beaupre, Lone Bredahl, Elizabeth Gadd, Laura Himanen, Aline Pacifico, Hirofumi Seike, Justin Shearer, Tanja Strøm, Baron G. Wolf, | Changing the world of research evaluation: the work of the INORMS Research Evaluation Working Group |
| May 2021 | UCL Open Science Event | Elizabeth Gadd | COUNTerproductive? The role of metrics in the advancement of open science. |
| April 2021 | Bibliometrics and Research Impact Community Conference, Canada | Laura Beaupre and Justin Shearer | Working towards meaningful, responsible and effective research evaluation. |
| March 2021 | NARMA Conference | Laura Himanen and Tanja Strøm | If our metrics are not shaped by our core values, our values will be distorted by our metrics. |
| February 2021 | Metricas Project Brazil | Aline Pacifico and Elizabeth Gadd | SCOPE method for responsible research evaluation |
| November 2020 | Global Research Council RRA Conference | Elizabeth Gadd | Introducing SCOPE - a five-stage process for evaluating responsibly. |
| October 2020 | Virginia Tech Open Access Week | Elizabeth Gadd | Counting What Counts In Recruitment, Promotion & Tenure |
| October 2020 | 25th Nordic Workshop on Bibliometrics and Research Policy | Elizabeth Gadd | The Research Evaluation Food Chain and how to fix it |
| October 2020 | NIH Bibliometrics & Research Evaluation Symposium | Elizabeth Gadd | The Five Habits of Highly-Effective Bibliometric Practitioners |
| October 2020 | SRA Conference | Baron Wolf | INORMS: Best Practices in Research Evaluation, Materials for Senior Decision Makers |
| October 2020 | EARMA conference | Tanja Strøm and Elizabeth Gadd | E-valu-ating what we value: the INORMS SCOPE model |
| September 2020 | Finnish Ministry of Education & Culture | Elizabeth Gadd | Bibliometrics: Diversity's friend or foe? |
| October 2019 | FORCE11 Conference, Edinburgh | Elizabeth Gadd | Responsible metrics - what’s the state of the art? |
| October 2019 | SRA Conference, USA | Baron Wolf and Elizabeth Gadd | Ensuring Research Evaluation is Meaningful, Responsible and Effective: Introducing the Work of the INORMS Research Evaluation Working Group |
| June 2019 | ARMA conference, Belfast | Elizabeth Gadd | Introduction to the work of the REWG |
| June 2019 | INORMS 2021 | Julie Bayley, Elizabeth Gadd, Simon Kerridge, David Phipps | Building research management across distance, time and cultures |