Research Evaluation Group Outputs and Outreach
Articles, blog posts and podcasts
- Gadd, Elizabeth. (2022). ‘More Than Our Rank’ reaches the places that league tables can’t. Research Fortnight. (17 October 2022) https://www.researchprofessionalnews.com/rr-news-uk-views-of-the-uk-2022-10-more-than-our-rank-reaches-the-places-that-league-tables-can-t/
- Emerald Podcast Series. Are you in? How close are we to reaching more responsible research assessment across the globe? (parts 1 & 2) [Elizabeth Gadd talking about the INORMS work on responsible research evaluation.] https://www.emeraldgrouppublishing.com/podcast-are-you-how-close-are-we-reaching-more-responsible-research-assessment-across-globe-parts-1
- Barnett, Adrian & Elizabeth Gadd. 2022. University league tables have no legs to stand on. Significance, 19 (4), 4-7. https://rss.onlinelibrary.wiley.com/doi/epdf/10.1111/1740-9713.01663 (Repository version also available)
- SRAI Shop Talk Podcast | Hot Topics in Research Administration – Episode 2 | Baron Wolf talking about SCOPE
- Gadd, Elizabeth, Richard Holmes & Justin Shearer. (2021) Developing a method for evaluating global university rankings, Scholarly Assessment Reports, 3(1), p.2. https://www.scholarlyassessmentreports.org/articles/10.29024/sar.31/
- Gadd, Elizabeth. (2021) Mis-measuring our universities: why global university rankings don’t add up. Frontiers in Research Metrics & Analytics, 09 September 2021 https://www.frontiersin.org/articles/10.3389/frma.2021.680023/fullin.org)
- Strøm, Tanja & Nils Pharo (2020). Rangeringene må bedømmes kritisk. Khrono 29.10.2020. https://khrono.no/rangeringene-ma-bedommes-kritisk/527018
- Gadd, Elizabeth. University Ranking need a rethink. (2020) Nature. 24 November 2020. https://www.nature.com/articles/d41586-020-03312-2
- Gadd, Elizabeth & Richard Holmes. (2020). Rethinking the rankings. ARMA Blog. https://arma.ac.uk/rethinking-the-rankings/
- Himanen, Laura & Elizabeth Gadd. (2019). Introducing SCOPE – a process for evaluating responsibly. https://thebibliomagician.wordpress.com/2019/12/11/introducing-scope-aprocess-for-evaluating-responsibly/
Reports
In the press
- Ber universitetene utdanne folk i bruk og misbruk av rangeringer.[Encourage the universities to educate people in the use and abuse of rankings.] https://khrono.no/ber-universitetene-utdanne-folk-i-bruk-og-misbruk-av-rangeringer/821622 (Khrono is an independent newspaper for higher education and research in Norway.)
- Recommendation of the use of SCOPE to address research assessment reform in China. https://www.nature.com/articles/d41586-022-00408-9
- Research assessment exercises are necessary — but we need to learn to do them better. Nature 617, 437 (2023). https://www.nature.com/articles/d41586-023-01611-y [Mention of SCOPE framework].
- Rapple, Charlie. (2023) Smorgasbord: Trends from the Spring 2023 Meetings and Conferences. Scholarly Kitchen [Mention of SCOPE framework as a key takeaway from the EARMA conference].
- Baron Wolf, More Than Our Rank: A New Initiative from the INORMS Research Evaluation Working Group, SRAI News 08 March 2023 https://www.srainternational.org/blogs/srai-news/2023/03/08/more-than-our-rank-a-new-initiative-from-the-inorm
- Morrish, Liz. (2022) No More Big Lie. Academic Irregularities Blog. https://academicirregularities.wordpress.com/2022/12/31/no-more-big-lie/ [Describes the INORMS More Than Our Rank scheme as “a fantastic initiative from actual practitioners”].
- Bredahl, Laura. (2022) “The Current and Evolving Landscape of Bibliometric Tools and Technologies”, Library Technology Reports vol. 58, no. 8 (November/December 2022). https://doi.org/10.5860/ltr.58n8. Describes the INORMS SCOPE Framework and states: “The work coming out of INORMS is crucial for a bibliometric practitioner to understand”.
- Rushforth, Alex, Marta Sienkiewicz, Sarah de Rijcke, Building knowledge infrastructure to support research assessment reforms: Dispatches from the Dutch Recognition and Rewards Festival 2022: https://leidenmadtrics.nl/articles/building-knowledge-infrastructure-to-support-research-assessment-reforms-dispatches-from-the-dutch-recognition-and-rewards-festival-2022[Reference to SCOPE framework]
- Research evaluation needs to change with the times. Nature 601, 166 (2022) doi: https://doi.org/10.1038/d41586-022-00056-z [Reference to SCOPE framework]
- INORMS Research Evaluation Group Releases Guide to SCOPE Framework for Responsible Research Evaluation. (10 December 2021). Baron G Wolf https://www.srainternational.org/blogs/srai-news/2021/12/08/inorms-research-evaluation-group-releases-guide-to
- INORMS Guide aims for more responsible research evaluation. (22 November 2021) Mico Tatalovic https://www.researchprofessionalnews.com/rr-news-world-2021-11-inorms-guide-aims-for-more-responsible-research-evaluation/
- Editorial – ‘Research managers are essential to a healthy research culture. (7 July 2021) https://www.nature.com/articles/d41586-021-01823-0
- University leaders urged to take a stand against rankings (16 March 2021) Fiona MacIntyre. https://www.researchprofessionalnews.com/rr-news-uk-universities-2021-3-university-leaders-urged-to-take-a-stand-against-rankings/
- Measure what matters: ranking universities in the age of a pandemic. (4 March 2021) Goda Naujokaitytė https://sciencebusiness.net/covid-19/news/measure-what-matters-ranking-universities-age-pandemic
- Baron Wolf, New Approach to Research Evaluation and University World Rankings, SRAI News 13 November 2020 https://www.srainternational.org/blogs/srai-news/2020/11/13/new-approach-to-research-evaluation-and-university
Allied Organisations
- Declaration on Research Assessment (DORA) https://sfdora.org/
- Humane Metrics Initiative (HumetricsHSS) https://humetricshss.org/
- Latin American Forum for Research Assessment (FOLEC)
- Metricas Project Brazil https://metricas.usp.br/
- UK Reproducibility Network: Open and Responsible Researcher Reward and Recognition (OR4). INORMS REG represented on the Advisory Board.
Key Findings and Outputs
Presentations
Date | Conference / Event Name | Presenters | Title | |
October 2024 | Swiss Rectors Conference | Elizabeth Gadd | University rankings: what's the problem & what can we do about it? | |
September 2024 | SInnoPSis-TWIN4MERIT Conference | Elizabeth Gadd | University rankings & responsible research assessment | |
September 2024 | Open Science Days Conference, Lausanne | Reingis Hauck and William Bramwell | The SCOPE framework: a tool for responsible research evaluation | |
August 2024 | National Council of University Research Administrators (NCURA) Annual Meeting | Baron Wolf | Report Out & Update from NSF GRANTED Research Analytics Summit | |
August 2024 | Workshop presenting NSF funded project: Research Analytics Using the Higher Education Research and Development Survey (HERD) to Impact Institutional Strategy | Baron Wolf, Lizzie Gadd & Tanja Strøm | The SCOPE framework applied to the US HE R&D (HERD) survey | |
July 2024 | ARQUA Alliance Annual Conference | Elizabeth Gadd | The positive potential of research assessment reform | |
July 2024 | SuRE Biennial Conference | Baron Wolf | Responsible Research Evaluation: Implementing the SCOPE Framework | |
June 2024 | Advancing & Evaluating the Societal Impact of Sciences | Elizabeth Gadd | Research assessment reform & the pursuit of societal impact | |
May 2024 | National Research Integrity Forum, Ireland | Elizabeth Gadd | The future of research assessment: & the intersection with integrity | |
May 2024 | Canadian Association of Research Administrators | Erica Conte | Making sure things actually add up: Ways to assess research responsibly | |
April 2024 | Responsible Assessment day, Finland | Laura Himanen | SCOPE Framework: five steps for responsible assessment of research | |
April 2024 | EARMA Conference Odense 2024 | Elizabeth Gadd | Responding Responsibly to the Rankings: introducing the More Than Our Rank initiative | |
March 2024 | Responsible Research Evaluation Forum 2024 | Baron Wolf, Erica Conte, Elizabeth Gadd | Implementation of the SCOPE framework | |
March 2024 | National Research Integrity Forum Ireland | William Bramwell | Research Assessment from an INORMS Perspective | |
February 2024 | Responsible Open Science in Europe (ROSIE) | Elizabeth Gadd | Measuring Open Science Responsibly | |
February 2024 | Bibliometrics and Research Impact Community | Erica Conte and Baron Wolf | Learning to be Responsible: From Recognition to Rankings | |
January 2024 | Curtin Open Knowledge Initiative Rankings event | Elizabeth Gadd | University Rankings: what's the problem & what can we do about it? | |
December 2023 | Universities UK R&I Conference | Elizabeth Gadd | Research Assessment Reform | |
November 2023 | German Rectors Conference | Elizabeth Gadd | Can rankings support universities' quest for excellence? | |
October 2023 | Knowledge Equity Network event | Elizabeth Gadd | University Rankings: what's the problem & what can we do about it? | |
September 2023 | Conference on Science, Technology and Innovation Indicators | William Bramwell and Elizabeth Gadd | University rankings: accept, amend or avoid? | |
September 2023 | Conference on Science, Technology and Innovation Indicators | Elizabeth Gadd | Assessing open research in a responsible way | |
September 2023 | Conference on Science, Technology and Innovation Indicators | Elizabeth Gadd | Keynote "Trust & Truth in Research Assessment" | |
September 2023 | Canadian Association of Research Administrators | Erica Conte | The Evolving Landscape of Research Assessment and Rankings | |
September 2023 | Enlight RISE WS | Tanja Strøm and Elizabeth Gadd | The SCOPE framework for Research evaluation | |
May 2023 | EARMA Ethics and Research Integrity Officer Network | Tanja Strøm | Responsible research assessment in the foundation of research integrity and positive research cultures | |
May 2023 | INORMS Congress | William Bramwell | More than our rank: supporting universities to showcase their wide-ranging contribution | |
May 2023 | INORMS Congress | William Bramwell and Elizabeth Gadd | SCOPE: A practical framework for designing responsible research evaluations | |
May 2023 | EARMA Conference Prague 2023 | Laura Himanen and Tanja Strøm | SCOPE: a tool for responsible research evaluations | |
May 2023 | Canadian Association of Research Administrators | Erica Conte | More Than Our Rank: Supporting organizations to showcase their wide-ranging contributions | |
April 2023 | Gdansk University, Poland (20 April 2023) | Elizabeth Gadd | Can rankings support universities' quest for excellence? | |
April 2023 | UKSG Conference. Glasgow, Scotland | Elizabeth Gadd | Investigating the appropriate role for publications in research evaluation using the INORMS ‘SCOPE’ framework. | |
April 2023 | Queens University Belfast (5 April 2023) | Elizabeth Gadd | Exploring responsible research evaluation approaches. | |
March 2023 | Philea-EU Research Forum. Warsaw, Poland (9 March 2023) | Elizabeth Gadd | In pursuit of fairer & more meaningful research assessment. | |
January 2023 | Event. University of Strathclyde, Scotland (30 January 2023) | Elizabeth Gadd | Seven priorities for improving research culture through research assessment. What next for Research Integrity? | |
November 2022 | Canadian Association of Research Administrators | Erica Conte | How academic organizations can support responsible research evaluation | |
November 2022 | ARMA Conference | Elizabeth Gadd | Evaluating global universities responsibly: the INORMS More Than Our Rank initiative. | |
September 2022 | Nordic Workshop on Bibliometrics and Research Policy, September 21-23, 2022 in Turku, Finland | Kasper Bruun and Marianne Gauffriau | Selected responsible research assessment guidelines – an overview | |
July 2022 | The Australasian Research Management Society | Erica Conte and Justin Shearer | Responsible Evaluation: from DORA and Leiden to SCOPE | |
May 2022 | Canadian Association of Research Administration | Erica Conte | Responsible Research Evaluation: Introduction of the SCOPE Framework | |
May 2022 | EARMA Conference 2022, Oslo | Marianne Gauffriau, Lone Bredahl, Tanja Strøm, Laura Himanen | Research evaluation matters - Barriers and incentives towards responsible research evaluations at Danish Universities | |
November 2021 | The Nordic Workshop on Bibliometrics and Research Policy 2021 | Marianne Gauffriau, Lone Bredahl, Tanja Strøm, Laura Himanen | Using SCOPE to investigate research evaluation practices at Danish universities - Work in progress | |
October 2021 | ARMA Conference | Elizabeth Gadd | ||
September 2021 | LATMetricas (https://latmetricas.wordpress.com/) | Elizabeth Gadd & Aline Pacifico | Title to be confirmed | |
July 2021 | Focus on Open Science Chapter XIII | Elizabeth Gadd | Value-led research evaluation: a practical guide for Open Research | |
May 2021 | INORMS Congress-Hiroshima | Laura Himanen, Tanja Strom, Baron Wolf | Introducing SCOPE: five steps to evaluating responsibly | |
May 2021 | INORMS 2021 | Laura Beaupre, Lone Bredahl, Elizabeth Gadd, Laura Himanen, Aline Pacifico, Hirofumi Seike, Justin Shearer, Tanja Strøm, Baron G. Wolf, | Changing the world of research evaluation: the work of the INORMS Research Evaluation Working Group | |
May 2021 | UCL Open Science Event | Elizabeth Gadd | COUNTerproductive? The role of metrics in the advancement of open science. | |
April 2021 | Bibliometrics and Research Impact Community Conference, Canada | Laura Beaupre and Justin Shearer | Working towards meaningful, responsible and effective research evaluation. | |
March 2021 | NARMA Conference | Laura Himanen and Tanja Strøm | If our metrics are not shaped by our core values, our values will be distorted by our metrics. | |
February 2021 | Metricas Project Brazil | Aline Pacifico and Elizabeth Gadd | SCOPE method for responsible research evaluation | |
November 2020 | Global Research Council RRA Conference | Elizabeth Gadd | Introducing SCOPE - a five-stage process for evaluating responsibly. | |
October 2020 | Virginia Tech Open Access Week | Elizabeth Gadd | Counting What Counts In Recruitment, Promotion & Tenure | |
October 2020 | 25th Nordic Workshop on Bibliometrics and Research Policy | Elizabeth Gadd | The Research Evaluation Food Chain and how to fix it | |
October 2020 | NIH Bibliometrics & Research Evaluation Symposium | Elizabeth Gadd | The Five Habits of Highly-Effective Bibliometric Practitioners | |
October 2020 | SRA Conference | Baron Wolf | INORMS: Best Practices in Research Evaluation, Materials for Senior Decision Makers | |
October 2020 | EARMA conference | Tanja Strøm and Elizabeth Gadd | E-valu-ating what we value: the INORMS SCOPE model | |
September 2020 | Finnish Ministry of Education & Culture | Elizabeth Gadd | Bibliometrics: Diversity's friend or foe? | |
October 2019 | FORCE11 Conference, Edinburgh | Elizabeth Gadd | Responsible metrics - what’s the state of the art? | |
October 2019 | SRA Conference, USA | Baron Wolf and Elizabeth Gadd | Ensuring Research Evaluation is Meaningful, Responsible and Effective: Introducing the Work of the INORMS Research Evaluation Working Group | |
June 2019 | ARMA conference, Belfast | Elizabeth Gadd | Introduction to the work of the REWG | |
June 2019 | INORMS 2021 | Julie Bayley, Elizabeth Gadd, Simon Kerridge, David Phipps | Building research management across distance, time and cultures |