BEGIN:VCALENDAR VERSION:2.0 PRODID:-//Research on Research - ECPv6.9.1//NONSGML v1.0//EN CALSCALE:GREGORIAN METHOD:PUBLISH X-WR-CALNAME:Research on Research X-ORIGINAL-URL:https://researchonresearch.org X-WR-CALDESC:Events for Research on Research REFRESH-INTERVAL;VALUE=DURATION:PT1H X-Robots-Tag:noindex X-PUBLISHED-TTL:PT1H BEGIN:VTIMEZONE TZID:UTC BEGIN:STANDARD TZOFFSETFROM:+0000 TZOFFSETTO:+0000 TZNAME:UTC DTSTART:20220101T000000 END:STANDARD END:VTIMEZONE BEGIN:VEVENT DTSTART;TZID=UTC:20241111T130000 DTEND;TZID=UTC:20241111T143000 DTSTAMP:20250708T064112 CREATED:20250117T110100Z LAST-MODIFIED:20250128T110759Z UID:2136-1731330000-1731335400@researchonresearch.org SUMMARY:Using Natural Language Processing (NLP) in classification of Social Sciences and Humanities research and societal impact DESCRIPTION:The European Network for Research Evaluation in the Social Sciences and the Humanities (ENRESSH) in partnership with the Research on Research Institute (RoRI) is proud to present the next webinar in its series on research evaluation as it is practiced across disciplines and countries. \n\n\n\nWe are opening a new thematic line on AI in research assessment with the presentation of two classification exercises using Natural Language Processing (NLP). \n\n\n\nMODERATORSpecial advisor Dr Jon Holm\, Research Council of Norway \n\n\n\nSPEAKERSTopic modeling of SSH publications from the VABB publication databaseSenior researcher Dr Raf Guns\, Flemish Centre for Research & Development Monitoring (ECOOM)\, Antwerp University \n\n\n\nClassifying REF impact cases by user groups – a lexical approachProfessor Andrea Bonaccorsi\, Economics and Management at the School of Engineering of the University of Pisa \n\n\n\nRESPONDENTDr Denis Newman-Griffis Lecturer in Data Science\, University of Sheffield\, and a Research Fellow of the Research on Research Institute \n\n\n\nSPEAKERS\n\n\n\nRaf Guns (he) is a senior researcher at the University of Antwerp\, where he coordinates the Antwerp branch of the Flemish Centre for Research & Development Monitoring (ECOOM). His research focuses on quantitative science studies\, addressing topics like interdisciplinarity\, open science\, and the characteristics of the social sciences and humanities. \n\n\n\nAndrea Bonaccorsi (he) is a Professor of Economics and Management at the School of Engineering of the University of Pisa. His main areas of research are economics of science and innovation. With more than 200 works\, he is listed in the top 2% of world scientists. \n\n\n\nDenis Newman-Griffis(they/them) is a Lecturer in Data Science at the University of Sheffield\, a Research Fellow of the Research on Research Institute\, and a British Academy Innovation Fellow. Their research investigates the principles and practices of Responsible AI\, focusing on health and disability as well as public sector governance. They lead the Research on Research Institute’s GRAIL project on Responsible AI and Machine Learning for research funding and evaluation\, and they are an active participant in Responsible AI policy discussions in research\, education\, and government. \n\n\n\nRegister on Eventbrite. URL:https://researchonresearch.org/event/using-natural-language-processing-nlp-in-classification-of-social-sciences-and-humanities-research-and-societal-impact/ CATEGORIES:Online,Research Evaluation ATTACH;FMTTYPE=image/jpeg:https://researchonresearch.org/wp-content/uploads/2024/10/natural-language-processing-spiral-of-letters-scaled.jpg END:VEVENT BEGIN:VEVENT DTSTART;TZID=UTC:20230705T113000 DTEND;TZID=UTC:20230705T123000 DTSTAMP:20250708T064112 CREATED:20250128T110759Z LAST-MODIFIED:20250128T110759Z UID:2140-1688556600-1688560200@researchonresearch.org SUMMARY:The emerging shape of REF 2028 DESCRIPTION:Digesting\, debating and delivering the outcomes of the UK’s Future of Research Assessment Programme \n\n\n\n\n\n\n\n\n\nSince 1986\, UK universities have lived through eight cycles of national research assessment. Over that time\, the purposes and methods of assessment have evolved and become more complex. The last Research Excellence Framework—REF 2021—involved 157 institutions submitting over 185\,000 research outputs and 6\,700 impact case studies from 76\,000 staff. \n\n\n\nNow the initial rules have been published for the 2028 REF\, with some significant changes in the design of the exercise\, and a sharper focus on the people\, cultures and environments that underpin a vibrant and sustainable research system. \n\n\n\nWith moves towards responsible research assessment gaining momentum across the global research community\, the next REF is an important opportunity to reshape incentives within the UK research system and look afresh at what should be recognised and rewarded. \n\n\n\nThe Speakers\n\n\n\nWelcome and introductory remarks\n\n\n\n\nProf. Geraint Rees\, Vice-Provost for Research\, Innovation & Global Engagement\, UCL\n\n\n\n\nPart 1: Where next for the REF?\n\n\n\n\nChair: Lord Willetts\, Chair\, Foundation for Science and Technology and former Minister for Universities and Science\n\n\n\nRedesigning assessment: outcomes of the FRAP and next steps — Prof. Dame Jessica Corner\, Executive Chair\, Research England\n\n\n\nPurposes\, priorities and pillars of REF 2028 — Dr Steven Hill\, Director of Research\, and Dr Catriona Firth (Associate Director for Research Environment)\, Research England\n\n\n\nPerspective from the International Advisory Group — Sir Peter Gluckman\, Chair FRAP IAG and President\, International Science Council\n\n\n\nA view from CoARA — Dr Elizabeth Gadd\, Vice-Chair\, CoARA and Loughborough University\n\n\n\nQ&A and discussion\n\n\n\n\nPart 2: The formative role of REF in UK research culture\n\n\n\n\nChair: James Wilsdon\, Director\, RoRI & Professor of Research Policy\, UCL\n\n\n\nPanel (opening statements\, followed by questions from participants)\n\n\n\nProf. Louise Bracken\, PVC for Research & Knowledge Exchange\, Northumbria University (TBC)\n\n\n\nDiego Baptista\, Head of Research Funding & Equity\, Wellcome\n\n\n\nProf. Simon Hettrick\, University of Southampton and Chair\, The Hidden REF\n\n\n\nEmma Todd\, Director of Research Culture\, UCL URL:https://researchonresearch.org/event/the-emerging-shape-of-ref-2028/ CATEGORIES:Research Evaluation ATTACH;FMTTYPE=image/jpeg:https://researchonresearch.org/wp-content/uploads/2023/09/technology-face-detection-concept-artificial-inte-2022-12-16-03-28-07-utc-scaled-e1737735302154.jpg END:VEVENT BEGIN:VEVENT DTSTART;TZID=UTC:20221212T080000 DTEND;TZID=UTC:20221212T170000 DTSTAMP:20250708T064112 CREATED:20250128T110800Z LAST-MODIFIED:20250128T110800Z UID:2143-1670832000-1670864400@researchonresearch.org SUMMARY:Machine learning\, metrics & merit: the future of research assessment DESCRIPTION:The use of quantitative indicators and metrics in research assessment continues to generate a mix of enthusiasm\, hostility and critique. To these possibilities\, we can add growing interest in uses of machine learning and artificial intelligence (AI) to automate assessment processes\, and reduce the cost and bureaucracy of conventional methods of peer and panel-based review. \n\n\n\n\n\n\n\n\n\nNovel methods also bring potential pitfalls\, uncertainties and dilemmas\, and may operate in some tension with moves towards responsible research assessment\, as reflected in the Declaration on Research Assessment (DORA) and the new Coalition for Advancing Research Assessment (CoARA). \n\n\n\nAs the UK again reviews its approach to research assessment and the design of the Research Excellence Framework (REF)\, these and other issues are up for discussion through the Future Research Assessment Programme (FRAP)\, initiated by the four UK higher education funding bodies. \n\n\n\nThis workshop launches two new studies that should make significant contributions to the FRAP process. \n\n\n\nThe first\, led by Professor Mike Thelwall\, is a ground-breaking analysis of whether one could run a REF exercise using AI. The second is an updated review of the role of metrics in the UK research assessment system\, which builds on the 2015 review\,The Metric Tide\, which called for responsible approaches to the use of metrics\, and cautioned against purely metric-based approaches to assessment. For more on these studies\, see recent articles in Nature\, Research Professional and Times Higher Education. \n\n\n\nWe were joined by Professor Dame Jessica Corner\, new Executive Chair of Research England who offered opening keynote remarks\, and by two panels of UK and international experts. URL:https://researchonresearch.org/event/machine-learning-metrics-merit-the-future-of-research-assessment/ CATEGORIES:Seminar,Research Evaluation ATTACH;FMTTYPE=image/jpeg:https://researchonresearch.org/wp-content/uploads/2024/03/tide-ocean-waves-beach-scaled-e1737735101368.jpeg END:VEVENT BEGIN:VEVENT DTSTART;TZID=UTC:20220616T153000 DTEND;TZID=UTC:20220616T163000 DTSTAMP:20250708T064112 CREATED:20250128T110801Z LAST-MODIFIED:20250128T110801Z UID:2145-1655393400-1655397000@researchonresearch.org SUMMARY:The Quantified Scholar DESCRIPTION:Around the world\, the good\, the bad and the ugly in research cultures are the focus of unprecedented scrutiny and debate. Imperatives of equality\, diversity\, inclusion\, impact\, integrity and sustainability are forcing overdue change to institutions\, policies and practices. But there is still a long way to go. \n\n\n\n\n\n\n\n\n\nJuan Pablo Pardo-Guerra\, associate professor of sociology at the University of California\, San Diego and author of the book The Quantified Scholar\, explores how processes of research evaluation themselves shape disciplines\, promote conformity and limit diversity. \n\n\n\nProf. Sarah de Rijcke\, Co-Chair of RoRI and Scientific Director at the Centre for Science and Technology Studies (CWTS)\, Leiden University and Dr Molly Morgan Jones\, Director of Policy at The British Academy\, offer their responses. \n\n\n\nThis seminar was organised by RoRI and Sheffield Metascience Network (MetaNet) at the University of Sheffield. URL:https://researchonresearch.org/event/the-quantified-scholar/ CATEGORIES:Online,Seminar,Research Evaluation ATTACH;FMTTYPE=image/jpeg:https://researchonresearch.org/wp-content/uploads/2024/03/stack-of-books-on-a-chair-e1737735006476.jpg END:VEVENT END:VCALENDAR