Open and Universal Science Project Final Conference

9 Rue Eugène Delacroix 7

9 Rue Eugène Delacroix, 75016, Paris, IDF, France

OPUS Project

0 フォロワー

The Open and Universal Science (OPUS) project is reforming research assessment by developing a system that encourages researchers to embrace Open Science principles incentivising and rewarding Open Science practices.Assessing Researchers and Incentivising Open ScienceOPUS has developed a set of indicators and metrics to monitor and drive Open Science adoption at Research Performing Organisations (RPOs) and Research Funding Organisations (RFOs). These metrics focus on various aspects of Open Science, including:Open access to research outputsEarly and open sharing of researchParticipation in open peer-reviewMeasures to ensure reproducibility of resultsStakeholder involvement in co-creationThe project has created a Generic Researcher Assessment Framework (RAF) structured around four main categories of activities: Proposal Development, Methods Development, Research Outputs, and Research Impact.Piloting the ReformsThe OPUS project is currently testing its interventions, indicators, and metrics through action plans in pilot programmes at three RPOs and two RFOs:RPOs:Nova University of Lisbon (UNL), PortugalUniversity of Cyprus (UCY), CyprusUniversity of Rijeka (UNIRI), CroatiaRFOs:Executive Agency for Higher Education, Research, Development, and Innovation Funding (UEFISCDI), RomaniaResearch Council of Lithuania (RCL), LithuaniaThese pilots, running from January 2024 to June 2025, will provide real-world implementation data and insights.Indicators and Metrics for Open ScienceThe OPUS project has established a set of indicators and metrics to monitor Open Science adoption, structured around a Generic Researcher Assessment Framework (RAF). This framework encompasses four main categories: Proposal Development, Methods Development, Research Outputs, and Research Impact. Within these categories, OPUS has developed specific indicators to measure various aspects of Open Science practices.For Proposal Development, OPUS tracks the number of project proposals being developed, submitted, and granted. In Methods Development, indicators include the number of method sets being developed, finalised, implemented, accessed, and cited. Research Outputs are measured through indicators such as the number of open access publications, datasets shared, and participation in open peer-review. The Research Impact category likely includes metrics related to the societal impact of research and stakeholder involvement, although specific details were not provided in the search results.OPUS has worked closely with each of the five pilot organisations to tailor these indicators to their specific contexts and goals. The three Research Performing Organisations (RPOs) – Nova University of Lisbon (UNL), University of Cyprus (UCY), and University of Rijeka (UNIRI) – and the two Research Funding Organisations (RFOs) – Executive Agency for Higher Education, Research, Development, and Innovation Funding (UEFISCDI) and Research Council of Lithuania (RCL) – have selected and customised indicators from the RAF to test in their respective pilots. Each pilot organisation has established baselines for their chosen indicators and set targets for the 9-month and 18-month marks of the pilot period, which runs from January 2024 to June 2025.As of February 2025, the OPUS project is in the implementation and testing phase of these indicators and metrics. The pilot organisations are currently working towards their 18-month targets, with the final evaluation of the pilots scheduled for June 2025. Moving forward, OPUS still needs to complete the testing of these indicators in the pilot programmes, analyse the results, and synthesise the outcomes into policy briefs. The project also aims to develop a revised OS-CAM2 for research(er) assessment based on the insights gained from the pilots. These final steps will be crucial in refining the indicators and metrics for broader application in reforming research assessment to better incentivise and reward Open Science practices.Interventions at RPOs and RFOsOPUS has developed a comprehensive set of interventions to foster Open Science adoption at Research Performing Organisations (RPOs) and Research Funding Organisations (RFOs). These interventions are structured around the dimensions of the main Researcher Assessment Framework (RAF) and are designed to support various indicators within the framework. The interventions are categorised into five main types: Policy, Resource, Repository, Awareness Raising, and Training.Policy interventions involve senior management support for data collection and evidence required for indicators, with clear strategies and procedures. Resource interventions ensure adequate financial, human, and time resources to support data collection. Repository interventions focus on creating easily accessible and suitable databases for storing required data and evidence. Awareness Raising interventions aim to inform researchers about how and why they should collect specific data. Training interventions provide researchers with the necessary skills to collect and report data effectively.OPUS has worked closely with each of the five pilot organisations to implement and test these interventions. The three RPOs (Nova University of Lisbon, University of Cyprus, and University of Rijeka) and the two RFOs (Executive Agency for Higher Education, Research, Development, and Innovation Funding in Romania and Research Council of Lithuania) have been involved in developing action plans to set up, implement, and monitor the interventions. A Pilot Committee consisting of project partners has been established to coordinate across the pilots, and a Mutual Learning Group of pilot organisations and experts has been formed to support and reflect on the implementation process.As of February 2025, OPUS is in the implementation and testing phase of these interventions. The project has completed the development of interventions and is currently monitoring and evaluating their effectiveness in the pilot organisations. Moving forward, OPUS needs to complete the testing phase, analyse the results, and synthesise the outcomes into policy briefs. The project also aims to develop a final set of interventions for Open Science at RPOs and RFOs based on the insights gained from the pilots. These steps will be crucial in refining the interventions for broader application in reforming research assessment to better incentivise and reward Open Science practices.Current Phase and Future ImplementationAs of February 2025, the OPUS project is in its final implementation and testing phase, with just six months remaining until its conclusion on 31 August 2025. The project has made significant progress in developing and implementing interventions, indicators, and metrics to foster Open Science practices at Research Performing Organisations (RPOs) and Research Funding Organisations (RFOs). Currently, OPUS is actively piloting these tools in real-world settings at three RPOs – University of Cyprus (UCY), University of Rijeka (UNIRI), and Universidade NOVA de Lisboa (UNL) – and two RFOs – the Research Council of Lithuania and UEFISCDI (Romania).In the coming months, OPUS will focus on finalising several key deliverables. The project team will complete the testing of interventions and indicators in the pilot programmes, gathering crucial data on their effectiveness and impact. This will involve analysing the results of over 40 interventions that have been implemented, including mentorship schemes and Open Science training programmes. Additionally, OPUS will finalise the Open Science Career Assessment Matrix 2 (OS-CAM2) and the Researcher Assessment Framework (RAF) based on feedback from the pilot phase. These tools are designed to incorporate new metrics such as citizen science participation and open peer review, addressing gaps identified in existing frameworks.Looking ahead to the project's conclusion in August 2025, OPUS has several critical tasks to complete. The team will synthesise the outcomes of their research and pilots into comprehensive policy briefs, providing actionable recommendations for reforming research assessment practices. The revised OS-CAM2 will be finalised, offering a robust framework for evaluating researchers' contributions to Open Science. OPUS will also focus on disseminating its findings and recommendations to the broader research community, including presenting results to EU policymakers, the European Commission, and the Coalition for Advancing Research Assessment (CoARA). This final phase will be crucial in ensuring that the project's outcomes have a lasting impact on research assessment practices across Europe and beyond, driving a cultural shift towards more open, transparent, and collaborative scientific practices.Progress in Other Work PackagesOPUS has made significant progress across its work packages, particularly in Work Package 1 (WP1) focused on the state-of-the-art review. The project team has conducted a comprehensive analysis of existing Open Science literature, policies, and initiatives. This extensive review identified gaps in current Open Science frameworks by mapping 34 networks, 36 Horizon projects, and 47 experts. The team analysed 129 academic papers, 25 policy documents, and 34 Open Science initiatives, highlighting critical gaps in areas such as gender equality, industry collaboration, and trust-building within the Open Science ecosystem. Soon, this will be updated in a new state-of-the-art review.Work Package 5 (WP5) is dedicated to policy synthesis and the development of key frameworks. A significant output of this work package is the drafting of the Open Science Career Assessment Matrix 2 (OS-CAM2), which is an updated version of the 2017 matrix. The OS-CAM2 incorporates new metrics such as citizen science participation and open peer review, addressing gaps identified in existing frameworks. WP5 has also produced an initial policy brief that aligns with global initiatives like UNESCO's Open Science Recommendation and the Coalition for Advancing Research Assessment (CoARA). As part of its stakeholder engagement efforts, WP5 is broadening consultations with RPOs, RFOs, and research institutions to gather feedback and refine the frameworks. The team is preparing to present findings to EU policymakers, including the European Commission and CoARA, to integrate Open Science incentives into mainstream research assessment frameworks.