FantasticSearch

1. The activities of the joint undertakings shall be subject to continuous monitoring and periodic reviews in accordance with their financial rules, to ensure the highest impact, scientific excellence and the most effective and efficient use of resources. The outcomes of monitoring and periodic reviews shall feed into the monitoring of European partnerships and evaluations of the joint undertakings as part of Horizon Europe evaluations, as specified in Articles 50 and 52 of the Horizon Europe Regulation.

2. The joint undertakings shall organise the continuous monitoring and reporting of the management and implementation of their activities and periodic reviews of the outputs, results and impacts of the funded indirect actions implemented in accordance with Article 50 of and Annex III to the Horizon Europe Regulation. That monitoring and reporting shall include:

(a) time-bound indicators for the purpose of reporting on an annual basis on the progress of their activities towards the achievement of the general, specific and operational objectives, including joint undertakings’ additional objectives laid down in Part Two, as well as along impact pathways set out in Annex V to the Horizon Europe Regulation;

(b) information on synergies between the joint undertaking’s actions and national or regional initiatives and policies based on information received by the participating states or the states’ representatives group as well as on synergies with other Union programmes and other European partnerships;

(c) information on the level of mainstreaming social sciences and humanities, the ratio between lower and higher TRLs in collaborative research, the progress on widening countries’ participation, the geographical composition of consortia in collaborative projects, the use of two-stage submission and evaluation procedure, the measures that aim to facilitate collaborative links in European research and innovation, the use of the evaluation review and the number and types of complaints, the level of climate mainstreaming and related expenditures, SME participation, private sector participation, gender participation in funded actions, evaluation panels, boards and advisory groups, the co-funding rate, the complementary and cumulative funding from other Union funds, the time-to-grant, the level of international cooperation, engagement of citizens’ and civil society participation;

(d) the levels of expenditure disaggregated at project level in order to allow for specific analysis, including per intervention area;

(e) the level of oversubscription, in particular the number of proposals and for each call for proposals, the average score, the share of proposals above and below quality thresholds;

(f) information on quantitative and qualitative leverage effects, including on committed and actually provided financial and in-kind contributions, visibility and positioning in the international context, impact on research and innovation related risks of private sector investments;

(g) information on measures for attracting newcomers, in particularly SMEs, higher education institutions and research organisations, and for expanding collaborative networks.

3. Evaluations of the joint undertakings’ operations shall be carried out in a timely manner to feed into the overall interim and final evaluations of Horizon Europe and the related decision-making process on Horizon Europe, its successor and other initiatives relevant to research and innovation, referred to in Article 52 of the Horizon Europe Regulation.

4. The Commission shall carry out an interim and a final evaluation of each Joint Undertaking feeding into the Horizon Europe evaluations, as specified in Article 52 of the Horizon Europe Regulation. The evaluations shall examine how each joint undertaking fulfils its mission and objectives, cover all activities of the joint undertaking and evaluate the joint undertaking’s concerned European added value, effectiveness, efficiency, including its openness and transparency, the relevance of the activities pursued and their coherence and complementarity with relevant regional, national and Union policies, including synergies with other parts of Horizon Europe, such as missions, clusters or thematic or specific programmes. The evaluations shall take into account the views of stakeholders, at both European and national level and shall, where relevant, also include an assessment of the long-term scientific, societal, economic and technological impacts of the joint undertakings referred to in Article 174(3) to (9). The evaluations shall also include, where relevant, an assessment of the most effective policy intervention mode for any future action, as well as the relevance and coherence of any possible renewal of each joint undertaking given the overall policy priorities and the research and innovation support landscape, including its positioning against other initiatives supported through the Framework Programme, in particular European partnerships or missions. The evaluations shall also take due account of the phasing-out plan adopted by the Governing Board in accordance with Article 17(2), point (a1).

5. On the basis of the conclusions of an interim evaluation referred to in paragraph 2 of this Article, the Commission may act in accordance with Article 11(6) or take any other appropriate action.

6. The Commission may carry out further evaluations of themes or topics of strategic relevance, with the assistance of external independent experts selected on the basis of a transparent process, to examine the progress made by a joint undertaking towards the objectives set, identify the factors contributing to the implementation of the activities and identify best practices. By carrying out those further evaluations, the Commission shall fully consider the administrative impact on the joint undertaking.

7. Joint undertakings shall perform periodic reviews of their activities to serve as a basis for their interim and final evaluations as part of Horizon Europe evaluations referred to in Article 52 of the Horizon Europe Regulation.

8. Periodic reviews and evaluations shall be taken into consideration in the winding up or phasing out of the joint undertaking referred to in Article 45 of this Regulation, in line with Annex III to the Horizon Europe Regulation. Within six months after the winding up of a joint undertaking, but no later than four years after the triggering of the winding-up procedure referred to in Article 45 of this Regulation, the Commission shall conduct a final evaluation of that joint undertaking in line with the final evaluation of Horizon Europe.

9. The Commission shall publish and communicate the results of the evaluations of the joint undertakings, which shall include conclusions of the evaluation and observations by the Commission, to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions as part of the Horizon Europe evaluations referred to in Article 52 of the Horizon Europe Regulation.