You should also follow the general reviewer guidance.
EXC1: Quality and excellence
Primary criterion
There is no simple definition of excellence. Proposals may build directly on prior work or may involve a speculative leap forward. It may involve progress along an established research direction or a tangential switch into a new or different area, or may bring together expertise and approaches from different discipline areas. All these approaches could demonstrate excellence so your judgement should not simply be based on which approach has been adopted.
A proposal that demonstrates excellence can be characterised by terms such as: novel, ambitious, timely, exciting, at the international forefront, adventurous, elegant, or transformative, but it need not demonstrate all of them. Normally you might expect to see a plausible hypothesis with some basis within the published literature, and some clearly identified objectives that sensibly test that hypothesis. Certainty of outcome is not an indicator of excellence, but neither is an incremental approach necessarily an indicator that a proposal lacks excellence.
Applicants are asked to set their proposal in context in terms of the current state of knowledge and other work under way in the field. You should comment explicitly on this aspect of the proposal and where possible give your view of where this work would sit in relation to related activity internationally, and the extent to which it would provide the UK with a unique capability. Note that the existence of competing groups elsewhere should not of itself be seen as a reason for downgrading a proposal.
The application should clearly demonstrate the methodology the applicants intend to use to attain their stated objectives, and you should comment on how clearly these are described, how appropriate they are for the planned activity, and their scientific or technical feasibility.
For multidisciplinary applications please state which aspects of the application you feel qualified to assess.
Reviewers are requested to comment on the degree of research excellence of the proposal, making reference to three key aspects:
1. Novelty, relationship to the context, timeliness and relevance to identified stakeholders
Applicants are asked to set their proposal in context, in terms of the current state of knowledge and other work under way in the field.
The reviewer should consider:
- how competitive the proposed work is and how it compares to related international activity
- whether the applicants show how their research fits with activities elsewhere in the world and whether they demonstrate awareness of the context and landscape within which they operate
- to what extent the research will provide the UK with a unique capability
- whether the applicant has presented the academic, industrial, policy, societal or other relevant context clearly
- whether the applicant has demonstrated that the research is timely – what would happen if they didn’t undertake this research now?
- whether the applicant has identified potential stakeholders and stated the relevance and possible benefits to the stakeholders.
2. Ambition, adventure, transformative aspects or potential outcomes
There is no one format to an excellent research programme: the research could directly build on previous work, or it could take a leap forward. The applicant could present a programme where they are moving into a new discipline, or the programme could bring together expertise and approaches from different disciplines, and in partnership with external organisations.
The reviewer should consider:
- whether the proposal contains a clear vision, addresses a specific challenge or makes a step change in its field
- the progress this programme will deliver beyond current state of the art
- the intended outputs of the programme, for example, new ideas, tools, techniques, discoveries, and whether these are ambitious but realistic
- whether the proposal details potential outcomes and clearly identifies any potential impacts.
3. Suitability of the proposed methodology and the appropriateness of the approach to achieving impact
The applicant should have provided appropriate methodology to deliver the research and impact programme.
You should comment on how clearly this is described, how appropriate it is for the planned activities, and their scientific and technical feasibility. As impact should be an embedded activity in the research programme, you should also assess the suitability and appropriateness of the methodology to realise impact in the proposal. Impact can take many forms over widely varying timescales. It might involve developing a commercial product or service, or creating a new technology, but it could also be about improved medical or healthcare, contributions to national planning or social policy or engaging the public in the outputs of research.
Planning for activities that maximise the likelihood of any identified impacts occurring is a vital part of research. It is expected that most proposals will have the potential to deliver some form of non-academic impact.
The reviewer should consider:
- the ideas, concepts and approaches proposed and any particularly strong or weak examples within the programme
- whether the applicant has provided clear aims and objectives for the technical programme, and how they will monitor their achievements
- whether the research programme and associated impact activities have been co-designed with external stakeholders or users:
-
- Does the proposal include objectives for impact related activities and are they appropriate to the research?
- If not, is there a clear and realistic plan to target potential beneficiaries of the outputs and outcomes?
-
- whether the proposal articulates a clear understanding of the context and needs of users:
-
- Does the proposed research programme consider how these needs will be met?
- Does the proposal specify routine and novel ways to engage end users or partners to help realise impacts?
-
- whether the applicant has considered responsible innovation in their research programme.
The applicant is not expected to predict the impact of their research in terms of value, reach or significance, and therefore assessors should not:
- take the relative importance of identified impacts into account
- seek to assess tangibility of deliverables, direct return on investment or detailed routes to exploitation – impact is not synonymous with early exploitation.
IMP5: Importance
Secondary criterion
Drawing upon what the applicant has said, reviewers should comment on:
- how the proposed research contributes to, or helps maintain the health of other research disciplines, contributes to addressing key UK societal challenges, contributes to current or future UK economic success or enables future development of key emerging industries
- the extent to which the research proposed has the potential to meet national strategic needs by establishing or maintaining a unique world-leading research activity (including areas of niche capability)
- how the research fits with and complements other UK research already funded in the area or related areas, including the relationship to the EPSRC portfolio and stated strategy set out in our portfolio.
The extent to which each bullet point is addressed will depend on the nature of the research proposed. Reviewers should comment on how the research relates to EPSRC’s research areas and strategies (many projects will be relevant to more than one EPSRC research area) and complements EPSRC’s current portfolio. Information on the portfolio is available through EPSRC’s Grants on the Web (GoW).
The reviewer form asks reviewers to comment on the national importance of the research. Include how the research:
- contributes to, or helps maintain the health of other disciplines, contributes to addressing key UK societal challenges or contributes to future UK economic success and development of emerging industries
- meets national needs by establishing or maintaining a unique world-leading activity
- complements other UK research already funded in the area, including any relationship to the EPSRC portfolio.
APP13: Fellowship vision and delivery
Secondary major criterion
Applicants are asked to outline what success at the end of the fellowship would look like, why a fellowship is an appropriate mechanism to achieve this and how the applicant will ensure successful project delivery.
Please comment on how the award of the fellowship will progress the career of the applicant over and above their current trajectory, and why the applicant needs this award in order to achieve this career progression. Open Fellowships are for all career stages beyond post-doctoral level and include researchers, from those embarking on their first academic appointment to those with vast amounts of experience. Applicants will need to justify how the fellowship adds value to their career beyond other funding routes available. Assessment should be made relative to the career stage of the applicant and the difference the fellowship would make, rather than considering the status of the applicant at the end of the fellowship. The applicant’s plan for ensuring that the success of the fellowship will be maximised (this should cover all elements of the fellowship, including the non-scientific elements of the proposal).
Please also comment on whether suitable risks have been identified and mitigated against.
APP14: Community leadership
Secondary major criterion
Applicants are expected to lead by example in matters relating to the modern research environment, have good communication skills across a range of stakeholders and clear plans for advocacy.
Please comment on:
- the extent to which the applicant can demonstrate that matters relating to the modern research environment (including research integrity, responsible research and innovation, and equality, diversity and inclusion) have been integrated within their proposal and how the ongoing management of these elements will be addressed
- the applicant’s ability to communicate clearly both orally and in writing
- how the applicant demonstrates awareness of the advocacy role required of a fellow (ability to influence policymakers or other stakeholders on the importance of your research area; willingness to participate in peer review activities, disseminate EPSRC information within their own department or network and sit on advisory groups; and planned involvement in at least one additional role).
Additional roles include:
- STEM outreach
- public engagement
- policy development
- industrial engagement
- research culture
- any area of ambassadorship required by the community not listed above.
APP15: Team leadership
Secondary major criterion
The fellowship scheme places emphasis on the importance of staff being managed by the applicant having a positive research experience, with opportunities and support to progress their own research careers.
Please comment on:
- the strategy in place for ensuring the continued research and professional development of staff or other colleagues they will be managing on the project
- the applicant’s plan for creating a positive working culture
- the track record of the applicant (relative to their career stage) in these matters to give the panel confidence that points 1 and 2 will be successfully delivered.
APP16: Continued professional development
Secondary major criterion
The applicant has been asked to outline their professional development goals and identify a route to achieving them. They should have outlined how these development goals will enable them to expand or enhance their current role.
Please comment on:
- the appropriateness of the professional development goals outlined in the application (relative to the career stage of the applicant) and the plans in place (noting that this may not constitute formal training) to enable the fellow to reach these goals
- the level and suitability of the support offered by the host organisation.
APP20: Applicant and partnerships
Secondary major criterion
Reviewers are requested to comment on the applicant’s ability to deliver the proposed project, making reference to:
Appropriateness of the track record of the applicant
- whether the proposal demonstrates that the applicant has the expertise and capabilities to deliver the project
- the ability of the applicant and the wider team to deliver the project through to the creation of impact.
Balance of skills of the project team, including collaborators
- existing engagements with relevant end users and the appropriateness of any partnerships
- whether the roles and responsibilities of all members of the team have been defined, including those of users or stakeholders in both research and impact activities.
RES1: Resources and management
Secondary criterion
Applicants are required to identify all resources required to undertake the project, and to clearly justify the request. You should comment on how well this has been done and on the appropriateness of the resources requested. You should explicitly consider the amount of time being allocated to the project by the applicant in this assessment.
You are asked to comment on the project plan and management arrangements, which should be proportionate to the scale and complexity of the activity proposed.
Reviewers are requested to comment on the effectiveness of the proposed planning and management making reference to equipment and resources as follows:
1. Any equipment requested, or the viability of the arrangements described to access equipment needed for this project, and particularly on any university or third-party contribution
You should draw attention to any request that in your view has not been justified or, conversely, if something is required but has not been identified. You should also comment on the suitability of arrangements for accessing resources other than through the grant, such as by collaboration with external groups. Your assessment should be based solely on the resources sought and not on the costs derived from them.
2. Any resources requested for activities to either increase impact, for public engagement or to support responsible innovation
Applicants are required to identify all resources required to successfully accelerate the creation of impact, and to clearly explain the need for these in the justification of resources.
Please consider:
- the project plan and management arrangements for impact, public engagement or responsible innovation
- aspects of the project including timing, personnel, skills, budget, deliverables and feasibility, which should be appropriate and proportionate to the scale and complexity of the activity to be undertaken
- whether there is clear responsibility for the delivery of each activity or task
- whether appropriate resources to deliver the activities been requested and justified
- whether mechanisms to monitor and evaluate the planned activities have been built in.
ANI1: Animal research and human participation
Where the applicants have ticked any boxes confirming that the application involves either animal research or human participation, then you are asked to comment specifically on any ethical considerations and particularly on whether ethical approval procedures have been complied with. You should also comment on any potential adverse consequences for humans, animals or the environment and whether these risks have been addressed satisfactorily in the application. It is particularly important that resources relating to these aspects are explicitly justified in terms of need, scale and nature of resource. For example, for animal research you should comment specifically on the need to use animals, the choice of species and the number of animals it is intended to use.
ASS1: Overall assessment
You should provide your overall assessment of the application. Think of this as your report to the prioritisation panel, highlighting the strengths and weaknesses you identified in the individual questions and then making a clear and explicit recommendation about whether or not you believe the application warrants funding.
Not all questions carry equal weighting. Research quality (excellence) will always be pre-eminent, and no application can be funded without clearly demonstrating this aspect. National importance should also be a major consideration in making your assessment. The weighting between the remaining aspects will depend on the specific nature of the particular application. You should indicate those aspects that you accorded higher or lower priority and why.
The reviewer form asks reviewers to summarise their view of the application.
ASS2: Overall assessment – part assessment
It may be that you feel you can only comment with authority on a specific part or component of an application, for example with a multidisciplinary project, or perhaps where there is a strong user-led element. In that case you should identify those aspects that you are able to comment on, and then give your review on just those aspects. Different reviewers will have been asked to cover those aspects you cannot, and the panel will then have the job of integrating these different comments. It is particularly important therefore that the panel have clear advice on the merits of each component. Your comments, scores and confidence level should explicitly reflect your views on those aspects you can assess, and you are asked not to moderate these in any way to reflect those areas you feel you cannot comment on.
A risk with part assessment is that it will miss the added value of the overall project (the whole ideally being greater than the sum of the parts) so even where you can only comment with authority on one aspect, it will be helpful to the panel to have your views on how compelling the arguments for the overall application are. Other issues you might also comment on are the uniqueness (or otherwise) of the collaboration, the value of the contribution of the component you can judge, and the significance of this in terms of future potential development in your own field.
ASS3: Overall assessment – overall score
You should assign a score using the six-point scale provided. This should reflect your overall conclusion, and should be consistent with your comments on the individual sections of your review, taking account of all the assessment criteria and the various weightings you applied.
The six levels of the scoring scale are as follows.
- This application is scientifically or technically flawed
- This application does not meet one or more of the assessment criteria
- This application meets all assessment criteria but with clear weaknesses
- This is a good application that meets all assessment criteria but with minor weaknesses
- This is a strong application that broadly meets all assessment criteria
- This is a very strong application that fully meets all assessment criteria.
ASS4: Level of confidence
To assist the prioritisation panel in reaching their overall conclusion on the application, and to help EPSRC in monitoring the effectiveness of its reviewer selection procedures, you are asked to indicate your confidence in your review. This should report your own confidence, or otherwise, in being able to make your assessment rather than your confidence in the success of the application if it were funded. If, for any reason, you feel that you are not able to assess the application, please advise EPSRC accordingly.
The reviewer form asks reviewers to score their confidence as low, medium or high.
Last updated: 29 November 2024