Read on Twitter
1/
Last week was my first year serving on @NSERC_CRSNG Discovery Grant Evaluation Group. It was an eye-opening experience and changed my view of how successful DGs should be written. Here is a summary of my thoughts. @RyersonResearch @ChrisNF @lemire @gouttec
Last week was my first year serving on @NSERC_CRSNG Discovery Grant Evaluation Group. It was an eye-opening experience and changed my view of how successful DGs should be written. Here is a summary of my thoughts. @RyersonResearch @ChrisNF @lemire @gouttec
2/
I found that many applicants (including the old me) did not read the grant application instructions carefully. The evaluation process is very tightly based on the requested information in the instructions guide.
I found that many applicants (including the old me) did not read the grant application instructions carefully. The evaluation process is very tightly based on the requested information in the instructions guide.
3/
If you do not follow it carefully, you will miss covering sections that are deemed to be important by the evaluation committee. I would even suggest every applicant to read the “Peer-Review Manual” ( https://www.nserc-crsng.gc.ca/_doc/Reviewers-Examinateurs/CompleteManual-ManualEvalComplet_eng.pdf)
If you do not follow it carefully, you will miss covering sections that are deemed to be important by the evaluation committee. I would even suggest every applicant to read the “Peer-Review Manual” ( https://www.nserc-crsng.gc.ca/_doc/Reviewers-Examinateurs/CompleteManual-ManualEvalComplet_eng.pdf)
4/ This shows clearly how discussions about each application are done and how decisions are made.
5/ The evaluation process for Discovery Grants is very carefully done based on the “Merit Indicators Grid” ( https://www.nserc-crsng.gc.ca/_doc/Professors-Professeurs/DG_Merit_Indicators_eng.pdf). The terminology in that grid is followed “extremely” carefully during deliberations.
6/
So if you would like to be successful, your application needs to reflect what the grid is asking. Make sure you present your application in a way that is consistent with grid language. Make sure you address each of the bold terms in the grid distinctly in your application
So if you would like to be successful, your application needs to reflect what the grid is asking. Make sure you present your application in a way that is consistent with grid language. Make sure you address each of the bold terms in the grid distinctly in your application
7/
The applicants should note that the evaluation group takes external referee reports very seriously but those reports are not the main deciding factors. Five members of the evaluation group evaluate the whole application, one part of which is the external referee reports.
The applicants should note that the evaluation group takes external referee reports very seriously but those reports are not the main deciding factors. Five members of the evaluation group evaluate the whole application, one part of which is the external referee reports.
8/
When suggesting external referees, try to suggest reviewers who are objective, speak the grid language and provide evidence-based reviews. Choosing people who are just overly positive is not helpful and can be overlooked by the evaluation group.
When suggesting external referees, try to suggest reviewers who are objective, speak the grid language and provide evidence-based reviews. Choosing people who are just overly positive is not helpful and can be overlooked by the evaluation group.
9/
Attached contributions are very important. The committee reads through them to understand the quality of the work by the applicant. Take the opportunity to explain why these contributions were selected, why they are “impactful”, “original” and “innovative” -note grid language!
Attached contributions are very important. The committee reads through them to understand the quality of the work by the applicant. Take the opportunity to explain why these contributions were selected, why they are “impactful”, “original” and “innovative” -note grid language!
10/
When talking about excellence of researcher, make sure you present a well rounded picture of yourself not just talk about your past publications. Excellence of a researcher is about “excellence, accomplishments, and service.” - excellence is both quality and quantity.
When talking about excellence of researcher, make sure you present a well rounded picture of yourself not just talk about your past publications. Excellence of a researcher is about “excellence, accomplishments, and service.” - excellence is both quality and quantity.
11/
Accomplishments are not about numbers, it's about impact and importance. Take the time to carefully explain why your accomplishments are impactful, how you measured impact, and why they were important.
Accomplishments are not about numbers, it's about impact and importance. Take the time to carefully explain why your accomplishments are impactful, how you measured impact, and why they were important.
12/
Be mindful that not all members of the evaluation group are experts in your area. If a journal is outstanding or a conference very competitive, make sure to explain.
Be mindful that not all members of the evaluation group are experts in your area. If a journal is outstanding or a conference very competitive, make sure to explain.
13/
If you wrote a workshop paper in an obscure venue because the idea was super innovative and would not get into bigger venues then explain this and show how it made impact down the road. These are things that matter.
If you wrote a workshop paper in an obscure venue because the idea was super innovative and would not get into bigger venues then explain this and show how it made impact down the road. These are things that matter.
14/
One of the things I noticed not all applicants valued or at least presented research service as they did the other categories. This is equally important. If you are involved, I encourage you to describe it with details, if you are not, now is the time to start being engaged!
One of the things I noticed not all applicants valued or at least presented research service as they did the other categories. This is equally important. If you are involved, I encourage you to describe it with details, if you are not, now is the time to start being engaged!
15/
From the perspective of HQP, there are a few dimensions and everyone needs to be mindful that all of them are important: Philosophy, Plan, History and EDI. What I found was that many applications mixed all of these together and it was hard to decipher which is which.
From the perspective of HQP, there are a few dimensions and everyone needs to be mindful that all of them are important: Philosophy, Plan, History and EDI. What I found was that many applications mixed all of these together and it was hard to decipher which is which.
16/
My suggestion would be to write these separately with clear headings and then have each of them synergize each other. A philosophy statement that does not match the plan and also does not reflect past training experience is not very good.
My suggestion would be to write these separately with clear headings and then have each of them synergize each other. A philosophy statement that does not match the plan and also does not reflect past training experience is not very good.
17/
Whatever you present in your HQP section for philosophy and plan, make sure you back it up with evidence of things you have done in the past. Provide specific examples (obviously you can make sure anonymity of students is respected).
Whatever you present in your HQP section for philosophy and plan, make sure you back it up with evidence of things you have done in the past. Provide specific examples (obviously you can make sure anonymity of students is respected).
18/
Do not offer generic statements. Contextualize your training philosophy and plan for your research, group, university and area. Again remember grid language - have your students moved onto “impactful” positions? Need to explain why you think so so the committee can also agree
Do not offer generic statements. Contextualize your training philosophy and plan for your research, group, university and area. Again remember grid language - have your students moved onto “impactful” positions? Need to explain why you think so so the committee can also agree
19/
I cannot stress enough how important EDI is. When presenting the EDI statement, remember it's about expressing “EDI Challenges” and “Actions”. Make sure you present what you think are EDI challenges in your context and then explain what your actions are to address them
I cannot stress enough how important EDI is. When presenting the EDI statement, remember it's about expressing “EDI Challenges” and “Actions”. Make sure you present what you think are EDI challenges in your context and then explain what your actions are to address them
20/
It's not about what % of female vs male students in your group. Be concrete on how you address EDI challenges & actions, e.g., are you involved with activities related to minority or underrepresented groups in research? e.g. ( https://bit.ly/37K852G , https://bit.ly/37Hifks )
It's not about what % of female vs male students in your group. Be concrete on how you address EDI challenges & actions, e.g., are you involved with activities related to minority or underrepresented groups in research? e.g. ( https://bit.ly/37K852G , https://bit.ly/37Hifks )
21/
Re the proposal, this is important and do not discount it. If you are an established researcher, you need to note that the proposal is evaluated for what it's worth - put in the effort to write a proposal that has “clearly defined” (short and long term) objectives, ...
Re the proposal, this is important and do not discount it. If you are an established researcher, you need to note that the proposal is evaluated for what it's worth - put in the effort to write a proposal that has “clearly defined” (short and long term) objectives, ...
22/
...has a clear methodology, distinguishes itself from the state of the art, and explains for the reader how and why it is “innovative” and will lead to “groundbreaking advances” in the field.
...has a clear methodology, distinguishes itself from the state of the art, and explains for the reader how and why it is “innovative” and will lead to “groundbreaking advances” in the field.
23/
Again, make sure you review the grid and specifically address the terms that are expected by the grid (the ones in bold). Address each of the bold terms in the grid distinctly in your proposal. Those are what the committee is looking for.
Again, make sure you review the grid and specifically address the terms that are expected by the grid (the ones in bold). Address each of the bold terms in the grid distinctly in your proposal. Those are what the committee is looking for.
24/
I would just add that these are my observations from the process. Make sure to read the instructions & peer-review manual. Hope its informative and feel free to let me know if you have comments or want to share your thoughts/experiences!
I would just add that these are my observations from the process. Make sure to read the instructions & peer-review manual. Hope its informative and feel free to let me know if you have comments or want to share your thoughts/experiences!
